2024-09-13T02:30:58.105 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T02:30:58.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T02:30:58.218 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074 branch: squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7903074' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3254 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 subset: 23/32 suite: upgrade suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJs3iES6qBLoSdYf4Eo3iGvhGfZ87oYoUcsZJvr57v2uzqsr4thLM2PfC+8YKdxlopYX/H1u/FC8YsFRshwHiCg= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDpbvFrhqQ1X3L5ullq5pTBTmVDs0p38lo952m5yAmiMXiWH1/pLsi6lol/neQ3WgDHzCDbxdIz6dfzSx+00eU= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/upgrade/cephfs/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_02:08:15 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T02:30:58.218 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T02:30:58.219 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T02:30:58.219 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T02:30:58.221 INFO:teuthology.task.internal:Checking packages... 2024-09-13T02:30:58.243 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T02:30:58.243 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:30:58.243 INFO:teuthology.packaging:ref: None 2024-09-13T02:30:58.243 INFO:teuthology.packaging:tag: None 2024-09-13T02:30:58.243 INFO:teuthology.packaging:branch: squid 2024-09-13T02:30:58.244 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:30:58.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T02:30:58.454 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-13T02:30:58.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T02:30:58.461 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T02:30:58.461 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T02:30:58.550 INFO:teuthology.task.internal:Saving configuration 2024-09-13T02:30:58.570 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T02:30:58.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T02:30:58.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:25:58.156993', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJs3iES6qBLoSdYf4Eo3iGvhGfZ87oYoUcsZJvr57v2uzqsr4thLM2PfC+8YKdxlopYX/H1u/FC8YsFRshwHiCg='} 2024-09-13T02:30:58.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:25:58.155132', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFDpbvFrhqQ1X3L5ullq5pTBTmVDs0p38lo952m5yAmiMXiWH1/pLsi6lol/neQ3WgDHzCDbxdIz6dfzSx+00eU='} 2024-09-13T02:30:58.624 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T02:30:58.637 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T02:30:58.638 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T02:30:58.638 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T02:30:58.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd563e6fac0>, signals=[15]) 2024-09-13T02:30:58.713 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T02:30:58.719 INFO:teuthology.task.internal:Opening connections... 2024-09-13T02:30:58.719 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:30:58.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:30:58.803 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-13T02:30:58.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:30:58.884 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T02:30:58.891 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-13T02:30:58.910 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-13T02:30:58.910 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-13T02:30:58.967 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-13T02:30:58.967 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-13T02:30:58.967 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-13T02:30:58.967 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:30:58.967 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:30:58.968 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:30:58.969 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-13T02:30:58.987 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-13T02:30:59.005 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-13T02:30:59.006 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:30:59.064 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:30:59.065 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:30:59.065 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:30:59.065 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-13T02:30:59.088 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T02:30:59.096 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T02:30:59.127 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T02:30:59.127 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:30:59.130 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:30:59.148 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T02:30:59.162 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T02:30:59.162 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:30:59.188 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:30:59.290 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T02:30:59.350 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T02:30:59.364 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T02:30:59.364 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T02:30:59.365 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:30:59.365 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:30:59.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:30:59.383 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-13T02:30:59.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:30:59.384 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-13T02:30:59.441 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:30:59.442 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-13T02:30:59.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-13T02:30:59.443 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:30:59.443 INFO:teuthology.task.kernel:Running kernel on smithi122: 5.14.0-503.el9.x86_64 2024-09-13T02:30:59.443 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-09-13T02:31:02.077 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.2 MB 00:00 2024-09-13T02:31:03.663 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-13T02:31:06.261 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-13T02:31:06.857 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-13T02:31:14.254 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-13T02:31:14.495 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-13T02:31:15.475 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T02:31:19.626 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T02:31:20.890 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T02:31:21.624 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:31:21.624 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:31:21.720 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:31:21.727 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:31:21.727 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-13T02:31:21.727 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-13T02:31:21.728 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:31:21.729 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-13T02:31:21.729 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-13T02:31:21.729 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:31:21.844 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 244 kB/s | 23 kB 00:00 2024-09-13T02:31:22.328 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 60 MB/s | 35 MB 00:00 2024-09-13T02:31:22.628 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-13T02:31:22.896 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:31:22.896 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:31:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-13T02:31:22.906 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:31:22.907 INFO:teuthology.orchestra.run.smithi100.stdout:Total 67 MB/s | 79 MB 00:01 2024-09-13T02:31:22.989 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:31:23.001 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:31:23.001 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-13T02:31:23.001 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:31:23.001 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 79 M 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 126 M 2024-09-13T02:31:23.002 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 246 kB/s | 23 kB 00:00 2024-09-13T02:31:23.525 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-13T02:31:23.588 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:31:23.946 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:31:23.946 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:31:23.975 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-13T02:31:24.250 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-13T02:31:24.251 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:31:24.251 INFO:teuthology.orchestra.run.smithi122.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-13T02:31:24.890 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:31:24.890 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:31:24.936 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:31:25.299 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:31:25.299 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:31:26.312 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:31:26.313 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:31:27.350 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:31:28.062 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:31:28.146 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:31:28.749 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:31:29.441 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:31:29.529 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:31:30.950 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:31:31.075 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:31:32.339 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:31:32.472 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:31:35.939 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:31:35.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:31:37.479 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:31:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:31:40.801 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:31:42.367 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:19.026 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:19.066 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:19.411 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:19.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:32:19.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:32:19.411 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:32:20.247 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:32:20.492 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:20.546 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:20.580 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:32:20.673 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.673 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:32:20.673 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:32:20.674 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:32:20.674 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:32:20.674 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T02:32:20.674 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:32:20.674 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:32:20.733 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:20.734 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:32:20.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-13T02:32:20.777 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:32:20.778 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:32:20.779 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-13T02:32:20.779 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:32:20.779 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:32:20.780 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:32:20.780 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:32:20.780 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:32:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:32:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:32:20.887 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:32:21.428 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-13T02:32:21.780 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:32:21.780 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:32:21.780 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:32:21.781 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:32:22.118 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:32:22.238 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:22.239 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:32:22.239 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:32:22.240 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:32:22.240 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:32:22.240 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T02:32:22.240 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:32:22.240 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:32:22.298 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:32:22.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:32:22.298 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.06 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 82.el9 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Group : Unspecified 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 8274670 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:32:22.330 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : builder@centos.org 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:32:22.331 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:32:22.332 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:32:22.332 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:32:22.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:32:22.804 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:32:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-13T02:32:22.839 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-13T02:32:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.o83c8mk7EE 2024-09-13T02:32:22.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.o83c8mk7EE 2024-09-13T02:32:22.921 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.o83c8mk7EE 2024-09-13T02:32:22.960 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-09-13T02:32:23.070 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.o83c8mk7EE is 6KB 2024-09-13T02:32:23.118 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.o83c8mk7EE 2024-09-13T02:32:23.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:32:23.196 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:32:23.196 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:32:23.196 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:32:23.196 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:32:23.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:32:23.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-13T02:32:24.290 INFO:teuthology.orchestra.run.smithi122.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:32:24.320 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-09-13T02:32:24.322 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-09-13T02:32:24.338 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.YndZKxoiao 2024-09-13T02:32:24.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YndZKxoiao 2024-09-13T02:32:24.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.YndZKxoiao 2024-09-13T02:32:24.550 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.YndZKxoiao is 6KB 2024-09-13T02:32:24.601 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.YndZKxoiao 2024-09-13T02:32:24.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:32:24.687 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:32:24.688 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:32:24.688 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:32:24.688 INFO:teuthology.orchestra.run.smithi122.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:32:24.689 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:32:24.858 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-09-13T02:32:53.381 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T02:32:53.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:32:53.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:32:54.863 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T02:32:54.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T02:32:54.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:33:27.869 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-13T02:33:36.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:33:36.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:33:54.881 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T02:33:55.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-13T02:34:03.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T02:34:03.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:34:04.265 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-13T02:34:04.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T02:34:04.778 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:34:04.778 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-09-13T02:34:04.793 INFO:teuthology.orchestra.run.smithi122.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:34:04.793 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:34:04.793 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:34:04.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:34:05.795 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T02:34:05.795 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:34:05.863 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-09-13T02:34:05.887 DEBUG:teuthology.parallel:result is None 2024-09-13T02:34:07.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:34:07.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:34:07.631 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-13T02:34:08.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:34:08.032 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:34:08.032 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-13T02:34:08.047 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:34:08.047 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:34:08.047 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:34:08.047 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:34:09.048 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T02:34:09.048 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:34:09.134 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-09-13T02:34:09.152 DEBUG:teuthology.parallel:result is None 2024-09-13T02:34:09.152 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T02:34:09.162 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T02:34:09.162 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:34:09.164 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:34:09.180 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T02:34:09.207 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T02:34:09.258 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T02:34:09.258 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:34:09.261 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:34:09.283 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T02:34:09.305 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T02:34:09.305 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:34:09.319 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:34:09.341 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:34:09.349 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:34:09.351 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:34:09.360 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:34:09.361 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T02:34:09.370 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T02:34:09.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:34:09.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:34:09.422 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T02:34:09.435 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T02:34:09.435 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:34:09.458 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:34:09.473 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:34:09.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:34:09.602 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:34:09.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:34:09.723 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:34:09.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:34:09.786 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:34:09.828 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:34:09.873 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:34:09.952 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:34:09.989 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:34:09.989 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:34:10.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-13T02:34:10.052 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-13T02:34:10.105 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:34:10.132 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:34:10.440 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T02:34:10.452 INFO:teuthology.task.internal:Starting timer... 2024-09-13T02:34:10.452 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T02:34:10.511 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T02:34:10.574 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T02:34:10.574 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-13T02:34:10.709 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-13T02:34:10.716 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-09-13T02:34:10.813 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-09-13T02:34:10.815 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T02:34:10.816 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-13T02:34:10.862 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-13T02:34:10.862 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-09-13T02:34:10.926 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-09-13T02:34:10.926 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-09-13T02:34:10.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:34:10.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:34:10.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:34:11.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:34:11.058 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T02:34:11.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:34:11.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:34:11.276 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T02:34:11.300 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T02:34:11.313 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T02:34:11.449 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T02:34:11.474 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T02:34:11.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T02:37:56.228 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-09-13T02:37:56.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:37:56.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:37:56.315 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-13T02:37:56.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-13T02:37:56.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T02:37:56.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:37:56.478 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-13T02:37:56.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T02:37:56.564 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T02:37:56.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T02:37:56.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:37:56.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:37:56.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:37:56.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:37:56.605 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:37:56.620 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:37:56.633 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:37:56.645 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-13T02:37:56.647 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:37:56.656 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-13T02:37:56.671 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:37:56.671 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-09-13T02:37:56.683 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-09-13T02:37:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:37:56.697 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:37:56.710 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:37:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.754 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.768 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.773 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:37:56.773 INFO:teuthology.run_tasks:Running task install... 2024-09-13T02:37:56.781 DEBUG:teuthology.task.install:project ceph 2024-09-13T02:37:56.781 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T02:37:56.781 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:37:56.782 INFO:teuthology.task.install:Using flavor: default 2024-09-13T02:37:56.789 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T02:37:56.789 INFO:teuthology.task.install:extra packages: [] 2024-09-13T02:37:56.790 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T02:37:56.790 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:37:56.790 INFO:teuthology.packaging:ref: None 2024-09-13T02:37:56.790 INFO:teuthology.packaging:tag: None 2024-09-13T02:37:56.790 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:37:56.790 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:37:56.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:37:56.792 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T02:37:56.793 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:37:56.793 INFO:teuthology.packaging:ref: None 2024-09-13T02:37:56.793 INFO:teuthology.packaging:tag: None 2024-09-13T02:37:56.793 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:37:56.793 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:37:56.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:37:57.013 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/ 2024-09-13T02:37:57.013 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1627.gbbdadfa3 2024-09-13T02:37:57.033 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/ 2024-09-13T02:37:57.034 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1627.gbbdadfa3 2024-09-13T02:37:57.123 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:37:57.124 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:37:57.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:37:57.141 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:37:57.141 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:37:57.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:37:57.151 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:37:57.151 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:37:57.151 INFO:teuthology.packaging:ref: None 2024-09-13T02:37:57.151 INFO:teuthology.packaging:tag: None 2024-09-13T02:37:57.151 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:37:57.151 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:37:57.151 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:37:57.168 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:37:57.168 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:37:57.168 INFO:teuthology.packaging:ref: None 2024-09-13T02:37:57.169 INFO:teuthology.packaging:tag: None 2024-09-13T02:37:57.169 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:37:57.169 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:37:57.169 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:37:57.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:37:57.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:37:57.292 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:37:57.311 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:37:57.355 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-09-13T02:37:57.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-09-13T02:37:57.375 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-13T02:37:57.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-13T02:37:57.601 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-13T02:37:57.604 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-09-13T02:37:57.628 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw 2024-09-13T02:37:57.630 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw 2024-09-13T02:37:58.168 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 304 kB/s | 77 kB 00:00 2024-09-13T02:37:58.186 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 283 kB/s | 77 kB 00:00 2024-09-13T02:37:58.443 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T02:37:58.470 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T02:37:58.702 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-13T02:37:58.746 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-13T02:38:00.096 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.2 MB 00:01 2024-09-13T02:38:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-13T02:38:02.005 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-13T02:38:04.770 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-13T02:38:06.348 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-13T02:38:08.707 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-13T02:38:09.097 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T02:38:09.912 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T02:38:10.640 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-13T02:38:11.994 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T02:38:15.259 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-09-13T02:38:17.333 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T02:38:17.627 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:38:17.640 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 14 M 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.1 M 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 5.0 M 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 22 M 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:38:17.641 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 637 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 457 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 4.9 M 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 45 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 120 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 156 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:38:17.642 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 320 k 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 294 k 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 99 k 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout:Install 22 Packages 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 2 Packages 2024-09-13T02:38:17.643 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:17.644 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 58 M 2024-09-13T02:38:17.644 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:38:18.452 INFO:teuthology.orchestra.run.smithi122.stdout:(1/24): ceph-base-17.2.7-1627.gbbdadfa3.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-13T02:38:18.519 INFO:teuthology.orchestra.run.smithi122.stdout:(2/24): ceph-selinux-17.2.7-1627.gbbdadfa3.el9. 379 kB/s | 25 kB 00:00 2024-09-13T02:38:18.603 INFO:teuthology.orchestra.run.smithi122.stdout:(3/24): libcephfs2-17.2.7-1627.gbbdadfa3.el9.x8 7.5 MB/s | 637 kB 00:00 2024-09-13T02:38:18.686 INFO:teuthology.orchestra.run.smithi122.stdout:(4/24): libradosstriper1-17.2.7-1627.gbbdadfa3. 5.4 MB/s | 457 kB 00:00 2024-09-13T02:38:18.970 INFO:teuthology.orchestra.run.smithi122.stdout:(5/24): ceph-radosgw-17.2.7-1627.gbbdadfa3.el9. 14 MB/s | 14 MB 00:01 2024-09-13T02:38:19.045 INFO:teuthology.orchestra.run.smithi122.stdout:(6/24): librgw2-17.2.7-1627.gbbdadfa3.el9.x86_6 14 MB/s | 4.9 MB 00:00 2024-09-13T02:38:19.070 INFO:teuthology.orchestra.run.smithi122.stdout:(7/24): python3-ceph-argparse-17.2.7-1627.gbbda 451 kB/s | 45 kB 00:00 2024-09-13T02:38:19.095 INFO:teuthology.orchestra.run.smithi122.stdout:(8/24): python3-ceph-common-17.2.7-1627.gbbdadf 2.3 MB/s | 120 kB 00:00 2024-09-13T02:38:19.121 INFO:teuthology.orchestra.run.smithi122.stdout:(9/24): python3-cephfs-17.2.7-1627.gbbdadfa3.el 3.0 MB/s | 156 kB 00:00 2024-09-13T02:38:19.146 INFO:teuthology.orchestra.run.smithi122.stdout:(10/24): python3-rados-17.2.7-1627.gbbdadfa3.el 6.2 MB/s | 320 kB 00:00 2024-09-13T02:38:19.172 INFO:teuthology.orchestra.run.smithi122.stdout:(11/24): python3-rbd-17.2.7-1627.gbbdadfa3.el9. 5.7 MB/s | 294 kB 00:00 2024-09-13T02:38:19.197 INFO:teuthology.orchestra.run.smithi122.stdout:(12/24): python3-rgw-17.2.7-1627.gbbdadfa3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T02:38:19.422 INFO:teuthology.orchestra.run.smithi122.stdout:(13/24): ceph-common-17.2.7-1627.gbbdadfa3.el9. 15 MB/s | 22 MB 00:01 2024-09-13T02:38:19.506 INFO:teuthology.orchestra.run.smithi122.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 146 kB/s | 45 kB 00:00 2024-09-13T02:38:19.556 INFO:teuthology.orchestra.run.smithi122.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 417 kB/s | 160 kB 00:00 2024-09-13T02:38:19.598 INFO:teuthology.orchestra.run.smithi122.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-13T02:38:19.615 INFO:teuthology.orchestra.run.smithi122.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 720 kB/s | 42 kB 00:00 2024-09-13T02:38:19.649 INFO:teuthology.orchestra.run.smithi122.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-09-13T02:38:19.691 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:38:19.699 INFO:teuthology.orchestra.run.smithi122.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-13T02:38:19.700 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:19.700 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 14 M 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.1 M 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 5.0 M 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 22 M 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 637 k 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:38:19.701 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 457 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 4.9 M 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 45 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 120 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 156 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 320 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 294 k 2024-09-13T02:38:19.702 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 99 k 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:Install 22 Packages 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 2 Packages 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 58 M 2024-09-13T02:38:19.703 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:38:19.733 INFO:teuthology.orchestra.run.smithi122.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 968 kB/s | 67 kB 00:00 2024-09-13T02:38:19.758 INFO:teuthology.orchestra.run.smithi122.stdout:(21/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2024-09-13T02:38:19.850 INFO:teuthology.orchestra.run.smithi122.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-13T02:38:19.917 INFO:teuthology.orchestra.run.smithi122.stdout:(23/24): librbd1-17.2.7-1627.gbbdadfa3.el9.x86_ 19 MB/s | 2.9 MB 00:00 2024-09-13T02:38:19.967 INFO:teuthology.orchestra.run.smithi122.stdout:(24/24): librados2-17.2.7-1627.gbbdadfa3.el9.x8 13 MB/s | 3.1 MB 00:00 2024-09-13T02:38:19.972 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:19.972 INFO:teuthology.orchestra.run.smithi122.stdout:Total 25 MB/s | 58 MB 00:02 2024-09-13T02:38:20.036 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:38:20.070 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:38:20.070 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:38:20.234 INFO:teuthology.orchestra.run.smithi100.stdout:(1/24): ceph-base-17.2.7-1627.gbbdadfa3.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-13T02:38:20.284 INFO:teuthology.orchestra.run.smithi100.stdout:(2/24): ceph-selinux-17.2.7-1627.gbbdadfa3.el9. 506 kB/s | 25 kB 00:00 2024-09-13T02:38:20.360 INFO:teuthology.orchestra.run.smithi100.stdout:(3/24): libcephfs2-17.2.7-1627.gbbdadfa3.el9.x8 8.3 MB/s | 637 kB 00:00 2024-09-13T02:38:20.443 INFO:teuthology.orchestra.run.smithi100.stdout:(4/24): libradosstriper1-17.2.7-1627.gbbdadfa3. 5.4 MB/s | 457 kB 00:00 2024-09-13T02:38:20.740 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:38:20.741 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:38:20.877 INFO:teuthology.orchestra.run.smithi100.stdout:(5/24): ceph-radosgw-17.2.7-1627.gbbdadfa3.el9. 13 MB/s | 14 MB 00:01 2024-09-13T02:38:20.952 INFO:teuthology.orchestra.run.smithi100.stdout:(6/24): librgw2-17.2.7-1627.gbbdadfa3.el9.x86_6 9.7 MB/s | 4.9 MB 00:00 2024-09-13T02:38:20.977 INFO:teuthology.orchestra.run.smithi100.stdout:(7/24): python3-ceph-argparse-17.2.7-1627.gbbda 450 kB/s | 45 kB 00:00 2024-09-13T02:38:21.002 INFO:teuthology.orchestra.run.smithi100.stdout:(8/24): python3-ceph-common-17.2.7-1627.gbbdadf 2.3 MB/s | 120 kB 00:00 2024-09-13T02:38:21.028 INFO:teuthology.orchestra.run.smithi100.stdout:(9/24): python3-cephfs-17.2.7-1627.gbbdadfa3.el 3.0 MB/s | 156 kB 00:00 2024-09-13T02:38:21.061 INFO:teuthology.orchestra.run.smithi100.stdout:(10/24): python3-rados-17.2.7-1627.gbbdadfa3.el 5.3 MB/s | 320 kB 00:00 2024-09-13T02:38:21.087 INFO:teuthology.orchestra.run.smithi100.stdout:(11/24): python3-rbd-17.2.7-1627.gbbdadfa3.el9. 4.9 MB/s | 294 kB 00:00 2024-09-13T02:38:21.112 INFO:teuthology.orchestra.run.smithi100.stdout:(12/24): python3-rgw-17.2.7-1627.gbbdadfa3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T02:38:21.354 INFO:teuthology.orchestra.run.smithi100.stdout:(13/24): ceph-common-17.2.7-1627.gbbdadfa3.el9. 14 MB/s | 22 MB 00:01 2024-09-13T02:38:21.379 INFO:teuthology.orchestra.run.smithi100.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 169 kB/s | 45 kB 00:00 2024-09-13T02:38:21.463 INFO:teuthology.orchestra.run.smithi100.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 426 kB/s | 160 kB 00:00 2024-09-13T02:38:21.514 INFO:teuthology.orchestra.run.smithi100.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-13T02:38:21.538 INFO:teuthology.orchestra.run.smithi100.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-13T02:38:21.597 INFO:teuthology.orchestra.run.smithi100.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-09-13T02:38:21.622 INFO:teuthology.orchestra.run.smithi100.stdout:(19/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-13T02:38:21.648 INFO:teuthology.orchestra.run.smithi100.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T02:38:21.681 INFO:teuthology.orchestra.run.smithi100.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-13T02:38:21.790 INFO:teuthology.orchestra.run.smithi100.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-13T02:38:21.890 INFO:teuthology.orchestra.run.smithi100.stdout:(23/24): librados2-17.2.7-1627.gbbdadfa3.el9.x8 13 MB/s | 3.1 MB 00:00 2024-09-13T02:38:21.940 INFO:teuthology.orchestra.run.smithi100.stdout:(24/24): librbd1-17.2.7-1627.gbbdadfa3.el9.x86_ 11 MB/s | 2.9 MB 00:00 2024-09-13T02:38:21.945 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:21.945 INFO:teuthology.orchestra.run.smithi100.stdout:Total 26 MB/s | 58 MB 00:02 2024-09-13T02:38:21.955 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:38:22.011 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:38:22.045 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:38:22.045 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:38:22.340 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T02:38:22.419 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:22.511 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:22.598 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:38:22.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:22.681 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:38:22.682 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:38:22.717 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:22.763 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T02:38:22.811 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T02:38:23.255 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T02:38:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:38:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:38:23.407 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T02:38:23.450 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 10/26 2024-09-13T02:38:23.487 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:38:23.549 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:38:23.577 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:38:23.668 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:38:23.715 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T02:38:23.760 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T02:38:23.793 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T02:38:23.917 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:38:24.100 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T02:38:24.147 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:38:24.238 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:38:24.308 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T02:38:24.311 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 19/26 2024-09-13T02:38:24.342 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 20/26 2024-09-13T02:38:24.509 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:24.606 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:24.688 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:38:24.727 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:24.861 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T02:38:24.891 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T02:38:25.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T02:38:25.364 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:38:25.426 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:38:25.463 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T02:38:25.506 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 10/26 2024-09-13T02:38:25.543 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:38:25.605 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:38:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:38:25.699 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:38:25.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T02:38:25.783 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T02:38:25.816 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T02:38:26.108 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T02:38:26.145 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:38:26.235 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:38:26.310 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 19/26 2024-09-13T02:38:26.340 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 20/26 2024-09-13T02:38:26.830 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:26.872 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:27.420 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:27.459 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:38:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:38:27.554 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:38:27.554 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:38:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:28.697 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:28.736 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:29.265 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:38:29.306 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:38:29.401 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:38:29.401 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:38:29.401 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:38:29.402 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:29.433 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:37.513 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-09-13T02:38:37.513 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-09-13T02:38:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:38.837 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:38:38.899 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:38.901 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:38:38.990 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:38:38.990 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-13T02:38:39.371 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:40.301 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 6/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 7/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 8/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 9/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 10/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:38:40.302 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 13/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T02:38:40.303 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 25/26 2024-09-13T02:38:40.701 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:38:40.780 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:40.782 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:38:40.871 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:38:40.871 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:41.347 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:41.347 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:41.347 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:38:41.348 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:38:41.349 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:41.350 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:38:41.644 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-test 2024-09-13T02:38:42.158 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/26 2024-09-13T02:38:42.159 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 6/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 7/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 8/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 9/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 10/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 13/26 2024-09-13T02:38:42.160 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T02:38:42.161 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T02:38:42.162 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T02:38:42.162 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T02:38:42.162 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:38:42.162 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T02:38:42.163 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 25/26 2024-09-13T02:38:42.212 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:38:42.343 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:38:42.343 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:42.343 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:38:42.343 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 48 M 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 163 k 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout:Install 4 Packages 2024-09-13T02:38:42.344 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:42.345 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 48 M 2024-09-13T02:38:42.345 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 193 M 2024-09-13T02:38:42.345 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:38:42.513 INFO:teuthology.orchestra.run.smithi122.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-13T02:38:42.555 INFO:teuthology.orchestra.run.smithi122.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T02:38:42.621 INFO:teuthology.orchestra.run.smithi122.stdout:(3/4): libcephsqlite-17.2.7-1627.gbbdadfa3.el9. 636 kB/s | 163 kB 00:00 2024-09-13T02:38:43.068 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:38:43.068 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:43.068 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-13T02:38:43.068 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.069 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:43.070 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:38:43.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-test 2024-09-13T02:38:43.880 INFO:teuthology.orchestra.run.smithi122.stdout:(4/4): ceph-test-17.2.7-1627.gbbdadfa3.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-13T02:38:43.882 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:43.883 INFO:teuthology.orchestra.run.smithi122.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-13T02:38:43.909 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:38:43.928 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:38:43.928 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:38:43.994 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:38:44.131 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 48 M 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 163 k 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:38:44.132 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:38:44.133 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:44.133 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:38:44.133 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:44.133 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-13T02:38:44.133 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:44.134 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 48 M 2024-09-13T02:38:44.134 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 193 M 2024-09-13T02:38:44.134 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:38:44.296 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:38:44.296 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:38:44.326 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-13T02:38:44.368 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T02:38:44.435 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): libcephsqlite-17.2.7-1627.gbbdadfa3.el9. 640 kB/s | 163 kB 00:00 2024-09-13T02:38:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:38:44.904 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:38:44.952 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:38:44.982 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:38:45.710 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): ceph-test-17.2.7-1627.gbbdadfa3.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-13T02:38:45.712 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:45.713 INFO:teuthology.orchestra.run.smithi100.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-13T02:38:45.741 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:38:45.760 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:38:45.760 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:38:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:38:46.128 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:38:46.645 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:38:46.731 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:38:46.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:38:46.812 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:38:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:38:49.464 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:38:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:38:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:38:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:38:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/4 2024-09-13T02:38:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/4 2024-09-13T02:38:51.679 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:38:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:38:51.979 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:51.979 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:51.980 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:38:52.259 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph 2024-09-13T02:38:52.826 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:38:52.961 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:38:52.963 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:38:52.963 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 6.5 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.1 M 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 1.4 M 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 240 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.9 M 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 15 M 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:38:52.964 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:38:52.965 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:38:52.966 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:38:52.967 INFO:teuthology.orchestra.run.smithi122.stdout:Install 34 Packages 2024-09-13T02:38:52.967 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:52.967 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 27 M 2024-09-13T02:38:52.967 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 96 M 2024-09-13T02:38:52.968 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:38:53.323 INFO:teuthology.orchestra.run.smithi122.stdout:(1/34): ceph-17.2.7-1627.gbbdadfa3.el9.x86_64.r 56 kB/s | 6.5 kB 00:00 2024-09-13T02:38:53.533 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:38:53.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/4 2024-09-13T02:38:53.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/4 2024-09-13T02:38:53.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:38:53.540 INFO:teuthology.orchestra.run.smithi122.stdout:(2/34): ceph-mds-17.2.7-1627.gbbdadfa3.el9.x86_ 6.2 MB/s | 2.1 MB 00:00 2024-09-13T02:38:53.582 INFO:teuthology.orchestra.run.smithi122.stdout:(3/34): ceph-mgr-17.2.7-1627.gbbdadfa3.el9.x86_ 3.8 MB/s | 1.4 MB 00:00 2024-09-13T02:38:53.674 INFO:teuthology.orchestra.run.smithi122.stdout:(4/34): ceph-mon-17.2.7-1627.gbbdadfa3.el9.x86_ 11 MB/s | 3.9 MB 00:00 2024-09-13T02:38:53.699 INFO:teuthology.orchestra.run.smithi122.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1627.gbbda 2.0 MB/s | 240 kB 00:00 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:53.880 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:38:54.033 INFO:teuthology.orchestra.run.smithi122.stdout:(6/34): ceph-osd-17.2.7-1627.gbbdadfa3.el9.x86_ 31 MB/s | 15 MB 00:00 2024-09-13T02:38:54.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph 2024-09-13T02:38:54.392 INFO:teuthology.orchestra.run.smithi122.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 353 kB/s | 253 kB 00:00 2024-09-13T02:38:54.492 INFO:teuthology.orchestra.run.smithi122.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-13T02:38:54.517 INFO:teuthology.orchestra.run.smithi122.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-13T02:38:54.626 INFO:teuthology.orchestra.run.smithi122.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-09-13T02:38:54.693 INFO:teuthology.orchestra.run.smithi122.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 622 kB/s | 125 kB 00:00 2024-09-13T02:38:54.744 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:38:54.751 INFO:teuthology.orchestra.run.smithi122.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-13T02:38:54.777 INFO:teuthology.orchestra.run.smithi122.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2024-09-13T02:38:54.802 INFO:teuthology.orchestra.run.smithi122.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 979 kB/s | 172 kB 00:00 2024-09-13T02:38:54.830 INFO:teuthology.orchestra.run.smithi122.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 951 kB/s | 51 kB 00:00 2024-09-13T02:38:54.856 INFO:teuthology.orchestra.run.smithi122.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 778 kB/s | 42 kB 00:00 2024-09-13T02:38:54.881 INFO:teuthology.orchestra.run.smithi122.stdout:(17/34): python3-packaging-20.9-5.el9.noarch.rp 596 kB/s | 77 kB 00:00 2024-09-13T02:38:54.882 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 6.5 k 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.1 M 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 1.4 M 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 240 k 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.9 M 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 15 M 2024-09-13T02:38:54.885 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:38:54.886 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:38:54.887 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout:Install 34 Packages 2024-09-13T02:38:54.888 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:38:54.889 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 27 M 2024-09-13T02:38:54.889 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 96 M 2024-09-13T02:38:54.889 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:38:54.931 INFO:teuthology.orchestra.run.smithi122.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-13T02:38:54.957 INFO:teuthology.orchestra.run.smithi122.stdout:(19/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-13T02:38:54.974 INFO:teuthology.orchestra.run.smithi122.stdout:(20/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 265 kB/s | 11 kB 00:00 2024-09-13T02:38:54.990 INFO:teuthology.orchestra.run.smithi122.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 528 kB/s | 18 kB 00:00 2024-09-13T02:38:55.008 INFO:teuthology.orchestra.run.smithi122.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 686 kB/s | 23 kB 00:00 2024-09-13T02:38:55.025 INFO:teuthology.orchestra.run.smithi122.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 576 kB/s | 19 kB 00:00 2024-09-13T02:38:55.050 INFO:teuthology.orchestra.run.smithi122.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 472 kB/s | 20 kB 00:00 2024-09-13T02:38:55.075 INFO:teuthology.orchestra.run.smithi122.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-13T02:38:55.100 INFO:teuthology.orchestra.run.smithi122.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T02:38:55.126 INFO:teuthology.orchestra.run.smithi122.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 658 kB/s | 16 kB 00:00 2024-09-13T02:38:55.151 INFO:teuthology.orchestra.run.smithi122.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T02:38:55.176 INFO:teuthology.orchestra.run.smithi122.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-13T02:38:55.202 INFO:teuthology.orchestra.run.smithi122.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-13T02:38:55.235 INFO:teuthology.orchestra.run.smithi122.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T02:38:55.260 INFO:teuthology.orchestra.run.smithi122.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-13T02:38:55.286 INFO:teuthology.orchestra.run.smithi122.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-13T02:38:55.294 INFO:teuthology.orchestra.run.smithi100.stdout:(1/34): ceph-17.2.7-1627.gbbdadfa3.el9.x86_64.r 57 kB/s | 6.5 kB 00:00 2024-09-13T02:38:55.311 INFO:teuthology.orchestra.run.smithi122.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-13T02:38:55.316 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:55.316 INFO:teuthology.orchestra.run.smithi122.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-13T02:38:55.447 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:38:55.485 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:38:55.485 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:38:55.486 INFO:teuthology.orchestra.run.smithi100.stdout:(2/34): ceph-mgr-17.2.7-1627.gbbdadfa3.el9.x86_ 4.6 MB/s | 1.4 MB 00:00 2024-09-13T02:38:55.537 INFO:teuthology.orchestra.run.smithi100.stdout:(3/34): ceph-mds-17.2.7-1627.gbbdadfa3.el9.x86_ 5.8 MB/s | 2.1 MB 00:00 2024-09-13T02:38:55.620 INFO:teuthology.orchestra.run.smithi100.stdout:(4/34): ceph-mon-17.2.7-1627.gbbdadfa3.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-13T02:38:55.645 INFO:teuthology.orchestra.run.smithi100.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1627.gbbda 2.2 MB/s | 240 kB 00:00 2024-09-13T02:38:55.876 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:38:55.876 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:38:55.971 INFO:teuthology.orchestra.run.smithi100.stdout:(6/34): ceph-osd-17.2.7-1627.gbbdadfa3.el9.x86_ 32 MB/s | 15 MB 00:00 2024-09-13T02:38:56.638 INFO:teuthology.orchestra.run.smithi100.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 249 kB/s | 253 kB 00:01 2024-09-13T02:38:56.730 INFO:teuthology.orchestra.run.smithi100.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 143 kB/s | 106 kB 00:00 2024-09-13T02:38:56.763 INFO:teuthology.orchestra.run.smithi100.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-13T02:38:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:38:57.255 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T02:38:57.296 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T02:38:57.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T02:38:57.355 INFO:teuthology.orchestra.run.smithi100.stdout:(10/34): python3-pycparser-2.20-6.el9.noarch.rp 189 kB/s | 135 kB 00:00 2024-09-13T02:38:57.414 INFO:teuthology.orchestra.run.smithi100.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 183 kB/s | 125 kB 00:00 2024-09-13T02:38:57.427 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T02:38:57.498 INFO:teuthology.orchestra.run.smithi100.stdout:(12/34): python3-urllib3-1.26.5-6.el9.noarch.rp 293 kB/s | 215 kB 00:00 2024-09-13T02:38:57.499 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T02:38:57.523 INFO:teuthology.orchestra.run.smithi100.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-13T02:38:57.541 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T02:38:57.548 INFO:teuthology.orchestra.run.smithi100.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 897 kB/s | 172 kB 00:00 2024-09-13T02:38:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T02:38:57.598 INFO:teuthology.orchestra.run.smithi100.stdout:(15/34): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-13T02:38:57.613 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T02:38:57.624 INFO:teuthology.orchestra.run.smithi100.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-09-13T02:38:57.648 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T02:38:57.674 INFO:teuthology.orchestra.run.smithi100.stdout:(17/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-13T02:38:57.681 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T02:38:57.699 INFO:teuthology.orchestra.run.smithi100.stdout:(18/34): python3-packaging-20.9-5.el9.noarch.rp 383 kB/s | 77 kB 00:00 2024-09-13T02:38:57.716 INFO:teuthology.orchestra.run.smithi100.stdout:(19/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-13T02:38:57.722 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T02:38:57.741 INFO:teuthology.orchestra.run.smithi100.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-13T02:38:57.756 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T02:38:57.758 INFO:teuthology.orchestra.run.smithi100.stdout:(21/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 182 kB/s | 11 kB 00:00 2024-09-13T02:38:57.775 INFO:teuthology.orchestra.run.smithi100.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 728 kB/s | 23 kB 00:00 2024-09-13T02:38:57.791 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T02:38:57.793 INFO:teuthology.orchestra.run.smithi100.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-09-13T02:38:57.817 INFO:teuthology.orchestra.run.smithi100.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 469 kB/s | 20 kB 00:00 2024-09-13T02:38:57.840 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T02:38:57.843 INFO:teuthology.orchestra.run.smithi100.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-13T02:38:57.872 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:38:57.877 INFO:teuthology.orchestra.run.smithi100.stdout:(26/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-13T02:38:57.910 INFO:teuthology.orchestra.run.smithi100.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 852 kB/s | 79 kB 00:00 2024-09-13T02:38:57.936 INFO:teuthology.orchestra.run.smithi100.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-09-13T02:38:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T02:38:57.961 INFO:teuthology.orchestra.run.smithi100.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.6 MB/s | 90 kB 00:00 2024-09-13T02:38:57.986 INFO:teuthology.orchestra.run.smithi100.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 716 kB/s | 36 kB 00:00 2024-09-13T02:38:58.012 INFO:teuthology.orchestra.run.smithi100.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-13T02:38:58.037 INFO:teuthology.orchestra.run.smithi100.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-13T02:38:58.062 INFO:teuthology.orchestra.run.smithi100.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T02:38:58.087 INFO:teuthology.orchestra.run.smithi100.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-13T02:38:58.092 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:38:58.093 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.5 MB/s | 27 MB 00:03 2024-09-13T02:38:58.097 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T02:38:58.178 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T02:38:58.225 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:38:58.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T02:38:58.262 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:38:58.262 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:38:58.273 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T02:38:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T02:38:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T02:38:58.578 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T02:38:58.628 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T02:38:58.661 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:38:58.662 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:38:58.704 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T02:38:58.800 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T02:38:58.837 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T02:38:58.949 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T02:38:59.097 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 29/34 2024-09-13T02:38:59.137 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:38:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:38:59.164 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:38:59.164 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:38:59.164 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:38:59.165 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:38:59.165 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:38:59.906 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:38:59.965 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T02:38:59.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T02:39:00.030 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T02:39:00.122 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T02:39:00.191 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T02:39:00.241 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T02:39:00.276 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T02:39:00.323 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T02:39:00.357 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T02:39:00.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T02:39:00.440 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T02:39:00.486 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T02:39:00.522 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:39:00.529 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T02:39:00.553 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:39:00.553 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:00.553 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:39:00.553 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:39:00.553 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:39:00.554 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T02:39:00.610 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:39:00.682 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T02:39:00.829 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T02:39:00.910 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T02:39:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:39:00.954 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:00.963 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T02:39:01.018 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T02:39:01.075 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T02:39:01.130 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T02:39:01.156 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:39:01.180 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:39:01.180 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:01.180 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:39:01.180 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:39:01.181 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:39:01.181 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:01.245 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:39:01.317 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T02:39:01.372 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T02:39:01.467 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T02:39:01.564 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T02:39:01.605 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T02:39:01.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T02:39:01.868 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 29/34 2024-09-13T02:39:01.891 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:39:01.916 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:39:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:39:01.917 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:39:01.917 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:39:01.917 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:39:02.721 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 6/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T02:39:02.722 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T02:39:02.723 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T02:39:02.724 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T02:39:03.275 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:39:03.305 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:03.687 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:39:03.711 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:39:03.712 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:03.712 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:39:03.712 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:39:03.712 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:39:03.712 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:03.790 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:39:03.791 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:39:03.792 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:03.793 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:03.912 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:39:03.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:04.001 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:39:04.179 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-base 2024-09-13T02:39:04.753 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:04.844 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:04.887 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:04.888 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:04.888 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:04.957 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install cephadm 2024-09-13T02:39:05.517 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:39:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 6/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T02:39:05.645 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T02:39:05.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T02:39:05.647 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T02:39:05.647 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T02:39:05.647 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T02:39:05.650 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 83 k 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:05.651 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:05.652 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:05.652 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:05.652 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 83 k 2024-09-13T02:39:05.652 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 375 k 2024-09-13T02:39:05.652 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:05.848 INFO:teuthology.orchestra.run.smithi122.stdout:cephadm-17.2.7-1627.gbbdadfa3.el9.noarch.rpm 422 kB/s | 83 kB 00:00 2024-09-13T02:39:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:Total 418 kB/s | 83 kB 00:00 2024-09-13T02:39:05.849 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:05.854 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:05.854 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:05.857 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:05.857 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:05.933 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:06.306 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:06.691 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:39:06.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:39:06.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:39:06.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:39:06.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:39:06.694 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:06.694 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:06.780 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:07.008 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:07.009 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:07.009 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:07.009 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:07.009 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:07.009 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:07.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-base 2024-09-13T02:39:07.251 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:39:07.638 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:07.770 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:07.771 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:39:07.771 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:07.827 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:07.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install cephadm 2024-09-13T02:39:07.964 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 137 k 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 137 k 2024-09-13T02:39:07.965 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 379 k 2024-09-13T02:39:07.966 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:08.179 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-immutable-object-cache-17.2.7-1627.gbbdadf 643 kB/s | 137 kB 00:00 2024-09-13T02:39:08.180 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:08.180 INFO:teuthology.orchestra.run.smithi122.stdout:Total 639 kB/s | 137 kB 00:00 2024-09-13T02:39:08.180 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:08.188 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:08.188 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:08.244 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:08.244 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:08.388 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:08.408 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:08.456 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:08.481 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:39:08.481 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:08.540 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 83 k 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 83 k 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 375 k 2024-09-13T02:39:08.541 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:08.754 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm-17.2.7-1627.gbbdadfa3.el9.noarch.rpm 390 kB/s | 83 kB 00:00 2024-09-13T02:39:08.755 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:08.755 INFO:teuthology.orchestra.run.smithi100.stdout:Total 387 kB/s | 83 kB 00:00 2024-09-13T02:39:08.755 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:08.760 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:08.760 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:08.761 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:08.762 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:08.848 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:09.312 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:09.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:09.419 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:09.419 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:09.419 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:09.420 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:09.420 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:09.420 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:09.642 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr 2024-09-13T02:39:09.783 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:39:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:10.046 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:10.046 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:10.047 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:10.223 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:10.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:39:10.319 INFO:teuthology.orchestra.run.smithi122.stdout:Package ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:10.361 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:10.362 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:10.362 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:10.451 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:39:10.849 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:10.987 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:10.987 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 137 k 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 137 k 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 379 k 2024-09-13T02:39:10.988 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:11.015 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:11.147 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:11.148 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:11.148 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:11.148 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 3.4 M 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 24 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 15 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:11.149 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout:Install 7 Packages 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 3.7 M 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 80 M 2024-09-13T02:39:11.150 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:11.201 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-immutable-object-cache-17.2.7-1627.gbbdadf 646 kB/s | 137 kB 00:00 2024-09-13T02:39:11.202 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:11.202 INFO:teuthology.orchestra.run.smithi100.stdout:Total 641 kB/s | 137 kB 00:00 2024-09-13T02:39:11.202 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:11.266 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:11.267 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:11.358 INFO:teuthology.orchestra.run.smithi122.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1627.gbbd 157 kB/s | 24 kB 00:00 2024-09-13T02:39:11.383 INFO:teuthology.orchestra.run.smithi122.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1627.gbbda 81 kB/s | 15 kB 00:00 2024-09-13T02:39:11.412 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:11.425 INFO:teuthology.orchestra.run.smithi122.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-13T02:39:11.451 INFO:teuthology.orchestra.run.smithi122.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T02:39:11.476 INFO:teuthology.orchestra.run.smithi122.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-13T02:39:11.477 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:11.502 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:11.502 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:39:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:11.509 INFO:teuthology.orchestra.run.smithi122.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-13T02:39:11.610 INFO:teuthology.orchestra.run.smithi122.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1627.gbbdadfa3 8.3 MB/s | 3.4 MB 00:00 2024-09-13T02:39:11.613 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:11.613 INFO:teuthology.orchestra.run.smithi122.stdout:Total 7.9 MB/s | 3.7 MB 00:00 2024-09-13T02:39:11.613 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:11.621 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:11.622 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:11.709 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:11.709 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:12.019 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:12.086 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:39:12.129 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:39:12.175 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:39:12.215 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:39:12.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 5/7 2024-09-13T02:39:12.447 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:39:12.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:12.448 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:12.448 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:12.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:12.448 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:12.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr 2024-09-13T02:39:13.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 6/7 2024-09-13T02:39:13.268 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:13.281 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:39:13.358 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:13.401 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:13.402 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:39:13.402 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:13.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:39:14.033 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:14.164 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:14.165 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:14.165 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:39:14.165 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:14.165 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 3.4 M 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 24 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 15 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout:Install 7 Packages 2024-09-13T02:39:14.166 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:14.167 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.7 M 2024-09-13T02:39:14.167 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 80 M 2024-09-13T02:39:14.167 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:14.390 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 1/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 2/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 3/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:39:14.391 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:39:14.474 INFO:teuthology.orchestra.run.smithi100.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1627.gbbd 162 kB/s | 24 kB 00:00 2024-09-13T02:39:14.500 INFO:teuthology.orchestra.run.smithi100.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1627.gbbda 83 kB/s | 15 kB 00:00 2024-09-13T02:39:14.541 INFO:teuthology.orchestra.run.smithi100.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T02:39:14.566 INFO:teuthology.orchestra.run.smithi100.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T02:39:14.592 INFO:teuthology.orchestra.run.smithi100.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-13T02:39:14.625 INFO:teuthology.orchestra.run.smithi100.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-13T02:39:14.691 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:14.692 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:14.726 INFO:teuthology.orchestra.run.smithi100.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1627.gbbdadfa3 8.3 MB/s | 3.4 MB 00:00 2024-09-13T02:39:14.730 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:14.730 INFO:teuthology.orchestra.run.smithi100.stdout:Total 6.5 MB/s | 3.7 MB 00:00 2024-09-13T02:39:14.730 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:14.738 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:14.738 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:14.819 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:14.819 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:14.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:39:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:39:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:39:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:39:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:39:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 5/7 2024-09-13T02:39:15.466 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:00 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:15.599 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 7.4 M 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:39:15.600 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-09-13T02:39:15.601 INFO:teuthology.orchestra.run.smithi122.stdout:Install 12 Packages 2024-09-13T02:39:15.602 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:15.602 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 38 M 2024-09-13T02:39:15.602 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 212 M 2024-09-13T02:39:15.602 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:15.852 INFO:teuthology.orchestra.run.smithi122.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 934 kB/s | 191 kB 00:00 2024-09-13T02:39:15.977 INFO:teuthology.orchestra.run.smithi122.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-13T02:39:16.178 INFO:teuthology.orchestra.run.smithi122.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-16 14 MB/s | 7.4 MB 00:00 2024-09-13T02:39:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 6/7 2024-09-13T02:39:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:39:16.436 INFO:teuthology.orchestra.run.smithi122.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 56 kB/s | 33 kB 00:00 2024-09-13T02:39:16.703 INFO:teuthology.orchestra.run.smithi122.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 35 kB/s | 18 kB 00:00 2024-09-13T02:39:17.037 INFO:teuthology.orchestra.run.smithi122.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-13T02:39:17.103 INFO:teuthology.orchestra.run.smithi122.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 1/7 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 2/7 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 3/7 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:39:17.440 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:39:17.441 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:39:17.722 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:39:17.722 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:17.723 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:17.787 INFO:teuthology.orchestra.run.smithi122.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 326 kB/s | 245 kB 00:00 2024-09-13T02:39:17.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:39:17.962 INFO:teuthology.orchestra.run.smithi122.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 3.9 MB/s | 4.9 MB 00:01 2024-09-13T02:39:18.363 INFO:teuthology.orchestra.run.smithi122.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-13T02:39:18.508 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:18.596 INFO:teuthology.orchestra.run.smithi122.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 310 kB/s | 250 kB 00:00 2024-09-13T02:39:18.642 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 7.4 M 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:39:18.643 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout:Install 12 Packages 2024-09-13T02:39:18.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:18.645 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 38 M 2024-09-13T02:39:18.645 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 212 M 2024-09-13T02:39:18.645 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:18.967 INFO:teuthology.orchestra.run.smithi100.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T02:39:19.109 INFO:teuthology.orchestra.run.smithi100.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-13T02:39:19.260 INFO:teuthology.orchestra.run.smithi100.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-13T02:39:19.285 INFO:teuthology.orchestra.run.smithi100.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 103 kB/s | 33 kB 00:00 2024-09-13T02:39:19.413 INFO:teuthology.orchestra.run.smithi122.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-13T02:39:19.415 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:19.415 INFO:teuthology.orchestra.run.smithi122.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-13T02:39:19.477 INFO:teuthology.orchestra.run.smithi100.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 201 kB/s | 38 kB 00:00 2024-09-13T02:39:19.573 INFO:teuthology.orchestra.run.smithi100.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 58 kB/s | 18 kB 00:00 2024-09-13T02:39:19.773 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:19.801 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:19.802 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:20.028 INFO:teuthology.orchestra.run.smithi100.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 538 kB/s | 245 kB 00:00 2024-09-13T02:39:20.322 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:20.323 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:20.378 INFO:teuthology.orchestra.run.smithi100.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-13T02:39:20.495 INFO:teuthology.orchestra.run.smithi100.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-13T02:39:20.853 INFO:teuthology.orchestra.run.smithi100.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-09-13T02:39:21.085 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:21.087 INFO:teuthology.orchestra.run.smithi100.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.1 MB/s | 4.9 MB 00:01 2024-09-13T02:39:21.183 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:39:21.219 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:39:21.318 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:39:21.354 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:39:21.539 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:39:21.569 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:39:21.652 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:39:22.330 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:39:22.458 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:39:23.725 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:39:24.763 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:39:24.786 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:39:27.475 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:39:27.475 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 1/12 2024-09-13T02:39:27.475 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:39:27.475 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:39:27.476 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:39:27.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:39:27.902 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:27.902 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:27.902 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:27.902 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:27.903 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:28.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:39:28.903 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:29.036 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:29.037 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 47 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:39:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout:Install 13 Packages 2024-09-13T02:39:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:29.040 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 2.2 M 2024-09-13T02:39:29.040 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 26 M 2024-09-13T02:39:29.040 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:29.429 INFO:teuthology.orchestra.run.smithi122.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 237 kB/s | 26 kB 00:00 2024-09-13T02:39:29.454 INFO:teuthology.orchestra.run.smithi122.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 144 kB/s | 19 kB 00:00 2024-09-13T02:39:29.479 INFO:teuthology.orchestra.run.smithi122.stdout:(3/13): ceph-mgr-rook-17.2.7-1627.gbbdadfa3.el9 300 kB/s | 47 kB 00:00 2024-09-13T02:39:29.564 INFO:teuthology.orchestra.run.smithi122.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-13T02:39:29.588 INFO:teuthology.orchestra.run.smithi122.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-13T02:39:29.622 INFO:teuthology.orchestra.run.smithi122.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 916 kB/s | 54 kB 00:00 2024-09-13T02:39:29.655 INFO:teuthology.orchestra.run.smithi122.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-13T02:39:29.689 INFO:teuthology.orchestra.run.smithi122.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-13T02:39:29.714 INFO:teuthology.orchestra.run.smithi122.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-13T02:39:29.748 INFO:teuthology.orchestra.run.smithi122.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-13T02:39:29.773 INFO:teuthology.orchestra.run.smithi122.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T02:39:29.798 INFO:teuthology.orchestra.run.smithi122.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-13T02:39:29.832 INFO:teuthology.orchestra.run.smithi122.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-13T02:39:29.835 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:29.836 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-09-13T02:39:29.900 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:29.916 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:29.916 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:30.003 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:30.003 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:30.679 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:39:30.850 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:39:30.922 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:39:30.959 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:39:31.009 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:39:31.119 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:39:31.222 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:39:31.270 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:39:31.995 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:39:32.050 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:39:32.084 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:39:32.130 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:39:32.162 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:39:32.932 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:39:32.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:39:33.296 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:39:33.296 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:33.296 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:33.296 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:33.297 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:33.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:39:34.124 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:34.258 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:34.258 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:34.258 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 124 k 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout:Install 6 Packages 2024-09-13T02:39:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:34.260 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 7.0 M 2024-09-13T02:39:34.260 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 33 M 2024-09-13T02:39:34.260 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:34.527 INFO:teuthology.orchestra.run.smithi122.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-13T02:39:34.585 INFO:teuthology.orchestra.run.smithi122.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1627.gbbdadfa3.e 597 kB/s | 124 kB 00:00 2024-09-13T02:39:34.619 INFO:teuthology.orchestra.run.smithi122.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.8 MB/s | 548 kB 00:00 2024-09-13T02:39:34.644 INFO:teuthology.orchestra.run.smithi122.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.1 MB/s | 74 kB 00:00 2024-09-13T02:39:34.670 INFO:teuthology.orchestra.run.smithi122.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 688 kB/s | 58 kB 00:00 2024-09-13T02:39:34.762 INFO:teuthology.orchestra.run.smithi122.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T02:39:34.764 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:34.765 INFO:teuthology.orchestra.run.smithi122.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-13T02:39:34.834 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:34.845 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:34.845 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:34.944 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:34.944 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:35.258 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:35.424 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:39:35.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:39:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:39:36.090 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:39:36.155 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:39:36.184 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:39:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:39:37.312 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:39:37.313 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:39:37.313 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:37.313 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:37.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-fuse 2024-09-13T02:39:38.130 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:38.262 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 813 k 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:38.263 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:38.264 INFO:teuthology.orchestra.run.smithi122.stdout:Install 2 Packages 2024-09-13T02:39:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:38.264 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 893 k 2024-09-13T02:39:38.264 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 2.6 M 2024-09-13T02:39:38.264 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:38.505 INFO:teuthology.orchestra.run.smithi122.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 558 kB/s | 80 kB 00:00 2024-09-13T02:39:38.655 INFO:teuthology.orchestra.run.smithi122.stdout:(2/2): ceph-fuse-17.2.7-1627.gbbdadfa3.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-13T02:39:38.656 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:38.656 INFO:teuthology.orchestra.run.smithi122.stdout:Total 2.2 MB/s | 893 kB 00:00 2024-09-13T02:39:38.668 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:38.689 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:38.689 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:38.767 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:38.768 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:38.950 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:39.085 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:39:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:39:39.780 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:39:39.780 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/2 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:40.055 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:40.326 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados-devel 2024-09-13T02:39:40.898 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:41.032 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:41.033 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:41.033 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-13T02:39:41.033 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:41.033 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 126 k 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 126 k 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 448 k 2024-09-13T02:39:41.034 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:41.252 INFO:teuthology.orchestra.run.smithi122.stdout:librados-devel-17.2.7-1627.gbbdadfa3.el9.x86_64 578 kB/s | 126 kB 00:00 2024-09-13T02:39:41.253 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:41.253 INFO:teuthology.orchestra.run.smithi122.stdout:Total 575 kB/s | 126 kB 00:00 2024-09-13T02:39:41.253 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:41.259 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:41.259 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:41.321 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:41.322 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:41.326 INFO:teuthology.orchestra.run.smithi100.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 799 kB/s | 16 MB 00:20 2024-09-13T02:39:41.327 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:41.328 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-13T02:39:41.476 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:41.608 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:41.679 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:41.704 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:41.704 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:42.014 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:42.224 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:42.225 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:42.290 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:42.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs2 2024-09-13T02:39:42.980 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:43.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:39:43.091 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:39:43.101 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:43.192 INFO:teuthology.orchestra.run.smithi122.stdout:Package libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:43.198 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:39:43.234 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:39:43.236 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:43.237 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:43.237 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:43.312 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install libcephfs-devel 2024-09-13T02:39:43.419 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:39:43.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:39:43.530 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:39:43.877 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:44.010 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:44.010 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 25 k 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 110 k 2024-09-13T02:39:44.011 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:44.172 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:39:44.173 INFO:teuthology.orchestra.run.smithi122.stdout:libcephfs-devel-17.2.7-1627.gbbdadfa3.el9.x86_6 155 kB/s | 25 kB 00:00 2024-09-13T02:39:44.173 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:44.174 INFO:teuthology.orchestra.run.smithi122.stdout:Total 153 kB/s | 25 kB 00:00 2024-09-13T02:39:44.174 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:44.177 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:44.177 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:44.179 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:44.179 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:44.262 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:39:44.402 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:44.769 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:44.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:44.995 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:44.995 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:44.995 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:44.995 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:44.996 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:45.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librados2 2024-09-13T02:39:45.532 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:39:45.737 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:45.825 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:45.868 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:45.869 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:45.870 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:45.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install librbd1 2024-09-13T02:39:46.508 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:46.569 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:39:46.598 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:46.599 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:39:46.640 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:46.641 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:46.642 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:46.711 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rados 2024-09-13T02:39:47.273 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:47.361 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:47.403 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:47.405 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:47.405 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:47.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rgw 2024-09-13T02:39:48.038 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:48.128 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:48.170 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:48.171 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:48.171 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:48.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-cephfs 2024-09-13T02:39:48.806 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:48.895 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:48.938 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:48.938 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:48.939 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:49.017 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install python3-rbd 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 1/12 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:39:49.117 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:39:49.118 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:39:49.501 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:39:49.501 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:49.501 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:39:49.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:39:49.503 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:49.503 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:49.577 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:49.666 INFO:teuthology.orchestra.run.smithi122.stdout:Package python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:39:49.710 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:49.711 INFO:teuthology.orchestra.run.smithi122.stdout:Nothing to do. 2024-09-13T02:39:49.711 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:49.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-fuse 2024-09-13T02:39:49.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:39:50.366 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:50.455 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:50.499 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:50.500 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:50.500 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-13T02:39:50.500 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:50.500 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 82 k 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 82 k 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 222 k 2024-09-13T02:39:50.501 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:50.588 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 47 k 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:39:50.589 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2024-09-13T02:39:50.590 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:50.591 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.2 M 2024-09-13T02:39:50.591 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 26 M 2024-09-13T02:39:50.591 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:50.701 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-fuse-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 408 kB/s | 82 kB 00:00 2024-09-13T02:39:50.702 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:50.702 INFO:teuthology.orchestra.run.smithi122.stdout:Total 405 kB/s | 82 kB 00:00 2024-09-13T02:39:50.702 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:50.709 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:50.709 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:50.771 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:50.771 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:51.032 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:51.132 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): ceph-mgr-rook-17.2.7-1627.gbbdadfa3.el9 299 kB/s | 47 kB 00:00 2024-09-13T02:39:51.257 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 67 kB/s | 19 kB 00:00 2024-09-13T02:39:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 83 kB/s | 26 kB 00:00 2024-09-13T02:39:51.414 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:51.633 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-13T02:39:51.675 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 410 kB/s | 222 kB 00:00 2024-09-13T02:39:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:51.677 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:51.677 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:51.678 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:51.678 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:51.717 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 772 kB/s | 32 kB 00:00 2024-09-13T02:39:51.742 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 607 kB/s | 279 kB 00:00 2024-09-13T02:39:51.767 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 279 kB/s | 14 kB 00:00 2024-09-13T02:39:51.793 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 336 kB/s | 54 kB 00:00 2024-09-13T02:39:51.843 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.9 MB/s | 220 kB 00:00 2024-09-13T02:39:51.868 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-13T02:39:51.893 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 632 kB/s | 59 kB 00:00 2024-09-13T02:39:51.937 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-mirror 2024-09-13T02:39:51.943 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-13T02:39:51.946 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:51.946 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-09-13T02:39:52.012 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:52.027 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:52.027 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:52.505 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:52.626 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:52.637 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:52.637 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:52.637 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repo Size 2024-09-13T02:39:52.637 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:52.638 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:52.639 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 2.9 M 2024-09-13T02:39:52.639 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 12 M 2024-09-13T02:39:52.639 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:39:52.862 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:39:52.917 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:39:52.954 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:39:52.954 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-mirror-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 9.3 MB/s | 2.9 MB 00:00 2024-09-13T02:39:52.955 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:52.956 INFO:teuthology.orchestra.run.smithi122.stdout:Total 9.2 MB/s | 2.9 MB 00:00 2024-09-13T02:39:52.956 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:52.964 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:52.965 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:52.996 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:39:53.043 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:53.043 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:39:53.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:39:53.264 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:39:53.452 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:53.514 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:39:53.540 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:53.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:39:54.036 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:39:54.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:39:54.125 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:39:54.148 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:39:54.648 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:54.649 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:54.649 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:54.649 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:54.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install rbd-nbd 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:39:54.983 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:39:54.984 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:39:54.984 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:39:55.349 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:55.350 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:55.532 INFO:teuthology.orchestra.run.smithi122.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 02:38:15 AM UTC. 2024-09-13T02:39:55.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:39:55.671 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 165 k 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout:Install 1 Package 2024-09-13T02:39:55.672 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:55.673 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 165 k 2024-09-13T02:39:55.673 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 477 k 2024-09-13T02:39:55.673 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T02:39:55.876 INFO:teuthology.orchestra.run.smithi122.stdout:rbd-nbd-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 813 kB/s | 165 kB 00:00 2024-09-13T02:39:55.877 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:55.877 INFO:teuthology.orchestra.run.smithi122.stdout:Total 804 kB/s | 165 kB 00:00 2024-09-13T02:39:55.878 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T02:39:55.885 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T02:39:55.885 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T02:39:55.952 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T02:39:55.952 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T02:39:56.116 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T02:39:56.172 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:39:56.233 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:56.305 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:39:56.306 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:56.306 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 124 k 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2024-09-13T02:39:56.307 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:56.308 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 7.0 M 2024-09-13T02:39:56.308 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 33 M 2024-09-13T02:39:56.308 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:39:56.661 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:56.671 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-13T02:39:56.697 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1627.gbbdadfa3.e 580 kB/s | 124 kB 00:00 2024-09-13T02:39:56.747 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T02:39:56.772 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T02:39:56.798 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.3 MB/s | 548 kB 00:00 2024-09-13T02:39:56.881 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-13T02:39:56.883 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:39:56.884 INFO:teuthology.orchestra.run.smithi100.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:39:56.920 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T02:39:56.954 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:39:56.966 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:39:56.966 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:39:57.064 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:39:57.065 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:39:57.179 DEBUG:teuthology.parallel:result is None 2024-09-13T02:39:57.361 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:39:57.521 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:39:57.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:39:58.113 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:39:58.215 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:39:58.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:39:58.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:39:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:39:59.322 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:39:59.323 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:39:59.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-fuse 2024-09-13T02:40:00.156 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:00.286 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:00.286 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:00.286 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 813 k 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout:Install 2 Packages 2024-09-13T02:40:00.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:00.288 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 893 k 2024-09-13T02:40:00.288 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 2.6 M 2024-09-13T02:40:00.288 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:00.433 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 803 kB/s | 80 kB 00:00 2024-09-13T02:40:00.609 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): ceph-fuse-17.2.7-1627.gbbdadfa3.el9.x86_ 2.9 MB/s | 813 kB 00:00 2024-09-13T02:40:00.610 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:00.610 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.7 MB/s | 893 kB 00:00 2024-09-13T02:40:00.621 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:00.643 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:00.643 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:00.723 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:00.723 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:00.903 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:01.029 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:40:01.100 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:40:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:40:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/2 2024-09-13T02:40:02.139 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:40:02.140 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:02.140 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:02.140 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:40:02.140 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:02.140 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:02.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados-devel 2024-09-13T02:40:03.054 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:03.188 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 126 k 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:40:03.189 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:03.190 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 126 k 2024-09-13T02:40:03.190 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 448 k 2024-09-13T02:40:03.190 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:03.405 INFO:teuthology.orchestra.run.smithi100.stdout:librados-devel-17.2.7-1627.gbbdadfa3.el9.x86_64 587 kB/s | 126 kB 00:00 2024-09-13T02:40:03.405 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:03.406 INFO:teuthology.orchestra.run.smithi100.stdout:Total 584 kB/s | 126 kB 00:00 2024-09-13T02:40:03.406 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:03.411 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:03.411 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:03.474 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:03.475 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:03.620 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:03.718 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:04.139 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:04.397 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:04.673 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs2 2024-09-13T02:40:05.250 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:48 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:05.342 INFO:teuthology.orchestra.run.smithi100.stdout:Package libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:05.385 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:05.386 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:05.386 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:05.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs-devel 2024-09-13T02:40:06.038 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:06.169 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:06.170 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:06.170 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-13T02:40:06.170 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:06.170 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 25 k 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 110 k 2024-09-13T02:40:06.171 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:06.325 INFO:teuthology.orchestra.run.smithi100.stdout:libcephfs-devel-17.2.7-1627.gbbdadfa3.el9.x86_6 162 kB/s | 25 kB 00:00 2024-09-13T02:40:06.326 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:06.326 INFO:teuthology.orchestra.run.smithi100.stdout:Total 160 kB/s | 25 kB 00:00 2024-09-13T02:40:06.326 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:06.329 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:06.330 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:06.331 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:06.331 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:06.415 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:06.530 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:06.884 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:07.103 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:07.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados2 2024-09-13T02:40:07.848 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:07.937 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:07.979 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:07.980 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:07.980 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:08.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librbd1 2024-09-13T02:40:08.627 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:51 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:08.730 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:08.774 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:08.775 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:08.775 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:08.848 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rados 2024-09-13T02:40:09.404 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:52 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:09.493 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:09.535 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:09.537 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:09.537 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:09.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rgw 2024-09-13T02:40:10.162 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:53 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:10.251 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:10.294 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:10.295 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:10.295 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:10.372 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-cephfs 2024-09-13T02:40:10.933 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:53 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:11.023 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:11.066 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:11.066 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:11.066 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:11.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rbd 2024-09-13T02:40:11.715 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:54 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:11.803 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:40:11.845 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:11.846 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-13T02:40:11.846 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:11.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-fuse 2024-09-13T02:40:12.471 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:55 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:12.603 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:12.604 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:12.604 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-13T02:40:12.604 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 82 k 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 82 k 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 222 k 2024-09-13T02:40:12.605 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:12.804 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-fuse-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 412 kB/s | 82 kB 00:00 2024-09-13T02:40:12.804 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:12.804 INFO:teuthology.orchestra.run.smithi100.stdout:Total 409 kB/s | 82 kB 00:00 2024-09-13T02:40:12.805 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:12.811 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:12.811 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:12.873 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:13.022 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:13.150 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:13.506 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:13.770 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:14.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-mirror 2024-09-13T02:40:14.626 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:57 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:14.761 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:14.762 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.9 M 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 12 M 2024-09-13T02:40:14.763 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:15.099 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-mirror-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 8.7 MB/s | 2.9 MB 00:00 2024-09-13T02:40:15.100 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:15.100 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.7 MB/s | 2.9 MB 00:00 2024-09-13T02:40:15.100 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:15.109 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:15.109 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:15.188 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:15.189 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:15.598 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:40:15.683 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:16.845 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:16.845 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:16.845 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:16.845 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:40:16.845 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:16.846 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:17.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-nbd 2024-09-13T02:40:17.715 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:02:00 ago on Fri 13 Sep 2024 02:38:17 AM UTC. 2024-09-13T02:40:17.849 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 165 k 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-13T02:40:17.850 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:17.851 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 165 k 2024-09-13T02:40:17.851 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 477 k 2024-09-13T02:40:17.851 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-13T02:40:18.062 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-nbd-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 784 kB/s | 165 kB 00:00 2024-09-13T02:40:18.062 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:40:18.062 INFO:teuthology.orchestra.run.smithi100.stdout:Total 779 kB/s | 165 kB 00:00 2024-09-13T02:40:18.063 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-13T02:40:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-13T02:40:18.070 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-13T02:40:18.133 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-13T02:40:18.133 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-13T02:40:18.287 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-13T02:40:18.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:19.079 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:40:19.079 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:19.080 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-13T02:40:19.080 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:40:19.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:40:19.080 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-13T02:40:19.350 DEBUG:teuthology.parallel:result is None 2024-09-13T02:40:19.351 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:40:19.351 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:19.351 INFO:teuthology.packaging:tag: None 2024-09-13T02:40:19.351 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:40:19.351 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:19.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:40:19.554 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:40:19.578 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:40:19.579 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:40:19.579 INFO:teuthology.task.install:The correct ceph version 17.2.7-1627.gbbdadfa3 is installed. 2024-09-13T02:40:19.581 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:40:19.581 INFO:teuthology.packaging:ref: None 2024-09-13T02:40:19.581 INFO:teuthology.packaging:tag: None 2024-09-13T02:40:19.581 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:40:19.581 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:40:19.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:40:19.780 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:40:19.806 INFO:teuthology.orchestra.run.smithi122.stdout:17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:40:19.806 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:40:19.806 INFO:teuthology.task.install:The correct ceph version 17.2.7-1627.gbbdadfa3 is installed. 2024-09-13T02:40:19.808 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T02:40:19.808 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:40:19.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:40:19.835 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:40:19.835 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:40:19.876 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T02:40:19.877 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:40:19.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:40:19.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:40:19.967 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:40:19.968 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:40:19.996 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:40:20.064 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T02:40:20.064 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:40:20.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:40:20.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:40:20.169 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:40:20.169 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:40:20.197 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:40:20.266 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T02:40:20.266 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:40:20.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:40:20.290 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:40:20.356 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:40:20.356 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:40:20.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:40:20.450 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:40:20.465 INFO:teuthology.task.print:**** done install task... 2024-09-13T02:40:20.465 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T02:40:20.602 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:40:20.603 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T02:40:20.603 INFO:tasks.cephadm:Cluster fsid is 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:40:20.603 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T02:40:20.604 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T02:40:20.604 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi100': '172.21.15.100', 'mon.smithi122': '172.21.15.122'} 2024-09-13T02:40:20.604 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T02:40:20.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-13T02:40:20.629 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-09-13T02:40:20.658 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-13T02:40:20.658 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:20.854 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 02:40 /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:20.854 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:20.999 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 02:40 /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:20.999 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:21.016 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:40:21.044 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-13T02:40:21.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T02:40:21.058 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T02:40:22.659 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:40:22.663 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)", 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c", 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be" 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-13T02:41:09.297 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:41:12.316 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)", 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c", 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be" 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-13T02:41:12.317 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T02:41:12.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-13T02:41:12.370 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-09-13T02:41:12.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-13T02:41:12.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-09-13T02:41:12.465 INFO:tasks.cephadm:Writing seed config... 2024-09-13T02:41:12.467 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T02:41:12.467 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T02:41:12.467 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T02:41:12.468 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T02:41:12.469 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T02:41:12.470 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T02:41:12.471 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T02:41:12.472 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T02:41:12.473 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T02:41:12.473 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T02:41:12.473 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T02:41:12.474 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:41:12.474 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T02:41:12.497 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 84e01cde-7179-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T02:41:12.498 DEBUG:teuthology.orchestra.run.smithi100:mon.smithi100> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service 2024-09-13T02:41:12.540 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T02:41:12.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 84e01cde-7179-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.100 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:41:12.742 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:41:12.742 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '84e01cde-7179-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.100', '--skip-admin-label'] 2024-09-13T02:41:12.767 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:41:12.767 INFO:teuthology.orchestra.run.smithi100.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T02:41:12.767 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying podman|docker is present... 2024-09-13T02:41:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:41:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying lvm2 is present... 2024-09-13T02:41:12.790 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying time synchronization is in place... 2024-09-13T02:41:12.797 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:41:12.797 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:41:12.804 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:41:12.804 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:41:12.811 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-13T02:41:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-13T02:41:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:41:12.818 INFO:teuthology.orchestra.run.smithi100.stdout:Repeating the final host check... 2024-09-13T02:41:12.840 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:41:12.840 INFO:teuthology.orchestra.run.smithi100.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T02:41:12.841 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl is present 2024-09-13T02:41:12.841 INFO:teuthology.orchestra.run.smithi100.stdout:lvcreate is present 2024-09-13T02:41:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:41:12.847 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:41:12.853 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:41:12.854 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:41:12.861 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout enabled 2024-09-13T02:41:12.868 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout active 2024-09-13T02:41:12.868 INFO:teuthology.orchestra.run.smithi100.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Host looks OK 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Cluster fsid: 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Acquiring lock 139977965912416 on /run/cephadm/84e01cde-7179-11ef-bceb-c7b262605968.lock 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Lock 139977965912416 acquired on /run/cephadm/84e01cde-7179-11ef-bceb-c7b262605968.lock 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 3300 ... 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying IP 172.21.15.100 port 6789 ... 2024-09-13T02:41:12.869 INFO:teuthology.orchestra.run.smithi100.stdout:Base mon IP(s) is [172.21.15.100:3300, 172.21.15.100:6789], mon addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-13T02:41:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2024-09-13T02:41:12.872 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 metric 100 2024-09-13T02:41:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T02:41:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T02:41:12.875 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T02:41:12.877 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T02:41:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T02:41:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:41:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T02:41:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-13T02:41:12.878 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:41:12.879 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-13T02:41:12.879 INFO:teuthology.orchestra.run.smithi100.stdout:Mon IP `172.21.15.100` is in CIDR network `172.21.0.0/20` 2024-09-13T02:41:12.879 INFO:teuthology.orchestra.run.smithi100.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T02:41:12.879 INFO:teuthology.orchestra.run.smithi100.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T02:41:12.880 INFO:teuthology.orchestra.run.smithi100.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stdout a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying blob sha256:ca308b3f556da579f99cd79db684ebbf678db4c29a649b66aaf6f99bc8124cd6 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Copying config sha256:a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c 2024-09-13T02:41:13.279 INFO:teuthology.orchestra.run.smithi100.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T02:41:14.184 INFO:teuthology.orchestra.run.smithi100.stdout:ceph: stdout ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable) 2024-09-13T02:41:14.184 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph version: ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable) 2024-09-13T02:41:14.184 INFO:teuthology.orchestra.run.smithi100.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T02:41:15.239 INFO:teuthology.orchestra.run.smithi100.stdout:stat: stdout 167 167 2024-09-13T02:41:15.239 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial keys... 2024-09-13T02:41:16.228 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQBLpuNm1/dkIRAAZyb19TvMljArWv51Ws/7Lg== 2024-09-13T02:41:17.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQBMpuNmU5/aIxAA/zgiEFa/LpeuxVX7srCnug== 2024-09-13T02:41:18.232 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph-authtool: stdout AQBNpuNmyCSlHhAAdEWXWc0e031K3t912V/iaQ== 2024-09-13T02:41:18.233 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial monmap... 2024-09-13T02:41:19.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:41:19.130 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool for smithi100 [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = octopus 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: set fsid to 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:41:19.132 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:41:19.132 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mon... 2024-09-13T02:41:20.120 INFO:teuthology.orchestra.run.smithi100.stdout:create mon.smithi100 on 2024-09-13T02:41:20.323 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T02:41:20.469 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T02:41:20.621 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target. 2024-09-13T02:41:20.621 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target. 2024-09-13T02:41:20.787 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100 2024-09-13T02:41:20.787 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service: Unit ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service not loaded. 2024-09-13T02:41:20.946 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target.wants/ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service → /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968@.service. 2024-09-13T02:41:21.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:21 smithi100 ceph-mon[27514]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2024-09-13T02:41:21.485 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:41:21.485 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-13T02:41:21.493 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:41:21.493 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:41:21.493 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-13T02:41:21.493 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:41:21.494 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon to start... 2024-09-13T02:41:21.494 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mon... 2024-09-13T02:41:21.722 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:21 smithi100 bash[27493]: a0fbb279bc8f40a3128a191ec56331c58f0a41d96da4b18baf293669e7572e21 2024-09-13T02:41:21.722 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:21 smithi100 systemd[1]: Started Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:41:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2024-09-13T02:41:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: monmap e1: 1 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:41:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: fsmap 2024-09-13T02:41:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:41:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: mgrmap e1: no daemons active 2024-09-13T02:41:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:22 smithi100 ceph-mon[27514]: from='client.? 172.21.15.100:0/3311197962' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T02:41:25.390 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T02:41:25.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout id: 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout services: 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi100 (age 0.569249s) 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout data: 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T02:41:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.896+0000 7fd380005640 1 Processor -- start 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.896+0000 7fd380005640 1 -- start start 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd380005640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd380005640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378102d60 con 0x7fd378102410 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd37dda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd37dda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33938/0 (socket says 172.21.15.100:33938) 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd37dda1640 1 -- 172.21.15.100:0/4194184662 learned_addr learned my addr 172.21.15.100:0/4194184662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.897+0000 7fd37dda1640 1 -- 172.21.15.100:0/4194184662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd378102ea0 con 0x7fd378102410 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.899+0000 7fd37dda1640 1 --2- 172.21.15.100:0/4194184662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd374009840 tx=0x7fd3740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b621b197e3c3c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.899+0000 7fd37cd9f640 1 -- 172.21.15.100:0/4194184662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd374032440 con 0x7fd378102410 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.899+0000 7fd37cd9f640 1 -- 172.21.15.100:0/4194184662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3740325a0 con 0x7fd378102410 2024-09-13T02:41:25.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.899+0000 7fd37cd9f640 1 -- 172.21.15.100:0/4194184662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3740328d0 con 0x7fd378102410 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 -- 172.21.15.100:0/4194184662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 msgr2=0x7fd378102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 --2- 172.21.15.100:0/4194184662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd374009840 tx=0x7fd3740091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 -- 172.21.15.100:0/4194184662 shutdown_connections 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 --2- 172.21.15.100:0/4194184662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd378102820 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 -- 172.21.15.100:0/4194184662 >> 172.21.15.100:0/4194184662 conn(0x7fd3780fbd90 msgr2=0x7fd3780fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 -- 172.21.15.100:0/4194184662 shutdown_connections 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.900+0000 7fd380005640 1 -- 172.21.15.100:0/4194184662 wait complete. 2024-09-13T02:41:25.399 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd380005640 1 Processor -- start 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd380005640 1 -- start start 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd380005640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd380005640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378110ae0 con 0x7fd378102410 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd37dda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd37dda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33952/0 (socket says 172.21.15.100:33952) 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd37dda1640 1 -- 172.21.15.100:0/3311197962 learned_addr learned my addr 172.21.15.100:0/3311197962 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd37dda1640 1 -- 172.21.15.100:0/3311197962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374009450 con 0x7fd378102410 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.901+0000 7fd37dda1640 1 --2- 172.21.15.100:0/3311197962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd37402a700 tx=0x7fd374032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd374031be0 con 0x7fd378102410 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374031d40 con 0x7fd378102410 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd378110ce0 con 0x7fd378102410 2024-09-13T02:41:25.400 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3781110f0 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd37403b5a0 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd374039040 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.902+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd374041030 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.903+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37804b720 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.905+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd374037070 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.964+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd378109ae0 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd36e7fc640 1 -- 172.21.15.100:0/3311197962 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fd37403bbd0 con 0x7fd378102410 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 msgr2=0x7fd3781105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd380005640 1 --2- 172.21.15.100:0/3311197962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd37402a700 tx=0x7fd374032000 comp rx=0 tx=0).stop 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 shutdown_connections 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd380005640 1 --2- 172.21.15.100:0/3311197962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd378102410 0x7fd3781105a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:25.401 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.965+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 >> 172.21.15.100:0/3311197962 conn(0x7fd3780fbd90 msgr2=0x7fd378100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.966+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 shutdown_connections 2024-09-13T02:41:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:21.966+0000 7fd380005640 1 -- 172.21.15.100:0/3311197962 wait complete. 2024-09-13T02:41:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:mon is available 2024-09-13T02:41:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T02:41:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:28 smithi100 ceph-mon[27514]: from='client.? 172.21.15.100:0/1916587189' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:41:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:28 smithi100 ceph-mon[27514]: from='client.? 172.21.15.100:0/1916587189' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:41:33.500 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6de2578640 1 Processor -- start 2024-09-13T02:41:33.501 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6de2578640 1 -- start start 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6de2578640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6de2578640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc076e10 con 0x7f6ddc076a00 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49064/0 (socket says 172.21.15.100:49064) 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.328+0000 7f6ddbfff640 1 -- 172.21.15.100:0/3165275307 learned_addr learned my addr 172.21.15.100:0/3165275307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.329+0000 7f6ddbfff640 1 -- 172.21.15.100:0/3165275307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc107520 con 0x7f6ddc076a00 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.329+0000 7f6ddbfff640 1 --2- 172.21.15.100:0/3165275307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009840 tx=0x7f6dcc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47bb270b814d21c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6ddaffd640 1 -- 172.21.15.100:0/3165275307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dcc032440 con 0x7f6ddc076a00 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6ddaffd640 1 -- 172.21.15.100:0/3165275307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0325a0 con 0x7f6ddc076a00 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6ddaffd640 1 -- 172.21.15.100:0/3165275307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dcc032890 con 0x7f6ddc076a00 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 -- 172.21.15.100:0/3165275307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 msgr2=0x7f6ddc106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 --2- 172.21.15.100:0/3165275307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009840 tx=0x7f6dcc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:33.502 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 -- 172.21.15.100:0/3165275307 shutdown_connections 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 --2- 172.21.15.100:0/3165275307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc106fe0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 -- 172.21.15.100:0/3165275307 >> 172.21.15.100:0/3165275307 conn(0x7f6ddc0fc6d0 msgr2=0x7f6ddc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 -- 172.21.15.100:0/3165275307 shutdown_connections 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.330+0000 7f6de2578640 1 -- 172.21.15.100:0/3165275307 wait complete. 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6de2578640 1 Processor -- start 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6de2578640 1 -- start start 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6de2578640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6de2578640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc112cc0 con 0x7f6ddc076a00 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49068/0 (socket says 172.21.15.100:49068) 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.331+0000 7f6ddbfff640 1 -- 172.21.15.100:0/1916587189 learned_addr learned my addr 172.21.15.100:0/1916587189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6ddbfff640 1 -- 172.21.15.100:0/1916587189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009450 con 0x7f6ddc076a00 2024-09-13T02:41:33.503 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6ddbfff640 1 --2- 172.21.15.100:0/1916587189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc02a790 tx=0x7f6dcc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dcc031be0 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc031d40 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc112ec0 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dcc03b5a0 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc1132d0 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6dcc039040 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.332+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6dcc041030 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.333+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc04b720 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.335+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6dcc02ae60 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.390+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6ddc10bf00 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.394+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6dcc046cd0 con 0x7f6ddc076a00 2024-09-13T02:41:33.504 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.394+0000 7f6dd8ff9640 1 -- 172.21.15.100:0/1916587189 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7f6dcc037070 con 0x7f6ddc076a00 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 msgr2=0x7f6ddc112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 --2- 172.21.15.100:0/1916587189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc02a790 tx=0x7f6dcc032000 comp rx=0 tx=0).stop 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 shutdown_connections 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 --2- 172.21.15.100:0/1916587189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ddc076a00 0x7f6ddc112780 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 >> 172.21.15.100:0/1916587189 conn(0x7f6ddc0fc6d0 msgr2=0x7f6ddc0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 shutdown_connections 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:28.395+0000 7f6de2578640 1 -- 172.21.15.100:0/1916587189 wait complete. 2024-09-13T02:41:33.505 INFO:teuthology.orchestra.run.smithi100.stdout:Generating new minimal ceph.conf... 2024-09-13T02:41:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:34 smithi100 ceph-mon[27514]: from='client.? 172.21.15.100:0/3427989660' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.909+0000 7fec4b141640 1 Processor -- start 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.909+0000 7fec4b141640 1 -- start start 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.909+0000 7fec4b141640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.909+0000 7fec4b141640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44101880 con 0x7fec44100f30 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.910+0000 7fec48edd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.910+0000 7fec48edd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49078/0 (socket says 172.21.15.100:49078) 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.910+0000 7fec48edd640 1 -- 172.21.15.100:0/1183872879 learned_addr learned my addr 172.21.15.100:0/1183872879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.910+0000 7fec48edd640 1 -- 172.21.15.100:0/1183872879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec441019c0 con 0x7fec44100f30 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec48edd640 1 --2- 172.21.15.100:0/1183872879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fec34009840 tx=0x7fec340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce2a21232746b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec437fe640 1 -- 172.21.15.100:0/1183872879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec34032440 con 0x7fec44100f30 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec437fe640 1 -- 172.21.15.100:0/1183872879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec34032a00 con 0x7fec44100f30 2024-09-13T02:41:34.453 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec437fe640 1 -- 172.21.15.100:0/1183872879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec340319e0 con 0x7fec44100f30 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec4b141640 1 -- 172.21.15.100:0/1183872879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 msgr2=0x7fec44101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec4b141640 1 --2- 172.21.15.100:0/1183872879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fec34009840 tx=0x7fec340091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec4b141640 1 -- 172.21.15.100:0/1183872879 shutdown_connections 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec4b141640 1 --2- 172.21.15.100:0/1183872879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44101340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.911+0000 7fec4b141640 1 -- 172.21.15.100:0/1183872879 >> 172.21.15.100:0/1183872879 conn(0x7fec440fc730 msgr2=0x7fec440feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 -- 172.21.15.100:0/1183872879 shutdown_connections 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 -- 172.21.15.100:0/1183872879 wait complete. 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 Processor -- start 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 -- start start 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.912+0000 7fec4b141640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec441113a0 con 0x7fec44100f30 2024-09-13T02:41:34.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec48edd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec48edd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49090/0 (socket says 172.21.15.100:49090) 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec48edd640 1 -- 172.21.15.100:0/3427989660 learned_addr learned my addr 172.21.15.100:0/3427989660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec48edd640 1 -- 172.21.15.100:0/3427989660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009450 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec48edd640 1 --2- 172.21.15.100:0/3427989660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3403d450 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec3403da10 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3403b8e0 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec441115a0 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.913+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec44111fa0 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.914+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fec34039070 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.914+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec34046400 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.914+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec44100390 con 0x7fec44100f30 2024-09-13T02:41:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.916+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fec340657a0 con 0x7fec44100f30 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.972+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fec44112aa0 con 0x7fec44100f30 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.972+0000 7fec417fa640 1 -- 172.21.15.100:0/3427989660 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fec34054020 con 0x7fec44100f30 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 msgr2=0x7fec44110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 --2- 172.21.15.100:0/3427989660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34008040 comp rx=0 tx=0).stop 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 shutdown_connections 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 --2- 172.21.15.100:0/3427989660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec44100f30 0x7fec44110e60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 >> 172.21.15.100:0/3427989660 conn(0x7fec440fc730 msgr2=0x7fec440fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 shutdown_connections 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:33.973+0000 7fec4b141640 1 -- 172.21.15.100:0/3427989660 wait complete. 2024-09-13T02:41:34.456 INFO:teuthology.orchestra.run.smithi100.stdout:Restarting the monitor... 2024-09-13T02:41:34.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:34 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:41:35.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:34 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[27509]: 2024-09-13T02:41:34.764+0000 7f5eb8690640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:41:35.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:34 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[27509]: 2024-09-13T02:41:34.764+0000 7f5eb8690640 -1 mon.smithi100@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T02:41:35.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:34 smithi100 podman[27769]: 2024-09-13 02:41:34.908772175 +0000 UTC m=+0.299864705 container died a0fbb279bc8f40a3128a191ec56331c58f0a41d96da4b18baf293669e7572e21 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:41:35.516 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 podman[27769]: 2024-09-13 02:41:35.265234656 +0000 UTC m=+0.656327231 container cleanup a0fbb279bc8f40a3128a191ec56331c58f0a41d96da4b18baf293669e7572e21 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=quincy-bbdadfa, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-13T02:41:35.516 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 bash[27769]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100 2024-09-13T02:41:35.843 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 podman[27781]: 2024-09-13 02:41:35.515999935 +0000 UTC m=+0.607411085 container remove a0fbb279bc8f40a3128a191ec56331c58f0a41d96da4b18baf293669e7572e21 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T02:41:35.843 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service: Deactivated successfully. 2024-09-13T02:41:35.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 systemd[1]: Stopped Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:41:35.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 systemd[1]: Starting Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 podman[27875]: 2024-09-13 02:41:35.745193275 +0000 UTC m=+0.015659118 image pull a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:35 smithi100 podman[27875]: 2024-09-13 02:41:35.85015688 +0000 UTC m=+0.120622722 container create 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, ceph=True) 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 podman[27875]: 2024-09-13 02:41:36.060801497 +0000 UTC m=+0.331267340 container init 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 podman[27875]: 2024-09-13 02:41:36.063824472 +0000 UTC m=+0.334290316 container start 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=quincy-bbdadfa, CEPH_POINT_RELEASE=) 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable), process ceph-mon, pid 2 2024-09-13T02:41:36.145 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: pidfile_write: ignore empty --pid-file 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: load: jerasure load: lrc 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: RocksDB version: 6.15.5 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Compile date Sep 12 2024 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: DB SUMMARY 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: DB Session ID: 860BRMPMO2K0IX5AXLT4 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000010.log size: 98148 ; 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:41:36.146 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.env: 0x558352edb440 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.fs: Posix File System 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.info_log: 0x558353b110c0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.statistics: (nil) 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.use_fsync: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:41:36.147 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.db_log_dir: 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi100/store.db 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.write_buffer_manager: 0x558353bce810 2024-09-13T02:41:36.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.unordered_write: 0 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:41:36.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.row_cache: None 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.wal_filter: None 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.preserve_deletes: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:41:36.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:41:36.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_open_files: -1 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:41:36.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:41:36.153 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Compression algorithms supported: 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kZSTD supported: 0 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:41:36.154 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.merge_operator: 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_filter: None 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558353ab7a38) 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2024-09-13T02:41:36.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: hash_index_allow_collision: 1 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 1 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x558353aed1f0 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2024-09-13T02:41:36.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2024-09-13T02:41:36.157 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 4 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression: NoCompression 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.num_levels: 7 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:41:36.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:41:36.159 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:41:36.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.arena_block_size: 4194304 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:41:36.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:41:36.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.ttl: 2592000 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-13T02:41:36.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195296086452, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195296087329, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93380, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91460, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84042, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726195296, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "bb6af400-03b8-41d8-a6ab-4f1c6cc6ebee", "db_session_id": "860BRMPMO2K0IX5AXLT4"}} 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195296087646, "job": 1, "event": "recovery_finished"} 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x558353b20700 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: DB pointer 0x558353af0000 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:41:36.164 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 27.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 27.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:41:36.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.0 0.00 0.00 1 0.001 0 0 2024-09-13T02:41:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 27.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: starting mon.smithi100 rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???) e1 preinit fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).mds e1 new map 2024-09-13T02:41:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).mds e1 print_map 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e1 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: -1 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: No filesystems configured 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 bash[27875]: 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 2024-09-13T02:41:36.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 systemd[1]: Started Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:41:36.170 INFO:teuthology.orchestra.run.smithi100.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T02:41:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mon.smithi100 is new leader, mons smithi100 in quorum (ranks 0) 2024-09-13T02:41:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: monmap e1: 1 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:41:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: fsmap 2024-09-13T02:41:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:41:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:36 smithi100 ceph-mon[27894]: mgrmap e1: no daemons active 2024-09-13T02:41:37.183 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.547+0000 7f5911598640 1 Processor -- start 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.547+0000 7f5911598640 1 -- start start 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.547+0000 7f5911598640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.547+0000 7f5911598640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c101780 con 0x7f590c100e30 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.548+0000 7f590affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.548+0000 7f590affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49104/0 (socket says 172.21.15.100:49104) 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.548+0000 7f590affd640 1 -- 172.21.15.100:0/1635949062 learned_addr learned my addr 172.21.15.100:0/1635949062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.548+0000 7f590affd640 1 -- 172.21.15.100:0/1635949062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c1018c0 con 0x7f590c100e30 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.550+0000 7f590affd640 1 --2- 172.21.15.100:0/1635949062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009e50 tx=0x7f58fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34376cbb74d2dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:37.184 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.550+0000 7f5909ffb640 1 -- 172.21.15.100:0/1635949062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58fc031560 con 0x7f590c100e30 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.550+0000 7f5909ffb640 1 -- 172.21.15.100:0/1635949062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f58fc02d050 con 0x7f590c100e30 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.550+0000 7f5909ffb640 1 -- 172.21.15.100:0/1635949062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58fc0079b0 con 0x7f590c100e30 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 -- 172.21.15.100:0/1635949062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 msgr2=0x7f590c101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 --2- 172.21.15.100:0/1635949062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009e50 tx=0x7f58fc009840 comp rx=0 tx=0).stop 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 -- 172.21.15.100:0/1635949062 shutdown_connections 2024-09-13T02:41:37.186 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 --2- 172.21.15.100:0/1635949062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c101240 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 -- 172.21.15.100:0/1635949062 >> 172.21.15.100:0/1635949062 conn(0x7f590c0fc5c0 msgr2=0x7f590c0fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 -- 172.21.15.100:0/1635949062 shutdown_connections 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 -- 172.21.15.100:0/1635949062 wait complete. 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.551+0000 7f5911598640 1 Processor -- start 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f5911598640 1 -- start start 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f5911598640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f5911598640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c1134b0 con 0x7f590c100e30 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f590affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f590affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49118/0 (socket says 172.21.15.100:49118) 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f590affd640 1 -- 172.21.15.100:0/3384352082 learned_addr learned my addr 172.21.15.100:0/3384352082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f590affd640 1 -- 172.21.15.100:0/3384352082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc009ae0 con 0x7f590c100e30 2024-09-13T02:41:37.187 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f590affd640 1 --2- 172.21.15.100:0/3384352082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009eb0 tx=0x7f58fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58fc03a400 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f58fc03a9c0 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c1136b0 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58fc0447d0 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.552+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c113b20 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.553+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f58fc038040 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.553+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f58fc040030 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.553+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c04b720 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.556+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f590c113b20 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.610+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f590c102bc0 con 0x7f590c100e30 2024-09-13T02:41:37.188 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.615+0000 7f59037fe640 1 -- 172.21.15.100:0/3384352082 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f58fc04a060 con 0x7f590c100e30 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 msgr2=0x7f590c112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 --2- 172.21.15.100:0/3384352082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009eb0 tx=0x7f58fc009840 comp rx=0 tx=0).stop 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 shutdown_connections 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 --2- 172.21.15.100:0/3384352082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f590c100e30 0x7f590c112f70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 >> 172.21.15.100:0/3384352082 conn(0x7f590c0fc5c0 msgr2=0x7f590c1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.616+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 shutdown_connections 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:36.617+0000 7f5911598640 1 -- 172.21.15.100:0/3384352082 wait complete. 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:Creating mgr... 2024-09-13T02:41:37.189 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T02:41:37.190 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T02:41:37.190 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T02:41:37.362 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-84e01cde-7179-11ef-bceb-c7b262605968@mgr.smithi100.lhjyck 2024-09-13T02:41:37.362 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Failed to reset failed state of unit ceph-84e01cde-7179-11ef-bceb-c7b262605968@mgr.smithi100.lhjyck.service: Unit ceph-84e01cde-7179-11ef-bceb-c7b262605968@mgr.smithi100.lhjyck.service not loaded. 2024-09-13T02:41:37.510 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968.target.wants/ceph-84e01cde-7179-11ef-bceb-c7b262605968@mgr.smithi100.lhjyck.service → /etc/systemd/system/ceph-84e01cde-7179-11ef-bceb-c7b262605968@.service. 2024-09-13T02:41:37.855 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:37 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3384352082' entity='client.admin' 2024-09-13T02:41:38.069 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:41:38.070 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-13T02:41:38.077 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:41:38.077 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:41:38.077 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-13T02:41:38.077 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:41:38.086 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:41:38.086 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-13T02:41:38.094 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:41:38.094 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:41:38.094 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-13T02:41:38.094 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T02:41:38.094 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr to start... 2024-09-13T02:41:38.095 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr... 2024-09-13T02:41:38.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:38 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3071495143' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "84e01cde-7179-11ef-bceb-c7b262605968", 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:41:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:41:40.250 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:41:40.251 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:41:40.258 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:41:40.259 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:41:21.397789+0000", 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.532+0000 7f420062c640 1 Processor -- start 2024-09-13T02:41:40.260 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.532+0000 7f420062c640 1 -- start start 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f420062c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f420062c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8076ea0 con 0x7f41f8076a90 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f41fe3c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f41fe3c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58894/0 (socket says 172.21.15.100:58894) 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f41fe3c8640 1 -- 172.21.15.100:0/1584961512 learned_addr learned my addr 172.21.15.100:0/1584961512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.533+0000 7f41fe3c8640 1 -- 172.21.15.100:0/1584961512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f81051a0 con 0x7f41f8076a90 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.534+0000 7f41fe3c8640 1 --2- 172.21.15.100:0/1584961512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009840 tx=0x7f41f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18216dc4150e90b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.534+0000 7f41fd3c6640 1 -- 172.21.15.100:0/1584961512 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f4032440 con 0x7f41f8076a90 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.534+0000 7f41fd3c6640 1 -- 172.21.15.100:0/1584961512 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f41f4032a00 con 0x7f41f8076a90 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.534+0000 7f41fd3c6640 1 -- 172.21.15.100:0/1584961512 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f4031a10 con 0x7f41f8076a90 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 -- 172.21.15.100:0/1584961512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 msgr2=0x7f41f8104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 --2- 172.21.15.100:0/1584961512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009840 tx=0x7f41f40091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 -- 172.21.15.100:0/1584961512 shutdown_connections 2024-09-13T02:41:40.261 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 --2- 172.21.15.100:0/1584961512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8104c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 -- 172.21.15.100:0/1584961512 >> 172.21.15.100:0/1584961512 conn(0x7f41f80fc6d0 msgr2=0x7f41f80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 -- 172.21.15.100:0/1584961512 shutdown_connections 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.535+0000 7f420062c640 1 -- 172.21.15.100:0/1584961512 wait complete. 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f420062c640 1 Processor -- start 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f420062c640 1 -- start start 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f420062c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f420062c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8111230 con 0x7f41f8076a90 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f41fe3c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f41fe3c8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58896/0 (socket says 172.21.15.100:58896) 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f41fe3c8640 1 -- 172.21.15.100:0/3071495143 learned_addr learned my addr 172.21.15.100:0/3071495143 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.536+0000 7f41fe3c8640 1 -- 172.21.15.100:0/3071495143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f4009450 con 0x7f41f8076a90 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41fe3c8640 1 --2- 172.21.15.100:0/3071495143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098a0 tx=0x7f41f402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f40327b0 con 0x7f41f8076a90 2024-09-13T02:41:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f41f403b870 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41f403a530 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f8111430 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f8111fc0 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f41f4039040 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.537+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f41f40447a0 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.538+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f81002f0 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.540+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f41f4049060 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.599+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f41f8105ec0 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.600+0000 7f41eeffd640 1 -- 172.21.15.100:0/3071495143 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f41f403f070 con 0x7f41f8076a90 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 msgr2=0x7f41f8110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 --2- 172.21.15.100:0/3071495143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098a0 tx=0x7f41f402c040 comp rx=0 tx=0).stop 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 shutdown_connections 2024-09-13T02:41:40.263 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 --2- 172.21.15.100:0/3071495143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41f8076a90 0x7f41f8110cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:40.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 >> 172.21.15.100:0/3071495143 conn(0x7f41f80fc6d0 msgr2=0x7f41f80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:40.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 shutdown_connections 2024-09-13T02:41:40.264 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:38.601+0000 7f420062c640 1 -- 172.21.15.100:0/3071495143 wait complete. 2024-09-13T02:41:40.264 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (1/15)... 2024-09-13T02:41:42.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:41:42.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: mgrmap e2: smithi100.lhjyck(active, starting, since 0.00305816s) 2024-09-13T02:41:42.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:41:42.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:41:42.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:42.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:42 smithi100 ceph-mon[27894]: from='mgr.14100 172.21.15.100:0/2944811964' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:43.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:43.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:41:43.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "84e01cde-7179-11ef-bceb-c7b262605968", 2024-09-13T02:41:43.454 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:43.455 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:41:43.456 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.457 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:41:43.458 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:41:21.397789+0000", 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.741+0000 7fc1735e1640 1 Processor -- start 2024-09-13T02:41:43.459 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.741+0000 7fc1735e1640 1 -- start start 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.741+0000 7fc1735e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.741+0000 7fc1735e1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c100f50 con 0x7fc16c100600 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.742+0000 7fc17137d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.742+0000 7fc17137d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58960/0 (socket says 172.21.15.100:58960) 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.742+0000 7fc17137d640 1 -- 172.21.15.100:0/511876357 learned_addr learned my addr 172.21.15.100:0/511876357 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.742+0000 7fc17137d640 1 -- 172.21.15.100:0/511876357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c101090 con 0x7fc16c100600 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc17137d640 1 --2- 172.21.15.100:0/511876357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc16800a9f0 tx=0x7fc16800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56d71b9d2d88997 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc163fff640 1 -- 172.21.15.100:0/511876357 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc168030670 con 0x7fc16c100600 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc163fff640 1 -- 172.21.15.100:0/511876357 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc16802e050 con 0x7fc16c100600 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc163fff640 1 -- 172.21.15.100:0/511876357 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc168032b70 con 0x7fc16c100600 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 -- 172.21.15.100:0/511876357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 msgr2=0x7fc16c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:43.460 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 --2- 172.21.15.100:0/511876357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc16800a9f0 tx=0x7fc16800a360 comp rx=0 tx=0).stop 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 -- 172.21.15.100:0/511876357 shutdown_connections 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 --2- 172.21.15.100:0/511876357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c100a10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 -- 172.21.15.100:0/511876357 >> 172.21.15.100:0/511876357 conn(0x7fc16c0fbdc0 msgr2=0x7fc16c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.743+0000 7fc1735e1640 1 -- 172.21.15.100:0/511876357 shutdown_connections 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc1735e1640 1 -- 172.21.15.100:0/511876357 wait complete. 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc1735e1640 1 Processor -- start 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc1735e1640 1 -- start start 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc1735e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc1735e1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c111320 con 0x7fc16c100600 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc17137d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc17137d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58972/0 (socket says 172.21.15.100:58972) 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc17137d640 1 -- 172.21.15.100:0/260646371 learned_addr learned my addr 172.21.15.100:0/260646371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:43.461 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.744+0000 7fc17137d640 1 -- 172.21.15.100:0/260646371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16800a600 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc17137d640 1 --2- 172.21.15.100:0/260646371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc168032850 tx=0x7fc16800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc16803b590 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c111520 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc16803bb50 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc16803a9d0 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.745+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c111f70 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.746+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 2) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fc16803abd0 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.746+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c0ffa60 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.746+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc16806c960 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.748+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc1680313a0 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.806+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc16c04b720 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.806+0000 7fc161ffb640 1 -- 172.21.15.100:0/260646371 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc168041030 con 0x7fc16c100600 2024-09-13T02:41:43.462 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 msgr2=0x7fc16c110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 --2- 172.21.15.100:0/260646371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc168032850 tx=0x7fc16800a360 comp rx=0 tx=0).stop 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 shutdown_connections 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 --2- 172.21.15.100:0/260646371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc16c100600 0x7fc16c110de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 >> 172.21.15.100:0/260646371 conn(0x7fc16c0fbdc0 msgr2=0x7fc16c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 shutdown_connections 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:42.807+0000 7fc1735e1640 1 -- 172.21.15.100:0/260646371 wait complete. 2024-09-13T02:41:43.463 INFO:teuthology.orchestra.run.smithi100.stdout:mgr not available, waiting (2/15)... 2024-09-13T02:41:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:43 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/260646371' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:41:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:43 smithi100 ceph-mon[27894]: mgrmap e3: smithi100.lhjyck(active, since 1.00638s) 2024-09-13T02:41:45.675 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:45 smithi100 ceph-mon[27894]: mgrmap e4: smithi100.lhjyck(active, since 2s) 2024-09-13T02:41:46.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:46 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/413654528' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:41:46.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:46.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:41:46.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsid": "84e01cde-7179-11ef-bceb-c7b262605968", 2024-09-13T02:41:46.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:41:46.669 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:41:46.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:41:46.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:41:46.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:41:46.670 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "smithi100" 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:41:46.672 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:41:46.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:41:46.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:41:46.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:41:46.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:41:21.397789+0000", 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa51e402640 1 Processor -- start 2024-09-13T02:41:46.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa51e402640 1 -- start start 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa51e402640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa51e402640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518076f00 con 0x7fa518076af0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa517fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa517fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58980/0 (socket says 172.21.15.100:58980) 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.837+0000 7fa517fff640 1 -- 172.21.15.100:0/2331510405 learned_addr learned my addr 172.21.15.100:0/2331510405 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.838+0000 7fa517fff640 1 -- 172.21.15.100:0/2331510405 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5181051c0 con 0x7fa518076af0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.838+0000 7fa517fff640 1 --2- 172.21.15.100:0/2331510405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa508009840 tx=0x7fa5080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb08b652285ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.838+0000 7fa516ffd640 1 -- 172.21.15.100:0/2331510405 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa508032440 con 0x7fa518076af0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.838+0000 7fa516ffd640 1 -- 172.21.15.100:0/2331510405 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa508032a00 con 0x7fa518076af0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa516ffd640 1 -- 172.21.15.100:0/2331510405 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa508031a10 con 0x7fa518076af0 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 -- 172.21.15.100:0/2331510405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 msgr2=0x7fa518104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 --2- 172.21.15.100:0/2331510405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa508009840 tx=0x7fa5080091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 -- 172.21.15.100:0/2331510405 shutdown_connections 2024-09-13T02:41:46.685 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 --2- 172.21.15.100:0/2331510405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518104c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 -- 172.21.15.100:0/2331510405 >> 172.21.15.100:0/2331510405 conn(0x7fa5180fc790 msgr2=0x7fa5180feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 -- 172.21.15.100:0/2331510405 shutdown_connections 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.839+0000 7fa51e402640 1 -- 172.21.15.100:0/2331510405 wait complete. 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa51e402640 1 Processor -- start 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa51e402640 1 -- start start 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa51e402640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa51e402640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa518111260 con 0x7fa518076af0 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa517fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa517fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58992/0 (socket says 172.21.15.100:58992) 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa517fff640 1 -- 172.21.15.100:0/413654528 learned_addr learned my addr 172.21.15.100:0/413654528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.840+0000 7fa517fff640 1 -- 172.21.15.100:0/413654528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508009450 con 0x7fa518076af0 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa517fff640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5080329d0 tx=0x7fa50802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:46.686 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa508031d10 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5181114c0 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa508031e70 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa50803b670 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.841+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa518111ff0 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fa508039070 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa514ff9640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 0x7fa50003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa50806cd00 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa5177fe640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 0x7fa50003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5181003f0 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.842+0000 7fa5177fe640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 0x7fa50003b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa50c006fd0 tx=0x7fa50c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:45.847+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa508041070 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.061+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa518112390 con 0x7fa518076af0 2024-09-13T02:41:46.687 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.061+0000 7fa514ff9640 1 -- 172.21.15.100:0/413654528 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7fa508037030 con 0x7fa518076af0 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 msgr2=0x7fa50003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 0x7fa50003b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa50c006fd0 tx=0x7fa50c006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 msgr2=0x7fa518110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa5080329d0 tx=0x7fa50802c040 comp rx=0 tx=0).stop 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 shutdown_connections 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fa500039450 0x7fa50003b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 --2- 172.21.15.100:0/413654528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa518076af0 0x7fa518110d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 >> 172.21.15.100:0/413654528 conn(0x7fa5180fc790 msgr2=0x7fa5180fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 shutdown_connections 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:46.063+0000 7fa51e402640 1 -- 172.21.15.100:0/413654528 wait complete. 2024-09-13T02:41:46.688 INFO:teuthology.orchestra.run.smithi100.stdout:mgr is available 2024-09-13T02:41:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:47 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/390643461' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout fsid = 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:41:47.815 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.041+0000 7f8522397640 1 Processor -- start 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.041+0000 7f8522397640 1 -- start start 2024-09-13T02:41:47.816 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f8522397640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f8522397640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c078fc0 con 0x7f851c078b20 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f851bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f851bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58998/0 (socket says 172.21.15.100:58998) 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f851bfff640 1 -- 172.21.15.100:0/844297044 learned_addr learned my addr 172.21.15.100:0/844297044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.042+0000 7f851bfff640 1 -- 172.21.15.100:0/844297044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c079100 con 0x7f851c078b20 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f851bfff640 1 --2- 172.21.15.100:0/844297044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f850c009840 tx=0x7f850c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb18a0d7b323b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f851affd640 1 -- 172.21.15.100:0/844297044 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f850c032440 con 0x7f851c078b20 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f851affd640 1 -- 172.21.15.100:0/844297044 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f850c032a00 con 0x7f851c078b20 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f851affd640 1 -- 172.21.15.100:0/844297044 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f850c0319e0 con 0x7f851c078b20 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f8522397640 1 -- 172.21.15.100:0/844297044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 msgr2=0x7f851c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f8522397640 1 --2- 172.21.15.100:0/844297044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f850c009840 tx=0x7f850c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:47.817 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f8522397640 1 -- 172.21.15.100:0/844297044 shutdown_connections 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.043+0000 7f8522397640 1 --2- 172.21.15.100:0/844297044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c077230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 -- 172.21.15.100:0/844297044 >> 172.21.15.100:0/844297044 conn(0x7f851c0fd850 msgr2=0x7f851c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 -- 172.21.15.100:0/844297044 shutdown_connections 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 -- 172.21.15.100:0/844297044 wait complete. 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 Processor -- start 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 -- start start 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.044+0000 7f8522397640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1134c0 con 0x7f851c078b20 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f851bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f851bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59004/0 (socket says 172.21.15.100:59004) 2024-09-13T02:41:47.818 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f851bfff640 1 -- 172.21.15.100:0/390643461 learned_addr learned my addr 172.21.15.100:0/390643461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f851bfff640 1 -- 172.21.15.100:0/390643461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009450 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f851bfff640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f850c006f00 tx=0x7f850c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f850c032880 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f850c03b8d0 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c1136c0 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f850c03a8f0 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.045+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c113b30 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.046+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f850c03b470 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.046+0000 7f8518ff9640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 0x7f850403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.046+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c04b720 con 0x7f851c078b20 2024-09-13T02:41:47.819 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.046+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f850c06c8f0 con 0x7f851c078b20 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.046+0000 7f851b7fe640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 0x7f850403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.047+0000 7f851b7fe640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 0x7f850403b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8510006fd0 tx=0x7f8510006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.051+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f850c03ba40 con 0x7f851c078b20 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.207+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f851c1081c0 con 0x7f851c078b20 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.208+0000 7f8518ff9640 1 -- 172.21.15.100:0/390643461 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f850c037020 con 0x7f851c078b20 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.209+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 msgr2=0x7f850403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.209+0000 7f8522397640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 0x7f850403b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8510006fd0 tx=0x7f8510006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.209+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 msgr2=0x7f851c112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.209+0000 7f8522397640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f850c006f00 tx=0x7f850c008040 comp rx=0 tx=0).stop 2024-09-13T02:41:47.820 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 shutdown_connections 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f8504039490 0x7f850403b940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 --2- 172.21.15.100:0/390643461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c078b20 0x7f851c112f80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 >> 172.21.15.100:0/390643461 conn(0x7f851c0fd850 msgr2=0x7f851c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 shutdown_connections 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:47.210+0000 7f8522397640 1 -- 172.21.15.100:0/390643461 wait complete. 2024-09-13T02:41:47.821 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling cephadm module... 2024-09-13T02:41:48.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:48 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2736154339' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T02:41:49.035 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdeed4bb640 1 Processor -- start 2024-09-13T02:41:49.035 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdeed4bb640 1 -- start start 2024-09-13T02:41:49.035 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdeed4bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdeed4bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8070e30 con 0x7fdee81035c0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59020/0 (socket says 172.21.15.100:59020) 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.182+0000 7fdee6ffd640 1 -- 172.21.15.100:0/3538309605 learned_addr learned my addr 172.21.15.100:0/3538309605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.183+0000 7fdee6ffd640 1 -- 172.21.15.100:0/3538309605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8103f10 con 0x7fdee81035c0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.183+0000 7fdee6ffd640 1 --2- 172.21.15.100:0/3538309605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fded8009840 tx=0x7fded80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cfd96a9857a15d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdee5ffb640 1 -- 172.21.15.100:0/3538309605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fded8032440 con 0x7fdee81035c0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdee5ffb640 1 -- 172.21.15.100:0/3538309605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fded8032a00 con 0x7fdee81035c0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdee5ffb640 1 -- 172.21.15.100:0/3538309605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fded80319e0 con 0x7fdee81035c0 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 -- 172.21.15.100:0/3538309605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 msgr2=0x7fdee81039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:49.036 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/3538309605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fded8009840 tx=0x7fded80091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 -- 172.21.15.100:0/3538309605 shutdown_connections 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/3538309605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee81039d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 -- 172.21.15.100:0/3538309605 >> 172.21.15.100:0/3538309605 conn(0x7fdee80fbdc0 msgr2=0x7fdee80fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 -- 172.21.15.100:0/3538309605 shutdown_connections 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.184+0000 7fdeed4bb640 1 -- 172.21.15.100:0/3538309605 wait complete. 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdeed4bb640 1 Processor -- start 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdeed4bb640 1 -- start start 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdeed4bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:49.037 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdeed4bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8111340 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdee6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59030/0 (socket says 172.21.15.100:59030) 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdee6ffd640 1 -- 172.21.15.100:0/2736154339 learned_addr learned my addr 172.21.15.100:0/2736154339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.185+0000 7fdee6ffd640 1 -- 172.21.15.100:0/2736154339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8009450 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdee6ffd640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fded80098a0 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fded8032880 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fded803d8b0 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee8111540 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fded803b910 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.186+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee8111f90 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fded8039070 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee80ffa60 con 0x7fdee81035c0 2024-09-13T02:41:49.038 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdecf7fe640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 0x7fded003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fded806cf10 con 0x7fdee81035c0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdee67fc640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 0x7fded003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.187+0000 7fdee67fc640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 0x7fded003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006fd0 tx=0x7fdedc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.191+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fded803da20 con 0x7fdee81035c0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.387+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fdee804b720 con 0x7fdee81035c0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.420+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fded803cbe0 con 0x7fdee81035c0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.420+0000 7fdecf7fe640 1 -- 172.21.15.100:0/2736154339 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fded80080b0 con 0x7fdee81035c0 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 msgr2=0x7fded003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 0x7fded003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006fd0 tx=0x7fdedc006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 msgr2=0x7fdee8110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fded80098a0 tx=0x7fded8008040 comp rx=0 tx=0).stop 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 shutdown_connections 2024-09-13T02:41:49.039 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7fded0039450 0x7fded003b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:49.040 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 --2- 172.21.15.100:0/2736154339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee81035c0 0x7fdee8110e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:49.040 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 >> 172.21.15.100:0/2736154339 conn(0x7fdee80fbdc0 msgr2=0x7fdee80fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:49.040 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 shutdown_connections 2024-09-13T02:41:49.040 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:48.422+0000 7fdeed4bb640 1 -- 172.21.15.100:0/2736154339 wait complete. 2024-09-13T02:41:49.627 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:49 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2736154339' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T02:41:49.627 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:49 smithi100 ceph-mon[27894]: mgrmap e5: smithi100.lhjyck(active, since 6s) 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "smithi100.lhjyck", 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.419+0000 7f23fce40640 1 Processor -- start 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23fce40640 1 -- start start 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23fce40640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23fce40640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f81017b0 con 0x7f23f8100e60 2024-09-13T02:41:50.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39504/0 (socket says 172.21.15.100:39504) 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23f659c640 1 -- 172.21.15.100:0/3708490331 learned_addr learned my addr 172.21.15.100:0/3708490331 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.420+0000 7f23f659c640 1 -- 172.21.15.100:0/3708490331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f81018f0 con 0x7f23f8100e60 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.421+0000 7f23f659c640 1 --2- 172.21.15.100:0/3708490331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009840 tx=0x7f23e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e14e712a44b4e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.421+0000 7f23f5d9b640 1 -- 172.21.15.100:0/3708490331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e8032440 con 0x7f23f8100e60 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.421+0000 7f23f5d9b640 1 -- 172.21.15.100:0/3708490331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f23e8032a00 con 0x7f23f8100e60 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.421+0000 7f23f5d9b640 1 -- 172.21.15.100:0/3708490331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e80319e0 con 0x7f23f8100e60 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 -- 172.21.15.100:0/3708490331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 msgr2=0x7f23f8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 --2- 172.21.15.100:0/3708490331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009840 tx=0x7f23e80091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 -- 172.21.15.100:0/3708490331 shutdown_connections 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 --2- 172.21.15.100:0/3708490331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f8101270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 -- 172.21.15.100:0/3708490331 >> 172.21.15.100:0/3708490331 conn(0x7f23f80fc5f0 msgr2=0x7f23f80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:50.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 -- 172.21.15.100:0/3708490331 shutdown_connections 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.422+0000 7f23fce40640 1 -- 172.21.15.100:0/3708490331 wait complete. 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23fce40640 1 Processor -- start 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23fce40640 1 -- start start 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23fce40640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23fce40640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8107600 con 0x7f23f8100e60 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23f659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39510/0 (socket says 172.21.15.100:39510) 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23f659c640 1 -- 172.21.15.100:0/2315718781 learned_addr learned my addr 172.21.15.100:0/2315718781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23f659c640 1 -- 172.21.15.100:0/2315718781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8009450 con 0x7f23f8100e60 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23f659c640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e8032880 con 0x7f23f8100e60 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f23e803d8b0 con 0x7f23f8100e60 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f8105690 con 0x7f23f8100e60 2024-09-13T02:41:50.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.423+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23e803b8e0 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.424+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f8105b00 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.424+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f23e8039070 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.424+0000 7f23eeffd640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 0x7f23e403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.424+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f23e803d510 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.425+0000 7f23effff640 1 -- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 msgr2=0x7f23e403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.425+0000 7f23effff640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 0x7f23e403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.425+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f804b720 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.429+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f23e8037070 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.626+0000 7f23effff640 1 -- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 msgr2=0x7f23e403b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.626+0000 7f23effff640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 0x7f23e403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.631+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f23f8106010 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.631+0000 7f23eeffd640 1 -- 172.21.15.100:0/2315718781 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f23e8041030 con 0x7f23f8100e60 2024-09-13T02:41:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 msgr2=0x7f23e403b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 0x7f23e403b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 msgr2=0x7f23f81070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f23e80098a0 tx=0x7f23e8008040 comp rx=0 tx=0).stop 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 shutdown_connections 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7f23e40394e0 0x7f23e403b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 --2- 172.21.15.100:0/2315718781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23f8100e60 0x7f23f81070c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 >> 172.21.15.100:0/2315718781 conn(0x7f23f80fc5f0 msgr2=0x7f23f80fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 shutdown_connections 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:49.633+0000 7f23fce40640 1 -- 172.21.15.100:0/2315718781 wait complete. 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-13T02:41:50.204 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 5... 2024-09-13T02:41:50.503 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:50 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2315718781' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:41:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: Active manager daemon smithi100.lhjyck restarted 2024-09-13T02:41:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:41:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T02:41:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: mgrmap e6: smithi100.lhjyck(active, starting, since 0.00366842s) 2024-09-13T02:41:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:41:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:52 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:41:54.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:53 smithi100 ceph-mon[27894]: Found migration_current of "None". Setting to last migration. 2024-09-13T02:41:54.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:53 smithi100 ceph-mon[27894]: mgrmap e7: smithi100.lhjyck(active, since 1.00516s) 2024-09-13T02:41:54.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:41:54.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T02:41:54.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:41:54.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:41:54.374 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.576+0000 7faac35d3640 1 Processor -- start 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.576+0000 7faac35d3640 1 -- start start 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac35d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac35d3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1017e0 con 0x7faabc100e90 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39526/0 (socket says 172.21.15.100:39526) 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac136f640 1 -- 172.21.15.100:0/1726443457 learned_addr learned my addr 172.21.15.100:0/1726443457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.577+0000 7faac136f640 1 -- 172.21.15.100:0/1726443457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc101920 con 0x7faabc100e90 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.578+0000 7faac136f640 1 --2- 172.21.15.100:0/1726443457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faab8009840 tx=0x7faab80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c375325779c8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.578+0000 7faab3fff640 1 -- 172.21.15.100:0/1726443457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab8032440 con 0x7faabc100e90 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.578+0000 7faab3fff640 1 -- 172.21.15.100:0/1726443457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faab8032a00 con 0x7faabc100e90 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.578+0000 7faab3fff640 1 -- 172.21.15.100:0/1726443457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab8031a10 con 0x7faabc100e90 2024-09-13T02:41:54.375 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- 172.21.15.100:0/1726443457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 msgr2=0x7faabc1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 --2- 172.21.15.100:0/1726443457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faab8009840 tx=0x7faab80091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- 172.21.15.100:0/1726443457 shutdown_connections 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 --2- 172.21.15.100:0/1726443457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc1012a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- 172.21.15.100:0/1726443457 >> 172.21.15.100:0/1726443457 conn(0x7faabc0fc6d0 msgr2=0x7faabc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- 172.21.15.100:0/1726443457 shutdown_connections 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- 172.21.15.100:0/1726443457 wait complete. 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 Processor -- start 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- start start 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.579+0000 7faac35d3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1075c0 con 0x7faabc100e90 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39540/0 (socket says 172.21.15.100:39540) 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac136f640 1 -- 172.21.15.100:0/143411859 learned_addr learned my addr 172.21.15.100:0/143411859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:54.376 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac136f640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8009450 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac136f640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faab8006a70 tx=0x7faab802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab8031d10 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faab8031e70 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab803b6f0 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc105650 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.580+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc105ac0 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faab8039070 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faab1ffb640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaa803c050 con 0x7faaa8039490 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faab806cc60 con 0x7faabc100e90 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faac0b6e640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 msgr2=0x7faaa803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.581+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:41:54.377 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.782+0000 7faac0b6e640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 msgr2=0x7faaa803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:50.782+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:51.183+0000 7faac0b6e640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 msgr2=0x7faaa803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:51.183+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:51.984+0000 7faac0b6e640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 msgr2=0x7faaa803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/1286357473 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:51.984+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:52.780+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7faab803dad0 con 0x7faabc100e90 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:52.780+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 msgr2=0x7faaa803b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:52.780+0000 7faab1ffb640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.780+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7faab8037d40 con 0x7faabc100e90 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.780+0000 7faab1ffb640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 0x7faaa803f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.780+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaa803c050 con 0x7faaa803cea0 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.781+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 0x7faaa803f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:54.378 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.781+0000 7faac0b6e640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 0x7faaa803f280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faaac003940 tx=0x7faaac009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.782+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7faaa803c050 con 0x7faaa803cea0 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7faabc04b720 con 0x7faaa803cea0 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faab1ffb640 1 -- 172.21.15.100:0/143411859 <== mgr.14118 v2:172.21.15.100:6800/808939656 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7faabc04b720 con 0x7faaa803cea0 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 msgr2=0x7faaa803f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 0x7faaa803f280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faaac003940 tx=0x7faaac009350 comp rx=0 tx=0).stop 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 msgr2=0x7faabc107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faab8006a70 tx=0x7faab802c040 comp rx=0 tx=0).stop 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 shutdown_connections 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7faaa803cea0 0x7faaa803f280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:6800/1286357473,v1:172.21.15.100:6801/1286357473] conn(0x7faaa8039490 0x7faaa803b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 --2- 172.21.15.100:0/143411859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc100e90 0x7faabc107080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 >> 172.21.15.100:0/143411859 conn(0x7faabc0fc6d0 msgr2=0x7faabc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:54.379 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 shutdown_connections 2024-09-13T02:41:54.380 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:53.787+0000 7faac35d3640 1 -- 172.21.15.100:0/143411859 wait complete. 2024-09-13T02:41:54.380 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 5 is available 2024-09-13T02:41:54.380 INFO:teuthology.orchestra.run.smithi100.stdout:Setting orchestrator backend to cephadm... 2024-09-13T02:41:55.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:54 smithi100 ceph-mon[27894]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T02:41:55.148 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:54 smithi100 ceph-mon[27894]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T02:41:55.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.966+0000 7f1a57475640 1 Processor -- start 2024-09-13T02:41:55.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.966+0000 7f1a57475640 1 -- start start 2024-09-13T02:41:55.720 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.966+0000 7f1a57475640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.967+0000 7f1a57475640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501028d0 con 0x7f1a50101f80 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.967+0000 7f1a55211640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.967+0000 7f1a55211640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39612/0 (socket says 172.21.15.100:39612) 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.967+0000 7f1a55211640 1 -- 172.21.15.100:0/4248358426 learned_addr learned my addr 172.21.15.100:0/4248358426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.967+0000 7f1a55211640 1 -- 172.21.15.100:0/4248358426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50102a10 con 0x7f1a50101f80 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a55211640 1 --2- 172.21.15.100:0/4248358426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009840 tx=0x7f1a4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3435acce0ef21666 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a47fff640 1 -- 172.21.15.100:0/4248358426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a4c032440 con 0x7f1a50101f80 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a47fff640 1 -- 172.21.15.100:0/4248358426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1a4c032a00 con 0x7f1a50101f80 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a47fff640 1 -- 172.21.15.100:0/4248358426 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a4c0319e0 con 0x7f1a50101f80 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 -- 172.21.15.100:0/4248358426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 msgr2=0x7f1a50102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 --2- 172.21.15.100:0/4248358426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009840 tx=0x7f1a4c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 -- 172.21.15.100:0/4248358426 shutdown_connections 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 --2- 172.21.15.100:0/4248358426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50102390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:55.721 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 -- 172.21.15.100:0/4248358426 >> 172.21.15.100:0/4248358426 conn(0x7f1a500fd7a0 msgr2=0x7f1a500ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.968+0000 7f1a57475640 1 -- 172.21.15.100:0/4248358426 shutdown_connections 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a57475640 1 -- 172.21.15.100:0/4248358426 wait complete. 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a57475640 1 Processor -- start 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a57475640 1 -- start start 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a57475640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a57475640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50111370 con 0x7f1a50101f80 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a55211640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a55211640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39616/0 (socket says 172.21.15.100:39616) 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a55211640 1 -- 172.21.15.100:0/548237414 learned_addr learned my addr 172.21.15.100:0/548237414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.969+0000 7f1a55211640 1 -- 172.21.15.100:0/548237414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009450 con 0x7f1a50101f80 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a55211640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a4c03d450 con 0x7f1a50101f80 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1a4c03da10 con 0x7f1a50101f80 2024-09-13T02:41:55.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a50111570 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a4c03b840 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.970+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a50112050 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.971+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1a4c039070 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.971+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a501013e0 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.971+0000 7f1a45ffb640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 0x7f1a3c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.971+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1a4c06d2a0 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.971+0000 7f1a54a10640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 0x7f1a3c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.972+0000 7f1a54a10640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 0x7f1a3c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:54.976+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1a4c03cb60 con 0x7f1a50101f80 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.147+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a500fec00 con 0x7f1a3c0394e0 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.155+0000 7f1a45ffb640 1 -- 172.21.15.100:0/548237414 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1a500fec00 con 0x7f1a3c0394e0 2024-09-13T02:41:55.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 msgr2=0x7f1a3c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 0x7f1a3c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a40006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 msgr2=0x7f1a50110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000c00 tx=0x7f1a4c008040 comp rx=0 tx=0).stop 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 shutdown_connections 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f1a3c0394e0 0x7f1a3c03b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 --2- 172.21.15.100:0/548237414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a50101f80 0x7f1a50110e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 >> 172.21.15.100:0/548237414 conn(0x7f1a500fd7a0 msgr2=0x7f1a500fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 shutdown_connections 2024-09-13T02:41:55.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:55.157+0000 7f1a57475640 1 -- 172.21.15.100:0/548237414 wait complete. 2024-09-13T02:41:56.032 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:55 smithi100 ceph-mon[27894]: mgrmap e8: smithi100.lhjyck(active, since 2s) 2024-09-13T02:41:56.032 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:55 smithi100 ceph-mon[27894]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:41:56.033 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:55 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:56.033 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:55 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:41:56.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T02:41:56.894 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f23a55a3640 1 Processor -- start 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f23a55a3640 1 -- start start 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f23a55a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f23a55a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0102d70 con 0x7f23a0102390 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f239effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f239effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39622/0 (socket says 172.21.15.100:39622) 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.105+0000 7f239effd640 1 -- 172.21.15.100:0/3453799494 learned_addr learned my addr 172.21.15.100:0/3453799494 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.106+0000 7f239effd640 1 -- 172.21.15.100:0/3453799494 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0102eb0 con 0x7f23a0102390 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.106+0000 7f239effd640 1 --2- 172.21.15.100:0/3453799494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2390009840 tx=0x7f23900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d527598ec3f89e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.106+0000 7f239dffb640 1 -- 172.21.15.100:0/3453799494 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2390032440 con 0x7f23a0102390 2024-09-13T02:41:56.895 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.106+0000 7f239dffb640 1 -- 172.21.15.100:0/3453799494 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2390032a00 con 0x7f23a0102390 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.106+0000 7f239dffb640 1 -- 172.21.15.100:0/3453799494 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23900319e0 con 0x7f23a0102390 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 -- 172.21.15.100:0/3453799494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 msgr2=0x7f23a01027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 --2- 172.21.15.100:0/3453799494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2390009840 tx=0x7f23900091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 -- 172.21.15.100:0/3453799494 shutdown_connections 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 --2- 172.21.15.100:0/3453799494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a01027a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 -- 172.21.15.100:0/3453799494 >> 172.21.15.100:0/3453799494 conn(0x7f23a00fbdd0 msgr2=0x7f23a00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 -- 172.21.15.100:0/3453799494 shutdown_connections 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.107+0000 7f23a55a3640 1 -- 172.21.15.100:0/3453799494 wait complete. 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f23a55a3640 1 Processor -- start 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f23a55a3640 1 -- start start 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f23a55a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f23a55a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0113470 con 0x7f23a0102390 2024-09-13T02:41:56.896 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f239effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f239effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39636/0 (socket says 172.21.15.100:39636) 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f239effd640 1 -- 172.21.15.100:0/1852975542 learned_addr learned my addr 172.21.15.100:0/1852975542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f239effd640 1 -- 172.21.15.100:0/1852975542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390009450 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.108+0000 7f239effd640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2390000c00 tx=0x7f2390008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f239003d450 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f239003da10 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a0113670 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f239003b8e0 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a0113ae0 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2390039070 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.109+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a004b720 con 0x7f23a0102390 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.110+0000 7f23877fe640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 0x7f238803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:56.897 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.110+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f239006d430 con 0x7f23a0102390 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.110+0000 7f239e7fc640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 0x7f238803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.110+0000 7f239e7fc640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 0x7f238803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2394006fd0 tx=0x7f2394006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.114+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f239004e350 con 0x7f23a0102390 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.270+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a0113ae0 con 0x7f2388039490 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.271+0000 7f23877fe640 1 -- 172.21.15.100:0/1852975542 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f23a0113ae0 con 0x7f2388039490 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 msgr2=0x7f238803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 0x7f238803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2394006fd0 tx=0x7f2394006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 msgr2=0x7f23a0112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2390000c00 tx=0x7f2390008040 comp rx=0 tx=0).stop 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 shutdown_connections 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2388039490 0x7f238803b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 --2- 172.21.15.100:0/1852975542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a0102390 0x7f23a0112f30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 >> 172.21.15.100:0/1852975542 conn(0x7f23a00fbdd0 msgr2=0x7f23a00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:56.898 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 shutdown_connections 2024-09-13T02:41:56.899 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:56.273+0000 7f23a55a3640 1 -- 172.21.15.100:0/1852975542 wait complete. 2024-09-13T02:41:56.899 INFO:teuthology.orchestra.run.smithi100.stdout:Generating ssh key... 2024-09-13T02:41:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: [13/Sep/2024:02:41:55] ENGINE Bus STARTING 2024-09-13T02:41:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: [13/Sep/2024:02:41:55] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:41:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: [13/Sep/2024:02:41:55] ENGINE Bus STARTED 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: [13/Sep/2024:02:41:55] ENGINE Error in HTTPServer.serve 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:41:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:41:57.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:56 smithi100 ceph-mon[27894]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:41:58.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:57 smithi100 ceph-mon[27894]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:41:58.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:57 smithi100 ceph-mon[27894]: Generating ssh key... 2024-09-13T02:41:58.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:57 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:58.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:57 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a531ae640 1 Processor -- start 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a531ae640 1 -- start start 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a531ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a531ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c076ec0 con 0x7f0a4c076ab0 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a50f4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a50f4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39638/0 (socket says 172.21.15.100:39638) 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a50f4a640 1 -- 172.21.15.100:0/2631829252 learned_addr learned my addr 172.21.15.100:0/2631829252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.294+0000 7f0a50f4a640 1 -- 172.21.15.100:0/2631829252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c105200 con 0x7f0a4c076ab0 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.295+0000 7f0a50f4a640 1 --2- 172.21.15.100:0/2631829252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009840 tx=0x7f0a400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c502f6b0771afb18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.295+0000 7f0a4b7fe640 1 -- 172.21.15.100:0/2631829252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a40032440 con 0x7f0a4c076ab0 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.295+0000 7f0a4b7fe640 1 -- 172.21.15.100:0/2631829252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0a40032a00 con 0x7f0a4c076ab0 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.295+0000 7f0a4b7fe640 1 -- 172.21.15.100:0/2631829252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a40031a10 con 0x7f0a4c076ab0 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- 172.21.15.100:0/2631829252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 msgr2=0x7f0a4c104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2631829252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009840 tx=0x7f0a400091d0 comp rx=0 tx=0).stop 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- 172.21.15.100:0/2631829252 shutdown_connections 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2631829252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c104cc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- 172.21.15.100:0/2631829252 >> 172.21.15.100:0/2631829252 conn(0x7f0a4c0fc750 msgr2=0x7f0a4c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- 172.21.15.100:0/2631829252 shutdown_connections 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- 172.21.15.100:0/2631829252 wait complete. 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 Processor -- start 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.296+0000 7f0a531ae640 1 -- start start 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a531ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a531ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c102b30 con 0x7f0a4c076ab0 2024-09-13T02:41:58.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a50f4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:58.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a50f4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39650/0 (socket says 172.21.15.100:39650) 2024-09-13T02:41:58.202 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a50f4a640 1 -- 172.21.15.100:0/2976715916 learned_addr learned my addr 172.21.15.100:0/2976715916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a50f4a640 1 -- 172.21.15.100:0/2976715916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009450 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a50f4a640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a400329d0 tx=0x7f0a4002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a40031d10 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0a40031e70 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.297+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c100bc0 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.298+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a4003b670 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.298+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c101030 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.298+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0a40039070 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.298+0000 7f0a497fa640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 0x7f0a3c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.299+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0a4003d450 con 0x7f0a4c076ab0 2024-09-13T02:41:58.204 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.299+0000 7f0a4bfff640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 0x7f0a3c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.299+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c04b720 con 0x7f0a4c076ab0 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.299+0000 7f0a4bfff640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 0x7f0a3c03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a38006fd0 tx=0x7f0a38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.303+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a40041070 con 0x7f0a4c076ab0 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.459+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a4c1015b0 con 0x7f0a3c039490 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.601+0000 7f0a497fa640 1 -- 172.21.15.100:0/2976715916 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0a4c1015b0 con 0x7f0a3c039490 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 msgr2=0x7f0a3c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 0x7f0a3c03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a38006fd0 tx=0x7f0a38006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 msgr2=0x7f0a4c1025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a400329d0 tx=0x7f0a4002c040 comp rx=0 tx=0).stop 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 shutdown_connections 2024-09-13T02:41:58.205 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f0a3c039490 0x7f0a3c03b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:58.206 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 --2- 172.21.15.100:0/2976715916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a4c076ab0 0x7f0a4c1025f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:58.206 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 >> 172.21.15.100:0/2976715916 conn(0x7f0a4c0fc750 msgr2=0x7f0a4c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:58.206 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 shutdown_connections 2024-09-13T02:41:58.206 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:57.603+0000 7f0a531ae640 1 -- 172.21.15.100:0/2976715916 wait complete. 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVY5CgUGZI3+WPx96nAexLcQKKLJJQlIALHC1kUOX8/GbTv0xqct7YScy0RJmOnWTFMXTrU4H/WdTX7SEKV/o/M0f04QKIJm5I93NT/vq4G1dx4YpA4CuZdhBelpGUkoem/vLcApjhSyMWbsyVWI7YwimF2U61v1M4/GlDb/myOR5XvWAPQRrLCoqPuT/beHUlr26sLmUQRXro3mA6oYX9kuHzzGgg0I9e6/m+QtjAr4fmfVAaPM8IyY5uU6x9s75cjdtV6xLy1gMXfRIbw3ZmEQlSylRdM2f0tYo8SSf4YOAOSWOMJic3uYBITcetAzDqD33sjLw08qLeCbVQ8rnlrQzUGLULiqCoTdQjcysWny7GY3WCVwMCM7gV6DbFWRehVpfFh8+X5Ao6+BASB4CAbCtVXHrI56V/FQUocx/If5iSRBKbKV6lazFP80G0LeXy+DDLgKm2mjBLst8KcKSENK2Otcy63YQlc3gInt0Mwl3Qi8CHsq6ESSGlDfB9smU= ceph-84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bc1126640 1 Processor -- start 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bc1126640 1 -- start start 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bc1126640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bc1126640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc076e20 con 0x7f6bbc076a10 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:59.265 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50102/0 (socket says 172.21.15.100:50102) 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bbad9d640 1 -- 172.21.15.100:0/1639274185 learned_addr learned my addr 172.21.15.100:0/1639274185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.558+0000 7f6bbad9d640 1 -- 172.21.15.100:0/1639274185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc1052a0 con 0x7f6bbc076a10 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bbad9d640 1 --2- 172.21.15.100:0/1639274185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009e50 tx=0x7f6bb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4b020dadbe9375 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bb9d9b640 1 -- 172.21.15.100:0/1639274185 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bb0031560 con 0x7f6bbc076a10 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bb9d9b640 1 -- 172.21.15.100:0/1639274185 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6bb002d050 con 0x7f6bbc076a10 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bb9d9b640 1 -- 172.21.15.100:0/1639274185 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bb00079b0 con 0x7f6bbc076a10 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bc1126640 1 -- 172.21.15.100:0/1639274185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 msgr2=0x7f6bbc104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.559+0000 7f6bc1126640 1 --2- 172.21.15.100:0/1639274185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009e50 tx=0x7f6bb0009840 comp rx=0 tx=0).stop 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- 172.21.15.100:0/1639274185 shutdown_connections 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 --2- 172.21.15.100:0/1639274185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc104d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- 172.21.15.100:0/1639274185 >> 172.21.15.100:0/1639274185 conn(0x7f6bbc0fc750 msgr2=0x7f6bbc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- 172.21.15.100:0/1639274185 shutdown_connections 2024-09-13T02:41:59.266 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- 172.21.15.100:0/1639274185 wait complete. 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 Processor -- start 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- start start 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bc1126640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc111340 con 0x7f6bbc076a10 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.560+0000 7f6bbad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50112/0 (socket says 172.21.15.100:50112) 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6bbad9d640 1 -- 172.21.15.100:0/2553988507 learned_addr learned my addr 172.21.15.100:0/2553988507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6bbad9d640 1 -- 172.21.15.100:0/2553988507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009ae0 con 0x7f6bbc076a10 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6bbad9d640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0007690 tx=0x7f6bb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bb0031b40 con 0x7f6bbc076a10 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6bb0031ca0 con 0x7f6bbc076a10 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc111540 con 0x7f6bbc076a10 2024-09-13T02:41:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bb0044400 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.561+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc111f90 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.562+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6bb0038040 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.562+0000 7f6ba37fe640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 0x7f6ba403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.562+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6bb0040030 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.562+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc1003f0 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.562+0000 7f6bba59c640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 0x7f6ba403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.563+0000 7f6bba59c640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 0x7f6ba403b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.566+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6bb0036080 con 0x7f6bbc076a10 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.724+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc0fdb60 con 0x7f6ba4039490 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.724+0000 7f6ba37fe640 1 -- 172.21.15.100:0/2553988507 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6bbc0fdb60 con 0x7f6ba4039490 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 msgr2=0x7f6ba403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:59.268 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 0x7f6ba403b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac006db0 comp rx=0 tx=0).stop 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 msgr2=0x7f6bbc110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0007690 tx=0x7f6bb0009840 comp rx=0 tx=0).stop 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 shutdown_connections 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f6ba4039490 0x7f6ba403b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 --2- 172.21.15.100:0/2553988507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc076a10 0x7f6bbc110e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.726+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 >> 172.21.15.100:0/2553988507 conn(0x7f6bbc0fc750 msgr2=0x7f6bbc0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.727+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 shutdown_connections 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:58.727+0000 7f6bc1126640 1 -- 172.21.15.100:0/2553988507 wait complete. 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T02:41:59.269 INFO:teuthology.orchestra.run.smithi100.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T02:41:59.271 INFO:teuthology.orchestra.run.smithi100.stdout:Adding host smithi100... 2024-09-13T02:41:59.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:41:59 smithi100 ceph-mon[27894]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:00.597 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:00 smithi100 ceph-mon[27894]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:01.526 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:01 smithi100 ceph-mon[27894]: Deploying cephadm binary to smithi100 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Added host 'smithi100' with addr '172.21.15.100' 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740f563640 1 Processor -- start 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740f563640 1 -- start start 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740f563640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740f563640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408076ec0 con 0x7f7408076ab0 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740d2ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740d2ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50124/0 (socket says 172.21.15.100:50124) 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740d2ff640 1 -- 172.21.15.100:0/3933244690 learned_addr learned my addr 172.21.15.100:0/3933244690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.642+0000 7f740d2ff640 1 -- 172.21.15.100:0/3933244690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408105200 con 0x7f7408076ab0 2024-09-13T02:42:03.134 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.643+0000 7f740d2ff640 1 --2- 172.21.15.100:0/3933244690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7404009840 tx=0x7f74040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7904a5e65faf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.643+0000 7f73fffff640 1 -- 172.21.15.100:0/3933244690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7404032440 con 0x7f7408076ab0 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.643+0000 7f73fffff640 1 -- 172.21.15.100:0/3933244690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7404032a00 con 0x7f7408076ab0 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.643+0000 7f73fffff640 1 -- 172.21.15.100:0/3933244690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7404031a10 con 0x7f7408076ab0 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 -- 172.21.15.100:0/3933244690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 msgr2=0x7f7408104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 --2- 172.21.15.100:0/3933244690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7404009840 tx=0x7f74040091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 -- 172.21.15.100:0/3933244690 shutdown_connections 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 --2- 172.21.15.100:0/3933244690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408104cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 -- 172.21.15.100:0/3933244690 >> 172.21.15.100:0/3933244690 conn(0x7f74080fc790 msgr2=0x7f74080feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 -- 172.21.15.100:0/3933244690 shutdown_connections 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 -- 172.21.15.100:0/3933244690 wait complete. 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.644+0000 7f740f563640 1 Processor -- start 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740f563640 1 -- start start 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740f563640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:03.135 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740f563640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408111360 con 0x7f7408076ab0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740d2ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740d2ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50130/0 (socket says 172.21.15.100:50130) 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740d2ff640 1 -- 172.21.15.100:0/364360180 learned_addr learned my addr 172.21.15.100:0/364360180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740d2ff640 1 -- 172.21.15.100:0/364360180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009450 con 0x7f7408076ab0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740d2ff640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74040098a0 tx=0x7f740402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74040327b0 con 0x7f7408076ab0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f740403b870 con 0x7f7408076ab0 2024-09-13T02:42:03.136 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f740403a550 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.645+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408111560 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.646+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408111fb0 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.646+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f7404039040 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.646+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74081003f0 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.646+0000 7f73fdffb640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 0x7f73f403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.647+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f740406c8d0 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.647+0000 7f740cafe640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 0x7f73f403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.647+0000 7f740cafe640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 0x7f73f403b900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006fd0 tx=0x7f73f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.651+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f740403bd70 con 0x7f7408076ab0 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:41:59.809+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "addr": "172.21.15.100", "target": ["mon-mgr", ""]}) v1 -- 0x7f74080fdb40 con 0x7f73f4039450 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.515+0000 7f73fdffb640 1 -- 172.21.15.100:0/364360180 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f74080fdb40 con 0x7f73f4039450 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 msgr2=0x7f73f403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:03.137 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 0x7f73f403b900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006fd0 tx=0x7f73f8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 msgr2=0x7f7408110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74040098a0 tx=0x7f740402c040 comp rx=0 tx=0).stop 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 shutdown_connections 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f73f4039450 0x7f73f403b900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 --2- 172.21.15.100:0/364360180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7408076ab0 0x7f7408110e20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 >> 172.21.15.100:0/364360180 conn(0x7f74080fc790 msgr2=0x7f74080fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 shutdown_connections 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:02.518+0000 7f740f563640 1 -- 172.21.15.100:0/364360180 wait complete. 2024-09-13T02:42:03.138 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying mon service with default placement... 2024-09-13T02:42:03.695 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:03 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:03.695 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:03 smithi100 ceph-mon[27894]: Added host smithi100 2024-09-13T02:42:03.695 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:03 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:42:04.444 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T02:42:04.444 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd2fa9640 1 Processor -- start 2024-09-13T02:42:04.444 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd2fa9640 1 -- start start 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd2fa9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd2fa9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1028e0 con 0x7f4bcc101f90 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd0d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd0d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50142/0 (socket says 172.21.15.100:50142) 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.512+0000 7f4bd0d45640 1 -- 172.21.15.100:0/712782762 learned_addr learned my addr 172.21.15.100:0/712782762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.513+0000 7f4bd0d45640 1 -- 172.21.15.100:0/712782762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc102a20 con 0x7f4bcc101f90 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.513+0000 7f4bd0d45640 1 --2- 172.21.15.100:0/712782762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009840 tx=0x7f4bc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1301c3ff65cebb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bcb7fe640 1 -- 172.21.15.100:0/712782762 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bc0032440 con 0x7f4bcc101f90 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bcb7fe640 1 -- 172.21.15.100:0/712782762 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4bc0032a00 con 0x7f4bcc101f90 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bcb7fe640 1 -- 172.21.15.100:0/712782762 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bc00319e0 con 0x7f4bcc101f90 2024-09-13T02:42:04.445 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/712782762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 msgr2=0x7f4bcc1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/712782762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009840 tx=0x7f4bc00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/712782762 shutdown_connections 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/712782762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc1023a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/712782762 >> 172.21.15.100:0/712782762 conn(0x7f4bcc0fd710 msgr2=0x7f4bcc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/712782762 shutdown_connections 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.516+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/712782762 wait complete. 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd2fa9640 1 Processor -- start 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd2fa9640 1 -- start start 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd2fa9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd2fa9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc111220 con 0x7f4bcc101f90 2024-09-13T02:42:04.446 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd0d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd0d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50150/0 (socket says 172.21.15.100:50150) 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.517+0000 7f4bd0d45640 1 -- 172.21.15.100:0/128380068 learned_addr learned my addr 172.21.15.100:0/128380068 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bd0d45640 1 -- 172.21.15.100:0/128380068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0009450 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bd0d45640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098a0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bc0032880 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4bc003d8b0 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc111420 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bc003b910 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.518+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc111890 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.519+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4bc0039070 con 0x7f4bcc101f90 2024-09-13T02:42:04.447 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.519+0000 7f4bc97fa640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 0x7f4bbc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.519+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4bc003de00 con 0x7f4bcc101f90 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.519+0000 7f4bcbfff640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 0x7f4bbc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.519+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc1013f0 con 0x7f4bcc101f90 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.520+0000 7f4bcbfff640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 0x7f4bbc03b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006fd0 tx=0x7f4bb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.524+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4bc0041070 con 0x7f4bcc101f90 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.693+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bcc0fe970 con 0x7f4bbc0394e0 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.700+0000 7f4bc97fa640 1 -- 172.21.15.100:0/128380068 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4bcc0fe970 con 0x7f4bbc0394e0 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 msgr2=0x7f4bbc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 0x7f4bbc03b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006fd0 tx=0x7f4bb8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 msgr2=0x7f4bcc110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:04.448 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098a0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 shutdown_connections 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4bbc0394e0 0x7f4bbc03b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 --2- 172.21.15.100:0/128380068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bcc101f90 0x7f4bcc110ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 >> 172.21.15.100:0/128380068 conn(0x7f4bcc0fd710 msgr2=0x7f4bcc0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 shutdown_connections 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:03.702+0000 7f4bd2fa9640 1 -- 172.21.15.100:0/128380068 wait complete. 2024-09-13T02:42:04.449 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying mgr service with default placement... 2024-09-13T02:42:04.912 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:04 smithi100 ceph-mon[27894]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:04.912 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:04 smithi100 ceph-mon[27894]: Saving service mon spec with placement count:5 2024-09-13T02:42:04.912 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:04 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:06.517 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:06 smithi100 ceph-mon[27894]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:06.517 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:06 smithi100 ceph-mon[27894]: Saving service mgr spec with placement count:2 2024-09-13T02:42:06.517 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:06 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:06.517 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:06 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:06.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T02:42:06.523 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.113+0000 7efd79bd7640 1 Processor -- start 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.113+0000 7efd79bd7640 1 -- start start 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd79bd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd79bd7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74076ea0 con 0x7efd74076a90 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50162/0 (socket says 172.21.15.100:50162) 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd737fe640 1 -- 172.21.15.100:0/2113927234 learned_addr learned my addr 172.21.15.100:0/2113927234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.114+0000 7efd737fe640 1 -- 172.21.15.100:0/2113927234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd741051a0 con 0x7efd74076a90 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd737fe640 1 --2- 172.21.15.100:0/2113927234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd64009840 tx=0x7efd640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265cedb2247f761a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd72ffd640 1 -- 172.21.15.100:0/2113927234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd64032440 con 0x7efd74076a90 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd72ffd640 1 -- 172.21.15.100:0/2113927234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efd64032a00 con 0x7efd74076a90 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd72ffd640 1 -- 172.21.15.100:0/2113927234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd64031a10 con 0x7efd74076a90 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd79bd7640 1 -- 172.21.15.100:0/2113927234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 msgr2=0x7efd74104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:06.524 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.115+0000 7efd79bd7640 1 --2- 172.21.15.100:0/2113927234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd64009840 tx=0x7efd640091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- 172.21.15.100:0/2113927234 shutdown_connections 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 --2- 172.21.15.100:0/2113927234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74104c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- 172.21.15.100:0/2113927234 >> 172.21.15.100:0/2113927234 conn(0x7efd740fc6d0 msgr2=0x7efd740feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- 172.21.15.100:0/2113927234 shutdown_connections 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- 172.21.15.100:0/2113927234 wait complete. 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 Processor -- start 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- start start 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.116+0000 7efd79bd7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74111230 con 0x7efd74076a90 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50172/0 (socket says 172.21.15.100:50172) 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd737fe640 1 -- 172.21.15.100:0/3026546557 learned_addr learned my addr 172.21.15.100:0/3026546557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd737fe640 1 -- 172.21.15.100:0/3026546557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009450 con 0x7efd74076a90 2024-09-13T02:42:06.525 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd737fe640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd640098a0 tx=0x7efd6402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd640327b0 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd74111430 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7efd6403b870 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd6403a530 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.117+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd74111fc0 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.118+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7efd64039040 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.118+0000 7efd70ff9640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 0x7efd6003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.118+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efd6406c8c0 con 0x7efd74076a90 2024-09-13T02:42:06.526 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.118+0000 7efd6affd640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 0x7efd6003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.118+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd741002f0 con 0x7efd74076a90 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.119+0000 7efd6affd640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 0x7efd6003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd5c006fd0 tx=0x7efd5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.123+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efd6403f080 con 0x7efd74076a90 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.288+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7efd740fdbe0 con 0x7efd60039490 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.292+0000 7efd70ff9640 1 -- 172.21.15.100:0/3026546557 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efd740fdbe0 con 0x7efd60039490 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.294+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 msgr2=0x7efd6003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.294+0000 7efd79bd7640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 0x7efd6003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd5c006fd0 tx=0x7efd5c006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.294+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 msgr2=0x7efd74110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.294+0000 7efd79bd7640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd640098a0 tx=0x7efd6402c040 comp rx=0 tx=0).stop 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 shutdown_connections 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7efd60039490 0x7efd6003b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 --2- 172.21.15.100:0/3026546557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd74076a90 0x7efd74110cf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 >> 172.21.15.100:0/3026546557 conn(0x7efd740fc6d0 msgr2=0x7efd740fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:06.527 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 shutdown_connections 2024-09-13T02:42:06.528 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:05.295+0000 7efd79bd7640 1 -- 172.21.15.100:0/3026546557 wait complete. 2024-09-13T02:42:06.528 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying crash service with default placement... 2024-09-13T02:42:07.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T02:42:07.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.957+0000 7fc34f7d0640 1 Processor -- start 2024-09-13T02:42:07.722 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.957+0000 7fc34f7d0640 1 -- start start 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.957+0000 7fc34f7d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.957+0000 7fc34f7d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481028e0 con 0x7fc348101f90 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.958+0000 7fc34d56c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.958+0000 7fc34d56c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50178/0 (socket says 172.21.15.100:50178) 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.958+0000 7fc34d56c640 1 -- 172.21.15.100:0/2496555227 learned_addr learned my addr 172.21.15.100:0/2496555227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.958+0000 7fc34d56c640 1 -- 172.21.15.100:0/2496555227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348102a20 con 0x7fc348101f90 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.958+0000 7fc34d56c640 1 --2- 172.21.15.100:0/2496555227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b2b8258de527c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc347fff640 1 -- 172.21.15.100:0/2496555227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc338031560 con 0x7fc348101f90 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc347fff640 1 -- 172.21.15.100:0/2496555227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc33802d050 con 0x7fc348101f90 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc347fff640 1 -- 172.21.15.100:0/2496555227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc338007a60 con 0x7fc348101f90 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 -- 172.21.15.100:0/2496555227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 msgr2=0x7fc3481023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/2496555227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e50 tx=0x7fc338009840 comp rx=0 tx=0).stop 2024-09-13T02:42:07.723 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 -- 172.21.15.100:0/2496555227 shutdown_connections 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/2496555227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc3481023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 -- 172.21.15.100:0/2496555227 >> 172.21.15.100:0/2496555227 conn(0x7fc3480fd710 msgr2=0x7fc3480ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 -- 172.21.15.100:0/2496555227 shutdown_connections 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.959+0000 7fc34f7d0640 1 -- 172.21.15.100:0/2496555227 wait complete. 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34f7d0640 1 Processor -- start 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34f7d0640 1 -- start start 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34f7d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34f7d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348079140 con 0x7fc348101f90 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34d56c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34d56c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50186/0 (socket says 172.21.15.100:50186) 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34d56c640 1 -- 172.21.15.100:0/351797927 learned_addr learned my addr 172.21.15.100:0/351797927 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34d56c640 1 -- 172.21.15.100:0/351797927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009ae0 con 0x7fc348101f90 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.960+0000 7fc34d56c640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc338009560 tx=0x7fc338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:07.724 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.961+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc33803b410 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.961+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc33803ba10 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.961+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc338045710 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.961+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3480771d0 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.961+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc348077640 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc338038050 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc345ffb640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 0x7fc33003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34804b720 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc33806d070 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc34cd6b640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 0x7fc33003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.962+0000 7fc34cd6b640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 0x7fc33003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:06.966+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc33803bb80 con 0x7fc348101f90 2024-09-13T02:42:07.725 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.138+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc348077cc0 con 0x7fc3300394e0 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.143+0000 7fc345ffb640 1 -- 172.21.15.100:0/351797927 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc348077cc0 con 0x7fc3300394e0 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 msgr2=0x7fc33003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 0x7fc33003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 msgr2=0x7fc348078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc338009560 tx=0x7fc338009840 comp rx=0 tx=0).stop 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 shutdown_connections 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fc3300394e0 0x7fc33003b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 --2- 172.21.15.100:0/351797927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc348101f90 0x7fc348078c00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 >> 172.21.15.100:0/351797927 conn(0x7fc3480fd710 msgr2=0x7fc3480fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 shutdown_connections 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:07.145+0000 7fc34f7d0640 1 -- 172.21.15.100:0/351797927 wait complete. 2024-09-13T02:42:07.726 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying prometheus service with default placement... 2024-09-13T02:42:08.305 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:08 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:08.305 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:08 smithi100 ceph-mon[27894]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:08.306 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:08 smithi100 ceph-mon[27894]: Saving service crash spec with placement * 2024-09-13T02:42:08.306 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:08 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.115+0000 7f49abe04640 1 Processor -- start 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49abe04640 1 -- start start 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49abe04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49abe04640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4105120 con 0x7f49a4076b90 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49a9ba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49a9ba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50202/0 (socket says 172.21.15.100:50202) 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49a9ba0640 1 -- 172.21.15.100:0/1575080629 learned_addr learned my addr 172.21.15.100:0/1575080629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:08.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.116+0000 7f49a9ba0640 1 -- 172.21.15.100:0/1575080629 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4105260 con 0x7f49a4076b90 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.117+0000 7f49a9ba0640 1 --2- 172.21.15.100:0/1575080629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4998009840 tx=0x7f49980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150f2298551460d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.117+0000 7f49a8b9e640 1 -- 172.21.15.100:0/1575080629 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4998032440 con 0x7f49a4076b90 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.117+0000 7f49a8b9e640 1 -- 172.21.15.100:0/1575080629 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4998032a40 con 0x7f49a4076b90 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.117+0000 7f49a8b9e640 1 -- 172.21.15.100:0/1575080629 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4998031a70 con 0x7f49a4076b90 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- 172.21.15.100:0/1575080629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 msgr2=0x7f49a4104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 --2- 172.21.15.100:0/1575080629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4998009840 tx=0x7f49980091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- 172.21.15.100:0/1575080629 shutdown_connections 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 --2- 172.21.15.100:0/1575080629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4104be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- 172.21.15.100:0/1575080629 >> 172.21.15.100:0/1575080629 conn(0x7f49a40fc710 msgr2=0x7f49a40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- 172.21.15.100:0/1575080629 shutdown_connections 2024-09-13T02:42:08.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- 172.21.15.100:0/1575080629 wait complete. 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 Processor -- start 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- start start 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.118+0000 7f49abe04640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4111380 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49a9ba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49a9ba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50214/0 (socket says 172.21.15.100:50214) 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49a9ba0640 1 -- 172.21.15.100:0/3441659040 learned_addr learned my addr 172.21.15.100:0/3441659040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49a9ba0640 1 -- 172.21.15.100:0/3441659040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998009450 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49a9ba0640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4998031750 tx=0x7f49980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f499803c400 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a4111580 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f499803ca00 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f499803a880 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.119+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a4111fd0 con 0x7f49a4076b90 2024-09-13T02:42:08.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.120+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f499803c560 con 0x7f49a4076b90 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.120+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a4100350 con 0x7f49a4076b90 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.120+0000 7f49967fc640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 0x7f499003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.120+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f499806cfd0 con 0x7f49a4076b90 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.120+0000 7f49a939f640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 0x7f499003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.121+0000 7f49a939f640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 0x7f499003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.124+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4998046460 con 0x7f49a4076b90 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.304+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f49a40fdab0 con 0x7f4990039490 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.309+0000 7f49967fc640 1 -- 172.21.15.100:0/3441659040 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f49a40fdab0 con 0x7f4990039490 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 msgr2=0x7f499003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 0x7f499003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f49a0006fd0 tx=0x7f49a0006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 msgr2=0x7f49a4110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:08.891 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4998031750 tx=0x7f49980091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 shutdown_connections 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4990039490 0x7f499003b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 --2- 172.21.15.100:0/3441659040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a4076b90 0x7f49a4110e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 >> 172.21.15.100:0/3441659040 conn(0x7f49a40fc710 msgr2=0x7f49a40fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 shutdown_connections 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:08.312+0000 7f49abe04640 1 -- 172.21.15.100:0/3441659040 wait complete. 2024-09-13T02:42:08.892 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying grafana service with default placement... 2024-09-13T02:42:09.475 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:09 smithi100 ceph-mon[27894]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:09.475 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:09 smithi100 ceph-mon[27894]: Saving service prometheus spec with placement count:1 2024-09-13T02:42:09.475 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:09 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:10.599 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:10 smithi100 ceph-mon[27894]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:10.599 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:10 smithi100 ceph-mon[27894]: Saving service grafana spec with placement count:1 2024-09-13T02:42:10.599 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:10 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:10.599 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:10 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26c69b2640 1 Processor -- start 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26c69b2640 1 -- start start 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26c69b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26c69b2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0102d60 con 0x7f26c0102410 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34294/0 (socket says 172.21.15.100:34294) 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.290+0000 7f26bffff640 1 -- 172.21.15.100:0/1799466180 learned_addr learned my addr 172.21.15.100:0/1799466180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:10.606 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.291+0000 7f26bffff640 1 -- 172.21.15.100:0/1799466180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0102ea0 con 0x7f26c0102410 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.291+0000 7f26bffff640 1 --2- 172.21.15.100:0/1799466180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009840 tx=0x7f26b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e650b659e0bf552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26beffd640 1 -- 172.21.15.100:0/1799466180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26b0032440 con 0x7f26c0102410 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26beffd640 1 -- 172.21.15.100:0/1799466180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26b0032a40 con 0x7f26c0102410 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26beffd640 1 -- 172.21.15.100:0/1799466180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26b0031a70 con 0x7f26c0102410 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 -- 172.21.15.100:0/1799466180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 msgr2=0x7f26c0102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 --2- 172.21.15.100:0/1799466180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009840 tx=0x7f26b00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 -- 172.21.15.100:0/1799466180 shutdown_connections 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 --2- 172.21.15.100:0/1799466180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0102820 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 -- 172.21.15.100:0/1799466180 >> 172.21.15.100:0/1799466180 conn(0x7f26c00fbd90 msgr2=0x7f26c00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 -- 172.21.15.100:0/1799466180 shutdown_connections 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.292+0000 7f26c69b2640 1 -- 172.21.15.100:0/1799466180 wait complete. 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.293+0000 7f26c69b2640 1 Processor -- start 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.293+0000 7f26c69b2640 1 -- start start 2024-09-13T02:42:10.607 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26c69b2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26c69b2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c01113a0 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34302/0 (socket says 172.21.15.100:34302) 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bffff640 1 -- 172.21.15.100:0/3020021537 learned_addr learned my addr 172.21.15.100:0/3020021537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bffff640 1 -- 172.21.15.100:0/3020021537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0009450 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bffff640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006a70 tx=0x7f26b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26b003c400 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26b003ca00 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c01115a0 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.294+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26b003a9a0 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.295+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c0111fa0 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.295+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f26b003abd0 con 0x7f26c0102410 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.296+0000 7f26bcff9640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 0x7f26ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:10.608 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.296+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c00ffa10 con 0x7f26c0102410 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.296+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f26b006cf50 con 0x7f26c0102410 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.296+0000 7f26bf7fe640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 0x7f26ac03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.296+0000 7f26bf7fe640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 0x7f26ac03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26a8006fd0 tx=0x7f26a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.300+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f26b0039b00 con 0x7f26c0102410 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.473+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f26c0112b90 con 0x7f26ac0394e0 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.480+0000 7f26bcff9640 1 -- 172.21.15.100:0/3020021537 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f26c0112b90 con 0x7f26ac0394e0 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 msgr2=0x7f26ac03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 0x7f26ac03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f26a8006fd0 tx=0x7f26a8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 msgr2=0x7f26c0110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006a70 tx=0x7f26b00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 shutdown_connections 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f26ac0394e0 0x7f26ac03b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.609 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 --2- 172.21.15.100:0/3020021537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26c0102410 0x7f26c0110e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:10.610 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.482+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 >> 172.21.15.100:0/3020021537 conn(0x7f26c00fbd90 msgr2=0x7f26c00fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:10.610 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.483+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 shutdown_connections 2024-09-13T02:42:10.610 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:09.483+0000 7f26c69b2640 1 -- 172.21.15.100:0/3020021537 wait complete. 2024-09-13T02:42:10.610 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying node-exporter service with default placement... 2024-09-13T02:42:11.679 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.959+0000 7f7043119640 1 Processor -- start 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.959+0000 7f7043119640 1 -- start start 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7043119640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7043119640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c079090 con 0x7f703c078c80 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7040eb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7040eb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34308/0 (socket says 172.21.15.100:34308) 2024-09-13T02:42:11.680 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7040eb5640 1 -- 172.21.15.100:0/2100097872 learned_addr learned my addr 172.21.15.100:0/2100097872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.960+0000 7f7040eb5640 1 -- 172.21.15.100:0/2100097872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c077790 con 0x7f703c078c80 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f7040eb5640 1 --2- 172.21.15.100:0/2100097872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7030009840 tx=0x7f70300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1294f8db9a919e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f703b7fe640 1 -- 172.21.15.100:0/2100097872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7030032440 con 0x7f703c078c80 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f703b7fe640 1 -- 172.21.15.100:0/2100097872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7030032a40 con 0x7f703c078c80 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f703b7fe640 1 -- 172.21.15.100:0/2100097872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7030031a70 con 0x7f703c078c80 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f7043119640 1 -- 172.21.15.100:0/2100097872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 msgr2=0x7f703c077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.961+0000 7f7043119640 1 --2- 172.21.15.100:0/2100097872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7030009840 tx=0x7f70300091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 -- 172.21.15.100:0/2100097872 shutdown_connections 2024-09-13T02:42:11.681 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 --2- 172.21.15.100:0/2100097872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c077250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 -- 172.21.15.100:0/2100097872 >> 172.21.15.100:0/2100097872 conn(0x7f703c0fd710 msgr2=0x7f703c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 -- 172.21.15.100:0/2100097872 shutdown_connections 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 -- 172.21.15.100:0/2100097872 wait complete. 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 Processor -- start 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.962+0000 7f7043119640 1 -- start start 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7043119640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7043119640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c1134f0 con 0x7f703c078c80 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7040eb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7040eb5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34318/0 (socket says 172.21.15.100:34318) 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7040eb5640 1 -- 172.21.15.100:0/4084524864 learned_addr learned my addr 172.21.15.100:0/4084524864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7040eb5640 1 -- 172.21.15.100:0/4084524864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009450 con 0x7f703c078c80 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7040eb5640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7030031750 tx=0x7f70300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:11.682 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f703003c400 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f703003ca00 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f703003a7f0 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c1136f0 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.963+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c113b60 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.964+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f703003c560 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.964+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c04b720 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.964+0000 7f70397fa640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 0x7f702c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.964+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f703006ccd0 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.965+0000 7f703bfff640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 0x7f702c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.965+0000 7f703bfff640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 0x7f702c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7028006fd0 tx=0x7f7028006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:10.969+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f703003b360 con 0x7f703c078c80 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.155+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f703c113b60 con 0x7f702c039490 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.160+0000 7f70397fa640 1 -- 172.21.15.100:0/4084524864 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f703c113b60 con 0x7f702c039490 2024-09-13T02:42:11.683 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 msgr2=0x7f702c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 0x7f702c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7028006fd0 tx=0x7f7028006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 msgr2=0x7f703c112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7030031750 tx=0x7f70300091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 shutdown_connections 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f702c039490 0x7f702c03b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 --2- 172.21.15.100:0/4084524864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703c078c80 0x7f703c112fb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 >> 172.21.15.100:0/4084524864 conn(0x7f703c0fd710 msgr2=0x7f703c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 shutdown_connections 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:11.162+0000 7f7043119640 1 -- 172.21.15.100:0/4084524864 wait complete. 2024-09-13T02:42:11.684 INFO:teuthology.orchestra.run.smithi100.stdout:Deploying alertmanager service with default placement... 2024-09-13T02:42:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:12 smithi100 ceph-mon[27894]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:12 smithi100 ceph-mon[27894]: Saving service node-exporter spec with placement * 2024-09-13T02:42:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:12 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.081+0000 7f520bbf0640 1 Processor -- start 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.081+0000 7f520bbf0640 1 -- start start 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.081+0000 7f520bbf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.081+0000 7f520bbf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52041028e0 con 0x7f5204101f90 2024-09-13T02:42:12.886 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.082+0000 7f520998c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.082+0000 7f520998c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34326/0 (socket says 172.21.15.100:34326) 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.082+0000 7f520998c640 1 -- 172.21.15.100:0/3065840830 learned_addr learned my addr 172.21.15.100:0/3065840830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.082+0000 7f520998c640 1 -- 172.21.15.100:0/3065840830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204102a20 con 0x7f5204101f90 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520998c640 1 --2- 172.21.15.100:0/3065840830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5200009840 tx=0x7f52000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c13bd11377fbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520898a640 1 -- 172.21.15.100:0/3065840830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5200032440 con 0x7f5204101f90 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520898a640 1 -- 172.21.15.100:0/3065840830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5200032a40 con 0x7f5204101f90 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520898a640 1 -- 172.21.15.100:0/3065840830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5200031a70 con 0x7f5204101f90 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520bbf0640 1 -- 172.21.15.100:0/3065840830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 msgr2=0x7f52041023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3065840830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5200009840 tx=0x7f52000091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520bbf0640 1 -- 172.21.15.100:0/3065840830 shutdown_connections 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3065840830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f52041023a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.083+0000 7f520bbf0640 1 -- 172.21.15.100:0/3065840830 >> 172.21.15.100:0/3065840830 conn(0x7f52040fd710 msgr2=0x7f52040ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 -- 172.21.15.100:0/3065840830 shutdown_connections 2024-09-13T02:42:12.887 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 -- 172.21.15.100:0/3065840830 wait complete. 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 Processor -- start 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 -- start start 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520bbf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204111260 con 0x7f5204101f90 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520998c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520998c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34332/0 (socket says 172.21.15.100:34332) 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.084+0000 7f520998c640 1 -- 172.21.15.100:0/3424774442 learned_addr learned my addr 172.21.15.100:0/3424774442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f520998c640 1 -- 172.21.15.100:0/3424774442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200009450 con 0x7f5204101f90 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f520998c640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5200009810 tx=0x7f52000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f520003c400 con 0x7f5204101f90 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f520003ca00 con 0x7f5204101f90 2024-09-13T02:42:12.888 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5204111460 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f520003a870 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.085+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041118d0 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f520003aae0 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f51fa7fc640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 0x7f51f003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520404b720 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f520006ce60 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f520918b640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 0x7f51f003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.086+0000 7f520918b640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 0x7f51f003b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51f4006fd0 tx=0x7f51f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.090+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f520003c560 con 0x7f5204101f90 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.259+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f52041118d0 con 0x7f51f00394e0 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.266+0000 7f51fa7fc640 1 -- 172.21.15.100:0/3424774442 <== mgr.14118 v2:172.21.15.100:6800/808939656 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f52041118d0 con 0x7f51f00394e0 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 msgr2=0x7f51f003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 0x7f51f003b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51f4006fd0 tx=0x7f51f4006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 msgr2=0x7f5204110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5200009810 tx=0x7f52000091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 shutdown_connections 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f51f00394e0 0x7f51f003b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 --2- 172.21.15.100:0/3424774442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5204101f90 0x7f5204110d20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 >> 172.21.15.100:0/3424774442 conn(0x7f52040fd710 msgr2=0x7f52040fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 shutdown_connections 2024-09-13T02:42:12.890 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:12.268+0000 7f520bbf0640 1 -- 172.21.15.100:0/3424774442 wait complete. 2024-09-13T02:42:13.459 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:13 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:13.459 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:13 smithi100 ceph-mon[27894]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:13.459 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:13 smithi100 ceph-mon[27894]: Saving service alertmanager spec with placement count:1 2024-09-13T02:42:13.460 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:13 smithi100 ceph-mon[27894]: from='mgr.14118 172.21.15.100:0/2058501088' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:14.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:14 smithi100 ceph-mon[27894]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:14.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:14 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1662209661' entity='client.admin' 2024-09-13T02:42:14.933 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.911+0000 7fd87af33640 1 Processor -- start 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.911+0000 7fd87af33640 1 -- start start 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.911+0000 7fd87af33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.911+0000 7fd87af33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8741028c0 con 0x7fd874101f70 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.912+0000 7fd878ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.912+0000 7fd878ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34334/0 (socket says 172.21.15.100:34334) 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.912+0000 7fd878ccf640 1 -- 172.21.15.100:0/2147019193 learned_addr learned my addr 172.21.15.100:0/2147019193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.912+0000 7fd878ccf640 1 -- 172.21.15.100:0/2147019193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874102a00 con 0x7fd874101f70 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.912+0000 7fd878ccf640 1 --2- 172.21.15.100:0/2147019193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd864009e50 tx=0x7fd864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3efdde1221ceff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd8737fe640 1 -- 172.21.15.100:0/2147019193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd864031560 con 0x7fd874101f70 2024-09-13T02:42:14.934 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd8737fe640 1 -- 172.21.15.100:0/2147019193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd86402d050 con 0x7fd874101f70 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd8737fe640 1 -- 172.21.15.100:0/2147019193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd864007a60 con 0x7fd874101f70 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 -- 172.21.15.100:0/2147019193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 msgr2=0x7fd874102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 --2- 172.21.15.100:0/2147019193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd864009e50 tx=0x7fd864009840 comp rx=0 tx=0).stop 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 -- 172.21.15.100:0/2147019193 shutdown_connections 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 --2- 172.21.15.100:0/2147019193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874102380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 -- 172.21.15.100:0/2147019193 >> 172.21.15.100:0/2147019193 conn(0x7fd8740fd770 msgr2=0x7fd8740ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 -- 172.21.15.100:0/2147019193 shutdown_connections 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.913+0000 7fd87af33640 1 -- 172.21.15.100:0/2147019193 wait complete. 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd87af33640 1 Processor -- start 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd87af33640 1 -- start start 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd87af33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd87af33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874111390 con 0x7fd874101f70 2024-09-13T02:42:14.935 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd878ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd878ccf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34348/0 (socket says 172.21.15.100:34348) 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.914+0000 7fd878ccf640 1 -- 172.21.15.100:0/1662209661 learned_addr learned my addr 172.21.15.100:0/1662209661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd878ccf640 1 -- 172.21.15.100:0/1662209661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864009ae0 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd878ccf640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd86402abe0 tx=0x7fd864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd864031bc0 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd864031d20 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd86403a530 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874111590 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.915+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd874112070 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.916+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd864038050 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.916+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8741013d0 con 0x7fd874101f70 2024-09-13T02:42:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.916+0000 7fd8717fa640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 0x7fd86003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.916+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd86406ca90 con 0x7fd874101f70 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.916+0000 7fd873fff640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 0x7fd86003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.917+0000 7fd873fff640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 0x7fd86003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006fd0 tx=0x7fd85c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:13.924+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd864039300 con 0x7fd874101f70 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.081+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd874112450 con 0x7fd874101f70 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.084+0000 7fd8717fa640 1 -- 172.21.15.100:0/1662209661 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd864036030 con 0x7fd874101f70 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 msgr2=0x7fd86003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 0x7fd86003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd85c006fd0 tx=0x7fd85c006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 msgr2=0x7fd874110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd86402abe0 tx=0x7fd864009840 comp rx=0 tx=0).stop 2024-09-13T02:42:14.937 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 shutdown_connections 2024-09-13T02:42:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fd860039490 0x7fd86003b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 --2- 172.21.15.100:0/1662209661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd874101f70 0x7fd874110e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 >> 172.21.15.100:0/1662209661 conn(0x7fd8740fd770 msgr2=0x7fd8740fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 shutdown_connections 2024-09-13T02:42:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:14.087+0000 7fd87af33640 1 -- 172.21.15.100:0/1662209661 wait complete. 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.344+0000 7f4c2a69f640 1 Processor -- start 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.344+0000 7f4c2a69f640 1 -- start start 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.344+0000 7f4c2a69f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.344+0000 7f4c2a69f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241017e0 con 0x7f4c24100e90 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.345+0000 7f4c23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.345+0000 7f4c23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34352/0 (socket says 172.21.15.100:34352) 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.345+0000 7f4c23fff640 1 -- 172.21.15.100:0/1507362408 learned_addr learned my addr 172.21.15.100:0/1507362408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:16.124 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.345+0000 7f4c23fff640 1 -- 172.21.15.100:0/1507362408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24101920 con 0x7f4c24100e90 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.345+0000 7f4c23fff640 1 --2- 172.21.15.100:0/1507362408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009840 tx=0x7f4c140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363723c2e33dda47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c237fe640 1 -- 172.21.15.100:0/1507362408 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c14032440 con 0x7f4c24100e90 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c237fe640 1 -- 172.21.15.100:0/1507362408 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c14032a40 con 0x7f4c24100e90 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c237fe640 1 -- 172.21.15.100:0/1507362408 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c14031aa0 con 0x7f4c24100e90 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 -- 172.21.15.100:0/1507362408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 msgr2=0x7f4c241012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/1507362408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009840 tx=0x7f4c140091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 -- 172.21.15.100:0/1507362408 shutdown_connections 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/1507362408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c241012a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 -- 172.21.15.100:0/1507362408 >> 172.21.15.100:0/1507362408 conn(0x7f4c240fc6d0 msgr2=0x7f4c240feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 -- 172.21.15.100:0/1507362408 shutdown_connections 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.346+0000 7f4c2a69f640 1 -- 172.21.15.100:0/1507362408 wait complete. 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c2a69f640 1 Processor -- start 2024-09-13T02:42:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c2a69f640 1 -- start start 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c2a69f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c2a69f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241118a0 con 0x7f4c24100e90 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c23fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34366/0 (socket says 172.21.15.100:34366) 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c23fff640 1 -- 172.21.15.100:0/870735710 learned_addr learned my addr 172.21.15.100:0/870735710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c23fff640 1 -- 172.21.15.100:0/870735710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009450 con 0x7f4c24100e90 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.347+0000 7f4c23fff640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009810 tx=0x7f4c140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.348+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c140327b0 con 0x7f4c24100e90 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.348+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c1403b8d0 con 0x7f4c24100e90 2024-09-13T02:42:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.348+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24115eb0 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.348+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c1403a6f0 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.348+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c241161e0 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4c14039040 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2404b720 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c217fa640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 0x7f4c1003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4c1406cad0 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c1bfff640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 0x7f4c1003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.349+0000 7f4c1bfff640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 0x7f4c1003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.353+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c1403a850 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.510+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4c24102b80 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.514+0000 7f4c217fa640 1 -- 172.21.15.100:0/870735710 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4c1403f070 con 0x7f4c24100e90 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 msgr2=0x7f4c1003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 0x7f4c1003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c006fd0 tx=0x7f4c0c006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 msgr2=0x7f4c24076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009810 tx=0x7f4c140091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 shutdown_connections 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f4c10039490 0x7f4c1003b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 --2- 172.21.15.100:0/870735710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c24100e90 0x7f4c24076ae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.516+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 >> 172.21.15.100:0/870735710 conn(0x7f4c240fc6d0 msgr2=0x7f4c240fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.517+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 shutdown_connections 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:15.517+0000 7f4c2a69f640 1 -- 172.21.15.100:0/870735710 wait complete. 2024-09-13T02:42:16.128 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling the dashboard module... 2024-09-13T02:42:16.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:16 smithi100 ceph-mon[27894]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:16.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:16 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/870735710' entity='client.admin' 2024-09-13T02:42:17.467 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:17 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/564190777' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.517+0000 7f3731b03640 1 Processor -- start 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.517+0000 7f3731b03640 1 -- start start 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.517+0000 7f3731b03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.517+0000 7f3731b03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1017f0 con 0x7f372c100ea0 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.518+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.518+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34376/0 (socket says 172.21.15.100:34376) 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.518+0000 7f372b7fe640 1 -- 172.21.15.100:0/745972207 learned_addr learned my addr 172.21.15.100:0/745972207 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.518+0000 7f372b7fe640 1 -- 172.21.15.100:0/745972207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c101930 con 0x7f372c100ea0 2024-09-13T02:42:17.822 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f372b7fe640 1 --2- 172.21.15.100:0/745972207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f371c009840 tx=0x7f371c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46ca16ade038241 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f372affd640 1 -- 172.21.15.100:0/745972207 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f371c032440 con 0x7f372c100ea0 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f372affd640 1 -- 172.21.15.100:0/745972207 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f371c032a40 con 0x7f372c100ea0 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f372affd640 1 -- 172.21.15.100:0/745972207 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f371c031aa0 con 0x7f372c100ea0 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f3731b03640 1 -- 172.21.15.100:0/745972207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 msgr2=0x7f372c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f3731b03640 1 --2- 172.21.15.100:0/745972207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f371c009840 tx=0x7f371c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f3731b03640 1 -- 172.21.15.100:0/745972207 shutdown_connections 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f3731b03640 1 --2- 172.21.15.100:0/745972207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c1012b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.519+0000 7f3731b03640 1 -- 172.21.15.100:0/745972207 >> 172.21.15.100:0/745972207 conn(0x7f372c0fc700 msgr2=0x7f372c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 -- 172.21.15.100:0/745972207 shutdown_connections 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 -- 172.21.15.100:0/745972207 wait complete. 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 Processor -- start 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 -- start start 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.520+0000 7f3731b03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c113b00 con 0x7f372c100ea0 2024-09-13T02:42:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34392/0 (socket says 172.21.15.100:34392) 2024-09-13T02:42:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f372b7fe640 1 -- 172.21.15.100:0/564190777 learned_addr learned my addr 172.21.15.100:0/564190777 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f372b7fe640 1 -- 172.21.15.100:0/564190777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c009450 con 0x7f372c100ea0 2024-09-13T02:42:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f372b7fe640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371c009420 tx=0x7f371c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f371c031d20 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f371c031e80 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f371c03a670 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c113c40 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.521+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c114050 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.522+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f371c039040 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.522+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c04b720 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.522+0000 7f3728ff9640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 0x7f371803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.522+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f371c06cab0 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.522+0000 7f3722ffd640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 0x7f371803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.523+0000 7f3722ffd640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 0x7f371803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3714006fd0 tx=0x7f3714006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.527+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f371c03b430 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:16.723+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f372c102b90 con 0x7f372c100ea0 2024-09-13T02:42:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.208+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f371c03bbf0 con 0x7f372c100ea0 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.209+0000 7f3728ff9640 1 -- 172.21.15.100:0/564190777 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f371c030340 con 0x7f372c100ea0 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 msgr2=0x7f371803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 0x7f371803b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3714006fd0 tx=0x7f3714006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 msgr2=0x7f372c076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371c009420 tx=0x7f371c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.826 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 shutdown_connections 2024-09-13T02:42:17.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f3718039490 0x7f371803b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 --2- 172.21.15.100:0/564190777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c100ea0 0x7f372c076ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:17.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 >> 172.21.15.100:0/564190777 conn(0x7f372c0fc700 msgr2=0x7f372c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:17.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 shutdown_connections 2024-09-13T02:42:17.827 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:17.211+0000 7f3731b03640 1 -- 172.21.15.100:0/564190777 wait complete. 2024-09-13T02:42:18.237 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:18 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/564190777' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T02:42:18.237 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:18 smithi100 ceph-mon[27894]: mgrmap e9: smithi100.lhjyck(active, since 24s) 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "active_name": "smithi100.lhjyck", 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:42:19.072 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd497d7640 1 Processor -- start 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd497d7640 1 -- start start 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd497d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd497d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44078fe0 con 0x7fcd44078b40 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34410/0 (socket says 172.21.15.100:34410) 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.226+0000 7fcd42ffd640 1 -- 172.21.15.100:0/3050802222 learned_addr learned my addr 172.21.15.100:0/3050802222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.227+0000 7fcd42ffd640 1 -- 172.21.15.100:0/3050802222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44079120 con 0x7fcd44078b40 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.227+0000 7fcd42ffd640 1 --2- 172.21.15.100:0/3050802222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009840 tx=0x7fcd340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cffa4a1135f43b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd427fc640 1 -- 172.21.15.100:0/3050802222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd44078b40 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd427fc640 1 -- 172.21.15.100:0/3050802222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd34032a40 con 0x7fcd44078b40 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd427fc640 1 -- 172.21.15.100:0/3050802222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd34031a70 con 0x7fcd44078b40 2024-09-13T02:42:19.073 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 -- 172.21.15.100:0/3050802222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 msgr2=0x7fcd44077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3050802222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009840 tx=0x7fcd340091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 -- 172.21.15.100:0/3050802222 shutdown_connections 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3050802222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44077250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 -- 172.21.15.100:0/3050802222 >> 172.21.15.100:0/3050802222 conn(0x7fcd440fd880 msgr2=0x7fcd440ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.228+0000 7fcd497d7640 1 -- 172.21.15.100:0/3050802222 shutdown_connections 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd497d7640 1 -- 172.21.15.100:0/3050802222 wait complete. 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd497d7640 1 Processor -- start 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd497d7640 1 -- start start 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd497d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd497d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44113560 con 0x7fcd44078b40 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34424/0 (socket says 172.21.15.100:34424) 2024-09-13T02:42:19.074 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.229+0000 7fcd42ffd640 1 -- 172.21.15.100:0/3379180313 learned_addr learned my addr 172.21.15.100:0/3379180313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd42ffd640 1 -- 172.21.15.100:0/3379180313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34009450 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd42ffd640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009420 tx=0x7fcd340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3403b470 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd3403ba70 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44113760 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3403a930 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.230+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd44113bd0 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fcd3403abf0 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd3b7fe640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 0x7fcd3003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4404b720 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd3bfff640 1 -- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 msgr2=0x7fcd3003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcd3406dd30 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.231+0000 7fcd3bfff640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 0x7fcd3003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.236+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcd3403f070 con 0x7fcd44078b40 2024-09-13T02:42:19.075 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.432+0000 7fcd3bfff640 1 -- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 msgr2=0x7fcd3003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.432+0000 7fcd3bfff640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 0x7fcd3003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.438+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcd44079120 con 0x7fcd44078b40 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.438+0000 7fcd3b7fe640 1 -- 172.21.15.100:0/3379180313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fcd44079120 con 0x7fcd44078b40 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 msgr2=0x7fcd3003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 0x7fcd3003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 msgr2=0x7fcd44113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009420 tx=0x7fcd340091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 shutdown_connections 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7fcd300394e0 0x7fcd3003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 --2- 172.21.15.100:0/3379180313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd44078b40 0x7fcd44113020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.440+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 >> 172.21.15.100:0/3379180313 conn(0x7fcd440fd880 msgr2=0x7fcd440fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.441+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 shutdown_connections 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:18.441+0000 7fcd497d7640 1 -- 172.21.15.100:0/3379180313 wait complete. 2024-09-13T02:42:19.076 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for the mgr to restart... 2024-09-13T02:42:19.077 INFO:teuthology.orchestra.run.smithi100.stdout:Waiting for mgr epoch 9... 2024-09-13T02:42:19.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:19 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3379180313' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:42:21.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: Active manager daemon smithi100.lhjyck restarted 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: mgrmap e10: smithi100.lhjyck(active, starting, since 0.00325791s) 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:42:21.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:21 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:42:23.425 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.523+0000 7f2dd2d6e640 1 Processor -- start 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.523+0000 7f2dd2d6e640 1 -- start start 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.523+0000 7f2dd2d6e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.523+0000 7f2dd2d6e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc105150 con 0x7f2dcc076ba0 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.524+0000 7f2dd0b0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.524+0000 7f2dd0b0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40622/0 (socket says 172.21.15.100:40622) 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.524+0000 7f2dd0b0a640 1 -- 172.21.15.100:0/4085739481 learned_addr learned my addr 172.21.15.100:0/4085739481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.524+0000 7f2dd0b0a640 1 -- 172.21.15.100:0/4085739481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc105290 con 0x7f2dcc076ba0 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd0b0a640 1 --2- 172.21.15.100:0/4085739481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009840 tx=0x7f2dc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fdf3774d00ffee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dcb7fe640 1 -- 172.21.15.100:0/4085739481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc0032440 con 0x7f2dcc076ba0 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dcb7fe640 1 -- 172.21.15.100:0/4085739481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2dc0032a40 con 0x7f2dcc076ba0 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dcb7fe640 1 -- 172.21.15.100:0/4085739481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc0031a70 con 0x7f2dcc076ba0 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/4085739481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 msgr2=0x7f2dcc104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/4085739481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009840 tx=0x7f2dc00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/4085739481 shutdown_connections 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/4085739481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc104c10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/4085739481 >> 172.21.15.100:0/4085739481 conn(0x7f2dcc0fc620 msgr2=0x7f2dcc0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/4085739481 shutdown_connections 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.525+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/4085739481 wait complete. 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd2d6e640 1 Processor -- start 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd2d6e640 1 -- start start 2024-09-13T02:42:23.427 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd2d6e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd2d6e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc102a80 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd0b0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd0b0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40630/0 (socket says 172.21.15.100:40630) 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.526+0000 7f2dd0b0a640 1 -- 172.21.15.100:0/3618495365 learned_addr learned my addr 172.21.15.100:0/3618495365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dd0b0a640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009450 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dd0b0a640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0031750 tx=0x7f2dc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc003c400 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2dc003ca00 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc100b10 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc003a880 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.527+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc100f20 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f2dc003aaf0 con 0x7f2dcc076ba0 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dc97fa640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dbc03c0a0 con 0x7f2dbc0394e0 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2dc006cf40 con 0x7f2dcc076ba0 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dcbfff640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 msgr2=0x7f2dbc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.528+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.729+0000 7f2dcbfff640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 msgr2=0x7f2dbc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:19.729+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:20.130+0000 7f2dcbfff640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 msgr2=0x7f2dbc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:20.130+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:20.931+0000 7f2dcbfff640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 msgr2=0x7f2dbc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/808939656 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:20.931+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:21.570+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f2dc003ada0 con 0x7f2dcc076ba0 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:21.570+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 msgr2=0x7f2dbc03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:42:23.429 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:21.570+0000 7f2dc97fa640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.572+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f2dc0039310 con 0x7f2dcc076ba0 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.572+0000 7f2dc97fa640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 0x7f2dbc03f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.572+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dbc03c0a0 con 0x7f2dbc03cf80 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.572+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 0x7f2dbc03f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.573+0000 7f2dcbfff640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 0x7f2dbc03f360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2db8003940 tx=0x7f2db8009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.574+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f2dbc03c0a0 con 0x7f2dbc03cf80 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.578+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2dcc04b720 con 0x7f2dbc03cf80 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dc97fa640 1 -- 172.21.15.100:0/3618495365 <== mgr.14160 v2:172.21.15.100:6800/3842284467 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2dcc04b720 con 0x7f2dbc03cf80 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 msgr2=0x7f2dbc03f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 0x7f2dbc03f360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2db8003940 tx=0x7f2db8009350 comp rx=0 tx=0).stop 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 msgr2=0x7f2dcc102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0031750 tx=0x7f2dc00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.430 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 shutdown_connections 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f2dbc03cf80 0x7f2dbc03f360 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:6800/808939656,v1:172.21.15.100:6801/808939656] conn(0x7f2dbc0394e0 0x7f2dbc03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 --2- 172.21.15.100:0/3618495365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dcc076ba0 0x7f2dcc102540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 >> 172.21.15.100:0/3618495365 conn(0x7f2dcc0fc620 msgr2=0x7f2dcc0fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 shutdown_connections 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:22.579+0000 7f2dd2d6e640 1 -- 172.21.15.100:0/3618495365 wait complete. 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:mgr epoch 9 is available 2024-09-13T02:42:23.431 INFO:teuthology.orchestra.run.smithi100.stdout:Generating a dashboard self-signed certificate... 2024-09-13T02:42:23.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: mgrmap e11: smithi100.lhjyck(active, since 1.00562s) 2024-09-13T02:42:23.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: [13/Sep/2024:02:42:22] ENGINE Bus STARTING 2024-09-13T02:42:23.670 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: [13/Sep/2024:02:42:22] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: [13/Sep/2024:02:42:22] ENGINE Bus STARTED 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: [13/Sep/2024:02:42:22] ENGINE Error in HTTPServer.serve 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:42:23.671 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:23.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:23 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f34417a5640 1 Processor -- start 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f34417a5640 1 -- start start 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f34417a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f34417a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1017e0 con 0x7f343c100e90 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f343affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f343affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40676/0 (socket says 172.21.15.100:40676) 2024-09-13T02:42:24.655 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f343affd640 1 -- 172.21.15.100:0/1742613454 learned_addr learned my addr 172.21.15.100:0/1742613454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.852+0000 7f343affd640 1 -- 172.21.15.100:0/1742613454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c101920 con 0x7f343c100e90 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.853+0000 7f343affd640 1 --2- 172.21.15.100:0/1742613454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3434009840 tx=0x7f34340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84975207c2b9e037 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.853+0000 7f3439ffb640 1 -- 172.21.15.100:0/1742613454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3434032440 con 0x7f343c100e90 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.853+0000 7f3439ffb640 1 -- 172.21.15.100:0/1742613454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3434032a40 con 0x7f343c100e90 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.853+0000 7f3439ffb640 1 -- 172.21.15.100:0/1742613454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3434031aa0 con 0x7f343c100e90 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- 172.21.15.100:0/1742613454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 msgr2=0x7f343c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 --2- 172.21.15.100:0/1742613454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3434009840 tx=0x7f34340091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- 172.21.15.100:0/1742613454 shutdown_connections 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 --2- 172.21.15.100:0/1742613454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c1012a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- 172.21.15.100:0/1742613454 >> 172.21.15.100:0/1742613454 conn(0x7f343c0fc6d0 msgr2=0x7f343c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- 172.21.15.100:0/1742613454 shutdown_connections 2024-09-13T02:42:24.656 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- 172.21.15.100:0/1742613454 wait complete. 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 Processor -- start 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.854+0000 7f34417a5640 1 -- start start 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34417a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34417a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c113a90 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f343affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f343affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40688/0 (socket says 172.21.15.100:40688) 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f343affd640 1 -- 172.21.15.100:0/223883223 learned_addr learned my addr 172.21.15.100:0/223883223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f343affd640 1 -- 172.21.15.100:0/223883223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3434009450 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f343affd640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3434009810 tx=0x7f34340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34340327b0 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f343403b8d0 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f343403a6f0 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c113bd0 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.855+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c114040 con 0x7f343c100e90 2024-09-13T02:42:24.657 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.856+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f3434039040 con 0x7f343c100e90 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.856+0000 7f34237fe640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 0x7f342403b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.856+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f343406caa0 con 0x7f343c100e90 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.856+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c04b720 con 0x7f343c100e90 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.856+0000 7f343a7fc640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 0x7f342403b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.857+0000 7f343a7fc640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 0x7f342403b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f343000ad90 tx=0x7f3430009410 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.861+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f343403f020 con 0x7f343c100e90 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:23.987+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f343404cc70 con 0x7f343c100e90 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.032+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f343c0fd9c0 con 0x7f34240393d0 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.094+0000 7f34237fe640 1 -- 172.21.15.100:0/223883223 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f343c0fd9c0 con 0x7f34240393d0 2024-09-13T02:42:24.658 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 msgr2=0x7f342403b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 0x7f342403b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f343000ad90 tx=0x7f3430009410 comp rx=0 tx=0).stop 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 msgr2=0x7f343c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3434009810 tx=0x7f34340091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 shutdown_connections 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f34240393d0 0x7f342403b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 --2- 172.21.15.100:0/223883223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f343c100e90 0x7f343c076b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 >> 172.21.15.100:0/223883223 conn(0x7f343c0fc6d0 msgr2=0x7f343c0fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 shutdown_connections 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:24.096+0000 7f34417a5640 1 -- 172.21.15.100:0/223883223 wait complete. 2024-09-13T02:42:24.659 INFO:teuthology.orchestra.run.smithi100.stdout:Creating initial admin user... 2024-09-13T02:42:25.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:24 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:25.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:24 smithi100 ceph-mon[27894]: mgrmap e12: smithi100.lhjyck(active, since 2s) 2024-09-13T02:42:25.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:24 smithi100 ceph-mon[27894]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:25.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:24 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:25.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:24 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:26.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:25 smithi100 ceph-mon[27894]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:26.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:25 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:26.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Jq.I8sSgNsTpki4IBRce1OgkaDvBA6aKIHkjsb/wLK1tm48N8m/zu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726195345, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T02:42:26.392 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadc03e9640 1 Processor -- start 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadc03e9640 1 -- start start 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadc03e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadc03e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb81028f0 con 0x7fadb8101fa0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadbe185640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadbe185640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40694/0 (socket says 172.21.15.100:40694) 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.062+0000 7fadbe185640 1 -- 172.21.15.100:0/2117178861 learned_addr learned my addr 172.21.15.100:0/2117178861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.063+0000 7fadbe185640 1 -- 172.21.15.100:0/2117178861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb8102a30 con 0x7fadb8101fa0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.063+0000 7fadbe185640 1 --2- 172.21.15.100:0/2117178861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009840 tx=0x7fadb40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f4b31ce863f174 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.063+0000 7fadbd183640 1 -- 172.21.15.100:0/2117178861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadb4032440 con 0x7fadb8101fa0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadbd183640 1 -- 172.21.15.100:0/2117178861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fadb4032a40 con 0x7fadb8101fa0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadbd183640 1 -- 172.21.15.100:0/2117178861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadb4031a70 con 0x7fadb8101fa0 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadc03e9640 1 -- 172.21.15.100:0/2117178861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 msgr2=0x7fadb81023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:26.393 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadc03e9640 1 --2- 172.21.15.100:0/2117178861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009840 tx=0x7fadb40091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadc03e9640 1 -- 172.21.15.100:0/2117178861 shutdown_connections 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadc03e9640 1 --2- 172.21.15.100:0/2117178861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb81023b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.064+0000 7fadc03e9640 1 -- 172.21.15.100:0/2117178861 >> 172.21.15.100:0/2117178861 conn(0x7fadb80fd740 msgr2=0x7fadb80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 -- 172.21.15.100:0/2117178861 shutdown_connections 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 -- 172.21.15.100:0/2117178861 wait complete. 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 Processor -- start 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 -- start start 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadc03e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8079140 con 0x7fadb8101fa0 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadbe185640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadbe185640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40702/0 (socket says 172.21.15.100:40702) 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.065+0000 7fadbe185640 1 -- 172.21.15.100:0/163935975 learned_addr learned my addr 172.21.15.100:0/163935975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:26.394 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadbe185640 1 -- 172.21.15.100:0/163935975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4009450 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadbe185640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadb4006a70 tx=0x7fadb40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadb403c400 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fadb403ca00 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb80771d0 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb8077640 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.066+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadb403a9a0 con 0x7fadb8101fa0 2024-09-13T02:42:26.395 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.067+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fadb403ac20 con 0x7fadb8101fa0 2024-09-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.067+0000 7fadaeffd640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 0x7fada403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.067+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fadb406cf50 con 0x7fadb8101fa0 2024-09-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.067+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8103dc0 con 0x7fadb8101fa0 2024-09-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.068+0000 7fadbd984640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 0x7fada403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.068+0000 7fadbd984640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 0x7fada403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.072+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fadb4037070 con 0x7fadb8101fa0 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.249+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fadb805eb60 con 0x7fada40394e0 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.473+0000 7fadaeffd640 1 -- 172.21.15.100:0/163935975 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fadb805eb60 con 0x7fada40394e0 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 msgr2=0x7fada403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 0x7fada403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.397 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 msgr2=0x7fadb8078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadb4006a70 tx=0x7fadb40091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 shutdown_connections 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fada40394e0 0x7fada403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 --2- 172.21.15.100:0/163935975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb8101fa0 0x7fadb8078c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 >> 172.21.15.100:0/163935975 conn(0x7fadb80fd740 msgr2=0x7fadb80fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 shutdown_connections 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:25.475+0000 7fadc03e9640 1 -- 172.21.15.100:0/163935975 wait complete. 2024-09-13T02:42:26.398 INFO:teuthology.orchestra.run.smithi100.stdout:Fetching dashboard port number... 2024-09-13T02:42:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:27 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2723991231' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T02:42:27.767 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T02:42:27.767 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcb5b5e640 1 Processor -- start 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcb5b5e640 1 -- start start 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcb5b5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcb5b5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01028f0 con 0x7fdcb0101fa0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40712/0 (socket says 172.21.15.100:40712) 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.786+0000 7fdcaf7fe640 1 -- 172.21.15.100:0/2428965866 learned_addr learned my addr 172.21.15.100:0/2428965866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.787+0000 7fdcaf7fe640 1 -- 172.21.15.100:0/2428965866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0102a30 con 0x7fdcb0101fa0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.787+0000 7fdcaf7fe640 1 --2- 172.21.15.100:0/2428965866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009840 tx=0x7fdca00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484c26935dc1b03f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcae7fc640 1 -- 172.21.15.100:0/2428965866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdca0032440 con 0x7fdcb0101fa0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcae7fc640 1 -- 172.21.15.100:0/2428965866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdca0032a40 con 0x7fdcb0101fa0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcae7fc640 1 -- 172.21.15.100:0/2428965866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdca0031a70 con 0x7fdcb0101fa0 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2428965866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 msgr2=0x7fdcb01023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:27.768 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2428965866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009840 tx=0x7fdca00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2428965866 shutdown_connections 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2428965866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb01023b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2428965866 >> 172.21.15.100:0/2428965866 conn(0x7fdcb00fd740 msgr2=0x7fdcb00ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2428965866 shutdown_connections 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.788+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2428965866 wait complete. 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcb5b5e640 1 Processor -- start 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcb5b5e640 1 -- start start 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcb5b5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcb5b5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0111370 con 0x7fdcb0101fa0 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40720/0 (socket says 172.21.15.100:40720) 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.789+0000 7fdcaf7fe640 1 -- 172.21.15.100:0/2723991231 learned_addr learned my addr 172.21.15.100:0/2723991231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:27.769 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdcaf7fe640 1 -- 172.21.15.100:0/2723991231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009450 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdcaf7fe640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdca0006a70 tx=0x7fdca00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdca003c400 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdca003ca00 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb0111570 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdca003a9a0 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.790+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb0111fc0 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.791+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fdca003abd0 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.791+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb0101400 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.791+0000 7fdc97fff640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 0x7fdc9803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.791+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdca006d010 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.791+0000 7fdcaeffd640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 0x7fdc9803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.792+0000 7fdcaeffd640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 0x7fdc9803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.796+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdca0030b20 con 0x7fdcb0101fa0 2024-09-13T02:42:27.770 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.956+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fdcb004b720 con 0x7fdcb0101fa0 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.957+0000 7fdc97fff640 1 -- 172.21.15.100:0/2723991231 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fdca0037070 con 0x7fdcb0101fa0 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 msgr2=0x7fdc9803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 0x7fdc9803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 msgr2=0x7fdcb0110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdca0006a70 tx=0x7fdca00091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 shutdown_connections 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fdc98039530 0x7fdc9803b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 --2- 172.21.15.100:0/2723991231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdcb0101fa0 0x7fdcb0110e30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 >> 172.21.15.100:0/2723991231 conn(0x7fdcb00fd740 msgr2=0x7fdcb00fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 shutdown_connections 2024-09-13T02:42:27.771 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:26.959+0000 7fdcb5b5e640 1 -- 172.21.15.100:0/2723991231 wait complete. 2024-09-13T02:42:27.776 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:42:27.776 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout disabled 2024-09-13T02:42:27.784 INFO:teuthology.orchestra.run.smithi100.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:42:27.785 INFO:teuthology.orchestra.run.smithi100.stdout:systemctl: stdout inactive 2024-09-13T02:42:27.785 INFO:teuthology.orchestra.run.smithi100.stdout:firewalld.service is not enabled 2024-09-13T02:42:27.785 INFO:teuthology.orchestra.run.smithi100.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout:Ceph Dashboard is now available at: 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: URL: https://smithi100.front.sepia.ceph.com:8443/ 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: User: admin 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: Password: cgixst40j7 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:27.787 INFO:teuthology.orchestra.run.smithi100.stdout:Saving cluster configuration to /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config directory 2024-09-13T02:42:27.788 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling autotune for osd_memory_target 2024-09-13T02:42:28.974 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aaebbe640 1 Processor -- start 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aaebbe640 1 -- start start 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aaebbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aaebbe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8101d00 con 0x7f8aa81013b0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aac95a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.189+0000 7f8aac95a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40724/0 (socket says 172.21.15.100:40724) 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.190+0000 7f8aac95a640 1 -- 172.21.15.100:0/33046810 learned_addr learned my addr 172.21.15.100:0/33046810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.190+0000 7f8aac95a640 1 -- 172.21.15.100:0/33046810 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8101e40 con 0x7f8aa81013b0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.190+0000 7f8aac95a640 1 --2- 172.21.15.100:0/33046810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00baf0 tx=0x7f8a9c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132dd077fd11b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aa77fe640 1 -- 172.21.15.100:0/33046810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a9c0327a0 con 0x7f8aa81013b0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aa77fe640 1 -- 172.21.15.100:0/33046810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a9c032da0 con 0x7f8aa81013b0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aa77fe640 1 -- 172.21.15.100:0/33046810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a9c031e60 con 0x7f8aa81013b0 2024-09-13T02:42:28.975 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 -- 172.21.15.100:0/33046810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 msgr2=0x7f8aa81017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/33046810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00baf0 tx=0x7f8a9c00b460 comp rx=0 tx=0).stop 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 -- 172.21.15.100:0/33046810 shutdown_connections 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/33046810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa81017c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 -- 172.21.15.100:0/33046810 >> 172.21.15.100:0/33046810 conn(0x7f8aa80fbdc0 msgr2=0x7f8aa80fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 -- 172.21.15.100:0/33046810 shutdown_connections 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.191+0000 7f8aaebbe640 1 -- 172.21.15.100:0/33046810 wait complete. 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aaebbe640 1 Processor -- start 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aaebbe640 1 -- start start 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aaebbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aaebbe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa810f060 con 0x7f8aa81013b0 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aac95a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aac95a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40730/0 (socket says 172.21.15.100:40730) 2024-09-13T02:42:28.976 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aac95a640 1 -- 172.21.15.100:0/3639338089 learned_addr learned my addr 172.21.15.100:0/3639338089 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.192+0000 7f8aac95a640 1 -- 172.21.15.100:0/3639338089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c00b700 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aac95a640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00b2c0 tx=0x7f8a9c03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a9c0329b0 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a9c032b10 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa810f260 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a9c045640 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.193+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa810f6d0 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f8a9c0457f0 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa804b720 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aa57fa640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 0x7f8a9803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8a9c06fe70 con 0x7f8aa81013b0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aa7fff640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 0x7f8a9803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:28.977 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.194+0000 7f8aa7fff640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 0x7f8a9803ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8a94006fd0 tx=0x7f8a94006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.198+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a9c04c300 con 0x7f8aa81013b0 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.358+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f8aa8110030 con 0x7f8aa81013b0 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.359+0000 7f8aa57fa640 1 -- 172.21.15.100:0/3639338089 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8a9c036070 con 0x7f8aa81013b0 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.360+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 msgr2=0x7f8a9803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.360+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 0x7f8a9803ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8a94006fd0 tx=0x7f8a94006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.360+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 msgr2=0x7f8aa810eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.360+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00b2c0 tx=0x7f8a9c03d040 comp rx=0 tx=0).stop 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 shutdown_connections 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f8a980395d0 0x7f8a9803ba80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 --2- 172.21.15.100:0/3639338089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8aa81013b0 0x7f8aa810eb20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 >> 172.21.15.100:0/3639338089 conn(0x7f8aa80fbdc0 msgr2=0x7f8aa81053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 shutdown_connections 2024-09-13T02:42:28.978 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:28.361+0000 7f8aaebbe640 1 -- 172.21.15.100:0/3639338089 wait complete. 2024-09-13T02:42:29.337 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:29 smithi100 ceph-mon[27894]: mgrmap e13: smithi100.lhjyck(active, since 6s) 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1ffaa640 1 Processor -- start 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1ffaa640 1 -- start start 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1ffaa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1ffaa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181029c0 con 0x7f7b18102070 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1dd46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1dd46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43474/0 (socket says 172.21.15.100:43474) 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1dd46640 1 -- 172.21.15.100:0/2803373663 learned_addr learned my addr 172.21.15.100:0/2803373663 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.419+0000 7f7b1dd46640 1 -- 172.21.15.100:0/2803373663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18102b00 con 0x7f7b18102070 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.420+0000 7f7b1dd46640 1 --2- 172.21.15.100:0/2803373663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009840 tx=0x7f7b140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f39ce92dba62b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.420+0000 7f7b1cd44640 1 -- 172.21.15.100:0/2803373663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b14032440 con 0x7f7b18102070 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.420+0000 7f7b1cd44640 1 -- 172.21.15.100:0/2803373663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b14032a40 con 0x7f7b18102070 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.420+0000 7f7b1cd44640 1 -- 172.21.15.100:0/2803373663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b14031aa0 con 0x7f7b18102070 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2803373663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 msgr2=0x7f7b18102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2803373663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009840 tx=0x7f7b140091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2803373663 shutdown_connections 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2803373663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18102480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2803373663 >> 172.21.15.100:0/2803373663 conn(0x7f7b180fd850 msgr2=0x7f7b180ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2803373663 shutdown_connections 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.421+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2803373663 wait complete. 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1ffaa640 1 Processor -- start 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1ffaa640 1 -- start start 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1ffaa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1ffaa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18111330 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1dd46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1dd46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43476/0 (socket says 172.21.15.100:43476) 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1dd46640 1 -- 172.21.15.100:0/2761043323 learned_addr learned my addr 172.21.15.100:0/2761043323 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1dd46640 1 -- 172.21.15.100:0/2761043323 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009450 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1dd46640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b14006a70 tx=0x7f7b140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b14031d20 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b14031e80 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b1403a750 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.422+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18111530 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.423+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b18111f80 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.423+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f7b14039040 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.423+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b181014d0 con 0x7f7b18102070 2024-09-13T02:42:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.424+0000 7f7b0e7fc640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 0x7f7b0403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.424+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7b1406ccc0 con 0x7f7b18102070 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.424+0000 7f7b1d545640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 0x7f7b0403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.424+0000 7f7b1d545640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 0x7f7b0403ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b08006fd0 tx=0x7f7b08006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.428+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b14030b00 con 0x7f7b18102070 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.667+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7b1804b720 con 0x7f7b18102070 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.670+0000 7f7b0e7fc640 1 -- 172.21.15.100:0/2761043323 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7b1403f070 con 0x7f7b18102070 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 msgr2=0x7f7b0403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 0x7f7b0403ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b08006fd0 tx=0x7f7b08006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 msgr2=0x7f7b18110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b14006a70 tx=0x7f7b140091d0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 shutdown_connections 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7b040395d0 0x7f7b0403ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 --2- 172.21.15.100:0/2761043323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b18102070 0x7f7b18110df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 >> 172.21.15.100:0/2761043323 conn(0x7f7b180fd850 msgr2=0x7f7b180fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 shutdown_connections 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/bin/ceph: stderr 2024-09-13T02:42:29.672+0000 7f7b1ffaa640 1 -- 172.21.15.100:0/2761043323 wait complete. 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T02:42:30.245 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: ceph telemetry on 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:For more information see: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:Bootstrap complete. 2024-09-13T02:42:30.276 INFO:tasks.cephadm:Fetching config... 2024-09-13T02:42:30.276 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:42:30.277 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T02:42:30.293 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T02:42:30.293 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:42:30.293 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T02:42:30.349 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T02:42:30.349 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:42:30.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/keyring of=/dev/stdout 2024-09-13T02:42:30.413 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T02:42:30.413 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:42:30.413 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T02:42:30.469 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T02:42:30.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVY5CgUGZI3+WPx96nAexLcQKKLJJQlIALHC1kUOX8/GbTv0xqct7YScy0RJmOnWTFMXTrU4H/WdTX7SEKV/o/M0f04QKIJm5I93NT/vq4G1dx4YpA4CuZdhBelpGUkoem/vLcApjhSyMWbsyVWI7YwimF2U61v1M4/GlDb/myOR5XvWAPQRrLCoqPuT/beHUlr26sLmUQRXro3mA6oYX9kuHzzGgg0I9e6/m+QtjAr4fmfVAaPM8IyY5uU6x9s75cjdtV6xLy1gMXfRIbw3ZmEQlSylRdM2f0tYo8SSf4YOAOSWOMJic3uYBITcetAzDqD33sjLw08qLeCbVQ8rnlrQzUGLULiqCoTdQjcysWny7GY3WCVwMCM7gV6DbFWRehVpfFh8+X5Ao6+BASB4CAbCtVXHrI56V/FQUocx/If5iSRBKbKV6lazFP80G0LeXy+DDLgKm2mjBLst8KcKSENK2Otcy63YQlc3gInt0Mwl3Qi8CHsq6ESSGlDfB9smU= ceph-84e01cde-7179-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:42:30.544 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVY5CgUGZI3+WPx96nAexLcQKKLJJQlIALHC1kUOX8/GbTv0xqct7YScy0RJmOnWTFMXTrU4H/WdTX7SEKV/o/M0f04QKIJm5I93NT/vq4G1dx4YpA4CuZdhBelpGUkoem/vLcApjhSyMWbsyVWI7YwimF2U61v1M4/GlDb/myOR5XvWAPQRrLCoqPuT/beHUlr26sLmUQRXro3mA6oYX9kuHzzGgg0I9e6/m+QtjAr4fmfVAaPM8IyY5uU6x9s75cjdtV6xLy1gMXfRIbw3ZmEQlSylRdM2f0tYo8SSf4YOAOSWOMJic3uYBITcetAzDqD33sjLw08qLeCbVQ8rnlrQzUGLULiqCoTdQjcysWny7GY3WCVwMCM7gV6DbFWRehVpfFh8+X5Ao6+BASB4CAbCtVXHrI56V/FQUocx/If5iSRBKbKV6lazFP80G0LeXy+DDLgKm2mjBLst8KcKSENK2Otcy63YQlc3gInt0Mwl3Qi8CHsq6ESSGlDfB9smU= ceph-84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:30.555 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVY5CgUGZI3+WPx96nAexLcQKKLJJQlIALHC1kUOX8/GbTv0xqct7YScy0RJmOnWTFMXTrU4H/WdTX7SEKV/o/M0f04QKIJm5I93NT/vq4G1dx4YpA4CuZdhBelpGUkoem/vLcApjhSyMWbsyVWI7YwimF2U61v1M4/GlDb/myOR5XvWAPQRrLCoqPuT/beHUlr26sLmUQRXro3mA6oYX9kuHzzGgg0I9e6/m+QtjAr4fmfVAaPM8IyY5uU6x9s75cjdtV6xLy1gMXfRIbw3ZmEQlSylRdM2f0tYo8SSf4YOAOSWOMJic3uYBITcetAzDqD33sjLw08qLeCbVQ8rnlrQzUGLULiqCoTdQjcysWny7GY3WCVwMCM7gV6DbFWRehVpfFh8+X5Ao6+BASB4CAbCtVXHrI56V/FQUocx/If5iSRBKbKV6lazFP80G0LeXy+DDLgKm2mjBLst8KcKSENK2Otcy63YQlc3gInt0Mwl3Qi8CHsq6ESSGlDfB9smU= ceph-84e01cde-7179-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:42:30.657 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVY5CgUGZI3+WPx96nAexLcQKKLJJQlIALHC1kUOX8/GbTv0xqct7YScy0RJmOnWTFMXTrU4H/WdTX7SEKV/o/M0f04QKIJm5I93NT/vq4G1dx4YpA4CuZdhBelpGUkoem/vLcApjhSyMWbsyVWI7YwimF2U61v1M4/GlDb/myOR5XvWAPQRrLCoqPuT/beHUlr26sLmUQRXro3mA6oYX9kuHzzGgg0I9e6/m+QtjAr4fmfVAaPM8IyY5uU6x9s75cjdtV6xLy1gMXfRIbw3ZmEQlSylRdM2f0tYo8SSf4YOAOSWOMJic3uYBITcetAzDqD33sjLw08qLeCbVQ8rnlrQzUGLULiqCoTdQjcysWny7GY3WCVwMCM7gV6DbFWRehVpfFh8+X5Ao6+BASB4CAbCtVXHrI56V/FQUocx/If5iSRBKbKV6lazFP80G0LeXy+DDLgKm2mjBLst8KcKSENK2Otcy63YQlc3gInt0Mwl3Qi8CHsq6ESSGlDfB9smU= ceph-84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:42:30.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T02:42:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:42:30.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:30 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2761043323' entity='client.admin' 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.516+0000 7f255e9ea640 1 -- 172.21.15.100:0/2804210778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 msgr2=0x7f25580fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.516+0000 7f255e9ea640 1 --2- 172.21.15.100:0/2804210778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f25580fcde0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2548004850 tx=0x7f2548009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.516+0000 7f255e9ea640 1 -- 172.21.15.100:0/2804210778 shutdown_connections 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.516+0000 7f255e9ea640 1 --2- 172.21.15.100:0/2804210778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f25580fcde0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.516+0000 7f255e9ea640 1 -- 172.21.15.100:0/2804210778 >> 172.21.15.100:0/2804210778 conn(0x7f25580f6ac0 msgr2=0x7f25580f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 -- 172.21.15.100:0/2804210778 shutdown_connections 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 -- 172.21.15.100:0/2804210778 wait complete. 2024-09-13T02:42:33.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 Processor -- start 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 -- start start 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.517+0000 7f255e9ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25581134a0 con 0x7f2558065650 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2557fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2557fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43490/0 (socket says 172.21.15.100:43490) 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2557fff640 1 -- 172.21.15.100:0/3408312304 learned_addr learned my addr 172.21.15.100:0/3408312304 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2557fff640 1 -- 172.21.15.100:0/3408312304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548005040 con 0x7f2558065650 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2557fff640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2548009920 tx=0x7f2548009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2548033630 con 0x7f2558065650 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2548033c30 con 0x7f2558065650 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25581136a0 con 0x7f2558065650 2024-09-13T02:42:33.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f254803dc00 con 0x7f2558065650 2024-09-13T02:42:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.518+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2558113b10 con 0x7f2558065650 2024-09-13T02:42:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.519+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2548030020 con 0x7f2558065650 2024-09-13T02:42:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.519+0000 7f2554ff9640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 0x7f254003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.519+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f254806d8b0 con 0x7f2558065650 2024-09-13T02:42:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.520+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25581005f0 con 0x7f2558065650 2024-09-13T02:42:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.520+0000 7f25577fe640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 0x7f254003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:33.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.520+0000 7f25577fe640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 0x7f254003ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:33.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.527+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f254803bb50 con 0x7f2558065650 2024-09-13T02:42:33.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.691+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f25580ffe20 con 0x7f2558065650 2024-09-13T02:42:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.694+0000 7f2554ff9640 1 -- 172.21.15.100:0/3408312304 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2548042210 con 0x7f2558065650 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.696+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 msgr2=0x7f254003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.696+0000 7f255e9ea640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 0x7f254003ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.696+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 msgr2=0x7f2558112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.696+0000 7f255e9ea640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2548009920 tx=0x7f2548009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 shutdown_connections 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f25400395d0 0x7f254003ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 --2- 172.21.15.100:0/3408312304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2558065650 0x7f2558112f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 >> 172.21.15.100:0/3408312304 conn(0x7f25580f6ac0 msgr2=0x7f2558109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 shutdown_connections 2024-09-13T02:42:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:33.697+0000 7f255e9ea640 1 -- 172.21.15.100:0/3408312304 wait complete. 2024-09-13T02:42:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3408312304' entity='client.admin' 2024-09-13T02:42:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:42:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:34.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:42:34.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:42:34.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:34 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:42:34.980 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T02:42:34.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T02:42:36.051 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:35 smithi100 ceph-mon[27894]: Deploying daemon crash.smithi100 on smithi100 2024-09-13T02:42:36.146 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 -- 172.21.15.100:0/1624109150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 msgr2=0x7fe0500fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 --2- 172.21.15.100:0/1624109150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe0500fee60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe040004850 tx=0x7fe040009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 -- 172.21.15.100:0/1624109150 shutdown_connections 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 --2- 172.21.15.100:0/1624109150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe0500fee60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 -- 172.21.15.100:0/1624109150 >> 172.21.15.100:0/1624109150 conn(0x7fe0500f68b0 msgr2=0x7fe0500f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 -- 172.21.15.100:0/1624109150 shutdown_connections 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.204+0000 7fe0558a2640 1 -- 172.21.15.100:0/1624109150 wait complete. 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe0558a2640 1 Processor -- start 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe0558a2640 1 -- start start 2024-09-13T02:42:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe0558a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe0558a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05010cc90 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe04effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe04effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43514/0 (socket says 172.21.15.100:43514) 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe04effd640 1 -- 172.21.15.100:0/116910953 learned_addr learned my addr 172.21.15.100:0/116910953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe04effd640 1 -- 172.21.15.100:0/116910953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040005040 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe04effd640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0400041d0 tx=0x7fe040009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.205+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe040007a20 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05010ce90 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe0400328e0 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0400339f0 con 0x7fe0500660e0 2024-09-13T02:42:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05010d220 con 0x7fe0500660e0 2024-09-13T02:42:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe040030020 con 0x7fe0500660e0 2024-09-13T02:42:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.206+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05005ed70 con 0x7fe0500660e0 2024-09-13T02:42:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.207+0000 7fe0477fe640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 0x7fe03c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.207+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe04006c170 con 0x7fe0500660e0 2024-09-13T02:42:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.207+0000 7fe047fff640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 0x7fe03c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.207+0000 7fe047fff640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 0x7fe03c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe038006fd0 tx=0x7fe038006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.211+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe040033b50 con 0x7fe0500660e0 2024-09-13T02:42:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.384+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fe050106470 con 0x7fe03c039580 2024-09-13T02:42:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.388+0000 7fe0477fe640 1 -- 172.21.15.100:0/116910953 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe050106470 con 0x7fe03c039580 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.389+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 msgr2=0x7fe03c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 0x7fe03c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe038006fd0 tx=0x7fe038006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 msgr2=0x7fe05010c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0400041d0 tx=0x7fe040009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 shutdown_connections 2024-09-13T02:42:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fe03c039580 0x7fe03c03ba30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 --2- 172.21.15.100:0/116910953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0500660e0 0x7fe05010c750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 >> 172.21.15.100:0/116910953 conn(0x7fe0500f68b0 msgr2=0x7fe0500f70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 shutdown_connections 2024-09-13T02:42:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:38.390+0000 7fe0558a2640 1 -- 172.21.15.100:0/116910953 wait complete. 2024-09-13T02:42:38.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:38 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:38.622 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:38 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:38.622 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:38 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:38.622 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:38 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:38.622 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:38 smithi100 ceph-mon[27894]: Deploying daemon node-exporter.smithi100 on smithi100 2024-09-13T02:42:38.999 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-09-13T02:42:39.000 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:42:39.000 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-09-13T02:42:39.019 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:42:39.019 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:42:39.077 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-09-13T02:42:39.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch host add smithi122 2024-09-13T02:42:39.332 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:42:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:39 smithi100 ceph-mon[27894]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:39 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:41.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 -- 172.21.15.100:0/28988915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 msgr2=0x7f05040fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:41.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 --2- 172.21.15.100:0/28988915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f05040fdc20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04f4004850 tx=0x7f04f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:41.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 -- 172.21.15.100:0/28988915 shutdown_connections 2024-09-13T02:42:41.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 --2- 172.21.15.100:0/28988915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f05040fdc20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:41.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 -- 172.21.15.100:0/28988915 >> 172.21.15.100:0/28988915 conn(0x7f05040f6010 msgr2=0x7f05040f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:41.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 -- 172.21.15.100:0/28988915 shutdown_connections 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.897+0000 7f050a121640 1 -- 172.21.15.100:0/28988915 wait complete. 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f050a121640 1 Processor -- start 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f050a121640 1 -- start start 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f050a121640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f050a121640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050410cc70 con 0x7f05040fd810 2024-09-13T02:42:41.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f05037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f05037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35794/0 (socket says 172.21.15.100:35794) 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f05037fe640 1 -- 172.21.15.100:0/4182114428 learned_addr learned my addr 172.21.15.100:0/4182114428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f05037fe640 1 -- 172.21.15.100:0/4182114428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4005040 con 0x7f05040fd810 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.898+0000 7f05037fe640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f402a6d0 tx=0x7f04f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f4033630 con 0x7f05040fd810 2024-09-13T02:42:41.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050410ce70 con 0x7f05040fd810 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f04f4033c30 con 0x7f05040fd810 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04f403dc30 con 0x7f05040fd810 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050410d2e0 con 0x7f05040fd810 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.899+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f04f4030020 con 0x7f05040fd810 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.900+0000 7f04ebfff640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 0x7f04ec03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:41.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.900+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050405ed70 con 0x7f05040fd810 2024-09-13T02:42:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.900+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f04f406c8b0 con 0x7f05040fd810 2024-09-13T02:42:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.900+0000 7f0502ffd640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 0x7f04ec03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.900+0000 7f0502ffd640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 0x7f04ec03ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f04f8006fd0 tx=0x7f04f8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:41.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:41.904+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f04f403bb50 con 0x7f05040fd810 2024-09-13T02:42:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:42.068+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) v1 -- 0x7f05041063a0 con 0x7f04ec039580 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:42 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:43 smithi100 ceph-mon[27894]: Deploying daemon alertmanager.smithi100 on smithi100 2024-09-13T02:42:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:43 smithi100 ceph-mon[27894]: Deploying cephadm binary to smithi122 2024-09-13T02:42:44.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.871+0000 7f04ebfff640 1 -- 172.21.15.100:0/4182114428 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f05041063a0 con 0x7f04ec039580 2024-09-13T02:42:44.873 INFO:teuthology.orchestra.run.smithi100.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-09-13T02:42:44.873 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:44 smithi100 ceph-mon[27894]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:44.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 msgr2=0x7f04ec03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 0x7f04ec03ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f04f8006fd0 tx=0x7f04f8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 msgr2=0x7f050410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f402a6d0 tx=0x7f04f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 shutdown_connections 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f04ec039580 0x7f04ec03ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 --2- 172.21.15.100:0/4182114428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05040fd810 0x7f050410c730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 >> 172.21.15.100:0/4182114428 conn(0x7f05040f6010 msgr2=0x7f05040f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 shutdown_connections 2024-09-13T02:42:44.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:44.873+0000 7f050a121640 1 -- 172.21.15.100:0/4182114428 wait complete. 2024-09-13T02:42:46.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:45 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:46.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:45 smithi100 ceph-mon[27894]: Added host smithi122 2024-09-13T02:42:46.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T02:42:47.132 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:46 smithi100 ceph-mon[27894]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:47.132 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:46 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:47.519 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:42:49.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:48 smithi100 ceph-mon[27894]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 -- 172.21.15.100:0/3579620425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 msgr2=0x7f734c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 --2- 172.21.15.100:0/3579620425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c0fc5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7340004850 tx=0x7f7340009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 -- 172.21.15.100:0/3579620425 shutdown_connections 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 --2- 172.21.15.100:0/3579620425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c0fc5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 -- 172.21.15.100:0/3579620425 >> 172.21.15.100:0/3579620425 conn(0x7f734c0f79b0 msgr2=0x7f734c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 -- 172.21.15.100:0/3579620425 shutdown_connections 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.303+0000 7f7352fb4640 1 -- 172.21.15.100:0/3579620425 wait complete. 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7352fb4640 1 Processor -- start 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7352fb4640 1 -- start start 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7352fb4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7352fb4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0719d0 con 0x7f734c0fc1d0 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7350d50640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7350d50640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33334/0 (socket says 172.21.15.100:33334) 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.304+0000 7f7350d50640 1 -- 172.21.15.100:0/1027273755 learned_addr learned my addr 172.21.15.100:0/1027273755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f7350d50640 1 -- 172.21.15.100:0/1027273755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340005040 con 0x7f734c0fc1d0 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f7350d50640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f734002a6d0 tx=0x7f7340009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7340033630 con 0x7f734c0fc1d0 2024-09-13T02:42:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7340033c30 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c06fa60 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f734003dc00 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.305+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c06fed0 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f7340030020 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f73497fa640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 0x7f733c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c1025f0 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f734006ca70 con 0x7f734c0fc1d0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f734bfff640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 0x7f733c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.306+0000 7f734bfff640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 0x7f733c03ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7338006fd0 tx=0x7f7338006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.310+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7340045800 con 0x7f734c0fc1d0 2024-09-13T02:42:50.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.476+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f734c070110 con 0x7f733c039580 2024-09-13T02:42:50.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.477+0000 7f73497fa640 1 -- 172.21.15.100:0/1027273755 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f734c070110 con 0x7f733c039580 2024-09-13T02:42:50.478 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:42:50.478 INFO:teuthology.orchestra.run.smithi100.stdout:[{"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 msgr2=0x7f733c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 0x7f733c03ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7338006fd0 tx=0x7f7338006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 msgr2=0x7f734c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f734002a6d0 tx=0x7f7340009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 shutdown_connections 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f733c039580 0x7f733c03ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 --2- 172.21.15.100:0/1027273755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734c0fc1d0 0x7f734c071490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 >> 172.21.15.100:0/1027273755 conn(0x7f734c0f79b0 msgr2=0x7f734c0f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 shutdown_connections 2024-09-13T02:42:50.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:50.479+0000 7f7352fb4640 1 -- 172.21.15.100:0/1027273755 wait complete. 2024-09-13T02:42:51.044 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:50 smithi100 ceph-mon[27894]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:51.700 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T02:42:51.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T02:42:51.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:51 smithi100 ceph-mon[27894]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:42:52.487 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:42:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:42:53.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:52 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:54.013 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:53 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:42:54.014 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:53 smithi100 ceph-mon[27894]: Deploying daemon grafana.smithi100 on smithi100 2024-09-13T02:42:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/3835666214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 msgr2=0x7f4ee00fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/3835666214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee00fb6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004850 tx=0x7f4ed0009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/3835666214 shutdown_connections 2024-09-13T02:42:54.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/3835666214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee00fb6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/3835666214 >> 172.21.15.100:0/3835666214 conn(0x7f4ee00f6ac0 msgr2=0x7f4ee00f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/3835666214 shutdown_connections 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/3835666214 wait complete. 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 Processor -- start 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.212+0000 7f4ee5dd5640 1 -- start start 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4ee5dd5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4ee5dd5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee010bd60 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33354/0 (socket says 172.21.15.100:33354) 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edf7fe640 1 -- 172.21.15.100:0/2995330383 learned_addr learned my addr 172.21.15.100:0/2995330383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edf7fe640 1 -- 172.21.15.100:0/2995330383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0005040 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edf7fe640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ed002a6d0 tx=0x7f4ed0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ed0033630 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ed0033c30 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee010bf60 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ed003dc00 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.213+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee010c3d0 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.214+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f4ed0030020 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.214+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee005ed70 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.214+0000 7f4edcff9640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 0x7f4ecc03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.214+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4ed006c920 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.214+0000 7f4ed7fff640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 0x7f4ecc03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:54.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.215+0000 7f4ed7fff640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 0x7f4ecc03ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:54.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.219+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ed0045b30 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.380+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4ee004b720 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.889+0000 7f4edcff9640 1 -- 172.21.15.100:0/2995330383 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4ed0045b30 con 0x7f4ee00fb2e0 2024-09-13T02:42:54.892 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-09-13T02:42:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 msgr2=0x7f4ecc03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 0x7f4ecc03ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 msgr2=0x7f4ee010b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:54.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ed002a6d0 tx=0x7f4ed0009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 shutdown_connections 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f4ecc0395d0 0x7f4ecc03ba80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 --2- 172.21.15.100:0/2995330383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00fb2e0 0x7f4ee010b820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 >> 172.21.15.100:0/2995330383 conn(0x7f4ee00f6ac0 msgr2=0x7f4ee00f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 shutdown_connections 2024-09-13T02:42:54.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:42:54.892+0000 7f4ee5dd5640 1 -- 172.21.15.100:0/2995330383 wait complete. 2024-09-13T02:42:55.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:54 smithi100 ceph-mon[27894]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:55.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:54 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2995330383' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T02:42:55.625 INFO:tasks.cephadm:Adding mon.smithi100 on smithi100 2024-09-13T02:42:55.625 INFO:tasks.cephadm:Adding mon.smithi122 on smithi122 2024-09-13T02:42:55.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi100:172.21.15.100=smithi100;smithi122:172.21.15.122=smithi122' 2024-09-13T02:42:55.880 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:42:55.926 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:42:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:55 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2995330383' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T02:42:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:55 smithi100 ceph-mon[27894]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T02:42:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:56 smithi100 ceph-mon[27894]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:56 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:57.413 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/4224582726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 msgr2=0x7fd1a80fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/4224582726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a80fc5c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd198004850 tx=0x7fd198009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/4224582726 shutdown_connections 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/4224582726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a80fc5c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/4224582726 >> 172.21.15.122:0/4224582726 conn(0x7fd1a80f7990 msgr2=0x7fd1a80f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/4224582726 shutdown_connections 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.411+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/4224582726 wait complete. 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1ad0ca640 1 Processor -- start 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1ad0ca640 1 -- start start 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1ad0ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1ad0ca640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a810cc30 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1a6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:57.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1a6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:36024/0 (socket says 172.21.15.122:36024) 2024-09-13T02:42:57.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.412+0000 7fd1a6d9d640 1 -- 172.21.15.122:0/3236565451 learned_addr learned my addr 172.21.15.122:0/3236565451 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:42:57.415 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd1a6d9d640 1 -- 172.21.15.122:0/3236565451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198005040 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd1a6d9d640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd19802a6d0 tx=0x7fd198009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd198033630 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd198033c30 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a810ce30 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd19803dc00 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.413+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a810d2a0 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.414+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fd198030020 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.414+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a805ed70 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.414+0000 7fd19f7fe640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 0x7fd19403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.414+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd19806c980 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.416 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.415+0000 7fd19ffff640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 0x7fd19403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:57.417 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.415+0000 7fd19ffff640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 0x7fd19403ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd190006fd0 tx=0x7fd190006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:57.420 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.419+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd198033790 con 0x7fd1a80fc1b0 2024-09-13T02:42:57.586 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.585+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 --> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi100:172.21.15.100=smithi100;smithi122:172.21.15.122=smithi122", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a810e3b0 con 0x7fd194039580 2024-09-13T02:42:57.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.590+0000 7fd19f7fe640 1 -- 172.21.15.122:0/3236565451 <== mgr.14160 v2:172.21.15.100:6800/3842284467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd1a810e3b0 con 0x7fd194039580 2024-09-13T02:42:57.592 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mon update... 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 msgr2=0x7fd19403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 0x7fd19403ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd190006fd0 tx=0x7fd190006db0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 msgr2=0x7fd1a810c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd19802a6d0 tx=0x7fd198009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 shutdown_connections 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fd194039580 0x7fd19403ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 --2- 172.21.15.122:0/3236565451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1a80fc1b0 0x7fd1a810c6f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.592+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 >> 172.21.15.122:0/3236565451 conn(0x7fd1a80f7990 msgr2=0x7fd1a80f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:57.594 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.593+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 shutdown_connections 2024-09-13T02:42:57.595 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:57.593+0000 7fd1ad0ca640 1 -- 172.21.15.122:0/3236565451 wait complete. 2024-09-13T02:42:58.200 DEBUG:teuthology.orchestra.run.smithi122:mon.smithi122> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi122.service 2024-09-13T02:42:58.202 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:42:58.202 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:42:58.478 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:42:58.552 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:42:58.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:58 smithi100 ceph-mon[27894]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:42:58.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:58 smithi100 ceph-mon[27894]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi100:172.21.15.100=smithi100;smithi122:172.21.15.122=smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:42:58.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:58 smithi100 ceph-mon[27894]: Saving service mon spec with placement smithi100:172.21.15.100=smithi100;smithi122:172.21.15.122=smithi122;count:2 2024-09-13T02:42:58.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:42:58 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 -- 172.21.15.122:0/3656612780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 msgr2=0x7f9ee00fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/3656612780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee00fb500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0004850 tx=0x7f9ed0009da0 comp rx=0 tx=0).stop 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 -- 172.21.15.122:0/3656612780 shutdown_connections 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/3656612780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee00fb500 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 -- 172.21.15.122:0/3656612780 >> 172.21.15.122:0/3656612780 conn(0x7f9ee00f68b0 msgr2=0x7f9ee00f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 -- 172.21.15.122:0/3656612780 shutdown_connections 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.975+0000 7f9ee52f0640 1 -- 172.21.15.122:0/3656612780 wait complete. 2024-09-13T02:42:59.978 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9ee52f0640 1 Processor -- start 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9ee52f0640 1 -- start start 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9ee52f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9ee52f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee010f470 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9edeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9edeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:36036/0 (socket says 172.21.15.122:36036) 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9edeffd640 1 -- 172.21.15.122:0/2712627279 learned_addr learned my addr 172.21.15.122:0/2712627279 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.976+0000 7f9edeffd640 1 -- 172.21.15.122:0/2712627279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0005040 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9edeffd640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ed002a6d0 tx=0x7f9ed0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed0033630 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee010f5b0 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ed0033c30 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ed003dc00 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.979 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.977+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee010f9c0 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.978+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee005ed70 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.978+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f9ed0030020 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.978+0000 7f9ed77fe640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 0x7f9ecc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:42:59.980 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.978+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9ed006cad0 con 0x7f9ee00fb0f0 2024-09-13T02:42:59.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.978+0000 7f9ed7fff640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 0x7f9ecc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:42:59.981 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.979+0000 7f9ed7fff640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 0x7f9ecc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8006fd0 tx=0x7f9ec8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:42:59.984 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:42:59.983+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ed0045570 con 0x7f9ee00fb0f0 2024-09-13T02:43:00.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.198+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9ee004b720 con 0x7f9ee00fb0f0 2024-09-13T02:43:00.199 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.198+0000 7f9ed77fe640 1 -- 172.21.15.122:0/2712627279 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9ed0042210 con 0x7f9ee00fb0f0 2024-09-13T02:43:00.200 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:00.200 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:00.200 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:00.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 msgr2=0x7f9ecc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:00.201 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 0x7f9ecc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8006fd0 tx=0x7f9ec8006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 msgr2=0x7f9ee0065fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ed002a6d0 tx=0x7f9ed0009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 shutdown_connections 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f9ecc039580 0x7f9ecc03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 --2- 172.21.15.122:0/2712627279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee00fb0f0 0x7f9ee0065fc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 >> 172.21.15.122:0/2712627279 conn(0x7f9ee00f68b0 msgr2=0x7f9ee00f7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 shutdown_connections 2024-09-13T02:43:00.202 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:00.200+0000 7f9ee52f0640 1 -- 172.21.15.122:0/2712627279 wait complete. 2024-09-13T02:43:00.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:00 smithi100 ceph-mon[27894]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:00.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:00 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/2712627279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:01.773 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:01.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:02.004 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:02.048 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:02.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:02 smithi100 ceph-mon[27894]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:03.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 -- 172.21.15.122:0/2671121297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 msgr2=0x7fcfec0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:03.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 --2- 172.21.15.122:0/2671121297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec0fc5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8004850 tx=0x7fcfe8009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.458 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 -- 172.21.15.122:0/2671121297 shutdown_connections 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 --2- 172.21.15.122:0/2671121297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec0fc5e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 -- 172.21.15.122:0/2671121297 >> 172.21.15.122:0/2671121297 conn(0x7fcfec0f79b0 msgr2=0x7fcfec0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 -- 172.21.15.122:0/2671121297 shutdown_connections 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.456+0000 7fcff32a1640 1 -- 172.21.15.122:0/2671121297 wait complete. 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff32a1640 1 Processor -- start 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff32a1640 1 -- start start 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff32a1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:03.459 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff32a1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec10cc10 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff103d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:03.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff103d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:36060/0 (socket says 172.21.15.122:36060) 2024-09-13T02:43:03.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.457+0000 7fcff103d640 1 -- 172.21.15.122:0/3571749638 learned_addr learned my addr 172.21.15.122:0/3571749638 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:03.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcff103d640 1 -- 172.21.15.122:0/3571749638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8005040 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcff103d640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfe802a6d0 tx=0x7fcfe8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe8033630 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec10ce10 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfe8033c30 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe803dc00 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.458+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec10d280 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.459+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fcfe8030020 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.459+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec05ed70 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.459+0000 7fcfe1ffb640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 0x7fcfd803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:03.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.460+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcfe806c960 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.460+0000 7fcff083c640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 0x7fcfd803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:03.463 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.460+0000 7fcff083c640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 0x7fcfd803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006fd0 tx=0x7fcfdc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:03.465 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.464+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfe8033790 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.680 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.679+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfec04b720 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.681 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.679+0000 7fcfe1ffb640 1 -- 172.21.15.122:0/3571749638 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fcfe8045800 con 0x7fcfec0fc1d0 2024-09-13T02:43:03.681 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:03.681 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:03.682 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 msgr2=0x7fcfd803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 0x7fcfd803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006fd0 tx=0x7fcfdc006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 msgr2=0x7fcfec10c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfe802a6d0 tx=0x7fcfe8009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 shutdown_connections 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fcfd8039580 0x7fcfd803ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 --2- 172.21.15.122:0/3571749638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfec0fc1d0 0x7fcfec10c6d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:03.683 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.681+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 >> 172.21.15.122:0/3571749638 conn(0x7fcfec0f79b0 msgr2=0x7fcfec0f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:03.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.682+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 shutdown_connections 2024-09-13T02:43:03.684 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:03.682+0000 7fcff32a1640 1 -- 172.21.15.122:0/3571749638 wait complete. 2024-09-13T02:43:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:04 smithi100 ceph-mon[27894]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:04.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:04 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3571749638' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:05.240 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:05.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:05.476 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:05.520 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:06.604 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:06 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 -- 172.21.15.122:0/2570618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 msgr2=0x7f79780fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 --2- 172.21.15.122:0/2570618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f79780fc5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7968004850 tx=0x7f7968009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 -- 172.21.15.122:0/2570618177 shutdown_connections 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 --2- 172.21.15.122:0/2570618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f79780fc5c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 -- 172.21.15.122:0/2570618177 >> 172.21.15.122:0/2570618177 conn(0x7f79780f7990 msgr2=0x7f79780f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:06.892 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 -- 172.21.15.122:0/2570618177 shutdown_connections 2024-09-13T02:43:06.893 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.889+0000 7f797ccc5640 1 -- 172.21.15.122:0/2570618177 wait complete. 2024-09-13T02:43:06.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797ccc5640 1 Processor -- start 2024-09-13T02:43:06.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797ccc5640 1 -- start start 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797ccc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797ccc5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797810cc30 con 0x7f79780fc1b0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:36084/0 (socket says 172.21.15.122:36084) 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.890+0000 7f797659c640 1 -- 172.21.15.122:0/1204384875 learned_addr learned my addr 172.21.15.122:0/1204384875 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f797659c640 1 -- 172.21.15.122:0/1204384875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968005040 con 0x7f79780fc1b0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f797659c640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796802a6d0 tx=0x7f7968009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7968033630 con 0x7f79780fc1b0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7968033c30 con 0x7f79780fc1b0 2024-09-13T02:43:06.895 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797810ce30 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f796803dc00 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.891+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797810d2a0 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.892+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f7968030020 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.892+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797805ed70 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.892+0000 7f796effd640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 0x7f796403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.892+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f796806ca40 con 0x7f79780fc1b0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.892+0000 7f796ffff640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 0x7f796403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:06.896 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.893+0000 7f796ffff640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 0x7f796403ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:06.899 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:06.897+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f796803bb50 con 0x7f79780fc1b0 2024-09-13T02:43:07.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.109+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f797804b720 con 0x7f79780fc1b0 2024-09-13T02:43:07.111 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.109+0000 7f796effd640 1 -- 172.21.15.122:0/1204384875 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7968042210 con 0x7f79780fc1b0 2024-09-13T02:43:07.112 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:07.112 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:07.112 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:07.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 msgr2=0x7f796403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:07.114 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 0x7f796403ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7960006fd0 tx=0x7f7960006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 msgr2=0x7f797810c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796802a6d0 tx=0x7f7968009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 shutdown_connections 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f7964039580 0x7f796403ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 --2- 172.21.15.122:0/1204384875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79780fc1b0 0x7f797810c6f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 >> 172.21.15.122:0/1204384875 conn(0x7f79780f7990 msgr2=0x7f79780f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 shutdown_connections 2024-09-13T02:43:07.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:07.112+0000 7f797ccc5640 1 -- 172.21.15.122:0/1204384875 wait complete. 2024-09-13T02:43:07.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:07 smithi100 ceph-mon[27894]: Deploying daemon prometheus.smithi100 on smithi100 2024-09-13T02:43:07.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:07 smithi100 ceph-mon[27894]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:07.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:07 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:07.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:07 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1204384875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:08.820 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:08.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:09.069 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:09.113 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:09 smithi100 ceph-mon[27894]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.487+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/275052415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 msgr2=0x7fc2d00fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.487+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/275052415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d00fc5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc004850 tx=0x7fc2cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.487+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/275052415 shutdown_connections 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.487+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/275052415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d00fc5c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.487+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/275052415 >> 172.21.15.122:0/275052415 conn(0x7fc2d00f7990 msgr2=0x7fc2d00f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/275052415 shutdown_connections 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/275052415 wait complete. 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 Processor -- start 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 -- start start 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d7fc1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00719d0 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d5d5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d5d5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:43068/0 (socket says 172.21.15.122:43068) 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.488+0000 7fc2d5d5d640 1 -- 172.21.15.122:0/3937900471 learned_addr learned my addr 172.21.15.122:0/3937900471 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2d5d5d640 1 -- 172.21.15.122:0/3937900471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc005040 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2d5d5d640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc02a6d0 tx=0x7fc2cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc033630 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc2cc033c30 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d006fa60 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2cc03dc00 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.489+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d006fed0 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.490+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fc2cc030020 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.490+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d01025d0 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.490+0000 7fc2c67fc640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 0x7fc2bc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.490+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc2cc06ca70 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.490+0000 7fc2d555c640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 0x7fc2bc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:10.494 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.491+0000 7fc2d555c640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 0x7fc2bc03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0006fd0 tx=0x7fc2c0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:10.498 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.495+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc2cc045800 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.710+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc2d005ed70 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.711+0000 7fc2c67fc640 1 -- 172.21.15.122:0/3937900471 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fc2cc042210 con 0x7fc2d00fc1b0 2024-09-13T02:43:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:10.714 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:10.714 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:10.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 msgr2=0x7fc2bc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:10.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 0x7fc2bc03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0006fd0 tx=0x7fc2c0006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 msgr2=0x7fc2d0071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:10.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc02a6d0 tx=0x7fc2cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 shutdown_connections 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7fc2bc039580 0x7fc2bc03ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 --2- 172.21.15.122:0/3937900471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d00fc1b0 0x7fc2d0071490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 >> 172.21.15.122:0/3937900471 conn(0x7fc2d00f7990 msgr2=0x7fc2d00f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 shutdown_connections 2024-09-13T02:43:10.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:10.713+0000 7fc2d7fc1640 1 -- 172.21.15.122:0/3937900471 wait complete. 2024-09-13T02:43:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:11 smithi100 ceph-mon[27894]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:11 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3937900471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:12.315 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:12.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:12.547 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:12.592 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:13.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:13 smithi100 ceph-mon[27894]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 -- 172.21.15.122:0/1327664316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 msgr2=0x7f585c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 --2- 172.21.15.122:0/1327664316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c0fc5e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5858004850 tx=0x7f5858009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 -- 172.21.15.122:0/1327664316 shutdown_connections 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 --2- 172.21.15.122:0/1327664316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c0fc5e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 -- 172.21.15.122:0/1327664316 >> 172.21.15.122:0/1327664316 conn(0x7f585c0f79b0 msgr2=0x7f585c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 -- 172.21.15.122:0/1327664316 shutdown_connections 2024-09-13T02:43:13.882 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.879+0000 7f58640ff640 1 -- 172.21.15.122:0/1327664316 wait complete. 2024-09-13T02:43:13.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f58640ff640 1 Processor -- start 2024-09-13T02:43:13.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f58640ff640 1 -- start start 2024-09-13T02:43:13.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f58640ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:13.883 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f58640ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c10cc10 con 0x7f585c0fc1d0 2024-09-13T02:43:13.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f5861e9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:13.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f5861e9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:43088/0 (socket says 172.21.15.122:43088) 2024-09-13T02:43:13.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.880+0000 7f5861e9b640 1 -- 172.21.15.122:0/1603778949 learned_addr learned my addr 172.21.15.122:0/1603778949 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:13.884 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f5861e9b640 1 -- 172.21.15.122:0/1603778949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858005040 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f5861e9b640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f585802a6d0 tx=0x7f5858009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5858033630 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5858033c30 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c10ce10 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f585803dc00 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.881+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c10d280 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.882+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f5858030020 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.882+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c05ed70 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.882+0000 7f58527fc640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 0x7f584803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.882+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f585806c8c0 con 0x7f585c0fc1d0 2024-09-13T02:43:13.885 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.882+0000 7f586169a640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 0x7f584803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:13.886 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.883+0000 7f586169a640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 0x7f584803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f584c006fd0 tx=0x7f584c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:13.889 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:13.888+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5858033790 con 0x7f585c0fc1d0 2024-09-13T02:43:14.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.101+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f585c04b720 con 0x7f585c0fc1d0 2024-09-13T02:43:14.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.102+0000 7f58527fc640 1 -- 172.21.15.122:0/1603778949 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f5858042210 con 0x7f585c0fc1d0 2024-09-13T02:43:14.104 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:14.104 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:14.105 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 msgr2=0x7f584803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 0x7f584803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f584c006fd0 tx=0x7f584c006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 msgr2=0x7f585c10c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f585802a6d0 tx=0x7f5858009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.107 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 shutdown_connections 2024-09-13T02:43:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f5848039580 0x7f584803ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 --2- 172.21.15.122:0/1603778949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f585c0fc1d0 0x7f585c10c6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 >> 172.21.15.122:0/1603778949 conn(0x7f585c0f79b0 msgr2=0x7f585c0f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 shutdown_connections 2024-09-13T02:43:14.108 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:14.104+0000 7f58640ff640 1 -- 172.21.15.122:0/1603778949 wait complete. 2024-09-13T02:43:14.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:14 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1603778949' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:15 smithi100 ceph-mon[27894]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:15.643 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:15.643 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:15.885 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:15.929 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 -- 172.21.15.122:0/769647608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 msgr2=0x7f208006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 --2- 172.21.15.122:0/769647608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f208006d870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f207c004850 tx=0x7f207c009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 -- 172.21.15.122:0/769647608 shutdown_connections 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 --2- 172.21.15.122:0/769647608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f208006d870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 -- 172.21.15.122:0/769647608 >> 172.21.15.122:0/769647608 conn(0x7f20800691b0 msgr2=0x7f208006b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 -- 172.21.15.122:0/769647608 shutdown_connections 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.224+0000 7f208810c640 1 -- 172.21.15.122:0/769647608 wait complete. 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f208810c640 1 Processor -- start 2024-09-13T02:43:17.227 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f208810c640 1 -- start start 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f208810c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f208810c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2080115440 con 0x7f208006f1b0 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f2085ea8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f2085ea8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:43104/0 (socket says 172.21.15.122:43104) 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.225+0000 7f2085ea8640 1 -- 172.21.15.122:0/2809479822 learned_addr learned my addr 172.21.15.122:0/2809479822 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:17.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f2085ea8640 1 -- 172.21.15.122:0/2809479822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c005040 con 0x7f208006f1b0 2024-09-13T02:43:17.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f2085ea8640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f207c02a6d0 tx=0x7f207c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:17.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c033630 con 0x7f208006f1b0 2024-09-13T02:43:17.229 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2080115640 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f207c033c30 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f207c03dc30 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.226+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2080115ab0 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.227+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f207c030020 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.227+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208005ed70 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.228+0000 7f20767fc640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 0x7f206c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.228+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f207c06ca10 con 0x7f208006f1b0 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.228+0000 7f20856a7640 1 -- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 msgr2=0x7f206c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3842284467 2024-09-13T02:43:17.230 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.228+0000 7f20856a7640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 0x7f206c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:17.237 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.236+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f207c03bb50 con 0x7f208006f1b0 2024-09-13T02:43:17.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.429+0000 7f20856a7640 1 -- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 msgr2=0x7f206c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3842284467 2024-09-13T02:43:17.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.429+0000 7f20856a7640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 0x7f206c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:43:17.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.452+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f208004b720 con 0x7f208006f1b0 2024-09-13T02:43:17.453 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.452+0000 7f20767fc640 1 -- 172.21.15.122:0/2809479822 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f207c042210 con 0x7f208006f1b0 2024-09-13T02:43:17.454 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:17.454 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:17.454 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.454+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 msgr2=0x7f206c03ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.454+0000 7f208810c640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 0x7f206c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 msgr2=0x7f2080114f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f207c02a6d0 tx=0x7f207c009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 shutdown_connections 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f206c0395d0 0x7f206c03ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 --2- 172.21.15.122:0/2809479822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f208006f1b0 0x7f2080114f00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:17.456 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 >> 172.21.15.122:0/2809479822 conn(0x7f20800691b0 msgr2=0x7f20800699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:17.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 shutdown_connections 2024-09-13T02:43:17.457 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:17.455+0000 7f208810c640 1 -- 172.21.15.122:0/2809479822 wait complete. 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T02:43:17.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:17 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:18 smithi100 ceph-mon[27894]: from='mgr.14160 172.21.15.100:0/3065484503' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T02:43:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:18 smithi100 ceph-mon[27894]: mgrmap e14: smithi100.lhjyck(active, since 55s) 2024-09-13T02:43:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:18 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/2809479822' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:19.031 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:19.031 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:19.278 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:19.323 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 -- 172.21.15.122:0/4089790800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 msgr2=0x7f39080fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 --2- 172.21.15.122:0/4089790800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f39080fc5e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38f8004850 tx=0x7f38f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 -- 172.21.15.122:0/4089790800 shutdown_connections 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 --2- 172.21.15.122:0/4089790800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f39080fc5e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 -- 172.21.15.122:0/4089790800 >> 172.21.15.122:0/4089790800 conn(0x7f39080f79b0 msgr2=0x7f39080f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 -- 172.21.15.122:0/4089790800 shutdown_connections 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.708+0000 7f390e430640 1 -- 172.21.15.122:0/4089790800 wait complete. 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.709+0000 7f390e430640 1 Processor -- start 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.709+0000 7f390e430640 1 -- start start 2024-09-13T02:43:20.711 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.709+0000 7f390e430640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:20.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.709+0000 7f390e430640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390810cc30 con 0x7f39080fc1d0 2024-09-13T02:43:20.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3907fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:20.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3907fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:39494/0 (socket says 172.21.15.122:39494) 2024-09-13T02:43:20.712 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3907fff640 1 -- 172.21.15.122:0/1538669112 learned_addr learned my addr 172.21.15.122:0/1538669112 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:20.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3907fff640 1 -- 172.21.15.122:0/1538669112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8005040 con 0x7f39080fc1d0 2024-09-13T02:43:20.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3907fff640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38f802a6d0 tx=0x7f38f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:20.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f8033630 con 0x7f39080fc1d0 2024-09-13T02:43:20.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390810ce30 con 0x7f39080fc1d0 2024-09-13T02:43:20.713 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38f8033c30 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f803dc00 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.710+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390810d2a0 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.711+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f38f8030020 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.711+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390805ed70 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.712+0000 7f3904ff9640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 0x7f38f003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.712+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f38f806ca10 con 0x7f39080fc1d0 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.712+0000 7f39077fe640 1 -- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 msgr2=0x7f38f003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3842284467 2024-09-13T02:43:20.714 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.712+0000 7f39077fe640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 0x7f38f003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:20.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.720+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f38f8033790 con 0x7f39080fc1d0 2024-09-13T02:43:20.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.913+0000 7f39077fe640 1 -- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 msgr2=0x7f38f003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/3842284467 2024-09-13T02:43:20.914 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.913+0000 7f39077fe640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 0x7f38f003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:43:20.932 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.931+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f390804b720 con 0x7f39080fc1d0 2024-09-13T02:43:20.933 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.932+0000 7f3904ff9640 1 -- 172.21.15.122:0/1538669112 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f38f8045800 con 0x7f39080fc1d0 2024-09-13T02:43:20.933 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:20.933 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:20.933 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.933+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 msgr2=0x7f38f003ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.933+0000 7f390e430640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 0x7f38f003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.933+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 msgr2=0x7f390810c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.933+0000 7f390e430640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38f802a6d0 tx=0x7f38f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 shutdown_connections 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:6800/3842284467,v1:172.21.15.100:6801/3842284467] conn(0x7f38f00395d0 0x7f38f003ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 --2- 172.21.15.122:0/1538669112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39080fc1d0 0x7f390810c6f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 >> 172.21.15.122:0/1538669112 conn(0x7f39080f79b0 msgr2=0x7f39080f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 shutdown_connections 2024-09-13T02:43:20.935 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:20.934+0000 7f390e430640 1 -- 172.21.15.122:0/1538669112 wait complete. 2024-09-13T02:43:21.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1538669112' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:22.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: Active manager daemon smithi100.lhjyck restarted 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: mgrmap e15: smithi100.lhjyck(active, starting, since 0.00300535s) 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:22.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:43:22.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:43:22.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:43:22.476 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:22.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:22.714 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:22.765 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:23 smithi100 ceph-mon[27894]: mgrmap e16: smithi100.lhjyck(active, since 1.00547s) 2024-09-13T02:43:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:24.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:24 smithi100 ceph-mon[27894]: [13/Sep/2024:02:43:22] ENGINE Bus STARTING 2024-09-13T02:43:24.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:24 smithi100 ceph-mon[27894]: [13/Sep/2024:02:43:22] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:43:24.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:24 smithi100 ceph-mon[27894]: [13/Sep/2024:02:43:22] ENGINE Bus STARTED 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:24 smithi100 ceph-mon[27894]: [13/Sep/2024:02:43:22] ENGINE Error in HTTPServer.serve 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:43:24.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:43:24.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:43:24.829 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 -- 172.21.15.122:0/402982311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 msgr2=0x7f0e100fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/402982311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e100fc5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e00004850 tx=0x7f0e00009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 -- 172.21.15.122:0/402982311 shutdown_connections 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/402982311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e100fc5c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 -- 172.21.15.122:0/402982311 >> 172.21.15.122:0/402982311 conn(0x7f0e100f7990 msgr2=0x7f0e100f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 -- 172.21.15.122:0/402982311 shutdown_connections 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.788+0000 7f0e17cd9640 1 -- 172.21.15.122:0/402982311 wait complete. 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e17cd9640 1 Processor -- start 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e17cd9640 1 -- start start 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e17cd9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e17cd9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100719d0 con 0x7f0e100fc1b0 2024-09-13T02:43:24.830 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e15a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e15a75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:39524/0 (socket says 172.21.15.122:39524) 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.789+0000 7f0e15a75640 1 -- 172.21.15.122:0/255947624 learned_addr learned my addr 172.21.15.122:0/255947624 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e15a75640 1 -- 172.21.15.122:0/255947624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00005040 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e15a75640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e0002a6d0 tx=0x7f0e00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e00033630 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1006fa60 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e00033c30 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e0003dc00 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.790+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1006fed0 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.791+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e101025d0 con 0x7f0e100fc1b0 2024-09-13T02:43:24.831 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.791+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f0e00030020 con 0x7f0e100fc1b0 2024-09-13T02:43:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.791+0000 7f0e067fc640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 0x7f0dfc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.791+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0e0006ccf0 con 0x7f0e100fc1b0 2024-09-13T02:43:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.791+0000 7f0e15274640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 0x7f0dfc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.792+0000 7f0e15274640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 0x7f0dfc03bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c006fd0 tx=0x7f0e0c006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:24.832 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:24.796+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0e00045800 con 0x7f0e100fc1b0 2024-09-13T02:43:25.015 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.014+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0e1005ed70 con 0x7f0e100fc1b0 2024-09-13T02:43:25.016 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.015+0000 7f0e067fc640 1 -- 172.21.15.122:0/255947624 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0e00045800 con 0x7f0e100fc1b0 2024-09-13T02:43:25.016 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:25.017 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:25.017 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 msgr2=0x7f0dfc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 0x7f0dfc03bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c006fd0 tx=0x7f0e0c006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 msgr2=0x7f0e10071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0e0002a6d0 tx=0x7f0e00009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 shutdown_connections 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0dfc039670 0x7f0dfc03bb20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 --2- 172.21.15.122:0/255947624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e100fc1b0 0x7f0e10071490 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 >> 172.21.15.122:0/255947624 conn(0x7f0e100f7990 msgr2=0x7f0e100f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 shutdown_connections 2024-09-13T02:43:25.019 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:25.017+0000 7f0e17cd9640 1 -- 172.21.15.122:0/255947624 wait complete. 2024-09-13T02:43:25.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:25 smithi100 ceph-mon[27894]: mgrmap e17: smithi100.lhjyck(active, since 2s) 2024-09-13T02:43:25.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:25 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/255947624' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:26.711 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:26.712 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:27.277 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:27.321 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:28.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:28.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 -- 172.21.15.122:0/1058776893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 msgr2=0x7f74a00fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 --2- 172.21.15.122:0/1058776893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a00fb4d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7490004850 tx=0x7f7490009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 -- 172.21.15.122:0/1058776893 shutdown_connections 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 --2- 172.21.15.122:0/1058776893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a00fb4d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 -- 172.21.15.122:0/1058776893 >> 172.21.15.122:0/1058776893 conn(0x7f74a00f6880 msgr2=0x7f74a00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 -- 172.21.15.122:0/1058776893 shutdown_connections 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 -- 172.21.15.122:0/1058776893 wait complete. 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.810+0000 7f74a639b640 1 Processor -- start 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f74a639b640 1 -- start start 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f74a639b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:28.812 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f74a639b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a010cc30 con 0x7f74a00fb0c0 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f749ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f749ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:50400/0 (socket says 172.21.15.122:50400) 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f749ffff640 1 -- 172.21.15.122:0/545279199 learned_addr learned my addr 172.21.15.122:0/545279199 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f749ffff640 1 -- 172.21.15.122:0/545279199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490005040 con 0x7f74a00fb0c0 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.811+0000 7f749ffff640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f749002a6d0 tx=0x7f7490009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.812+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7490033630 con 0x7f74a00fb0c0 2024-09-13T02:43:28.814 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.812+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a010ce30 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.812+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7490033c30 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.812+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f749003dc00 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.812+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a010d2a0 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.813+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a005ed70 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.813+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f7490030020 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.813+0000 7f749d7fa640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 0x7f748c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.813+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f749006caf0 con 0x7f74a00fb0c0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.813+0000 7f7497fff640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 0x7f748c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:28.815 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.814+0000 7f7497fff640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 0x7f748c03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f7488006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:28.819 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:28.818+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7490033790 con 0x7f74a00fb0c0 2024-09-13T02:43:29.033 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.032+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74a004b720 con 0x7f74a00fb0c0 2024-09-13T02:43:29.034 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.033+0000 7f749d7fa640 1 -- 172.21.15.122:0/545279199 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7490042210 con 0x7f74a00fb0c0 2024-09-13T02:43:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:29.034 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:29.035 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 msgr2=0x7f748c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 0x7f748c03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7488006fd0 tx=0x7f7488006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 msgr2=0x7f74a010c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f749002a6d0 tx=0x7f7490009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 shutdown_connections 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f748c039670 0x7f748c03bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 --2- 172.21.15.122:0/545279199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74a00fb0c0 0x7f74a010c6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:29.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 >> 172.21.15.122:0/545279199 conn(0x7f74a00f6880 msgr2=0x7f74a0065500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:29.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 shutdown_connections 2024-09-13T02:43:29.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:29.035+0000 7f74a639b640 1 -- 172.21.15.122:0/545279199 wait complete. 2024-09-13T02:43:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:29 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/545279199' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:30.594 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:30.594 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:30.834 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:30.879 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:43:32.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 -- 172.21.15.122:0/3897655077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 msgr2=0x7fa5180fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.367 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 --2- 172.21.15.122:0/3897655077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa5180fb6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa514004850 tx=0x7fa514009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 -- 172.21.15.122:0/3897655077 shutdown_connections 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 --2- 172.21.15.122:0/3897655077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa5180fb6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 -- 172.21.15.122:0/3897655077 >> 172.21.15.122:0/3897655077 conn(0x7fa5180f6ac0 msgr2=0x7fa5180f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 -- 172.21.15.122:0/3897655077 shutdown_connections 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.365+0000 7fa51f94f640 1 -- 172.21.15.122:0/3897655077 wait complete. 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.366+0000 7fa51f94f640 1 Processor -- start 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.366+0000 7fa51f94f640 1 -- start start 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.366+0000 7fa51f94f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:32.368 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.366+0000 7fa51f94f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51810ce40 con 0x7fa5180fb2e0 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51d6eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51d6eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:50424/0 (socket says 172.21.15.122:50424) 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51d6eb640 1 -- 172.21.15.122:0/1992032056 learned_addr learned my addr 172.21.15.122:0/1992032056 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51d6eb640 1 -- 172.21.15.122:0/1992032056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa514005040 con 0x7fa5180fb2e0 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51d6eb640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa51402a6d0 tx=0x7fa514009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:32.369 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa514033630 con 0x7fa5180fb2e0 2024-09-13T02:43:32.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51810d040 con 0x7fa5180fb2e0 2024-09-13T02:43:32.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa514033c30 con 0x7fa5180fb2e0 2024-09-13T02:43:32.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.367+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa51403dc00 con 0x7fa5180fb2e0 2024-09-13T02:43:32.370 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.368+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51810d4b0 con 0x7fa5180fb2e0 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.368+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fa514030020 con 0x7fa5180fb2e0 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.369+0000 7fa50dffb640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 0x7fa50403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.369+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa51406ce50 con 0x7fa5180fb2e0 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.369+0000 7fa51ceea640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 0x7fa50403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.369+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa518101700 con 0x7fa5180fb2e0 2024-09-13T02:43:32.371 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.369+0000 7fa51ceea640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 0x7fa50403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa508006fd0 tx=0x7fa508006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:32.375 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.374+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa51403bb50 con 0x7fa5180fb2e0 2024-09-13T02:43:32.589 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.588+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa518100f30 con 0x7fa5180fb2e0 2024-09-13T02:43:32.590 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.589+0000 7fa50dffb640 1 -- 172.21.15.122:0/1992032056 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa51403b370 con 0x7fa5180fb2e0 2024-09-13T02:43:32.590 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:32.590 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:32.590 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:32.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 msgr2=0x7fa50403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 0x7fa50403bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa508006fd0 tx=0x7fa508006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.592 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 msgr2=0x7fa51810c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa51402a6d0 tx=0x7fa514009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 shutdown_connections 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa504039670 0x7fa50403bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 --2- 172.21.15.122:0/1992032056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fb2e0 0x7fa51810c900 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 >> 172.21.15.122:0/1992032056 conn(0x7fa5180f6ac0 msgr2=0x7fa518064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 shutdown_connections 2024-09-13T02:43:32.593 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:32.591+0000 7fa51f94f640 1 -- 172.21.15.122:0/1992032056 wait complete. 2024-09-13T02:43:32.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:32 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1992032056' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:43:34.258 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:34.258 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:34.499 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:43:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:43:35.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:35.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:35 smithi100 ceph-mon[27894]: Deploying daemon crash.smithi122 on smithi122 2024-09-13T02:43:36.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:36 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 -- 172.21.15.122:0/3477583124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c801008c0 msgr2=0x7f3c80100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 --2- 172.21.15.122:0/3477583124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c801008c0 0x7f3c80100c90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c70004940 tx=0x7f3c7000aeb0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 -- 172.21.15.122:0/3477583124 shutdown_connections 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 --2- 172.21.15.122:0/3477583124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c801008c0 0x7f3c80100c90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 -- 172.21.15.122:0/3477583124 >> 172.21.15.122:0/3477583124 conn(0x7f3c80071790 msgr2=0x7f3c80071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 -- 172.21.15.122:0/3477583124 shutdown_connections 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.014+0000 7f3c86681640 1 -- 172.21.15.122:0/3477583124 wait complete. 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.015+0000 7f3c86681640 1 Processor -- start 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.015+0000 7f3c86681640 1 -- start start 2024-09-13T02:43:37.035 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.015+0000 7f3c86681640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.015+0000 7f3c86681640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80113230 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:50442/0 (socket says 172.21.15.122:50442) 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7ffff640 1 -- 172.21.15.122:0/3346577622 learned_addr learned my addr 172.21.15.122:0/3346577622 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7ffff640 1 -- 172.21.15.122:0/3346577622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70005040 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7ffff640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a300 tx=0x7f3c7000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c7000a850 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.016+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c7000a9b0 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.017+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c80113430 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.017+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c70034770 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.017+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8010cae0 con 0x7f3c80112920 2024-09-13T02:43:37.036 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.018+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f3c70031020 con 0x7f3c80112920 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.018+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c800fbfe0 con 0x7f3c80112920 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.018+0000 7f3c7cff9640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 0x7f3c6803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.018+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3c7006c720 con 0x7f3c80112920 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.018+0000 7f3c7f7fe640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 0x7f3c6803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.019+0000 7f3c7f7fe640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 0x7f3c6803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c74006fd0 tx=0x7f3c74006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:37.037 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.023+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c700348d0 con 0x7f3c80112920 2024-09-13T02:43:37.266 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.265+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3c8004b720 con 0x7f3c80112920 2024-09-13T02:43:37.267 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.266+0000 7f3c7cff9640 1 -- 172.21.15.122:0/3346577622 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3c7004d300 con 0x7f3c80112920 2024-09-13T02:43:37.267 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:37.267 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:37.267 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.267+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 msgr2=0x7f3c6803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.267+0000 7f3c86681640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 0x7f3c6803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3c74006fd0 tx=0x7f3c74006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.267+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 msgr2=0x7f3c80112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.267+0000 7f3c86681640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a300 tx=0x7f3c7000aeb0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 shutdown_connections 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c68039670 0x7f3c6803bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 --2- 172.21.15.122:0/3346577622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c80112920 0x7f3c80112cf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:37.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 >> 172.21.15.122:0/3346577622 conn(0x7f3c80071790 msgr2=0x7f3c800ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 shutdown_connections 2024-09-13T02:43:37.270 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:37.268+0000 7f3c86681640 1 -- 172.21.15.122:0/3346577622 wait complete. 2024-09-13T02:43:37.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:37 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3346577622' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:38.893 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:38.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:39.210 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:39 smithi100 ceph-mon[27894]: Deploying daemon node-exporter.smithi122 on smithi122 2024-09-13T02:43:41.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 -- 172.21.15.122:0/2931422642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 msgr2=0x7f11d41014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/2931422642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d41014b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f11d0004850 tx=0x7f11d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.560 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 -- 172.21.15.122:0/2931422642 shutdown_connections 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/2931422642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d41014b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 -- 172.21.15.122:0/2931422642 >> 172.21.15.122:0/2931422642 conn(0x7f11d40710b0 msgr2=0x7f11d40714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 -- 172.21.15.122:0/2931422642 shutdown_connections 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.502+0000 7f11dc6f3640 1 -- 172.21.15.122:0/2931422642 wait complete. 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11dc6f3640 1 Processor -- start 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11dc6f3640 1 -- start start 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11dc6f3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11dc6f3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4065910 con 0x7f11d41010e0 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11da48f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11da48f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:33714/0 (socket says 172.21.15.122:33714) 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11da48f640 1 -- 172.21.15.122:0/3980109611 learned_addr learned my addr 172.21.15.122:0/3980109611 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:41.561 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.503+0000 7f11da48f640 1 -- 172.21.15.122:0/3980109611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0005040 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11da48f640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f11d002a6d0 tx=0x7f11d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d002cf10 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d410df30 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f11d0033ad0 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11d003ebb0 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.504+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d410e380 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f11d0030020 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d40fc850 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11caffd640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 0x7f11c003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f11d006c7b0 con 0x7f11d41010e0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11d9c8e640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 0x7f11c003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.505+0000 7f11d9c8e640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 0x7f11c003bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006fd0 tx=0x7f11c4006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:41.562 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.510+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f11d0043210 con 0x7f11d41010e0 2024-09-13T02:43:41.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.729+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f11d404b720 con 0x7f11d41010e0 2024-09-13T02:43:41.731 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.730+0000 7f11caffd640 1 -- 172.21.15.122:0/3980109611 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f11d0043210 con 0x7f11d41010e0 2024-09-13T02:43:41.731 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:41.731 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:41.732 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 msgr2=0x7f11c003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 0x7f11c003bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006fd0 tx=0x7f11c4006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 msgr2=0x7f11d410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f11d002a6d0 tx=0x7f11d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 shutdown_connections 2024-09-13T02:43:41.733 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f11c0039670 0x7f11c003bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 --2- 172.21.15.122:0/3980109611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11d41010e0 0x7f11d410d930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:41.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 >> 172.21.15.122:0/3980109611 conn(0x7f11d40710b0 msgr2=0x7f11d4102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:41.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 shutdown_connections 2024-09-13T02:43:41.734 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:41.732+0000 7f11dc6f3640 1 -- 172.21.15.122:0/3980109611 wait complete. 2024-09-13T02:43:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:42 smithi100 ceph-mon[27894]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:42 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3980109611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:43.403 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:43.403 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:43.757 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:44.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:44.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:44.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:43 smithi100 ceph-mon[27894]: Deploying daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:43:45.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:44 smithi100 ceph-mon[27894]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:46.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 -- 172.21.15.122:0/1401929200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 msgr2=0x7f19dc1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:46.296 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 --2- 172.21.15.122:0/1401929200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc1025b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19cc004850 tx=0x7f19cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 -- 172.21.15.122:0/1401929200 shutdown_connections 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 --2- 172.21.15.122:0/1401929200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc1025b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 -- 172.21.15.122:0/1401929200 >> 172.21.15.122:0/1401929200 conn(0x7f19dc0f7d90 msgr2=0x7f19dc0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 -- 172.21.15.122:0/1401929200 shutdown_connections 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.087+0000 7f19e4048640 1 -- 172.21.15.122:0/1401929200 wait complete. 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e4048640 1 Processor -- start 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e4048640 1 -- start start 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e4048640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e4048640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc112cc0 con 0x7f19dc1021e0 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e1de4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e1de4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.122:33740/0 (socket says 172.21.15.122:33740) 2024-09-13T02:43:46.297 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.088+0000 7f19e1de4640 1 -- 172.21.15.122:0/605913946 learned_addr learned my addr 172.21.15.122:0/605913946 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19e1de4640 1 -- 172.21.15.122:0/605913946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc005040 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19e1de4640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02a6d0 tx=0x7f19cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19cc02cf10 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19cc033ad0 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc112ec0 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19cc03ebb0 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.089+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc113390 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.090+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f19cc030020 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.090+0000 7f19d27fc640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 0x7f19c803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.090+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f19cc06c550 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.091+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc113390 con 0x7f19dc1021e0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.091+0000 7f19e15e3640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 0x7f19c803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.091+0000 7f19e15e3640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 0x7f19c803bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19d8006fd0 tx=0x7f19d8006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:46.298 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.096+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f19dc113390 con 0x7f19dc1021e0 2024-09-13T02:43:46.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.343+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f19dc113390 con 0x7f19dc1021e0 2024-09-13T02:43:46.345 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.344+0000 7f19d27fc640 1 -- 172.21.15.122:0/605913946 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f19dc113390 con 0x7f19dc1021e0 2024-09-13T02:43:46.345 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:46.346 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:41:18.575466Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:43:46.346 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 msgr2=0x7f19c803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 0x7f19c803bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19d8006fd0 tx=0x7f19d8006db0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 msgr2=0x7f19dc112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02a6d0 tx=0x7f19cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 shutdown_connections 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19c8039670 0x7f19c803bb20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 --2- 172.21.15.122:0/605913946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19dc1021e0 0x7f19dc112780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 >> 172.21.15.122:0/605913946 conn(0x7f19dc0f7d90 msgr2=0x7f19dc0f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 shutdown_connections 2024-09-13T02:43:46.348 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:46.346+0000 7f19e4048640 1 -- 172.21.15.122:0/605913946 wait complete. 2024-09-13T02:43:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: Deploying daemon mon.smithi122 on smithi122 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/605913946' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:47.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:47 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:47.942 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:43:47.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:43:48.593 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:43:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:49 smithi100 ceph-mon[27894]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:43:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: mon.smithi100 calling monitor election 2024-09-13T02:43:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: mon.smithi122 calling monitor election 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: mon.smithi100 is new leader, mons smithi100,smithi122 in quorum (ranks 0,1) 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: monmap e2: 2 mons at {smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],smithi122=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: fsmap 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:43:56.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: mgrmap e17: smithi100.lhjyck(active, since 34s) 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: overall HEALTH_OK 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:56.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:55 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:57.019 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:57.019 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: mgrmap e18: smithi100.lhjyck(active, since 34s), standbys: smithi122.ptcenr 2024-09-13T02:43:57.019 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:43:57.019 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:57.019 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:57.020 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:56 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:57.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 -- 172.21.15.122:0/3518526849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 msgr2=0x7fb2d80085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:57.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/3518526849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2d80085c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00fc1b0 tx=0x7fb2ec002040 comp rx=0 tx=0).stop 2024-09-13T02:43:57.091 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 -- 172.21.15.122:0/3518526849 shutdown_connections 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/3518526849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2d80085c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 -- 172.21.15.122:0/3518526849 >> 172.21.15.122:0/3518526849 conn(0x7fb2f00f6c90 msgr2=0x7fb2f00f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 -- 172.21.15.122:0/3518526849 shutdown_connections 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.089+0000 7fb2f6d63640 1 -- 172.21.15.122:0/3518526849 wait complete. 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 Processor -- start 2024-09-13T02:43:57.092 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 -- start start 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2f01128e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01133e0 con 0x7fb2d8006160 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.090+0000 7fb2f6d63640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0113520 con 0x7fb2f0112e20 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:59496/0 (socket says 172.21.15.122:59496) 2024-09-13T02:43:57.095 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 -- 172.21.15.122:0/2413136095 learned_addr learned my addr 172.21.15.122:0/2413136095 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f4aff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2f01128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 -- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 msgr2=0x7fb2f010c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 -- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 msgr2=0x7fb2f010c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e7fff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f4aff640 1 -- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 msgr2=0x7fb2f010c880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f4aff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f4aff640 1 -- 172.21.15.122:0/2413136095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec005040 con 0x7fb2d8006160 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f4aff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2f01128e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00fc1b0 tx=0x7fb2ec02d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:57.096 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ec02be00 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f010ce80 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2ec00f040 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2ec03e7a0 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.091+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f010d3a0 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.092+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f00fc830 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.093+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fb2ec03e900 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.093+0000 7fb2e57fa640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 0x7fb2dc071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.093+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb2ec0af0b0 con 0x7fb2d8006160 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.093+0000 7fb2e7fff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 0x7fb2dc071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:43:57.097 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.094+0000 7fb2e7fff640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 0x7fb2dc071280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:43:57.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.098+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb2ec07d2b0 con 0x7fb2d8006160 2024-09-13T02:43:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: mgrmap e18: smithi100.lhjyck(active, since 34s), standbys: smithi122.ptcenr 2024-09-13T02:43:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:43:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:43:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:56 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:43:57.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.315+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb2f004b720 con 0x7fb2d8006160 2024-09-13T02:43:57.317 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.316+0000 7fb2e57fa640 1 -- 172.21.15.122:0/2413136095 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7fb2ec031090 con 0x7fb2d8006160 2024-09-13T02:43:57.318 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:43:57.318 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","modified":"2024-09-13T02:43:50.646765Z","created":"2024-09-13T02:41:18.575466Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi122","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T02:43:57.318 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-09-13T02:43:57.319 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 msgr2=0x7fb2dc071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 0x7fb2dc071280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 msgr2=0x7fb2f01128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2f01128e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00fc1b0 tx=0x7fb2ec02d040 comp rx=0 tx=0).stop 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 shutdown_connections 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb2dc06edd0 0x7fb2dc071280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2f0112e20 0x7fb2f010c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 --2- 172.21.15.122:0/2413136095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2d8006160 0x7fb2f01128e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 >> 172.21.15.122:0/2413136095 conn(0x7fb2f00f6c90 msgr2=0x7fb2f01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 shutdown_connections 2024-09-13T02:43:57.320 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:43:57.318+0000 7fb2f6d63640 1 -- 172.21.15.122:0/2413136095 wait complete. 2024-09-13T02:43:57.917 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:57 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/2413136095' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:57.941 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T02:43:57.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T02:43:58.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:57 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/2413136095' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:43:58.212 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:43:59.373 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:59.373 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:43:59.374 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:43:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:43:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:43:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:43:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:43:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- 172.21.15.100:0/3908720435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 msgr2=0x7f0364101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 --2- 172.21.15.100:0/3908720435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f0364101440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0354009bd0 tx=0x7f0354004d10 comp rx=0 tx=0).stop 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- 172.21.15.100:0/3908720435 shutdown_connections 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 --2- 172.21.15.100:0/3908720435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f0364101440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- 172.21.15.100:0/3908720435 >> 172.21.15.100:0/3908720435 conn(0x7f0364071040 msgr2=0x7f0364071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- 172.21.15.100:0/3908720435 shutdown_connections 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- 172.21.15.100:0/3908720435 wait complete. 2024-09-13T02:44:00.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 Processor -- start 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.029+0000 7f036bb6d640 1 -- start start 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f036410dd20 0x7f036410e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03641168e0 con 0x7f0364101070 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364116a20 con 0x7f036410dd20 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58236/0 (socket says 172.21.15.100:58236) 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 -- 172.21.15.100:0/1269638650 learned_addr learned my addr 172.21.15.100:0/1269638650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 -- 172.21.15.100:0/1269638650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f036410dd20 msgr2=0x7f036410e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f036410dd20 0x7f036410e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 -- 172.21.15.100:0/1269638650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540098b0 con 0x7f0364101070 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f0369909640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0354009c30 tx=0x7f0354004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0354008f00 con 0x7f0364101070 2024-09-13T02:44:00.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0354032d20 con 0x7f0364101070 2024-09-13T02:44:00.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0364116c20 con 0x7f0364101070 2024-09-13T02:44:00.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035403dde0 con 0x7f0364101070 2024-09-13T02:44:00.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.030+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0364117190 con 0x7f0364101070 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.031+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03640fc7e0 con 0x7f0364101070 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.032+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f035402f030 con 0x7f0364101070 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.032+0000 7f03627fc640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 0x7f034c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.032+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f03540ae400 con 0x7f0364101070 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.032+0000 7f0369108640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 0x7f034c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.033+0000 7f0369108640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 0x7f034c0712c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0358006fd0 tx=0x7f0358006d50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:00.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.036+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f035407c680 con 0x7f0364101070 2024-09-13T02:44:00.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:00 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:44:00.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:00 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:44:00.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:00 smithi100 ceph-mon[27894]: Reconfiguring mon.smithi100 (unknown last config time)... 2024-09-13T02:44:00.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:00 smithi100 ceph-mon[27894]: Reconfiguring daemon mon.smithi100 on smithi100 2024-09-13T02:44:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.198+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f036405ed70 con 0x7f0364101070 2024-09-13T02:44:00.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.199+0000 7f03627fc640 1 -- 172.21.15.100:0/1269638650 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f03540adbb0 con 0x7f0364101070 2024-09-13T02:44:00.200 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:44:00.200 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-13T02:44:00.200 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:44:00.200 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-09-13T02:44:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 msgr2=0x7f034c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 0x7f034c0712c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0358006fd0 tx=0x7f0358006d50 comp rx=0 tx=0).stop 2024-09-13T02:44:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 msgr2=0x7f036410d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0354009c30 tx=0x7f0354004d10 comp rx=0 tx=0).stop 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 shutdown_connections 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f034c06ee10 0x7f034c0712c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f036410dd20 0x7f036410e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 --2- 172.21.15.100:0/1269638650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0364101070 0x7f036410d7e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 >> 172.21.15.100:0/1269638650 conn(0x7f0364071040 msgr2=0x7f03640fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 shutdown_connections 2024-09-13T02:44:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:00.201+0000 7f036bb6d640 1 -- 172.21.15.100:0/1269638650 wait complete. 2024-09-13T02:44:00.337 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:00 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:44:00.337 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:00 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:44:00.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:00 smithi122 ceph-mon[34559]: Reconfiguring mon.smithi100 (unknown last config time)... 2024-09-13T02:44:00.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:00 smithi122 ceph-mon[34559]: Reconfiguring daemon mon.smithi100 on smithi100 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1269638650' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:44:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:44:01.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1269638650' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:01.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:01.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:01.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:44:01.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:44:01.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:01.653 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T02:44:01.653 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:44:01.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:44:01.680 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:44:01.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:44:01.749 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:44:01.750 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:44:01.778 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:44:01.778 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:44:01.843 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T02:44:01.843 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:44:01.843 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:44:01.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:44:01.860 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-13 02:43:15.576375691 +0000 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-13 02:37:34.981156573 +0000 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-13 02:37:34.981156573 +0000 2024-09-13T02:44:01.917 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-13 02:37:34.981156573 +0000 2024-09-13T02:44:01.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:44:01.989 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-13T02:44:01.989 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-13T02:44:01.989 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000212434 s, 2.4 MB/s 2024-09-13T02:44:01.991 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:44:02.048 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-13 02:43:15.577375666 +0000 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-13 02:37:35.321147723 +0000 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-13 02:37:35.321147723 +0000 2024-09-13T02:44:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-13 02:37:35.321147723 +0000 2024-09-13T02:44:02.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:44:02.168 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-13T02:44:02.168 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-13T02:44:02.168 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00021323 s, 2.4 MB/s 2024-09-13T02:44:02.170 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:44:02.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:02 smithi122 ceph-mon[34559]: Reconfiguring mgr.smithi100.lhjyck (unknown last config time)... 2024-09-13T02:44:02.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:02 smithi122 ceph-mon[34559]: Reconfiguring daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:44:02.226 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-13T02:44:02.280 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-13 02:43:15.577375666 +0000 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-13 02:37:35.646139264 +0000 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-13 02:37:35.646139264 +0000 2024-09-13T02:44:02.281 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-13 02:37:35.646139264 +0000 2024-09-13T02:44:02.281 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:44:02.342 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:02 smithi100 ceph-mon[27894]: Reconfiguring mgr.smithi100.lhjyck (unknown last config time)... 2024-09-13T02:44:02.342 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:02 smithi100 ceph-mon[27894]: Reconfiguring daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:44:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-13T02:44:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-13T02:44:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000186321 s, 2.7 MB/s 2024-09-13T02:44:02.346 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:44:02.402 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-13 02:43:15.577375666 +0000 2024-09-13T02:44:02.457 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-13 02:37:35.991130285 +0000 2024-09-13T02:44:02.458 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-13 02:37:35.991130285 +0000 2024-09-13T02:44:02.458 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-13 02:37:35.991130285 +0000 2024-09-13T02:44:02.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:44:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-13T02:44:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-13T02:44:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000210692 s, 2.4 MB/s 2024-09-13T02:44:02.521 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:44:02.578 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:44:02.578 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:44:02.596 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:44:02.597 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-13T02:44:02.654 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 02:43:49.334971142 +0000 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 02:37:34.979566815 +0000 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 02:37:34.979566815 +0000 2024-09-13T02:44:02.655 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 02:37:34.979566815 +0000 2024-09-13T02:44:02.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:44:02.721 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T02:44:02.721 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T02:44:02.721 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000234224 s, 2.2 MB/s 2024-09-13T02:44:02.723 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:44:02.781 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-13T02:44:02.837 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:44:02.837 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:02.837 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T02:44:02.837 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:02.838 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:02.838 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 02:43:49.335971118 +0000 2024-09-13T02:44:02.838 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 02:37:35.309558721 +0000 2024-09-13T02:44:02.838 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 02:37:35.309558721 +0000 2024-09-13T02:44:02.838 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 02:37:35.309558721 +0000 2024-09-13T02:44:02.838 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:44:02.903 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T02:44:02.903 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T02:44:02.903 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000215153 s, 2.4 MB/s 2024-09-13T02:44:02.904 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:44:02.962 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 02:43:49.335971118 +0000 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 02:37:35.632550797 +0000 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 02:37:35.632550797 +0000 2024-09-13T02:44:03.018 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 02:37:35.632550797 +0000 2024-09-13T02:44:03.018 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:44:03.081 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T02:44:03.081 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T02:44:03.082 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000238536 s, 2.1 MB/s 2024-09-13T02:44:03.083 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:44:03.139 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 02:43:49.335971118 +0000 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 02:37:35.970542507 +0000 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 02:37:35.970542507 +0000 2024-09-13T02:44:03.195 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 02:37:35.970542507 +0000 2024-09-13T02:44:03.196 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:44:03.258 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T02:44:03.258 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T02:44:03.258 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000220894 s, 2.3 MB/s 2024-09-13T02:44:03.259 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:44:03.316 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-13T02:44:03.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:44:03.339 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:03 smithi100 ceph-mon[27894]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:03.339 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:03.339 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:03.339 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:44:03.339 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:03 smithi122 ceph-mon[34559]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:44:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:04 smithi100 ceph-mon[27894]: Reconfiguring crash.smithi100 (monmap changed)... 2024-09-13T02:44:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:04 smithi100 ceph-mon[27894]: Reconfiguring daemon crash.smithi100 on smithi100 2024-09-13T02:44:04.302 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:44:04.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:04 smithi122 ceph-mon[34559]: Reconfiguring crash.smithi100 (monmap changed)... 2024-09-13T02:44:04.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:04 smithi122 ceph-mon[34559]: Reconfiguring daemon crash.smithi100 on smithi100 2024-09-13T02:44:05.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:05 smithi100 ceph-mon[27894]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:05.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:05.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:05.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:05 smithi100 ceph-mon[27894]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2024-09-13T02:44:05.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:05 smithi100 ceph-mon[27894]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2024-09-13T02:44:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:05 smithi122 ceph-mon[34559]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:05 smithi122 ceph-mon[34559]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2024-09-13T02:44:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:05 smithi122 ceph-mon[34559]: Reconfiguring daemon alertmanager.smithi100 on smithi100 2024-09-13T02:44:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:07 smithi100 ceph-mon[27894]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:07 smithi122 ceph-mon[34559]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:09.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:09 smithi100 ceph-mon[27894]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:09 smithi122 ceph-mon[34559]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:10 smithi100 ceph-mon[27894]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:10 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:10 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:10 smithi100 ceph-mon[27894]: Reconfiguring grafana.smithi100 (dependencies changed)... 2024-09-13T02:44:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:10 smithi100 ceph-mon[27894]: Reconfiguring daemon grafana.smithi100 on smithi100 2024-09-13T02:44:11.328 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:44:11.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-13T02:44:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:10 smithi122 ceph-mon[34559]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:10 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:10 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:10 smithi122 ceph-mon[34559]: Reconfiguring grafana.smithi100 (dependencies changed)... 2024-09-13T02:44:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:10 smithi122 ceph-mon[34559]: Reconfiguring daemon grafana.smithi100 on smithi100 2024-09-13T02:44:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:44:13.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:12 smithi100 ceph-mon[27894]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:13.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:12 smithi122 ceph-mon[34559]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:15.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- 172.21.15.100:0/1195838498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 msgr2=0x7f2d8c101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:15.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 --2- 172.21.15.100:0/1195838498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c101ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2d800048d0 tx=0x7f2d80009da0 comp rx=0 tx=0).stop 2024-09-13T02:44:15.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- 172.21.15.100:0/1195838498 shutdown_connections 2024-09-13T02:44:15.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 --2- 172.21.15.100:0/1195838498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c101ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:15.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 --2- 172.21.15.100:0/1195838498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 0x7f2d8c0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- 172.21.15.100:0/1195838498 >> 172.21.15.100:0/1195838498 conn(0x7f2d8c0f6c00 msgr2=0x7f2d8c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- 172.21.15.100:0/1195838498 shutdown_connections 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- 172.21.15.100:0/1195838498 wait complete. 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 Processor -- start 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- start start 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 0x7f2d8c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c10e4d0 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d90929640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c10e640 con 0x7f2d8c0666f0 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d89d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:15.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d89d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32846/0 (socket says 172.21.15.100:32846) 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.159+0000 7f2d89d9b640 1 -- 172.21.15.100:0/2283427865 learned_addr learned my addr 172.21.15.100:0/2283427865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d8a59c640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 0x7f2d8c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d89d9b640 1 -- 172.21.15.100:0/2283427865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 msgr2=0x7f2d8c10d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d89d9b640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 0x7f2d8c10d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d89d9b640 1 -- 172.21.15.100:0/2283427865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80005040 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d89d9b640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d800048a0 tx=0x7f2d80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d80038070 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d80032d30 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c10e8c0 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d8003dc80 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.160+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c10ed80 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.161+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c0fa8a0 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.162+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f2d80030020 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.162+0000 7f2d7affd640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 0x7f2d74071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.162+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2d800adc00 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.162+0000 7f2d8a59c640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 0x7f2d74071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.162+0000 7f2d8a59c640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 0x7f2d74071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006fd0 tx=0x7f2d7c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:15.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.166+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2d800b4080 con 0x7f2d8c0ff6f0 2024-09-13T02:44:15.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:15.340+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d8c10efa0 con 0x7f2d7406ecc0 2024-09-13T02:44:15.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:14 smithi100 ceph-mon[27894]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:15.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:14 smithi122 ceph-mon[34559]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:16.232 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:44:16.232 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:44:16.232 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:16.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:44:16.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:44:16.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:17.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:17 smithi100 ceph-mon[27894]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:17.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:17 smithi100 ceph-mon[27894]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:17 smithi122 ceph-mon[34559]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:17 smithi122 ceph-mon[34559]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:19.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:18 smithi100 ceph-mon[27894]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:19.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:19.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:19.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:18 smithi100 ceph-mon[27894]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:44:19.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:18 smithi100 ceph-mon[27894]: Reconfiguring daemon prometheus.smithi100 on smithi100 2024-09-13T02:44:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:18 smithi122 ceph-mon[34559]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:18 smithi122 ceph-mon[34559]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:44:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:18 smithi122 ceph-mon[34559]: Reconfiguring daemon prometheus.smithi100 on smithi100 2024-09-13T02:44:20.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:19 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1701371222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5f6e881-cfda-48aa-8b89-a283f4eafdf8"}]: dispatch 2024-09-13T02:44:20.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:19 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1701371222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5f6e881-cfda-48aa-8b89-a283f4eafdf8"}]': finished 2024-09-13T02:44:20.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:19 smithi100 ceph-mon[27894]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:44:20.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:20.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:19 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3216558153' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:44:20.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:19 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1701371222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5f6e881-cfda-48aa-8b89-a283f4eafdf8"}]: dispatch 2024-09-13T02:44:20.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:19 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1701371222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5f6e881-cfda-48aa-8b89-a283f4eafdf8"}]': finished 2024-09-13T02:44:20.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:19 smithi122 ceph-mon[34559]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:44:20.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:20.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:19 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3216558153' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:44:21.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:20 smithi100 ceph-mon[27894]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:21.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:20 smithi122 ceph-mon[34559]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:22.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:22.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:23.367 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:23 smithi100 ceph-mon[27894]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:23.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:23 smithi122 ceph-mon[34559]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:25.278 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:25 smithi100 ceph-mon[27894]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:25.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:25 smithi122 ceph-mon[34559]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:27.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:27 smithi100 ceph-mon[27894]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:27 smithi122 ceph-mon[34559]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:29.141 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:29 smithi100 ceph-mon[27894]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:29.141 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:29.141 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:29.141 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:44:29.141 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:29.321 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:29 smithi122 ceph-mon[34559]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:29.321 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:29.321 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:29.321 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:44:29.321 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:30.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: Reconfiguring crash.smithi122 (monmap changed)... 2024-09-13T02:44:30.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: Reconfiguring daemon crash.smithi122 on smithi122 2024-09-13T02:44:30.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:44:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:30 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: Reconfiguring crash.smithi122 (monmap changed)... 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: Reconfiguring daemon crash.smithi122 on smithi122 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:44:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:30 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:31.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:31 smithi100 ceph-mon[27894]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:31.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:31 smithi100 ceph-mon[27894]: Deploying daemon osd.0 on smithi100 2024-09-13T02:44:31.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:31 smithi100 ceph-mon[27894]: Reconfiguring mgr.smithi122.ptcenr (monmap changed)... 2024-09-13T02:44:31.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:31 smithi100 ceph-mon[27894]: Reconfiguring daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:44:31.319 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:31 smithi122 ceph-mon[34559]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:31.319 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:31 smithi122 ceph-mon[34559]: Deploying daemon osd.0 on smithi100 2024-09-13T02:44:31.319 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:31 smithi122 ceph-mon[34559]: Reconfiguring mgr.smithi122.ptcenr (monmap changed)... 2024-09-13T02:44:31.319 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:31 smithi122 ceph-mon[34559]: Reconfiguring daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: Reconfiguring mon.smithi122 (monmap changed)... 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:32.487 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:32 smithi122 ceph-mon[34559]: Reconfiguring daemon mon.smithi122 on smithi122 2024-09-13T02:44:32.506 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:32.506 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:32.507 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: Reconfiguring mon.smithi122 (monmap changed)... 2024-09-13T02:44:32.507 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:44:32.507 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:44:32.507 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:32.507 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:32 smithi100 ceph-mon[27894]: Reconfiguring daemon mon.smithi122 on smithi122 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:33 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:33 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:44:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:44:34.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:44:34.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:44:34.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:44:34.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:34 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:44:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:44:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:44:34.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:44:34.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi100.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:44:34.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:44:34.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:34 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi100.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:44:35.501 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:35 smithi100 ceph-mon[27894]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:35.501 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:35.501 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:35 smithi122 ceph-mon[34559]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:35 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:35 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:37.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:37 smithi100 ceph-mon[27894]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:37.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:37.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:37.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:37 smithi122 ceph-mon[34559]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:39.354 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:39 smithi100 ceph-mon[27894]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:39 smithi122 ceph-mon[34559]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:40.262 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2024-09-13T02:44:40.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.259+0000 7f2d7affd640 1 -- 172.21.15.100:0/2283427865 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2d8c10efa0 con 0x7f2d7406ecc0 2024-09-13T02:44:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 msgr2=0x7f2d74071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 0x7f2d74071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006fd0 tx=0x7f2d7c008040 comp rx=0 tx=0).stop 2024-09-13T02:44:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 msgr2=0x7f2d8c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d800048a0 tx=0x7f2d80009da0 comp rx=0 tx=0).stop 2024-09-13T02:44:40.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 shutdown_connections 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2d7406ecc0 0x7f2d74071170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d8c0ff6f0 0x7f2d8c10d660 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 --2- 172.21.15.100:0/2283427865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d8c0666f0 0x7f2d8c10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 >> 172.21.15.100:0/2283427865 conn(0x7f2d8c0f6c00 msgr2=0x7f2d8c0f7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 shutdown_connections 2024-09-13T02:44:40.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:40.262+0000 7f2d90929640 1 -- 172.21.15.100:0/2283427865 wait complete. 2024-09-13T02:44:40.611 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:40.612 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:40 smithi100 ceph-mon[27894]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:44:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:40.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:40.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:40.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:40 smithi122 ceph-mon[34559]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:44:40.911 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T02:44:40.914 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-13T02:44:40.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:41.631 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-mon[27894]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:44:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:44:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:44:41.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:44:41.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:41.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:41 smithi122 ceph-mon[34559]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:44:41.909 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[46603]: 2024-09-13T02:44:41.629+0000 7fa725048640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T02:44:41.910 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:44:41 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[46603]: 2024-09-13T02:44:41.632+0000 7fa71fe7f640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:44:42.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:42.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:42.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:42.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:44:42.810 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:44:42.811 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:42.811 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:42.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:42.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:42.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:42.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: from='osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:44:42.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:44:42.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:42.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:43 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:44:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:43 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:44:43.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:43 smithi100 ceph-mon[27894]: osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] boot 2024-09-13T02:44:43.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:43 smithi100 ceph-mon[27894]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:44:43.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:43.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:43 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:44:43.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:43 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:44:43.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:43 smithi122 ceph-mon[34559]: osd.0 [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] boot 2024-09-13T02:44:43.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:43 smithi122 ceph-mon[34559]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:44:43.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:44:44.802 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:44 smithi100 ceph-mon[27894]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:44.803 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:44 smithi100 ceph-mon[27894]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:44:44.808 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:44:44.829 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-13T02:44:44.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:44 smithi122 ceph-mon[34559]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:44:44.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:44 smithi122 ceph-mon[34559]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:44:45.189 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:44:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:46 smithi122 ceph-mon[34559]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:46.864 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:46 smithi100 ceph-mon[27894]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:47.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.969+0000 7fb46ccb7640 1 -- 172.21.15.100:0/1445462756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 msgr2=0x7fb468101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.969+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/1445462756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb468101b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0048d0 tx=0x7fb45c009da0 comp rx=0 tx=0).stop 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- 172.21.15.100:0/1445462756 shutdown_connections 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/1445462756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb468101b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/1445462756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 0x7fb4680ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- 172.21.15.100:0/1445462756 >> 172.21.15.100:0/1445462756 conn(0x7fb4680f6c10 msgr2=0x7fb4680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- 172.21.15.100:0/1445462756 shutdown_connections 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- 172.21.15.100:0/1445462756 wait complete. 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 Processor -- start 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- start start 2024-09-13T02:44:47.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 0x7fb46810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46810dc20 con 0x7fb4680ff740 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb46ccb7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46810e3f0 con 0x7fb468065b80 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb465d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb465d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38870/0 (socket says 172.21.15.100:38870) 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.970+0000 7fb465d9b640 1 -- 172.21.15.100:0/4202818898 learned_addr learned my addr 172.21.15.100:0/4202818898 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb46659c640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 0x7fb46810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb465d9b640 1 -- 172.21.15.100:0/4202818898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 msgr2=0x7fb46810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb465d9b640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 0x7fb46810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:44:47.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb465d9b640 1 -- 172.21.15.100:0/4202818898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c005040 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb465d9b640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb45c003080 tx=0x7fb45c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c038070 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46810e620 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb45c02abd0 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c03e670 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.971+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46810ebc0 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.972+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4680fa890 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.973+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fb45c030020 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.973+0000 7fb456ffd640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 0x7fb450071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.973+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fb45c0ad620 con 0x7fb4680ff740 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.973+0000 7fb46659c640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 0x7fb450071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.974+0000 7fb46659c640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 0x7fb450071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4680658e0 tx=0x7fb458009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:44:47.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:47.977+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb45c07b670 con 0x7fb4680ff740 2024-09-13T02:44:48.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:44:48.151+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb46810eef0 con 0x7fb45006ecc0 2024-09-13T02:44:49.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:44:49.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:44:49.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:50.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:50 smithi100 ceph-mon[27894]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:50 smithi122 ceph-mon[34559]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:51.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi100 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:44:53.248 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi100 to 12863M 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:53.249 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:52 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2925826696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fa6f0a5-199f-452f-a231-8117e593e81c"}]: dispatch 2024-09-13T02:44:53.335 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:53.335 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi100 2024-09-13T02:44:53.335 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi100 to 12863M 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:44:53.336 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:52 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2925826696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4fa6f0a5-199f-452f-a231-8117e593e81c"}]: dispatch 2024-09-13T02:44:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2925826696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fa6f0a5-199f-452f-a231-8117e593e81c"}]': finished 2024-09-13T02:44:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:44:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:44:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/895667556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:44:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2925826696' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4fa6f0a5-199f-452f-a231-8117e593e81c"}]': finished 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/895667556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:55.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:55 smithi100 ceph-mon[27894]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:55.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:55 smithi122 ceph-mon[34559]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:57.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:57 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:57.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:57.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:57.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:57.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:44:57.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:44:57.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:57 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:44:59.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:44:59 smithi100 ceph-mon[27894]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:44:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:44:59 smithi122 ceph-mon[34559]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:01.359 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:01 smithi100 ceph-mon[27894]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:01.359 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:45:01.359 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:01 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:01.359 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:01 smithi100 ceph-mon[27894]: Deploying daemon osd.1 on smithi100 2024-09-13T02:45:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:01 smithi122 ceph-mon[34559]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:45:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:01 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:01 smithi122 ceph-mon[34559]: Deploying daemon osd.1 on smithi100 2024-09-13T02:45:03.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:03 smithi100 ceph-mon[27894]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:03.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:03 smithi122 ceph-mon[34559]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:05.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:05 smithi100 ceph-mon[27894]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:05.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:05.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:05.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:05.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:05 smithi122 ceph-mon[34559]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:05.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:05.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:05.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:07.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:07 smithi100 ceph-mon[27894]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:07.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:07 smithi122 ceph-mon[34559]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:08.401 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2024-09-13T02:45:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.400+0000 7fb456ffd640 1 -- 172.21.15.100:0/4202818898 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb46810eef0 con 0x7fb45006ecc0 2024-09-13T02:45:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 msgr2=0x7fb450071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 0x7fb450071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4680658e0 tx=0x7fb458009040 comp rx=0 tx=0).stop 2024-09-13T02:45:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 msgr2=0x7fb46810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb45c003080 tx=0x7fb45c009da0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 shutdown_connections 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb45006ecc0 0x7fb450071170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4680ff740 0x7fb46810d5d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 --2- 172.21.15.100:0/4202818898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb468065b80 0x7fb46810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 >> 172.21.15.100:0/4202818898 conn(0x7fb4680f6c10 msgr2=0x7fb4680f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 shutdown_connections 2024-09-13T02:45:08.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:08.402+0000 7fb46ccb7640 1 -- 172.21.15.100:0/4202818898 wait complete. 2024-09-13T02:45:09.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:09 smithi100 ceph-mon[27894]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:09.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:09 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:09.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:09 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:09.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:09 smithi100 ceph-mon[27894]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:45:09.334 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T02:45:09.337 INFO:tasks.cephadm:Deploying osd.2 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-13T02:45:09.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:45:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:09 smithi122 ceph-mon[34559]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:09.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:09 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:09.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:09 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:09.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:09 smithi122 ceph-mon[34559]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:45:09.756 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:45:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-mon[27894]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:45:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-mon[27894]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:45:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-mon[27894]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:45:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-mon[27894]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:10.677 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[54438]: 2024-09-13T02:45:10.410+0000 7f4a344b9640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T02:45:10.677 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:10 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[54438]: 2024-09-13T02:45:10.417+0000 7f4a2f2f0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:45:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:10 smithi122 ceph-mon[34559]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:45:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:10 smithi122 ceph-mon[34559]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:45:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:10 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:10 smithi122 ceph-mon[34559]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:45:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:10 smithi122 ceph-mon[34559]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:45:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:11 smithi100 ceph-mon[27894]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:45:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:11 smithi100 ceph-mon[27894]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:45:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:11 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:11.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:11 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:11 smithi122 ceph-mon[34559]: from='osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:45:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:11 smithi122 ceph-mon[34559]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:45:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:11 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:11 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] boot 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:12.555 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:12 smithi100 ceph-mon[27894]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:45:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:45:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: osd.1 [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] boot 2024-09-13T02:45:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:45:12.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:45:12.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:12 smithi122 ceph-mon[34559]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:13.533 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:13 smithi100 ceph-mon[27894]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:45:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:13 smithi122 ceph-mon[34559]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:45:14.247 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:45:14.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-13T02:45:14.557 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:14 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:14.557 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:14 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:14.557 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:14 smithi100 ceph-mon[27894]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:14 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:14 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:14 smithi122 ceph-mon[34559]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:15.389 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:45:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:16 smithi122 ceph-mon[34559]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:16.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:16 smithi100 ceph-mon[27894]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:17.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 -- 172.21.15.100:0/755991851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 msgr2=0x7f6bbc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/755991851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fcb70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40048d0 tx=0x7f6ba4009da0 comp rx=0 tx=0).stop 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 -- 172.21.15.100:0/755991851 shutdown_connections 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/755991851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fcb70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/755991851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 0x7f6bbc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 -- 172.21.15.100:0/755991851 >> 172.21.15.100:0/755991851 conn(0x7f6bbc0f6c10 msgr2=0x7f6bbc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 -- 172.21.15.100:0/755991851 shutdown_connections 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.423+0000 7f6bc18eb640 1 -- 172.21.15.100:0/755991851 wait complete. 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 Processor -- start 2024-09-13T02:45:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 -- start start 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 0x7f6bbc0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0fe060 con 0x7f6bbc0fc700 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bc18eb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0fe1a0 con 0x7f6bbc0fb430 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54916/0 (socket says 172.21.15.100:54916) 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 -- 172.21.15.100:0/3522869420 learned_addr learned my addr 172.21.15.100:0/3522869420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bbaffd640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 0x7f6bbc0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 -- 172.21.15.100:0/3522869420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 msgr2=0x7f6bbc0ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 0x7f6bbc0ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.424+0000 7f6bb3fff640 1 -- 172.21.15.100:0/3522869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4005040 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bb3fff640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4003080 tx=0x7f6ba4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba4038070 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6ba402abd0 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0fe420 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba403e670 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.425+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc115100 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.426+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc04b720 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.426+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f6ba4030020 con 0x7f6bbc0fc700 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.427+0000 7f6bb37fe640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 0x7f6ba8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.427+0000 7f6bbaffd640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 0x7f6ba8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.427+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f6ba40ad7d0 con 0x7f6bbc0fc700 2024-09-13T02:45:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.427+0000 7f6bbaffd640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 0x7f6ba8071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ff300 tx=0x7f6bac009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.434+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6ba407b670 con 0x7f6bbc0fc700 2024-09-13T02:45:17.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:17.609+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc104030 con 0x7f6ba806ecc0 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi100 2024-09-13T02:45:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi100 to 6431M 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:18 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi100 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:18.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi100 to 6431M 2024-09-13T02:45:18.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:18.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:18.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:18.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:18 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:20 smithi100 ceph-mon[27894]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:21.038 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1494985121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d8800b-517c-40c1-b738-07bd0f42c46b"}]: dispatch 2024-09-13T02:45:21.038 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1494985121' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61d8800b-517c-40c1-b738-07bd0f42c46b"}]': finished 2024-09-13T02:45:21.038 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:20 smithi100 ceph-mon[27894]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:45:21.038 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:20 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:21.039 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:20 smithi122 ceph-mon[34559]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:21.039 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:20 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1494985121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d8800b-517c-40c1-b738-07bd0f42c46b"}]: dispatch 2024-09-13T02:45:21.039 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:20 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1494985121' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61d8800b-517c-40c1-b738-07bd0f42c46b"}]': finished 2024-09-13T02:45:21.039 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:20 smithi122 ceph-mon[34559]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:45:21.039 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:20 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:21.901 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:21 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2967085897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:21.902 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:21.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:21 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2967085897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:21.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:21 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:22 smithi100 ceph-mon[27894]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:22 smithi122 ceph-mon[34559]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:25.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:25.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:25.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:25.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:25.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:25.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:26.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:26 smithi100 ceph-mon[27894]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:27.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:26 smithi122 ceph-mon[34559]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:28.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:45:28.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:28.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:45:28.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:29.109 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:28 smithi100 ceph-mon[27894]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:29.109 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:28 smithi100 ceph-mon[27894]: Deploying daemon osd.2 on smithi100 2024-09-13T02:45:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:28 smithi122 ceph-mon[34559]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:28 smithi122 ceph-mon[34559]: Deploying daemon osd.2 on smithi100 2024-09-13T02:45:31.135 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:30 smithi100 ceph-mon[27894]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:31.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:30 smithi122 ceph-mon[34559]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:33.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:32 smithi100 ceph-mon[27894]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:33.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:33.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:33.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:32 smithi122 ceph-mon[34559]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:35.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:34 smithi100 ceph-mon[27894]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:35.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:34 smithi122 ceph-mon[34559]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:36.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.156+0000 7f6bb37fe640 1 -- 172.21.15.100:0/3522869420 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6bbc104030 con 0x7f6ba806ecc0 2024-09-13T02:45:36.159 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 2 on host 'smithi100' 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 msgr2=0x7f6ba8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 0x7f6ba8071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ff300 tx=0x7f6bac009120 comp rx=0 tx=0).stop 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 msgr2=0x7f6bbc0fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4003080 tx=0x7f6ba4009da0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 shutdown_connections 2024-09-13T02:45:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6ba806ecc0 0x7f6ba8071170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0fc700 0x7f6bbc0fda40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 --2- 172.21.15.100:0/3522869420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bbc0fb430 0x7f6bbc0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 >> 172.21.15.100:0/3522869420 conn(0x7f6bbc0f6c10 msgr2=0x7f6bbc065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 shutdown_connections 2024-09-13T02:45:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:45:36.159+0000 7f6bc18eb640 1 -- 172.21.15.100:0/3522869420 wait complete. 2024-09-13T02:45:37.101 DEBUG:teuthology.orchestra.run.smithi100:osd.2> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T02:45:37.104 INFO:tasks.cephadm:Deploying osd.3 on smithi122 with /dev/vg_nvme/lv_4... 2024-09-13T02:45:37.104 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:45:37.362 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:45:37.380 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:37 smithi100 ceph-mon[27894]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:37.380 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:37.380 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:37.380 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:37.381 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:37 smithi100 ceph-mon[27894]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:45:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:37 smithi122 ceph-mon[34559]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:37.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:37.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:37 smithi122 ceph-mon[34559]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:45:38.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-mon[27894]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:45:38.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-mon[27894]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:45:38.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:38.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-mon[27894]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:45:38.427 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[61834]: 2024-09-13T02:45:38.163+0000 7f8f30a29640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T02:45:38.427 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:38 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[61834]: 2024-09-13T02:45:38.169+0000 7f8f2a03b640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:45:38.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:38 smithi122 ceph-mon[34559]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:45:38.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:38 smithi122 ceph-mon[34559]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:45:38.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:38 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:38.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:38 smithi122 ceph-mon[34559]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:45:39.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:39 smithi122 ceph-mon[34559]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:39.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:39 smithi122 ceph-mon[34559]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:45:39.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:39 smithi122 ceph-mon[34559]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:45:39.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:39 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:39.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:39 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:39 smithi100 ceph-mon[27894]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:39 smithi100 ceph-mon[27894]: from='osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-13T02:45:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:39 smithi100 ceph-mon[27894]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:45:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:39 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:39.777 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:45:39.797 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-09-13T02:45:40.043 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:45:40.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] boot 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:40.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:40.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:40 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T02:45:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:45:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:45:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: osd.2 [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] boot 2024-09-13T02:45:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:45:40.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:45:40.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:40.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:40.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:40 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T02:45:41.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:41 smithi100 ceph-mon[27894]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:41.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T02:45:41.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:41 smithi100 ceph-mon[27894]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:45:41.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:45:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:41 smithi122 ceph-mon[34559]: pgmap v76: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:45:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T02:45:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:41 smithi122 ceph-mon[34559]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:45:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:45:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 -- 172.21.15.122:0/1042747750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 msgr2=0x7fd0e80ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:41.523 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/1042747750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e80ff1f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80048d0 tx=0x7fd0d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 -- 172.21.15.122:0/1042747750 shutdown_connections 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/1042747750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 0x7fd0e8101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/1042747750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e80ff1f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 -- 172.21.15.122:0/1042747750 >> 172.21.15.122:0/1042747750 conn(0x7fd0e80f6c20 msgr2=0x7fd0e80f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 -- 172.21.15.122:0/1042747750 shutdown_connections 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.493+0000 7fd0ef7da640 1 -- 172.21.15.122:0/1042747750 wait complete. 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 Processor -- start 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 -- start start 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 0x7fd0e810d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e810dd00 con 0x7fd0e80ff730 2024-09-13T02:45:41.524 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ef7da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e810e4d0 con 0x7fd0e8066610 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33036/0 (socket says 172.21.15.122:33036) 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 -- 172.21.15.122:0/2877799879 learned_addr learned my addr 172.21.15.122:0/2877799879 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ecd75640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 0x7fd0e810d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 -- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 msgr2=0x7fd0e810d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 0x7fd0e810d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 -- 172.21.15.122:0/2877799879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8005040 con 0x7fd0e8066610 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ed576640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80094f0 tx=0x7fd0d8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.494+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0d8038070 con 0x7fd0e8066610 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.495+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0d802ae90 con 0x7fd0e8066610 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.495+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e810e700 con 0x7fd0e8066610 2024-09-13T02:45:41.525 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.495+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0d803e430 con 0x7fd0e8066610 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.495+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e810eca0 con 0x7fd0e8066610 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.496+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80fa8a0 con 0x7fd0e8066610 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.496+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fd0d8030020 con 0x7fd0e8066610 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.496+0000 7fd0ddffb640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 0x7fd0d4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.497+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7fd0d80ad850 con 0x7fd0e8066610 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.497+0000 7fd0ecd75640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 0x7fd0d4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.497+0000 7fd0ecd75640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 0x7fd0d4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0e810cf20 tx=0x7fd0e400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:41.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.501+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd0d807b3c0 con 0x7fd0e8066610 2024-09-13T02:45:41.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:41.664+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0e810efd0 con 0x7fd0d406ecc0 2024-09-13T02:45:41.926 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:41 smithi100 sudo[66348]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:45:41.926 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:41 smithi100 sudo[66348]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:41.926 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:41 smithi100 sudo[66348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:41.926 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:41 smithi100 sudo[66348]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:42.334 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66355]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:45:42.334 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66355]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:42.334 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:42.335 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66355]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:42.665 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66362]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:45:42.665 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66362]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:42.665 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:42.665 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66362]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:42.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:45:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:45:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:42.919 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:45:42.919 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:42.919 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:42.919 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66459]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:43.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66492]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:45:43.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66492]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:43.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:43.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:42 smithi100 sudo[66492]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:43.440 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:45:43.440 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:43.440 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:43.440 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66527]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:43.440 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66530]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:45:43.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66530]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:43.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:43.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66530]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66533]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66533]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 sudo[66533]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:43.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:43.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:43.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:43.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:43 smithi100 ceph-mon[27894]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:45:43.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:45:43.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:43.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 ceph-mon[34559]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:45:44.181 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 sudo[37907]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:45:44.182 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 sudo[37907]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:44.182 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 sudo[37907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:44.182 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:43 smithi122 sudo[37907]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:44.190 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:44.189+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd0d802c2a0 con 0x7fd0e8066610 2024-09-13T02:45:44.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 sudo[37910]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:45:44.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 sudo[37910]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:45:44.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 sudo[37910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:45:44.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 sudo[37910]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:45:44.885 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi100 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi100 to 4287M 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: mgrmap e19: smithi100.lhjyck(active, since 2m), standbys: smithi122.ptcenr 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:44.886 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/3619106598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]: dispatch 2024-09-13T02:45:44.887 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]: dispatch 2024-09-13T02:45:44.887 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]': finished 2024-09-13T02:45:44.887 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T02:45:44.887 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:44 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:45:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi100 2024-09-13T02:45:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi100 to 4287M 2024-09-13T02:45:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: mgrmap e19: smithi100.lhjyck(active, since 2m), standbys: smithi122.ptcenr 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3619106598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]: dispatch 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57ef77cc-690a-4143-90c1-f5439dd84b6f"}]': finished 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T02:45:44.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:44 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:45:46.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:45 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/4213796626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:46.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:45 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/4213796626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:45:47.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:46 smithi100 ceph-mon[27894]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:47.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:46 smithi122 ceph-mon[34559]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:48 smithi122 ceph-mon[34559]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:49.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:48 smithi100 ceph-mon[27894]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:50.913 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:50 smithi122 ceph-mon[34559]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:50 smithi100 ceph-mon[27894]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:51.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:45:51.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:51.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:51 smithi122 ceph-mon[34559]: Deploying daemon osd.3 on smithi122 2024-09-13T02:45:51.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:45:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:51 smithi100 ceph-mon[27894]: Deploying daemon osd.3 on smithi122 2024-09-13T02:45:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:45:53.060 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:52 smithi122 ceph-mon[34559]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:52 smithi100 ceph-mon[27894]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:54.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:54 smithi100 ceph-mon[27894]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:55.011 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:54 smithi122 ceph-mon[34559]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:55.996 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:55 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:55.996 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:55 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:55.996 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:55 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:55 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:56.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:56 smithi122 ceph-mon[34559]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:57.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:56 smithi100 ceph-mon[27894]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:58.797 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:58 smithi122 ceph-mon[34559]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:59.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:58 smithi100 ceph-mon[27894]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:45:59.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.380+0000 7fd0ddffb640 1 -- 172.21.15.122:0/2877799879 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd0e810efd0 con 0x7fd0d406ecc0 2024-09-13T02:45:59.383 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 3 on host 'smithi122' 2024-09-13T02:45:59.384 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 msgr2=0x7fd0d4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 0x7fd0d4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0e810cf20 tx=0x7fd0e400b040 comp rx=0 tx=0).stop 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 msgr2=0x7fd0e810d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80094f0 tx=0x7fd0d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 shutdown_connections 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd0d406ecc0 0x7fd0d4071170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0e80ff730 0x7fd0e810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 --2- 172.21.15.122:0/2877799879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0e8066610 0x7fd0e810d170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 >> 172.21.15.122:0/2877799879 conn(0x7fd0e80f6c20 msgr2=0x7fd0e80f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 shutdown_connections 2024-09-13T02:45:59.385 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:45:59.382+0000 7fd0ef7da640 1 -- 172.21.15.122:0/2877799879 wait complete. 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:59.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:59.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:59.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:45:59.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:45:59.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:45:59 smithi122 ceph-mon[34559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:45:59.956 DEBUG:teuthology.orchestra.run.smithi122:osd.3> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T02:45:59.958 INFO:tasks.cephadm:Deploying osd.4 on smithi122 with /dev/vg_nvme/lv_3... 2024-09-13T02:45:59.958 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:46:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:46:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:45:59 smithi100 ceph-mon[27894]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:46:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:46:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:46:00.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:46:00.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:00.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: from='osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:00.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:00 smithi122 ceph-mon[34559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:01.007 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:46:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:46:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:46:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:46:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:01.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: from='osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:01.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:00 smithi100 ceph-mon[27894]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:01.487 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:46:01 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[39946]: 2024-09-13T02:46:01.390+0000 7f1e14e90640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T02:46:01.487 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:46:01 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[39946]: 2024-09-13T02:46:01.396+0000 7f1e10cc9640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:46:02.449 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:02 smithi122 ceph-mon[34559]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:02.449 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:02 smithi122 ceph-mon[34559]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:46:02.449 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:02 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:02.449 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:02 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:02.449 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:02 smithi122 ceph-mon[34559]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:46:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:02 smithi100 ceph-mon[27894]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:02 smithi100 ceph-mon[27894]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:46:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:02 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:02 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:02 smithi100 ceph-mon[27894]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:46:03.635 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] boot 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi122 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi122 to 15935M 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:03.636 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: osd.3 [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] boot 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi122 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi122 to 15935M 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:03.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:04.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:04 smithi122 ceph-mon[34559]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:46:04.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:04 smithi122 ceph-mon[34559]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:04.453 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:46:04.472 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-09-13T02:46:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:04 smithi100 ceph-mon[27894]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:46:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:04 smithi100 ceph-mon[27894]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:04.712 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:46:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:05 smithi100 ceph-mon[27894]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:46:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:05 smithi122 ceph-mon[34559]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:46:06.258 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 -- 172.21.15.122:0/1178879281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 msgr2=0x7f090c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 --2- 172.21.15.122:0/1178879281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c0fc960 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f09000048d0 tx=0x7f0900009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 -- 172.21.15.122:0/1178879281 shutdown_connections 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 --2- 172.21.15.122:0/1178879281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f090c0fd820 0x7f090c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 --2- 172.21.15.122:0/1178879281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c0fc960 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 -- 172.21.15.122:0/1178879281 >> 172.21.15.122:0/1178879281 conn(0x7f090c0f7d30 msgr2=0x7f090c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 -- 172.21.15.122:0/1178879281 shutdown_connections 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.244+0000 7f0913932640 1 -- 172.21.15.122:0/1178879281 wait complete. 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 Processor -- start 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 -- start start 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:06.259 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f090c0fd820 0x7f090c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c10dc70 con 0x7f090c0fd820 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f0913932640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c10e490 con 0x7f090c0fc550 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45832/0 (socket says 172.21.15.122:45832) 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 -- 172.21.15.122:0/2562911771 learned_addr learned my addr 172.21.15.122:0/2562911771 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 -- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f090c0fd820 msgr2=0x7f090c10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f090c0fd820 0x7f090c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 -- 172.21.15.122:0/2562911771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900005040 con 0x7f090c0fc550 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f09116ce640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f09000043d0 tx=0x7f0900009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.245+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0900038070 con 0x7f090c0fc550 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.246+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f090002ae90 con 0x7f090c0fc550 2024-09-13T02:46:06.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.246+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c10e6c0 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.246+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f090003e670 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.246+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c10ec60 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.247+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c0fb9b0 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.247+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0900030020 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.247+0000 7f08fdffb640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 0x7f08f8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.248+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f09000add80 con 0x7f090c0fc550 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.248+0000 7f0910ecd640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 0x7f08f8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.248+0000 7f0910ecd640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 0x7f08f8071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f090c10ce90 tx=0x7f0908009c50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:06.261 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.252+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f090007b540 con 0x7f090c0fc550 2024-09-13T02:46:06.414 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:06.413+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f090c10f040 con 0x7f08f806ed60 2024-09-13T02:46:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:06 smithi100 ceph-mon[27894]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:06 smithi122 ceph-mon[34559]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:07.657 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:07 smithi122 ceph-mon[34559]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:07.657 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:07.657 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:07.657 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:07.657 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:07 smithi100 ceph-mon[27894]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:08.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:08 smithi122 ceph-mon[34559]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:46:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:08 smithi100 ceph-mon[27894]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:46:09.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1416505915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]: dispatch 2024-09-13T02:46:09.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]: dispatch 2024-09-13T02:46:09.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]': finished 2024-09-13T02:46:09.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T02:46:09.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:09.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:09 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/899307626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:09.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/1416505915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]: dispatch 2024-09-13T02:46:09.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]: dispatch 2024-09-13T02:46:09.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb50fff9-3678-4137-b256-9f5c64e48f80"}]': finished 2024-09-13T02:46:09.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T02:46:09.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:09.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:09 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/899307626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:10.842 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:10 smithi100 ceph-mon[27894]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-13T02:46:10.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:10 smithi122 ceph-mon[34559]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-13T02:46:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:12 smithi122 ceph-mon[34559]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T02:46:12.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:12 smithi100 ceph-mon[27894]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T02:46:14.747 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:14 smithi122 ceph-mon[34559]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-13T02:46:14.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:14 smithi100 ceph-mon[27894]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-13T02:46:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:16 smithi122 ceph-mon[34559]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:46:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:46:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:16 smithi122 ceph-mon[34559]: Deploying daemon osd.4 on smithi122 2024-09-13T02:46:16.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:16 smithi100 ceph-mon[27894]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:46:16.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:46:16.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:16.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:16 smithi100 ceph-mon[27894]: Deploying daemon osd.4 on smithi122 2024-09-13T02:46:18.855 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:18 smithi122 ceph-mon[34559]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:18.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:18 smithi100 ceph-mon[27894]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:20.843 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:20 smithi122 ceph-mon[34559]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:20.844 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:20 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:20.844 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:20 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:20.844 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:20 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:20 smithi100 ceph-mon[27894]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:20 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:20 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:20 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:21.863 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:21.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:21 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:22.642 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:22 smithi122 ceph-mon[34559]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:22 smithi100 ceph-mon[27894]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:24.099 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.097+0000 7f08fdffb640 1 -- 172.21.15.122:0/2562911771 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f090c10f040 con 0x7f08f806ed60 2024-09-13T02:46:24.100 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 4 on host 'smithi122' 2024-09-13T02:46:24.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 msgr2=0x7f08f8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:24.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 0x7f08f8071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f090c10ce90 tx=0x7f0908009c50 comp rx=0 tx=0).stop 2024-09-13T02:46:24.102 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 msgr2=0x7f090c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f09000043d0 tx=0x7f0900009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 shutdown_connections 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f08f806ed60 0x7f08f8071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f090c0fd820 0x7f090c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 --2- 172.21.15.122:0/2562911771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f090c0fc550 0x7f090c10d0e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:24.103 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 >> 172.21.15.122:0/2562911771 conn(0x7f090c0f7d30 msgr2=0x7f090c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:24.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 shutdown_connections 2024-09-13T02:46:24.104 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:24.100+0000 7f0913932640 1 -- 172.21.15.122:0/2562911771 wait complete. 2024-09-13T02:46:24.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:46:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:24 smithi100 ceph-mon[27894]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:46:24.665 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:46:24.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:24 smithi122 ceph-mon[34559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:46:24.689 DEBUG:teuthology.orchestra.run.smithi122:osd.4> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T02:46:24.692 INFO:tasks.cephadm:Deploying osd.5 on smithi122 with /dev/vg_nvme/lv_2... 2024-09-13T02:46:24.692 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:46:25.754 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:46:26.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:26 smithi100 ceph-mon[27894]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:46:26.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:26 smithi100 ceph-mon[27894]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T02:46:26.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:26 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:26.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:26 smithi100 ceph-mon[27894]: from='osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:26.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:26 smithi100 ceph-mon[27894]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:26.427 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-mon[34559]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:46:26.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-mon[34559]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T02:46:26.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:26.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-mon[34559]: from='osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:26.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-mon[34559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:26.428 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[46576]: 2024-09-13T02:46:26.104+0000 7f5961fb7640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T02:46:26.428 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:46:26 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[46576]: 2024-09-13T02:46:26.111+0000 7f59595c5640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:46:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:27 smithi100 ceph-mon[27894]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:27 smithi100 ceph-mon[27894]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:27 smithi100 ceph-mon[27894]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T02:46:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:27.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:27 smithi122 ceph-mon[34559]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:27 smithi122 ceph-mon[34559]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:27 smithi122 ceph-mon[34559]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T02:46:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] boot 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T02:46:28.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:28 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:46:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:46:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: osd.4 [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] boot 2024-09-13T02:46:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T02:46:28.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:28 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:46:29.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:29.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T02:46:29.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:29.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:29.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:29.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:29.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:29.692 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T02:46:29.714 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-09-13T02:46:29.958 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:46:30.390 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:30 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi122 2024-09-13T02:46:30.390 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:30 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi122 to 7967M 2024-09-13T02:46:30.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:30 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi122 2024-09-13T02:46:30.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:30 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi122 to 7967M 2024-09-13T02:46:31.421 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:31 smithi122 ceph-mon[34559]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:31.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:31 smithi100 ceph-mon[27894]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:31.427 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- 172.21.15.122:0/862493367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 msgr2=0x7f26a40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/862493367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a40fb840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f26940048d0 tx=0x7f2694009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- 172.21.15.122:0/862493367 shutdown_connections 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/862493367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 0x7f26a40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/862493367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a40fb840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- 172.21.15.122:0/862493367 >> 172.21.15.122:0/862493367 conn(0x7f26a40f6c10 msgr2=0x7f26a40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- 172.21.15.122:0/862493367 shutdown_connections 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- 172.21.15.122:0/862493367 wait complete. 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 Processor -- start 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- start start 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 0x7f26a410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:31.428 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a410e490 con 0x7f26a40fc700 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.425+0000 7f26a9c4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a410e600 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:57662/0 (socket says 172.21.15.122:57662) 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 -- 172.21.15.122:0/2472731860 learned_addr learned my addr 172.21.15.122:0/2472731860 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f269bfff640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 0x7f26a410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 -- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 msgr2=0x7f26a410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 0x7f26a410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 -- 172.21.15.122:0/2472731860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694005040 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a37fe640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2694003080 tx=0x7f2694009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2694038070 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a410e880 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2694009800 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2694033660 con 0x7f26a40fb430 2024-09-13T02:46:31.429 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.426+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a410ed40 con 0x7f26a40fb430 2024-09-13T02:46:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.427+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a41046c0 con 0x7f26a40fb430 2024-09-13T02:46:31.430 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.428+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2694030020 con 0x7f26a40fb430 2024-09-13T02:46:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.428+0000 7f26a0ff9640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 0x7f2690071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.429+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f26940ade40 con 0x7f26a40fb430 2024-09-13T02:46:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.429+0000 7f269bfff640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 0x7f2690071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:31.431 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.429+0000 7f269bfff640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 0x7f2690071200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f268c006fd0 tx=0x7f268c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:31.434 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.433+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f269407b450 con 0x7f26a40fb430 2024-09-13T02:46:31.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:31.595+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a4103eb0 con 0x7f269006ed50 2024-09-13T02:46:32.308 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:32.308 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:32.309 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:32 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:32.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:46:32.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:46:32.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:32 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:33 smithi122 ceph-mon[34559]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:33.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:33 smithi122 ceph-mon[34559]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:33.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:33 smithi100 ceph-mon[27894]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:33.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:33 smithi100 ceph-mon[27894]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:34.413 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:34 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/2461178693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]: dispatch 2024-09-13T02:46:34.413 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:34 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]: dispatch 2024-09-13T02:46:34.413 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:34 smithi122 ceph-mon[34559]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]': finished 2024-09-13T02:46:34.413 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:34 smithi122 ceph-mon[34559]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T02:46:34.413 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:34 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/2461178693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]: dispatch 2024-09-13T02:46:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:34 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]: dispatch 2024-09-13T02:46:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:34 smithi100 ceph-mon[27894]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c5a9b2c-5c20-4d97-a061-068689c170d9"}]': finished 2024-09-13T02:46:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:34 smithi100 ceph-mon[27894]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T02:46:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:35 smithi100 ceph-mon[27894]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:35 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/3005987790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:35 smithi122 ceph-mon[34559]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:35 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/3005987790' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:46:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:37 smithi100 ceph-mon[27894]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:37 smithi122 ceph-mon[34559]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:39 smithi100 ceph-mon[27894]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:39.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:39 smithi122 ceph-mon[34559]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:41.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:41 smithi100 ceph-mon[27894]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:41.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:46:41.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:41 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:41 smithi122 ceph-mon[34559]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:46:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:41 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:42.351 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:42 smithi122 ceph-mon[34559]: Deploying daemon osd.5 on smithi122 2024-09-13T02:46:42.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:42 smithi100 ceph-mon[27894]: Deploying daemon osd.5 on smithi122 2024-09-13T02:46:43.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:43 smithi100 ceph-mon[27894]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:43.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:43 smithi122 ceph-mon[34559]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:45.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:45 smithi122 ceph-mon[34559]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:45.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:45 smithi100 ceph-mon[27894]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:46 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:46 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:46 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:46.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:46 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:46.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:46 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:46.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:46 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:47.341 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:47 smithi122 ceph-mon[34559]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:47 smithi100 ceph-mon[27894]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:49.043 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.042+0000 7f26a0ff9640 1 -- 172.21.15.122:0/2472731860 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f26a4103eb0 con 0x7f269006ed50 2024-09-13T02:46:49.044 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 5 on host 'smithi122' 2024-09-13T02:46:49.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 msgr2=0x7f2690071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:49.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 0x7f2690071200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f268c006fd0 tx=0x7f268c008040 comp rx=0 tx=0).stop 2024-09-13T02:46:49.045 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 msgr2=0x7f26a410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2694003080 tx=0x7f2694009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 shutdown_connections 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f269006ed50 0x7f2690071200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26a40fc700 0x7f26a410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 --2- 172.21.15.122:0/2472731860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26a40fb430 0x7f26a410d0e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 >> 172.21.15.122:0/2472731860 conn(0x7f26a40f6c10 msgr2=0x7f26a4065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 shutdown_connections 2024-09-13T02:46:49.046 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:46:49.044+0000 7f26a9c4b640 1 -- 172.21.15.122:0/2472731860 wait complete. 2024-09-13T02:46:49.409 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:49 smithi122 ceph-mon[34559]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:49.409 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:49 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:49.409 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:49 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:49 smithi100 ceph-mon[27894]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:49 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:49 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:50.081 DEBUG:teuthology.orchestra.run.smithi122:osd.5> sudo journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T02:46:50.083 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T02:46:50.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T02:46:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:46:50.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:50 smithi100 ceph-mon[27894]: from='osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:46:50.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:50 smithi100 ceph-mon[27894]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:46:50.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:50 smithi122 ceph-mon[34559]: from='osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:46:50.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:50 smithi122 ceph-mon[34559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:46:51.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:51.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:51.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:51.220 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[53424]: 2024-09-13T02:46:51.177+0000 7f1c29e03640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T02:46:51.220 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:46:51 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[53424]: 2024-09-13T02:46:51.184+0000 7f1c25c3c640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:46:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:46:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T02:46:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:51.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:51.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:46:51.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:51.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:51.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.968+0000 7f81c066a640 1 -- 172.21.15.100:0/257384461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 msgr2=0x7f81b80fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.968+0000 7f81c066a640 1 --2- 172.21.15.100:0/257384461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b80fad10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f81a80048d0 tx=0x7f81a8009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- 172.21.15.100:0/257384461 shutdown_connections 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 --2- 172.21.15.100:0/257384461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 0x7f81b80fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 --2- 172.21.15.100:0/257384461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b80fad10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- 172.21.15.100:0/257384461 >> 172.21.15.100:0/257384461 conn(0x7f81b80f6360 msgr2=0x7f81b80f8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- 172.21.15.100:0/257384461 shutdown_connections 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- 172.21.15.100:0/257384461 wait complete. 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 Processor -- start 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- start start 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 0x7f81b810d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:51.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b810ddc0 con 0x7f81b80fa900 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.969+0000 7f81c066a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b810e5e0 con 0x7f81b80fb250 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50866/0 (socket says 172.21.15.100:50866) 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 -- 172.21.15.100:0/1678155535 learned_addr learned my addr 172.21.15.100:0/1678155535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81bdc05640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 0x7f81b810d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 -- 172.21.15.100:0/1678155535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 msgr2=0x7f81b810d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 0x7f81b810d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 -- 172.21.15.100:0/1678155535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8005040 con 0x7f81b80fa900 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81be406640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f81a80043d0 tx=0x7f81a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a8038070 con 0x7f81b80fa900 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81a802ae90 con 0x7f81b80fa900 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b810e810 con 0x7f81b80fa900 2024-09-13T02:46:51.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a803e670 con 0x7f81b80fa900 2024-09-13T02:46:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.970+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b810edb0 con 0x7f81b80fa900 2024-09-13T02:46:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.971+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b805ed70 con 0x7f81b80fa900 2024-09-13T02:46:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.972+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f81a8030020 con 0x7f81b80fa900 2024-09-13T02:46:51.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.972+0000 7f81aeffd640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 0x7f81a4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.972+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f81a80ade60 con 0x7f81b80fa900 2024-09-13T02:46:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.972+0000 7f81bdc05640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 0x7f81a4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:51.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.973+0000 7f81bdc05640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 0x7f81a4071200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81b810cfe0 tx=0x7f81b400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:51.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:51.976+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f81a807b500 con 0x7f81b80fa900 2024-09-13T02:46:52.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.133+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f81b804b720 con 0x7f81b80fa900 2024-09-13T02:46:52.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.134+0000 7f81aeffd640 1 -- 172.21.15.100:0/1678155535 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f81a807aea0 con 0x7f81b80fa900 2024-09-13T02:46:52.136 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:46:52.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 msgr2=0x7f81a4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:52.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 0x7f81a4071200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81b810cfe0 tx=0x7f81b400b040 comp rx=0 tx=0).stop 2024-09-13T02:46:52.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 msgr2=0x7f81b810d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:52.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f81a80043d0 tx=0x7f81a8009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 shutdown_connections 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f81a406ed50 0x7f81a4071200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81b80fb250 0x7f81b810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 --2- 172.21.15.100:0/1678155535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80fa900 0x7f81b810d230 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 >> 172.21.15.100:0/1678155535 conn(0x7f81b80f6360 msgr2=0x7f81b80f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 shutdown_connections 2024-09-13T02:46:52.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:52.136+0000 7f81c066a640 1 -- 172.21.15.100:0/1678155535 wait complete. 2024-09-13T02:46:52.229 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:52.229 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T02:46:52.230 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:52.230 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:52.230 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:52.230 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:52 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1678155535' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:52.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:52 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1678155535' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:46:52.822 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726195587,"num_in_osds":6,"osd_in_since":1726195593,"num_remapped_pgs":0} 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: purged_snaps scrub starts 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: purged_snaps scrub ok 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] boot 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T02:46:53.297 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:53 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:53.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: purged_snaps scrub starts 2024-09-13T02:46:53.772 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: purged_snaps scrub ok 2024-09-13T02:46:53.773 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:46:53.773 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: osd.5 [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] boot 2024-09-13T02:46:53.773 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T02:46:53.773 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:53 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:46:53.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T02:46:54.070 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:54.451 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.452 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:54.452 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:54.452 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:54.452 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T02:46:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:46:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:46:55.448 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:55 smithi100 ceph-mon[27894]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:55.448 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:55 smithi100 ceph-mon[27894]: Detected new or changed devices on smithi122 2024-09-13T02:46:55.448 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:55 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi122 to 5311M 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- 172.21.15.100:0/294062818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 msgr2=0x7f9df80fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 --2- 172.21.15.100:0/294062818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df80fa680 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9df40048d0 tx=0x7f9df4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- 172.21.15.100:0/294062818 shutdown_connections 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 --2- 172.21.15.100:0/294062818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 0x7f9df8101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 --2- 172.21.15.100:0/294062818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df80fa680 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- 172.21.15.100:0/294062818 >> 172.21.15.100:0/294062818 conn(0x7f9df80f5f20 msgr2=0x7f9df80f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- 172.21.15.100:0/294062818 shutdown_connections 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- 172.21.15.100:0/294062818 wait complete. 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 Processor -- start 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- start start 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 0x7f9df810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df810dc20 con 0x7f9df80fa270 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.626+0000 7f9dff85a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df810e440 con 0x7f9df80fabc0 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50882/0 (socket says 172.21.15.100:50882) 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 -- 172.21.15.100:0/1636371610 learned_addr learned my addr 172.21.15.100:0/1636371610 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfcdf5640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 0x7f9df810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 -- 172.21.15.100:0/1636371610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 msgr2=0x7f9df810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:55.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 0x7f9df810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 -- 172.21.15.100:0/1636371610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4005040 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dfd5f6640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9df40043d0 tx=0x7f9df4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df4038070 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9df402ae90 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df810e670 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df403e670 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.627+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df810ec10 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.628+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df80f9bc0 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.629+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9df4030020 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.629+0000 7f9dedffb640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 0x7f9de40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.629+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9df40adf90 con 0x7f9df80fa270 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.629+0000 7f9dfcdf5640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 0x7f9de40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.630+0000 7f9dfcdf5640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 0x7f9de40712d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9df810ce40 tx=0x7f9de800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.633+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9df407b480 con 0x7f9df80fa270 2024-09-13T02:46:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:55 smithi122 ceph-mon[34559]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:55 smithi122 ceph-mon[34559]: Detected new or changed devices on smithi122 2024-09-13T02:46:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:55 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi122 to 5311M 2024-09-13T02:46:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.791+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9df810ef20 con 0x7f9df80fa270 2024-09-13T02:46:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.791+0000 7f9dedffb640 1 -- 172.21.15.100:0/1636371610 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f9df407ae20 con 0x7f9df80fa270 2024-09-13T02:46:55.793 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 msgr2=0x7f9de40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 0x7f9de40712d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9df810ce40 tx=0x7f9de800b040 comp rx=0 tx=0).stop 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 msgr2=0x7f9df810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9df40043d0 tx=0x7f9df4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 shutdown_connections 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9de406ee20 0x7f9de40712d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9df80fabc0 0x7f9df810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 --2- 172.21.15.100:0/1636371610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80fa270 0x7f9df810d090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 >> 172.21.15.100:0/1636371610 conn(0x7f9df80f5f20 msgr2=0x7f9df80fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 shutdown_connections 2024-09-13T02:46:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:55.794+0000 7f9dff85a640 1 -- 172.21.15.100:0/1636371610 wait complete. 2024-09-13T02:46:56.497 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:56 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1636371610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:46:56.523 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726195612,"num_in_osds":6,"osd_in_since":1726195593,"num_remapped_pgs":0} 2024-09-13T02:46:56.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:46:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:56 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1636371610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:46:56.810 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:46:57.645 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:57 smithi100 ceph-mon[27894]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:57 smithi122 ceph-mon[34559]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:58.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 -- 172.21.15.100:0/2698720319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd600fe460 msgr2=0x7fbd600fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 --2- 172.21.15.100:0/2698720319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd600fe460 0x7fbd600fe830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009c50 tx=0x7fbd50004d10 comp rx=0 tx=0).stop 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 -- 172.21.15.100:0/2698720319 shutdown_connections 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 --2- 172.21.15.100:0/2698720319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd60064fc0 0x7fbd60065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 --2- 172.21.15.100:0/2698720319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd600fe460 0x7fbd600fe830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 -- 172.21.15.100:0/2698720319 >> 172.21.15.100:0/2698720319 conn(0x7fbd600723b0 msgr2=0x7fbd600727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 -- 172.21.15.100:0/2698720319 shutdown_connections 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 -- 172.21.15.100:0/2698720319 wait complete. 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.516+0000 7fbd678c7640 1 Processor -- start 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 -- start start 2024-09-13T02:46:58.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd600fe460 0x7fbd601136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60113cf0 con 0x7fbd60064fc0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6010d130 con 0x7fbd600fe460 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38642/0 (socket says 172.21.15.100:38642) 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 -- 172.21.15.100:0/1757066870 learned_addr learned my addr 172.21.15.100:0/1757066870 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd64e62640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd600fe460 0x7fbd601136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 -- 172.21.15.100:0/1757066870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd600fe460 msgr2=0x7fbd601136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd600fe460 0x7fbd601136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 -- 172.21.15.100:0/1757066870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500098b0 con 0x7fbd60064fc0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd65663640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd50004750 tx=0x7fbd50004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd50009610 con 0x7fbd60064fc0 2024-09-13T02:46:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbd50032b10 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6010d3b0 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.517+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5003d990 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.518+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6010d950 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.519+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600fdcf0 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.519+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fbd5002f030 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.520+0000 7fbd5dffb640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 0x7fbd48071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.520+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbd500aef00 con 0x7fbd60064fc0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.520+0000 7fbd64e62640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 0x7fbd48071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.520+0000 7fbd64e62640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 0x7fbd48071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd6010ea70 tx=0x7fbd5400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:58.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.524+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbd5007c360 con 0x7fbd60064fc0 2024-09-13T02:46:58.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.681+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd6004b720 con 0x7fbd60064fc0 2024-09-13T02:46:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.682+0000 7fbd5dffb640 1 -- 172.21.15.100:0/1757066870 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11119 (secure 0 0 0) 0x7fbd500480c0 con 0x7fbd60064fc0 2024-09-13T02:46:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:46:58.684 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:41:21.397372+0000","modified":"2024-09-13T02:46:53.177185+0000","last_up_change":"2024-09-13T02:46:52.171235+0000","last_in_change":"2024-09-13T02:46:33.883191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:45:39.806191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d5f6e881-cfda-48aa-8b89-a283f4eafdf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6803","nonce":1204592836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6805","nonce":1204592836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6809","nonce":1204592836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6807","nonce":1204592836}]},"public_addr":"172.21.15.100:6803/1204592836","cluster_addr":"172.21.15.100:6805/1204592836","heartbeat_back_addr":"172.21.15.100:6809/1204592836","heartbeat_front_addr":"172.21.15.100:6807/1204592836","state":["exists","up"]},{"osd":1,"uuid":"4fa6f0a5-199f-452f-a231-8117e593e81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6811","nonce":843516816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6813","nonce":843516816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6817","nonce":843516816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6815","nonce":843516816}]},"public_addr":"172.21.15.100:6811/843516816","cluster_addr":"172.21.15.100:6813/843516816","heartbeat_back_addr":"172.21.15.100:6817/843516816","heartbeat_front_addr":"172.21.15.100:6815/843516816","state":["exists","up"]},{"osd":2,"uuid":"61d8800b-517c-40c1-b738-07bd0f42c46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6819","nonce":2293665926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6821","nonce":2293665926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6825","nonce":2293665926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6823","nonce":2293665926}]},"public_addr":"172.21.15.100:6819/2293665926","cluster_addr":"172.21.15.100:6821/2293665926","heartbeat_back_addr":"172.21.15.100:6825/2293665926","heartbeat_front_addr":"172.21.15.100:6823/2293665926","state":["exists","up"]},{"osd":3,"uuid":"57ef77cc-690a-4143-90c1-f5439dd84b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6801","nonce":1634825900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6803","nonce":1634825900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6807","nonce":1634825900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6805","nonce":1634825900}]},"public_addr":"172.21.15.122:6801/1634825900","cluster_addr":"172.21.15.122:6803/1634825900","heartbeat_back_addr":"172.21.15.122:6807/1634825900","heartbeat_front_addr":"172.21.15.122:6805/1634825900","state":["exists","up"]},{"osd":4,"uuid":"eb50fff9-3678-4137-b256-9f5c64e48f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6809","nonce":3191781421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6811","nonce":3191781421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6815","nonce":3191781421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6813","nonce":3191781421}]},"public_addr":"172.21.15.122:6809/3191781421","cluster_addr":"172.21.15.122:6811/3191781421","heartbeat_back_addr":"172.21.15.122:6815/3191781421","heartbeat_front_addr":"172.21.15.122:6813/3191781421","state":["exists","up"]},{"osd":5,"uuid":"9c5a9b2c-5c20-4d97-a061-068689c170d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6817","nonce":719018416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6819","nonce":719018416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6823","nonce":719018416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6821","nonce":719018416}]},"public_addr":"172.21.15.122:6817/719018416","cluster_addr":"172.21.15.122:6819/719018416","heartbeat_back_addr":"172.21.15.122:6823/719018416","heartbeat_front_addr":"172.21.15.122:6821/719018416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:44:41.005265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:09.862642+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:37.579465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:00.425601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:25.238203+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:50.623397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6800/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/610472047":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/1318550883":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6800/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/3061337984":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/2208660492":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6801/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/62422032":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/2288018786":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/3600671764":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/2463712336":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6800/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/3198025344":"2024-09-14T02:43:21.494498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:46:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 msgr2=0x7fbd48071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 0x7fbd48071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd6010ea70 tx=0x7fbd5400b040 comp rx=0 tx=0).stop 2024-09-13T02:46:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 msgr2=0x7fbd601131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbd50004750 tx=0x7fbd50004d10 comp rx=0 tx=0).stop 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 shutdown_connections 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fbd4806ed60 0x7fbd48071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd600fe460 0x7fbd601136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 --2- 172.21.15.100:0/1757066870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60064fc0 0x7fbd601131b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 >> 172.21.15.100:0/1757066870 conn(0x7fbd600723b0 msgr2=0x7fbd60105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 shutdown_connections 2024-09-13T02:46:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:46:58.684+0000 7fbd678c7640 1 -- 172.21.15.100:0/1757066870 wait complete. 2024-09-13T02:46:59.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:59 smithi100 ceph-mon[27894]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:59.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:46:59 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1757066870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:46:59.455 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T02:45:39.806191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-13T02:46:59.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T02:46:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:59 smithi122 ceph-mon[34559]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:46:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:46:59 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1757066870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:46:59.699 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 -- 172.21.15.100:0/3943045015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fd580 msgr2=0x7f29c40fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3943045015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fd580 0x7f29c40fd950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29b4004900 tx=0x7f29b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 -- 172.21.15.100:0/3943045015 shutdown_connections 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3943045015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fdf20 0x7f29c41065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3943045015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fd580 0x7f29c40fd950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 -- 172.21.15.100:0/3943045015 >> 172.21.15.100:0/3943045015 conn(0x7f29c40f7060 msgr2=0x7f29c40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 -- 172.21.15.100:0/3943045015 shutdown_connections 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.226+0000 7f29c8acb640 1 -- 172.21.15.100:0/3943045015 wait complete. 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 Processor -- start 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 -- start start 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fd580 0x7f29c40fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40fbec0 con 0x7f29c40fdf20 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c8acb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40fc030 con 0x7f29c40fd580 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38668/0 (socket says 172.21.15.100:38668) 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 -- 172.21.15.100:0/3697491514 learned_addr learned my addr 172.21.15.100:0/3697491514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c259c640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fd580 0x7f29c40fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 -- 172.21.15.100:0/3697491514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fd580 msgr2=0x7f29c40fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fd580 0x7f29c40fb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 -- 172.21.15.100:0/3697491514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4005040 con 0x7f29c40fdf20 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.227+0000 7f29c1d9b640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b8002a50 tx=0x7f29b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.228+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8007c30 con 0x7f29c40fdf20 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.228+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29b800f040 con 0x7f29c40fdf20 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.228+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40fc2c0 con 0x7f29c40fdf20 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.228+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b800da10 con 0x7f29c40fdf20 2024-09-13T02:47:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.228+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c41198f0 con 0x7f29c40fdf20 2024-09-13T02:47:01.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.229+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40662d0 con 0x7f29c40fdf20 2024-09-13T02:47:01.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.229+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f29b800dc80 con 0x7f29c40fdf20 2024-09-13T02:47:01.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.230+0000 7f29b2ffd640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 0x7f29ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:01.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.230+0000 7f29c259c640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 0x7f29ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:01.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.230+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29b808d600 con 0x7f29c40fdf20 2024-09-13T02:47:01.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.230+0000 7f29c259c640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 0x7f29ac071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29b4004540 tx=0x7f29b4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.234+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f29b804d2a0 con 0x7f29c40fdf20 2024-09-13T02:47:01.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.388+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29c40fac60 con 0x7f29c40fdf20 2024-09-13T02:47:01.389 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:01 smithi100 ceph-mon[27894]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:01.390 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-13T02:47:01.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.388+0000 7f29b2ffd640 1 -- 172.21.15.100:0/3697491514 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29c40fac60 con 0x7f29c40fdf20 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 msgr2=0x7f29ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 0x7f29ac071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29b4004540 tx=0x7f29b4035040 comp rx=0 tx=0).stop 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 msgr2=0x7f29c40fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b8002a50 tx=0x7f29b8004600 comp rx=0 tx=0).stop 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 shutdown_connections 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f29ac06ed60 0x7f29ac071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29c40fdf20 0x7f29c40fb980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 --2- 172.21.15.100:0/3697491514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c40fd580 0x7f29c40fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 >> 172.21.15.100:0/3697491514 conn(0x7f29c40f7060 msgr2=0x7f29c40f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:01.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 shutdown_connections 2024-09-13T02:47:01.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:01.390+0000 7f29c8acb640 1 -- 172.21.15.100:0/3697491514 wait complete. 2024-09-13T02:47:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:01 smithi122 ceph-mon[34559]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:02.086 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T02:47:02.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:47:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:02.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:02 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3697491514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:47:02.587 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:02 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3697491514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:47:03.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:03 smithi100 ceph-mon[27894]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:03 smithi122 ceph-mon[34559]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:03.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 -- 172.21.15.100:0/3750494049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fc730 msgr2=0x7fe2980fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:03.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/3750494049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fc730 0x7fe2980fcba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2800048d0 tx=0x7fe280009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:03.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 -- 172.21.15.100:0/3750494049 shutdown_connections 2024-09-13T02:47:03.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/3750494049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fc730 0x7fe2980fcba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/3750494049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fb460 0x7fe2980fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 -- 172.21.15.100:0/3750494049 >> 172.21.15.100:0/3750494049 conn(0x7fe2980f6c20 msgr2=0x7fe2980f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 -- 172.21.15.100:0/3750494049 shutdown_connections 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.864+0000 7fe29d5e9640 1 -- 172.21.15.100:0/3750494049 wait complete. 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 Processor -- start 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 -- start start 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fc730 0x7fe298112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298066750 con 0x7fe2980fb460 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe29d5e9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980668c0 con 0x7fe2980fc730 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38690/0 (socket says 172.21.15.100:38690) 2024-09-13T02:47:03.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 -- 172.21.15.100:0/564312424 learned_addr learned my addr 172.21.15.100:0/564312424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe28ffff640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fc730 0x7fe298112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 -- 172.21.15.100:0/564312424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fc730 msgr2=0x7fe298112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fc730 0x7fe298112320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 -- 172.21.15.100:0/564312424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280005040 con 0x7fe2980fb460 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.865+0000 7fe296ffd640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c790 tx=0x7fe2880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.866+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28800a7a0 con 0x7fe2980fb460 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.866+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2981128c0 con 0x7fe2980fb460 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.866+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe28800ada0 con 0x7fe2980fb460 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.866+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2880113a0 con 0x7fe2980fb460 2024-09-13T02:47:03.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.866+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298112e30 con 0x7fe2980fb460 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.867+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2980fa8c0 con 0x7fe2980fb460 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.867+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe28800a900 con 0x7fe2980fb460 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.868+0000 7fe28f7fe640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 0x7fe284071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.868+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe28808df00 con 0x7fe2980fb460 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.868+0000 7fe28ffff640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 0x7fe284071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.868+0000 7fe28ffff640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 0x7fe284071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe280000c00 tx=0x7fe280035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:03.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:03.872+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe28805b3e0 con 0x7fe2980fb460 2024-09-13T02:47:04.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.085+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe298104020 con 0x7fe2980fb460 2024-09-13T02:47:04.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.088+0000 7fe28f7fe640 1 -- 172.21.15.100:0/564312424 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe28805ad80 con 0x7fe2980fb460 2024-09-13T02:47:04.090 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-13T02:47:04.090 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCop+NmEWklBRAAp6mYNkUP3QklGkSx9SDGDw== 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.090+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 msgr2=0x7fe284071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.090+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 0x7fe284071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe280000c00 tx=0x7fe280035040 comp rx=0 tx=0).stop 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.090+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 msgr2=0x7fe29810fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.090+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe28800c790 tx=0x7fe2880043c0 comp rx=0 tx=0).stop 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 shutdown_connections 2024-09-13T02:47:04.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe28406ed60 0x7fe284071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2980fc730 0x7fe298112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 --2- 172.21.15.100:0/564312424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2980fb460 0x7fe29810fdd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 >> 172.21.15.100:0/564312424 conn(0x7fe2980f6c20 msgr2=0x7fe2980f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 shutdown_connections 2024-09-13T02:47:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:04.091+0000 7fe29d5e9640 1 -- 172.21.15.100:0/564312424 wait complete. 2024-09-13T02:47:04.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:04 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/564312424' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:04.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:04 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/564312424' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:47:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:04 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/564312424' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:04 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/564312424' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:47:04.743 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:47:04.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T02:47:04.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T02:47:04.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:47:05.037 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi122/config 2024-09-13T02:47:05.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:05 smithi122 ceph-mon[34559]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:05 smithi100 ceph-mon[27894]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:06.526 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 -- 172.21.15.122:0/286583939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 msgr2=0x7f3c780fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:06.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 --2- 172.21.15.122:0/286583939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c780fc960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c680048d0 tx=0x7f3c68009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 -- 172.21.15.122:0/286583939 shutdown_connections 2024-09-13T02:47:06.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 --2- 172.21.15.122:0/286583939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c780fd820 0x7f3c780fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.527 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 --2- 172.21.15.122:0/286583939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c780fc960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 -- 172.21.15.122:0/286583939 >> 172.21.15.122:0/286583939 conn(0x7f3c780f7d10 msgr2=0x7f3c780fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 -- 172.21.15.122:0/286583939 shutdown_connections 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.516+0000 7f3c7d689640 1 -- 172.21.15.122:0/286583939 wait complete. 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 Processor -- start 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 -- start start 2024-09-13T02:47:06.528 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c780fd820 0x7f3c7810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7810dc40 con 0x7f3c780fd820 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c7d689640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7810e410 con 0x7f3c780fc550 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c76ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:33568/0 (socket says 172.21.15.122:33568) 2024-09-13T02:47:06.529 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.517+0000 7f3c76ffd640 1 -- 172.21.15.122:0/1591602278 learned_addr learned my addr 172.21.15.122:0/1591602278 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c76ffd640 1 -- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c780fd820 msgr2=0x7f3c7810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c76ffd640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c780fd820 0x7f3c7810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c76ffd640 1 -- 172.21.15.122:0/1591602278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68005040 con 0x7f3c780fc550 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c76ffd640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c68003080 tx=0x7f3c68009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c68038070 con 0x7f3c780fc550 2024-09-13T02:47:06.530 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c6802abd0 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7810e640 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c6803e670 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.518+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7810ebe0 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.519+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c780fb9b0 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.519+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3c68030020 con 0x7f3c780fc550 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.520+0000 7f3c5f7fe640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 0x7f3c60071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:06.531 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.520+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3c680ae220 con 0x7f3c780fc550 2024-09-13T02:47:06.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.520+0000 7f3c767fc640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 0x7f3c60071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:06.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.520+0000 7f3c767fc640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 0x7f3c60071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c7810ce60 tx=0x7f3c6c007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:06.532 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.524+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c6807b660 con 0x7f3c780fc550 2024-09-13T02:47:06.738 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.736+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3c7804b720 con 0x7f3c780fc550 2024-09-13T02:47:06.743 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.741+0000 7f3c5f7fe640 1 -- 172.21.15.122:0/1591602278 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3c6807b000 con 0x7f3c780fc550 2024-09-13T02:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout:[client.1] 2024-09-13T02:47:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: key = AQCqp+NmpjICLBAAJARRb4sxc6OQze3T/tSjMQ== 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 msgr2=0x7f3c60071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 0x7f3c60071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c7810ce60 tx=0x7f3c6c007cb0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 msgr2=0x7f3c7810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c68003080 tx=0x7f3c68009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 shutdown_connections 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f3c6006ed60 0x7f3c60071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c780fd820 0x7f3c7810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 --2- 172.21.15.122:0/1591602278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c780fc550 0x7f3c7810d0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:06.745 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.743+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 >> 172.21.15.122:0/1591602278 conn(0x7f3c780f7d10 msgr2=0x7f3c780f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:06.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.744+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 shutdown_connections 2024-09-13T02:47:06.746 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:47:06.744+0000 7f3c7d689640 1 -- 172.21.15.122:0/1591602278 wait complete. 2024-09-13T02:47:07.329 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:47:07.329 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T02:47:07.330 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T02:47:07.367 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T02:47:07.367 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T02:47:07.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T02:47:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:07 smithi122 ceph-mon[34559]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:07 smithi122 ceph-mon[34559]: from='client.? 172.21.15.122:0/1591602278' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:07.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:07 smithi122 ceph-mon[34559]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:07.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:07 smithi122 ceph-mon[34559]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:47:07.623 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:07 smithi100 ceph-mon[27894]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:07 smithi100 ceph-mon[27894]: from='client.? 172.21.15.122:0/1591602278' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:07 smithi100 ceph-mon[27894]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:47:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:07 smithi100 ceph-mon[27894]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:47:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 -- 172.21.15.100:0/61831276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fcf80 msgr2=0x7f82280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 --2- 172.21.15.100:0/61831276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fcf80 0x7f82280fd3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f821c0048d0 tx=0x7f821c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 -- 172.21.15.100:0/61831276 shutdown_connections 2024-09-13T02:47:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 --2- 172.21.15.100:0/61831276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fcf80 0x7f82280fd3d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 --2- 172.21.15.100:0/61831276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fb810 0x7f82280fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 -- 172.21.15.100:0/61831276 >> 172.21.15.100:0/61831276 conn(0x7f82280723b0 msgr2=0x7f82280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 -- 172.21.15.100:0/61831276 shutdown_connections 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.266+0000 7f822cef2640 1 -- 172.21.15.100:0/61831276 wait complete. 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 Processor -- start 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 -- start start 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fcf80 0x7f82280f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280f9050 con 0x7f82280fb810 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822cef2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280f91c0 con 0x7f82280fcf80 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48314/0 (socket says 172.21.15.100:48314) 2024-09-13T02:47:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 -- 172.21.15.100:0/957097847 learned_addr learned my addr 172.21.15.100:0/957097847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f8225d9b640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fcf80 0x7f82280f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 -- 172.21.15.100:0/957097847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fcf80 msgr2=0x7f82280f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fcf80 0x7f82280f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.267+0000 7f822659c640 1 -- 172.21.15.100:0/957097847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c005040 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f822659c640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f821800b790 tx=0x7f82180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821800c700 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8228119580 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f821800cd00 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8218015e70 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.268+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82281199c0 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.269+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280fcbc0 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.269+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8218012070 con 0x7f82280fb810 2024-09-13T02:47:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.270+0000 7f8216ffd640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 0x7f8210071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:09.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.270+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f821808d9c0 con 0x7f82280fb810 2024-09-13T02:47:09.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.270+0000 7f8225d9b640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 0x7f8210071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:09.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.270+0000 7f8225d9b640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 0x7f8210071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f821c0043d0 tx=0x7f821c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:09.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.274+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f821805ae20 con 0x7f82280fb810 2024-09-13T02:47:09.334 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:09 smithi100 ceph-mon[27894]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.476+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f82280f9c30 con 0x7f82280fb810 2024-09-13T02:47:09.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.480+0000 7f8216ffd640 1 -- 172.21.15.100:0/957097847 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176722 (secure 0 0 0) 0x7f821805a7c0 con 0x7f82280fb810 2024-09-13T02:47:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.482+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 msgr2=0x7f8210071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.482+0000 7f822cef2640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 0x7f8210071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f821c0043d0 tx=0x7f821c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.482+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 msgr2=0x7f82280f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.482+0000 7f822cef2640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f821800b790 tx=0x7f82180091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 shutdown_connections 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f821006ed60 0x7f8210071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82280fcf80 0x7f82280f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 --2- 172.21.15.100:0/957097847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82280fb810 0x7f82280f8540 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 >> 172.21.15.100:0/957097847 conn(0x7f82280723b0 msgr2=0x7f8228064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 shutdown_connections 2024-09-13T02:47:09.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:09.483+0000 7f822cef2640 1 -- 172.21.15.100:0/957097847 wait complete. 2024-09-13T02:47:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:09 smithi122 ceph-mon[34559]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:10.151 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi100.lhjyck","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":3121511218},{"type":"v1","addr":"172.21.15.100:6801","nonce":3121511218}]},"active_addr":"172.21.15.100:6801/3121511218","active_change":"2024-09-13T02:43:21.494609+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi122.ptcenr","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.100:8443/","prometheus":"http://172.21.15.100:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1955372089}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1141279129}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2459548553}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3404957479}]}]} 2024-09-13T02:47:10.157 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T02:47:10.157 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T02:47:10.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:47:10.409 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:10 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/957097847' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:47:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:10 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/957097847' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:47:11.542 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:11 smithi100 ceph-mon[27894]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:11 smithi122 ceph-mon[34559]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 -- 172.21.15.100:0/2676873816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 msgr2=0x7f63bc0fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/2676873816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc0fb160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63b80048d0 tx=0x7f63b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 -- 172.21.15.100:0/2676873816 shutdown_connections 2024-09-13T02:47:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/2676873816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc0fb160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/2676873816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 -- 172.21.15.100:0/2676873816 >> 172.21.15.100:0/2676873816 conn(0x7f63bc070d50 msgr2=0x7f63bc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 -- 172.21.15.100:0/2676873816 shutdown_connections 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.064+0000 7f63c3ff4640 1 -- 172.21.15.100:0/2676873816 wait complete. 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 Processor -- start 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 -- start start 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc113ee0 con 0x7f63bc0facf0 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c3ff4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63bc10d290 con 0x7f63bc102680 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48330/0 (socket says 172.21.15.100:48330) 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 -- 172.21.15.100:0/4037372901 learned_addr learned my addr 172.21.15.100:0/4037372901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:12.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c158f640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 -- 172.21.15.100:0/4037372901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 msgr2=0x7f63bc113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 -- 172.21.15.100:0/4037372901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8005040 con 0x7f63bc0facf0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c158f640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.065+0000 7f63c1d90640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63b000b790 tx=0x7f63b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.066+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b000c700 con 0x7f63bc0facf0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.066+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f63b000cd00 con 0x7f63bc0facf0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.066+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b0015e70 con 0x7f63bc0facf0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.066+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc10d570 con 0x7f63bc0facf0 2024-09-13T02:47:12.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.066+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63bc10da90 con 0x7f63bc0facf0 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.067+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63bc0657f0 con 0x7f63bc0facf0 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.067+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f63b0012070 con 0x7f63bc0facf0 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.068+0000 7f63ae7fc640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 0x7f63a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.068+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f63b008d9b0 con 0x7f63bc0facf0 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.068+0000 7f63c158f640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 0x7f63a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:12.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.068+0000 7f63c158f640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 0x7f63a8071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63b800b020 tx=0x7f63b8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:12.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.072+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f63b005ae10 con 0x7f63bc0facf0 2024-09-13T02:47:12.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.227+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63bc04b750 con 0x7f63bc0facf0 2024-09-13T02:47:12.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.228+0000 7f63ae7fc640 1 -- 172.21.15.100:0/4037372901 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11119 (secure 0 0 0) 0x7f63b005a7b0 con 0x7f63bc0facf0 2024-09-13T02:47:12.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:12.230 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:41:21.397372+0000","modified":"2024-09-13T02:46:53.177185+0000","last_up_change":"2024-09-13T02:46:52.171235+0000","last_in_change":"2024-09-13T02:46:33.883191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:45:39.806191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d5f6e881-cfda-48aa-8b89-a283f4eafdf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6803","nonce":1204592836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6805","nonce":1204592836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6809","nonce":1204592836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6807","nonce":1204592836}]},"public_addr":"172.21.15.100:6803/1204592836","cluster_addr":"172.21.15.100:6805/1204592836","heartbeat_back_addr":"172.21.15.100:6809/1204592836","heartbeat_front_addr":"172.21.15.100:6807/1204592836","state":["exists","up"]},{"osd":1,"uuid":"4fa6f0a5-199f-452f-a231-8117e593e81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6811","nonce":843516816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6813","nonce":843516816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6817","nonce":843516816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6815","nonce":843516816}]},"public_addr":"172.21.15.100:6811/843516816","cluster_addr":"172.21.15.100:6813/843516816","heartbeat_back_addr":"172.21.15.100:6817/843516816","heartbeat_front_addr":"172.21.15.100:6815/843516816","state":["exists","up"]},{"osd":2,"uuid":"61d8800b-517c-40c1-b738-07bd0f42c46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6819","nonce":2293665926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6821","nonce":2293665926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6825","nonce":2293665926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6823","nonce":2293665926}]},"public_addr":"172.21.15.100:6819/2293665926","cluster_addr":"172.21.15.100:6821/2293665926","heartbeat_back_addr":"172.21.15.100:6825/2293665926","heartbeat_front_addr":"172.21.15.100:6823/2293665926","state":["exists","up"]},{"osd":3,"uuid":"57ef77cc-690a-4143-90c1-f5439dd84b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6801","nonce":1634825900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6803","nonce":1634825900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6807","nonce":1634825900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6805","nonce":1634825900}]},"public_addr":"172.21.15.122:6801/1634825900","cluster_addr":"172.21.15.122:6803/1634825900","heartbeat_back_addr":"172.21.15.122:6807/1634825900","heartbeat_front_addr":"172.21.15.122:6805/1634825900","state":["exists","up"]},{"osd":4,"uuid":"eb50fff9-3678-4137-b256-9f5c64e48f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6809","nonce":3191781421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6811","nonce":3191781421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6815","nonce":3191781421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6813","nonce":3191781421}]},"public_addr":"172.21.15.122:6809/3191781421","cluster_addr":"172.21.15.122:6811/3191781421","heartbeat_back_addr":"172.21.15.122:6815/3191781421","heartbeat_front_addr":"172.21.15.122:6813/3191781421","state":["exists","up"]},{"osd":5,"uuid":"9c5a9b2c-5c20-4d97-a061-068689c170d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6817","nonce":719018416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6819","nonce":719018416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6823","nonce":719018416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6821","nonce":719018416}]},"public_addr":"172.21.15.122:6817/719018416","cluster_addr":"172.21.15.122:6819/719018416","heartbeat_back_addr":"172.21.15.122:6823/719018416","heartbeat_front_addr":"172.21.15.122:6821/719018416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:44:41.005265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:09.862642+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:37.579465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:00.425601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:25.238203+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:50.623397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6800/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/610472047":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/1318550883":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6800/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/3061337984":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/2208660492":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6801/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/62422032":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/2288018786":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/3600671764":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/2463712336":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6800/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/3198025344":"2024-09-14T02:43:21.494498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 msgr2=0x7f63a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 0x7f63a8071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63b800b020 tx=0x7f63b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 msgr2=0x7f63bc113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63b000b790 tx=0x7f63b00091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 shutdown_connections 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f63a806ed60 0x7f63a8071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63bc102680 0x7f63bc113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 --2- 172.21.15.100:0/4037372901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63bc0facf0 0x7f63bc113310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 >> 172.21.15.100:0/4037372901 conn(0x7f63bc070d50 msgr2=0x7f63bc0fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:12.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.230+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 shutdown_connections 2024-09-13T02:47:12.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:12.231+0000 7f63c3ff4640 1 -- 172.21.15.100:0/4037372901 wait complete. 2024-09-13T02:47:12.542 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:12 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/4037372901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:47:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:12 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/4037372901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:47:12.943 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T02:47:12.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:47:13.188 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:13.521 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:13 smithi100 ceph-mon[27894]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:13 smithi122 ceph-mon[34559]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 -- 172.21.15.100:0/2254037988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fb810 msgr2=0x7fba600fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 --2- 172.21.15.100:0/2254037988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fb810 0x7fba600fbbe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba580048d0 tx=0x7fba58009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 -- 172.21.15.100:0/2254037988 shutdown_connections 2024-09-13T02:47:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 --2- 172.21.15.100:0/2254037988 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fcf80 0x7fba600fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 --2- 172.21.15.100:0/2254037988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fb810 0x7fba600fbbe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.769+0000 7fba658ad640 1 -- 172.21.15.100:0/2254037988 >> 172.21.15.100:0/2254037988 conn(0x7fba600723b0 msgr2=0x7fba600727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:14.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 -- 172.21.15.100:0/2254037988 shutdown_connections 2024-09-13T02:47:14.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 -- 172.21.15.100:0/2254037988 wait complete. 2024-09-13T02:47:14.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 Processor -- start 2024-09-13T02:47:14.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 -- start start 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fb810 0x7fba6010e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6010ed70 con 0x7fba600fcf80 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.770+0000 7fba658ad640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6010eee0 con 0x7fba600fb810 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48338/0 (socket says 172.21.15.100:48338) 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 -- 172.21.15.100:0/1923648148 learned_addr learned my addr 172.21.15.100:0/1923648148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5effd640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fb810 0x7fba6010e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 -- 172.21.15.100:0/1923648148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fb810 msgr2=0x7fba6010e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fb810 0x7fba6010e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 -- 172.21.15.100:0/1923648148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba58005040 con 0x7fba600fcf80 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba5e7fc640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba5400bbb0 tx=0x7fba54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:14.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5400c940 con 0x7fba600fcf80 2024-09-13T02:47:14.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba540092e0 con 0x7fba600fcf80 2024-09-13T02:47:14.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba60117270 con 0x7fba600fcf80 2024-09-13T02:47:14.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba54007640 con 0x7fba600fcf80 2024-09-13T02:47:14.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.771+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba60117740 con 0x7fba600fcf80 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.772+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba600fcbc0 con 0x7fba600fcf80 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.773+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fba54012070 con 0x7fba600fcf80 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.773+0000 7fba477fe640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 0x7fba48071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.773+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fba5408dee0 con 0x7fba600fcf80 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.773+0000 7fba5effd640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 0x7fba48071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:14.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.774+0000 7fba5effd640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 0x7fba48071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba58009ac0 tx=0x7fba58035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:14.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.777+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fba5405b340 con 0x7fba600fcf80 2024-09-13T02:47:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.934+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba60072ec0 con 0x7fba600fcf80 2024-09-13T02:47:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.934+0000 7fba477fe640 1 -- 172.21.15.100:0/1923648148 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11119 (secure 0 0 0) 0x7fba5405ace0 con 0x7fba600fcf80 2024-09-13T02:47:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:14.936 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"84e01cde-7179-11ef-bceb-c7b262605968","created":"2024-09-13T02:41:21.397372+0000","modified":"2024-09-13T02:46:53.177185+0000","last_up_change":"2024-09-13T02:46:52.171235+0000","last_in_change":"2024-09-13T02:46:33.883191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:45:39.806191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d5f6e881-cfda-48aa-8b89-a283f4eafdf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6803","nonce":1204592836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6805","nonce":1204592836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6809","nonce":1204592836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1204592836},{"type":"v1","addr":"172.21.15.100:6807","nonce":1204592836}]},"public_addr":"172.21.15.100:6803/1204592836","cluster_addr":"172.21.15.100:6805/1204592836","heartbeat_back_addr":"172.21.15.100:6809/1204592836","heartbeat_front_addr":"172.21.15.100:6807/1204592836","state":["exists","up"]},{"osd":1,"uuid":"4fa6f0a5-199f-452f-a231-8117e593e81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6811","nonce":843516816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6813","nonce":843516816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6817","nonce":843516816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":843516816},{"type":"v1","addr":"172.21.15.100:6815","nonce":843516816}]},"public_addr":"172.21.15.100:6811/843516816","cluster_addr":"172.21.15.100:6813/843516816","heartbeat_back_addr":"172.21.15.100:6817/843516816","heartbeat_front_addr":"172.21.15.100:6815/843516816","state":["exists","up"]},{"osd":2,"uuid":"61d8800b-517c-40c1-b738-07bd0f42c46b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6819","nonce":2293665926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6821","nonce":2293665926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6825","nonce":2293665926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2293665926},{"type":"v1","addr":"172.21.15.100:6823","nonce":2293665926}]},"public_addr":"172.21.15.100:6819/2293665926","cluster_addr":"172.21.15.100:6821/2293665926","heartbeat_back_addr":"172.21.15.100:6825/2293665926","heartbeat_front_addr":"172.21.15.100:6823/2293665926","state":["exists","up"]},{"osd":3,"uuid":"57ef77cc-690a-4143-90c1-f5439dd84b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6801","nonce":1634825900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6803","nonce":1634825900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6807","nonce":1634825900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1634825900},{"type":"v1","addr":"172.21.15.122:6805","nonce":1634825900}]},"public_addr":"172.21.15.122:6801/1634825900","cluster_addr":"172.21.15.122:6803/1634825900","heartbeat_back_addr":"172.21.15.122:6807/1634825900","heartbeat_front_addr":"172.21.15.122:6805/1634825900","state":["exists","up"]},{"osd":4,"uuid":"eb50fff9-3678-4137-b256-9f5c64e48f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6809","nonce":3191781421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6811","nonce":3191781421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6815","nonce":3191781421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":3191781421},{"type":"v1","addr":"172.21.15.122:6813","nonce":3191781421}]},"public_addr":"172.21.15.122:6809/3191781421","cluster_addr":"172.21.15.122:6811/3191781421","heartbeat_back_addr":"172.21.15.122:6815/3191781421","heartbeat_front_addr":"172.21.15.122:6813/3191781421","state":["exists","up"]},{"osd":5,"uuid":"9c5a9b2c-5c20-4d97-a061-068689c170d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6817","nonce":719018416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6819","nonce":719018416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6823","nonce":719018416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":719018416},{"type":"v1","addr":"172.21.15.122:6821","nonce":719018416}]},"public_addr":"172.21.15.122:6817/719018416","cluster_addr":"172.21.15.122:6819/719018416","heartbeat_back_addr":"172.21.15.122:6823/719018416","heartbeat_front_addr":"172.21.15.122:6821/719018416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:44:41.005265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:09.862642+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:45:37.579465+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:00.425601+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:25.238203+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:46:50.623397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6800/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/610472047":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6801/3842284467":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/1318550883":"2024-09-14T02:41:52.778377+0000","172.21.15.100:6800/1286357473":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/3061337984":"2024-09-14T02:41:52.778377+0000","172.21.15.100:0/2208660492":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6801/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/62422032":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/2288018786":"2024-09-14T02:43:21.494498+0000","172.21.15.100:0/3600671764":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/2463712336":"2024-09-14T02:42:21.569382+0000","172.21.15.100:6800/808939656":"2024-09-14T02:42:21.569382+0000","172.21.15.100:0/3198025344":"2024-09-14T02:43:21.494498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 msgr2=0x7fba48071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 0x7fba48071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba58009ac0 tx=0x7fba58035040 comp rx=0 tx=0).stop 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 msgr2=0x7fba6010e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba5400bbb0 tx=0x7fba54009840 comp rx=0 tx=0).stop 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 shutdown_connections 2024-09-13T02:47:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fba4806ed60 0x7fba48071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba600fcf80 0x7fba6010e6e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 --2- 172.21.15.100:0/1923648148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba600fb810 0x7fba6010e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 >> 172.21.15.100:0/1923648148 conn(0x7fba600723b0 msgr2=0x7fba600fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 shutdown_connections 2024-09-13T02:47:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:14.936+0000 7fba658ad640 1 -- 172.21.15.100:0/1923648148 wait complete. 2024-09-13T02:47:15.632 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:15 smithi100 ceph-mon[27894]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:15.632 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:15 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1923648148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:47:15.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T02:47:15.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T02:47:15.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T02:47:15.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T02:47:15.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T02:47:15.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T02:47:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:15 smithi122 ceph-mon[34559]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:15 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1923648148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:47:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:17 smithi100 ceph-mon[27894]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:17 smithi122 ceph-mon[34559]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:19.011 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:19.012 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:19.629 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:19 smithi100 ceph-mon[27894]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:19 smithi122 ceph-mon[34559]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 -- 172.21.15.100:0/3183019002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102550 msgr2=0x7f1288102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 --2- 172.21.15.100:0/3183019002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102550 0x7f1288102920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f12780048d0 tx=0x7f1278009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 -- 172.21.15.100:0/3183019002 shutdown_connections 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 --2- 172.21.15.100:0/3183019002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102ef0 0x7f12880fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 --2- 172.21.15.100:0/3183019002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102550 0x7f1288102920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 -- 172.21.15.100:0/3183019002 >> 172.21.15.100:0/3183019002 conn(0x7f12880f80f0 msgr2=0x7f12880fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 -- 172.21.15.100:0/3183019002 shutdown_connections 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.705+0000 7f128e85e640 1 -- 172.21.15.100:0/3183019002 wait complete. 2024-09-13T02:47:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 Processor -- start 2024-09-13T02:47:19.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 -- start start 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102550 0x7f1288113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12881140c0 con 0x7f1288102ef0 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f128e85e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128810d4d0 con 0x7f1288102550 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f12877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f12877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46502/0 (socket says 172.21.15.100:46502) 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.706+0000 7f12877fe640 1 -- 172.21.15.100:0/1056259690 learned_addr learned my addr 172.21.15.100:0/1056259690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f1287fff640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102550 0x7f1288113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f12877fe640 1 -- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102550 msgr2=0x7f1288113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f12877fe640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102550 0x7f1288113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f12877fe640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278005040 con 0x7f1288102ef0 2024-09-13T02:47:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f12877fe640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f127c002840 tx=0x7f127c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c007c30 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128810d7b0 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f127c00f040 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f127c00d990 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.707+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128810dd50 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.708+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12880fdcd0 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f127c009600 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 0x7f1270071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f127c08d650 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1287fff640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 0x7f1270071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 0x7f1270076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1270077590 con 0x7f1270074ad0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f127c08fca0 con 0x7f1288102ef0 2024-09-13T02:47:19.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.709+0000 7f1287fff640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 0x7f1270071200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1278009ac0 tx=0x7f1278035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.710+0000 7f128cdfb640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 0x7f1270076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.710+0000 7f128cdfb640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 0x7f1270076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.711+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== osd.5 v2:172.21.15.122:6816/719018416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1270077590 con 0x7f1270074ad0 2024-09-13T02:47:19.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.726+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 --> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f128810e230 con 0x7f1270074ad0 2024-09-13T02:47:19.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.726+0000 7f1284ff9640 1 -- 172.21.15.100:0/1056259690 <== osd.5 v2:172.21.15.122:6816/719018416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f128810e230 con 0x7f1270074ad0 2024-09-13T02:47:19.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 msgr2=0x7f1270076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 0x7f1270076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 msgr2=0x7f1270071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 0x7f1270071200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1278009ac0 tx=0x7f1278035040 comp rx=0 tx=0).stop 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 msgr2=0x7f1288113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f127c002840 tx=0x7f127c004570 comp rx=0 tx=0).stop 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 shutdown_connections 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:6816/719018416,v1:172.21.15.122:6817/719018416] conn(0x7f1270074ad0 0x7f1270076ee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f127006ed50 0x7f1270071200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1288102ef0 0x7f1288113a70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 --2- 172.21.15.100:0/1056259690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1288102550 0x7f1288113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:19.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 >> 172.21.15.100:0/1056259690 conn(0x7f12880f80f0 msgr2=0x7f12880f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:19.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 shutdown_connections 2024-09-13T02:47:19.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:19.727+0000 7f128e85e640 1 -- 172.21.15.100:0/1056259690 wait complete. 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.652+0000 7f64201f0640 1 -- 172.21.15.100:0/1566346115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fbd10 msgr2=0x7f6418100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.652+0000 7f64201f0640 1 --2- 172.21.15.100:0/1566346115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fbd10 0x7f6418100330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f64080048d0 tx=0x7f6408009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- 172.21.15.100:0/1566346115 shutdown_connections 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 --2- 172.21.15.100:0/1566346115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fbd10 0x7f6418100330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 --2- 172.21.15.100:0/1566346115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fb370 0x7f64180fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- 172.21.15.100:0/1566346115 >> 172.21.15.100:0/1566346115 conn(0x7f64180f7010 msgr2=0x7f64180f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- 172.21.15.100:0/1566346115 shutdown_connections 2024-09-13T02:47:20.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- 172.21.15.100:0/1566346115 wait complete. 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 Processor -- start 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- start start 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 0x7f6418119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641811a520 con 0x7f64180fb370 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.653+0000 7f64201f0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64181138a0 con 0x7f64180fbd10 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46508/0 (socket says 172.21.15.100:46508) 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 -- 172.21.15.100:0/3348858450 learned_addr learned my addr 172.21.15.100:0/3348858450 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641d78b640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 0x7f6418119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 -- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 msgr2=0x7f6418119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 0x7f6418119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408005040 con 0x7f64180fb370 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641d78b640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 0x7f6418119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f641df8c640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f641400b790 tx=0x7f64140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f641400c700 con 0x7f64180fb370 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f641400cd00 con 0x7f64180fb370 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6418113b30 con 0x7f64180fb370 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6414015e70 con 0x7f64180fb370 2024-09-13T02:47:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.654+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6418114020 con 0x7f64180fb370 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.655+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64181145a0 con 0x7f64180fb370 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.656+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6414012070 con 0x7f64180fb370 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.656+0000 7f640e7fc640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 0x7f6404071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.656+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f641408d930 con 0x7f64180fb370 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.656+0000 7f641d78b640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 0x7f6404071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f640e7fc640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 0x7f6404076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64040775a0 con 0x7f6404074ae0 2024-09-13T02:47:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6414092220 con 0x7f64180fb370 2024-09-13T02:47:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f641d78b640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 0x7f6404071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6418114cc0 tx=0x7f6408035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f641e78d640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 0x7f6404076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.657+0000 7f641e78d640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 0x7f6404076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.658+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== osd.3 v2:172.21.15.122:6800/1634825900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f64040775a0 con 0x7f6404074ae0 2024-09-13T02:47:20.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.676+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 --> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64180f9160 con 0x7f6404074ae0 2024-09-13T02:47:20.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f640e7fc640 1 -- 172.21.15.100:0/3348858450 <== osd.3 v2:172.21.15.122:6800/1634825900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f64180f9160 con 0x7f6404074ae0 2024-09-13T02:47:20.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 msgr2=0x7f6404076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 0x7f6404076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 msgr2=0x7f6404071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 0x7f6404071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6418114cc0 tx=0x7f6408035040 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 msgr2=0x7f6418119900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f641400b790 tx=0x7f64140091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 shutdown_connections 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:6800/1634825900,v1:172.21.15.122:6801/1634825900] conn(0x7f6404074ae0 0x7f6404076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f640406ed60 0x7f6404071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f64180fbd10 0x7f6418119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 --2- 172.21.15.100:0/3348858450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64180fb370 0x7f6418119900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:20.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 >> 172.21.15.100:0/3348858450 conn(0x7f64180f7010 msgr2=0x7f64180f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:20.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 shutdown_connections 2024-09-13T02:47:20.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:20.677+0000 7f64201f0640 1 -- 172.21.15.100:0/3348858450 wait complete. 2024-09-13T02:47:21.514 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:21 smithi100 ceph-mon[27894]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:21 smithi122 ceph-mon[34559]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/182246562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 msgr2=0x7f4e580fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/182246562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e580fb8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4e400048d0 tx=0x7f4e40009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/182246562 shutdown_connections 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/182246562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e580fb8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/182246562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 0x7f4e58101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/182246562 >> 172.21.15.100:0/182246562 conn(0x7f4e580f7000 msgr2=0x7f4e580f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.308+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/182246562 shutdown_connections 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/182246562 wait complete. 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 Processor -- start 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 -- start start 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 0x7f4e5810c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5810ca20 con 0x7f4e580fb480 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5c9e8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5810cb60 con 0x7f4e581014c0 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46528/0 (socket says 172.21.15.100:46528) 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.309+0000 7f4e5659c640 1 -- 172.21.15.100:0/3051403514 learned_addr learned my addr 172.21.15.100:0/3051403514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e55d9b640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 0x7f4e5810c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5659c640 1 -- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 msgr2=0x7f4e5810c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5659c640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 0x7f4e5810c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5659c640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40005040 con 0x7f4e580fb480 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5659c640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c790 tx=0x7f4e480043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4800a820 con 0x7f4e580fb480 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58119610 con 0x7f4e580fb480 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e4800ae20 con 0x7f4e580fb480 2024-09-13T02:47:22.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e480113a0 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.310+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581199c0 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.311+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e580f9310 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.311+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4e48012400 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e4effd640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 0x7f4e44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e4808e910 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e55d9b640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 0x7f4e44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e4effd640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 0x7f4e44076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e440775a0 con 0x7f4e44074ae0 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e4808ecf0 con 0x7f4e580fb480 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.312+0000 7f4e56d9d640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 0x7f4e44076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.313+0000 7f4e55d9b640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 0x7f4e44071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009ac0 tx=0x7f4e40009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.313+0000 7f4e56d9d640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 0x7f4e44076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:22.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.314+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== osd.4 v2:172.21.15.122:6808/3191781421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4e440775a0 con 0x7f4e44074ae0 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 --> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e5810cd20 con 0x7f4e44074ae0 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e4effd640 1 -- 172.21.15.100:0/3051403514 <== osd.4 v2:172.21.15.122:6808/3191781421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4e5810cd20 con 0x7f4e44074ae0 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 msgr2=0x7f4e44076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 0x7f4e44076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 msgr2=0x7f4e44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 0x7f4e44071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009ac0 tx=0x7f4e40009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 msgr2=0x7f4e5810bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.326+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c790 tx=0x7f4e480043c0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 shutdown_connections 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:6808/3191781421,v1:172.21.15.122:6809/3191781421] conn(0x7f4e44074ae0 0x7f4e44076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f4e4406ed60 0x7f4e44071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e581014c0 0x7f4e5810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 --2- 172.21.15.100:0/3051403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e580fb480 0x7f4e5810bfa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:22.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 >> 172.21.15.100:0/3051403514 conn(0x7f4e580f7000 msgr2=0x7f4e580f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:22.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 shutdown_connections 2024-09-13T02:47:22.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:22.327+0000 7f4e5c9e8640 1 -- 172.21.15.100:0/3051403514 wait complete. 2024-09-13T02:47:22.623 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:23.629 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:23 smithi100 ceph-mon[27894]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:23.655 INFO:teuthology.orchestra.run.smithi100.stdout:137438953486 2024-09-13T02:47:23.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T02:47:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:23 smithi122 ceph-mon[34559]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:24.055 INFO:teuthology.orchestra.run.smithi100.stdout:111669149714 2024-09-13T02:47:24.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T02:47:25.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:25 smithi100 ceph-mon[27894]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:25.631 INFO:teuthology.orchestra.run.smithi100.stdout:158913789960 2024-09-13T02:47:25.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T02:47:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:25 smithi122 ceph-mon[34559]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:26.071 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:26.077 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 -- 172.21.15.100:0/2738018148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464101540 msgr2=0x7f8464064fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 --2- 172.21.15.100:0/2738018148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464101540 0x7f8464064fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f84600048d0 tx=0x7f8460009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 -- 172.21.15.100:0/2738018148 shutdown_connections 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 --2- 172.21.15.100:0/2738018148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464065520 0x7f8464065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 --2- 172.21.15.100:0/2738018148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464101540 0x7f8464064fe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 -- 172.21.15.100:0/2738018148 >> 172.21.15.100:0/2738018148 conn(0x7f84640723b0 msgr2=0x7f84640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.364+0000 7f846ba6d640 1 -- 172.21.15.100:0/2738018148 shutdown_connections 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 -- 172.21.15.100:0/2738018148 wait complete. 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 Processor -- start 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 -- start start 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 0x7f8464119d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846411a360 con 0x7f8464065520 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f846ba6d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464113770 con 0x7f8464101540 2024-09-13T02:47:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f8469809640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f8469809640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46552/0 (socket says 172.21.15.100:46552) 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.365+0000 7f8469809640 1 -- 172.21.15.100:0/1874682119 learned_addr learned my addr 172.21.15.100:0/1874682119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469809640 1 -- 172.21.15.100:0/1874682119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 msgr2=0x7f8464119d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469008640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 0x7f8464119d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469809640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 0x7f8464119d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469809640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8460005040 con 0x7f8464065520 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469008640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 0x7f8464119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f8469809640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8460003080 tx=0x7f8460009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8460038070 con 0x7f8464065520 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84600097e0 con 0x7f8464065520 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84641139f0 con 0x7f8464065520 2024-09-13T02:47:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f846003d420 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.366+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8464113f30 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.367+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8464114450 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.367+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8460030020 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f845a7fc640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 0x7f8450071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84600ae410 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f8469008640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 0x7f8450071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f845a7fc640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 0x7f8450076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84500775a0 con 0x7f8450074ae0 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84600b0a60 con 0x7f8464065520 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f8469008640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 0x7f8450071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8464114a50 tx=0x7f8454009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.368+0000 7f846a00a640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 0x7f8450076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.369+0000 7f846a00a640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 0x7f8450076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.369+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== osd.2 v2:172.21.15.100:6818/2293665926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f84500775a0 con 0x7f8450074ae0 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 --> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f84640fae50 con 0x7f8450074ae0 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f845a7fc640 1 -- 172.21.15.100:0/1874682119 <== osd.2 v2:172.21.15.100:6818/2293665926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f84640fae50 con 0x7f8450074ae0 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 msgr2=0x7f8450076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 0x7f8450076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 msgr2=0x7f8450071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 0x7f8450071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8464114a50 tx=0x7f8454009040 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 msgr2=0x7f84641197d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.382+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8460003080 tx=0x7f8460009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 shutdown_connections 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6818/2293665926,v1:172.21.15.100:6819/2293665926] conn(0x7f8450074ae0 0x7f8450076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f845006ed60 0x7f8450071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8464101540 0x7f8464119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 --2- 172.21.15.100:0/1874682119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8464065520 0x7f84641197d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 >> 172.21.15.100:0/1874682119 conn(0x7f84640723b0 msgr2=0x7f84640fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 shutdown_connections 2024-09-13T02:47:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.383+0000 7f846ba6d640 1 -- 172.21.15.100:0/1874682119 wait complete. 2024-09-13T02:47:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:27 smithi100 ceph-mon[27894]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:27 smithi122 ceph-mon[34559]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 -- 172.21.15.100:0/3800356806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 msgr2=0x7fa5b00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 --2- 172.21.15.100:0/3800356806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b00fd3d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00048d0 tx=0x7fa5a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 -- 172.21.15.100:0/3800356806 shutdown_connections 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 --2- 172.21.15.100:0/3800356806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b00fd3d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 --2- 172.21.15.100:0/3800356806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 0x7fa5b00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 -- 172.21.15.100:0/3800356806 >> 172.21.15.100:0/3800356806 conn(0x7fa5b00723b0 msgr2=0x7fa5b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 -- 172.21.15.100:0/3800356806 shutdown_connections 2024-09-13T02:47:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.848+0000 7fa5b7541640 1 -- 172.21.15.100:0/3800356806 wait complete. 2024-09-13T02:47:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 Processor -- start 2024-09-13T02:47:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 -- start start 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 0x7fa5b0113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0113c90 con 0x7fa5b00fcf80 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b7541640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b010d0d0 con 0x7fa5b00fb810 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46578/0 (socket says 172.21.15.100:46578) 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 -- 172.21.15.100:0/2394129486 learned_addr learned my addr 172.21.15.100:0/2394129486 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b52dd640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 0x7fa5b0113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 -- 172.21.15.100:0/2394129486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 msgr2=0x7fa5b0113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 0x7fa5b0113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.849+0000 7fa5b4adc640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0005040 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5b4adc640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000c00 tx=0x7fa5a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a0038070 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5a002ade0 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b010d350 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a002c7e0 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.850+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b010d890 con 0x7fa5b00fcf80 2024-09-13T02:47:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.851+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5b010dd70 con 0x7fa5b00fcf80 2024-09-13T02:47:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.852+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa5a0030020 con 0x7fa5b00fcf80 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.852+0000 7fa5a5ffb640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 0x7fa59c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.852+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa5a00adad0 con 0x7fa5b00fcf80 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.852+0000 7fa5b52dd640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 0x7fa59c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5a5ffb640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 0x7fa59c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa59c0775a0 con 0x7fa59c074ae0 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a00b2220 con 0x7fa5b00fcf80 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5b52dd640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 0x7fa59c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac004ed0 tx=0x7fa5ac00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5b5ade640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 0x7fa59c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:27.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.853+0000 7fa5b5ade640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 0x7fa59c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:27.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.854+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== osd.0 v2:172.21.15.100:6802/1204592836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa59c0775a0 con 0x7fa59c074ae0 2024-09-13T02:47:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.866+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 --> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5b005de50 con 0x7fa59c074ae0 2024-09-13T02:47:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.866+0000 7fa5a5ffb640 1 -- 172.21.15.100:0/2394129486 <== osd.0 v2:172.21.15.100:6802/1204592836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5b005de50 con 0x7fa59c074ae0 2024-09-13T02:47:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 msgr2=0x7fa59c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 0x7fa59c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 msgr2=0x7fa59c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 0x7fa59c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac004ed0 tx=0x7fa5ac00b040 comp rx=0 tx=0).stop 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 msgr2=0x7fa5b0113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000c00 tx=0x7fa5a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 shutdown_connections 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6802/1204592836,v1:172.21.15.100:6803/1204592836] conn(0x7fa59c074ae0 0x7fa59c076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa59c06ed60 0x7fa59c071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b00fcf80 0x7fa5b0113690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 --2- 172.21.15.100:0/2394129486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b00fb810 0x7fa5b0113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:27.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 >> 172.21.15.100:0/2394129486 conn(0x7fa5b00723b0 msgr2=0x7fa5b0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 shutdown_connections 2024-09-13T02:47:27.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:27.867+0000 7fa5b7541640 1 -- 172.21.15.100:0/2394129486 wait complete. 2024-09-13T02:47:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:29.169 INFO:teuthology.orchestra.run.smithi100.stdout:38654705700 2024-09-13T02:47:29.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T02:47:29.395 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:29 smithi100 ceph-mon[27894]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:29 smithi122 ceph-mon[34559]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 -- 172.21.15.100:0/3937391231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 msgr2=0x7f6bf4108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3937391231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4108870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6be40048d0 tx=0x7f6be4009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 -- 172.21.15.100:0/3937391231 shutdown_connections 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3937391231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4108870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3937391231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 0x7f6bf406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.012+0000 7f6bfb452640 1 -- 172.21.15.100:0/3937391231 >> 172.21.15.100:0/3937391231 conn(0x7f6bf40f80f0 msgr2=0x7f6bf40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 -- 172.21.15.100:0/3937391231 shutdown_connections 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 -- 172.21.15.100:0/3937391231 wait complete. 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 Processor -- start 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 -- start start 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 0x7f6bf41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4115f20 con 0x7f6bf40703c0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bfb452640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4116090 con 0x7f6bf406fab0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bf89ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bf89ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52318/0 (socket says 172.21.15.100:52318) 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.013+0000 7f6bf89ed640 1 -- 172.21.15.100:0/3474560574 learned_addr learned my addr 172.21.15.100:0/3474560574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bf91ee640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 0x7f6bf41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bf89ed640 1 -- 172.21.15.100:0/3474560574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 msgr2=0x7f6bf41153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bf89ed640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 0x7f6bf41153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bf89ed640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4005040 con 0x7f6bf40703c0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bf89ed640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6be4003080 tx=0x7f6be4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be4038070 con 0x7f6bf40703c0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf410f4b0 con 0x7f6bf40703c0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6be402ade0 con 0x7f6bf40703c0 2024-09-13T02:47:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be402c8a0 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.014+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf410f910 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.015+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bf40fa0b0 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f6be4030020 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 0x7f6be0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6be40ae510 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6bf91ee640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 0x7f6be0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 0x7f6be0076d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6be0077420 con 0x7f6be0074960 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6be40ae8f0 con 0x7f6bf40703c0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.016+0000 7f6bf99ef640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 0x7f6be0076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.017+0000 7f6bf91ee640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 0x7f6be0071200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00041d0 tx=0x7f6bf0009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.017+0000 7f6bf99ef640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 0x7f6be0076d70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.017+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== osd.1 v2:172.21.15.100:6810/843516816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6be0077420 con 0x7f6be0074960 2024-09-13T02:47:30.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 --> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bf40711f0 con 0x7f6be0074960 2024-09-13T02:47:30.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6be9ffb640 1 -- 172.21.15.100:0/3474560574 <== osd.1 v2:172.21.15.100:6810/843516816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bf40711f0 con 0x7f6be0074960 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 msgr2=0x7f6be0076d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 0x7f6be0076d70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 msgr2=0x7f6be0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 0x7f6be0071200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00041d0 tx=0x7f6bf0009040 comp rx=0 tx=0).stop 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 msgr2=0x7f6bf4115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6be4003080 tx=0x7f6be4009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 shutdown_connections 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6810/843516816,v1:172.21.15.100:6811/843516816] conn(0x7f6be0074960 0x7f6be0076d70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6be006ed50 0x7f6be0071200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf40703c0 0x7f6bf4115920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 --2- 172.21.15.100:0/3474560574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf406fab0 0x7f6bf41153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 >> 172.21.15.100:0/3474560574 conn(0x7f6bf40f80f0 msgr2=0x7f6bf40f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 shutdown_connections 2024-09-13T02:47:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:30.030+0000 7f6bfb452640 1 -- 172.21.15.100:0/3474560574 wait complete. 2024-09-13T02:47:30.655 INFO:teuthology.orchestra.run.smithi100.stdout:60129542174 2024-09-13T02:47:30.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T02:47:31.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:31 smithi100 ceph-mon[27894]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:31.629 INFO:teuthology.orchestra.run.smithi100.stdout:81604378649 2024-09-13T02:47:31.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T02:47:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:31 smithi122 ceph-mon[34559]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 -- 172.21.15.100:0/1309059390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 msgr2=0x7ff4e0102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 --2- 172.21.15.100:0/1309059390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0102a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00048d0 tx=0x7ff4d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 -- 172.21.15.100:0/1309059390 shutdown_connections 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 --2- 172.21.15.100:0/1309059390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 0x7ff4e00fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 --2- 172.21.15.100:0/1309059390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0102a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 -- 172.21.15.100:0/1309059390 >> 172.21.15.100:0/1309059390 conn(0x7ff4e0070d50 msgr2=0x7ff4e0071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 -- 172.21.15.100:0/1309059390 shutdown_connections 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.076+0000 7ff4e4946640 1 -- 172.21.15.100:0/1309059390 wait complete. 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 Processor -- start 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 -- start start 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 0x7ff4e0113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:32.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0113f20 con 0x7ff4e0102680 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4e4946640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e010d2d0 con 0x7ff4e00facf0 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52336/0 (socket says 172.21.15.100:52336) 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 -- 172.21.15.100:0/3430240995 learned_addr learned my addr 172.21.15.100:0/3430240995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4de59c640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 0x7ff4e0113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 -- 172.21.15.100:0/3430240995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 msgr2=0x7ff4e0113350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 0x7ff4e0113350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 -- 172.21.15.100:0/3430240995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0005040 con 0x7ff4e0102680 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.077+0000 7ff4d7fff640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800b790 tx=0x7ff4c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.078+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c800c700 con 0x7ff4e0102680 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.078+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4c800cd00 con 0x7ff4e0102680 2024-09-13T02:47:32.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.078+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e010d5b0 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.078+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c8015e70 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.078+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e010dad0 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.079+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e00657f0 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.079+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff4c8012070 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.080+0000 7ff4d6ffd640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.080+0000 7ff4de59c640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.080+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff4c808d9c0 con 0x7ff4e0102680 2024-09-13T02:47:32.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.080+0000 7ff4de59c640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 0x7ff4cc071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009ac0 tx=0x7ff4d0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:32.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.085+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff4c805ae20 con 0x7ff4e0102680 2024-09-13T02:47:32.119 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:32.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.252+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff4e0109700 con 0x7ff4e0102680 2024-09-13T02:47:32.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.252+0000 7ff4d6ffd640 1 -- 172.21.15.100:0/3430240995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4c805a7c0 con 0x7ff4e0102680 2024-09-13T02:47:32.254 INFO:teuthology.orchestra.run.smithi100.stdout:137438953488 2024-09-13T02:47:32.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 msgr2=0x7ff4cc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 0x7ff4cc071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009ac0 tx=0x7ff4d0035040 comp rx=0 tx=0).stop 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 msgr2=0x7ff4e0113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800b790 tx=0x7ff4c80091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 shutdown_connections 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4e0102680 0x7ff4e0113890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 --2- 172.21.15.100:0/3430240995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4e00facf0 0x7ff4e0113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 >> 172.21.15.100:0/3430240995 conn(0x7ff4e0070d50 msgr2=0x7ff4e00fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 shutdown_connections 2024-09-13T02:47:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:32.254+0000 7ff4e4946640 1 -- 172.21.15.100:0/3430240995 wait complete. 2024-09-13T02:47:32.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:32 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3430240995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:47:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:32 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3430240995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:47:32.838 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953486 got 137438953488 for osd.4 2024-09-13T02:47:32.839 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:33.401 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:33 smithi100 ceph-mon[27894]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:33 smithi122 ceph-mon[34559]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/3191890709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa00fbd90 msgr2=0x7f0aa00fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/3191890709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa00fbd90 0x7f0aa00fc200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a940048d0 tx=0x7f0a94009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/3191890709 shutdown_connections 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/3191890709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa00fbd90 0x7f0aa00fc200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/3191890709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa01014f0 0x7f0aa01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/3191890709 >> 172.21.15.100:0/3191890709 conn(0x7f0aa0070ce0 msgr2=0x7f0aa00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/3191890709 shutdown_connections 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.423+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/3191890709 wait complete. 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 Processor -- start 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 -- start start 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 0x7f0aa010e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa010ed10 con 0x7f0aa01014f0 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0aa5d3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa010ee80 con 0x7f0aa00fbd90 2024-09-13T02:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0a9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0a9effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52348/0 (socket says 172.21.15.100:52348) 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.424+0000 7f0a9effd640 1 -- 172.21.15.100:0/2686927712 learned_addr learned my addr 172.21.15.100:0/2686927712 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9effd640 1 -- 172.21.15.100:0/2686927712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 msgr2=0x7f0aa010e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9f7fe640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 0x7f0aa010e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9effd640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 0x7f0aa010e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9effd640 1 -- 172.21.15.100:0/2686927712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94005040 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9f7fe640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 0x7f0aa010e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a9effd640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0a94003080 tx=0x7f0a94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a94038070 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a9402ade0 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa01171f0 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9402c880 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.425+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa01175f0 con 0x7f0aa01014f0 2024-09-13T02:47:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.426+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00f9fa0 con 0x7f0aa01014f0 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.426+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0a94030020 con 0x7f0aa01014f0 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.427+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 0x7f0a88071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.427+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0a940adf50 con 0x7f0aa01014f0 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.427+0000 7f0a9f7fe640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 0x7f0a88071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.427+0000 7f0a9f7fe640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 0x7f0a88071200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a90004c80 tx=0x7f0a90009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.431+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a9407b470 con 0x7f0aa01014f0 2024-09-13T02:47:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:34.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.601+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0aa00fcda0 con 0x7f0aa01014f0 2024-09-13T02:47:34.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.601+0000 7f0a87fff640 1 -- 172.21.15.100:0/2686927712 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a9407ae10 con 0x7f0aa01014f0 2024-09-13T02:47:34.603 INFO:teuthology.orchestra.run.smithi100.stdout:111669149717 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 msgr2=0x7f0a88071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 0x7f0a88071200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a90004c80 tx=0x7f0a90009040 comp rx=0 tx=0).stop 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 msgr2=0x7f0aa010e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0a94003080 tx=0x7f0a94009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 shutdown_connections 2024-09-13T02:47:34.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f0a8806ed50 0x7f0a88071200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0aa01014f0 0x7f0aa010e6c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 --2- 172.21.15.100:0/2686927712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0aa00fbd90 0x7f0aa010e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 >> 172.21.15.100:0/2686927712 conn(0x7f0aa0070ce0 msgr2=0x7f0aa00fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 shutdown_connections 2024-09-13T02:47:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:34.603+0000 7f0aa5d3c640 1 -- 172.21.15.100:0/2686927712 wait complete. 2024-09-13T02:47:35.674 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:35 smithi100 ceph-mon[27894]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:35.674 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:35 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2686927712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:47:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:35 smithi122 ceph-mon[34559]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:35 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2686927712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:47:35.700 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149717 for osd.3 2024-09-13T02:47:35.700 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 -- 172.21.15.100:0/3885497384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d41014e0 msgr2=0x7fc0d41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 --2- 172.21.15.100:0/3885497384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d41014e0 0x7fc0d41018b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009c50 tx=0x7fc0c4004d10 comp rx=0 tx=0).stop 2024-09-13T02:47:36.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 -- 172.21.15.100:0/3885497384 shutdown_connections 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 --2- 172.21.15.100:0/3885497384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 --2- 172.21.15.100:0/3885497384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d41014e0 0x7fc0d41018b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 -- 172.21.15.100:0/3885497384 >> 172.21.15.100:0/3885497384 conn(0x7fc0d40f7060 msgr2=0x7fc0d40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 -- 172.21.15.100:0/3885497384 shutdown_connections 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.086+0000 7fc0da084640 1 -- 172.21.15.100:0/3885497384 wait complete. 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 Processor -- start 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 -- start start 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 0x7fc0d4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4113de0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0da084640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d410d190 con 0x7fc0d41014e0 2024-09-13T02:47:36.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0d37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0d37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52368/0 (socket says 172.21.15.100:52368) 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.087+0000 7fc0d37fe640 1 -- 172.21.15.100:0/3512410497 learned_addr learned my addr 172.21.15.100:0/3512410497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d2ffd640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 0x7fc0d4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d37fe640 1 -- 172.21.15.100:0/3512410497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 msgr2=0x7fc0d4113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d37fe640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 0x7fc0d4113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d37fe640 1 -- 172.21.15.100:0/3512410497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c40098b0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d2ffd640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 0x7fc0d4113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0d37fe640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4004a30 tx=0x7fc0c4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c4009690 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d410d410 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0c4032b10 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0c403daa0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.088+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d410d930 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.089+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d40fcbe0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.089+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc0c402f030 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.090+0000 7fc0bbfff640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 0x7fc0bc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.090+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc0c40aef50 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.090+0000 7fc0d2ffd640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 0x7fc0bc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.090+0000 7fc0d2ffd640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 0x7fc0bc071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:36.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.094+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc0c40e12a0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.251+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0d410e880 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.252+0000 7fc0bbfff640 1 -- 172.21.15.100:0/3512410497 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0c407c3b0 con 0x7fc0d40fb4a0 2024-09-13T02:47:36.253 INFO:teuthology.orchestra.run.smithi100.stdout:81604378650 2024-09-13T02:47:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 msgr2=0x7fc0bc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 0x7fc0bc071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 msgr2=0x7fc0d4113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4004a30 tx=0x7fc0c4004d10 comp rx=0 tx=0).stop 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 shutdown_connections 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc0bc06ed50 0x7fc0bc071200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0d41014e0 0x7fc0d4113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.253+0000 7fc0da084640 1 --2- 172.21.15.100:0/3512410497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d40fb4a0 0x7fc0d4113210 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.254+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 >> 172.21.15.100:0/3512410497 conn(0x7fc0d40f7060 msgr2=0x7fc0d4065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.254+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 shutdown_connections 2024-09-13T02:47:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:36.254+0000 7fc0da084640 1 -- 172.21.15.100:0/3512410497 wait complete. 2024-09-13T02:47:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:36 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3512410497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:47:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:36 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3512410497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:47:36.991 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378650 for osd.2 2024-09-13T02:47:36.991 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:37.039 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:37.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:37 smithi100 ceph-mon[27894]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:37.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:37 smithi122 ceph-mon[34559]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- 172.21.15.100:0/75872830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102ed0 msgr2=0x7f1a540fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 --2- 172.21.15.100:0/75872830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102ed0 0x7f1a540fc590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a480048d0 tx=0x7f1a48009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- 172.21.15.100:0/75872830 shutdown_connections 2024-09-13T02:47:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 --2- 172.21.15.100:0/75872830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102ed0 0x7f1a540fc590 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 --2- 172.21.15.100:0/75872830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102530 0x7f1a54102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- 172.21.15.100:0/75872830 >> 172.21.15.100:0/75872830 conn(0x7f1a540f80f0 msgr2=0x7f1a540fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- 172.21.15.100:0/75872830 shutdown_connections 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- 172.21.15.100:0/75872830 wait complete. 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 Processor -- start 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- start start 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102ed0 0x7f1a541137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54113e80 con 0x7f1a54102530 2024-09-13T02:47:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.937+0000 7f1a5b993640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5410d230 con 0x7f1a54102ed0 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34176/0 (socket says 172.21.15.100:34176) 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 -- 172.21.15.100:0/2963468106 learned_addr learned my addr 172.21.15.100:0/2963468106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a58f2e640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102ed0 0x7f1a541137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 -- 172.21.15.100:0/2963468106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102ed0 msgr2=0x7f1a541137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102ed0 0x7f1a541137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 -- 172.21.15.100:0/2963468106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48005040 con 0x7f1a54102530 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5972f640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400bbb0 tx=0x7f1a44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a4400c9c0 con 0x7f1a54102530 2024-09-13T02:47:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a440092e0 con 0x7f1a54102530 2024-09-13T02:47:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5410d510 con 0x7f1a54102530 2024-09-13T02:47:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a44007640 con 0x7f1a54102530 2024-09-13T02:47:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.938+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5410da00 con 0x7f1a54102530 2024-09-13T02:47:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.939+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540fdcb0 con 0x7f1a54102530 2024-09-13T02:47:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.940+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1a44012070 con 0x7f1a54102530 2024-09-13T02:47:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.940+0000 7f1a51ffb640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 0x7f1a3c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.940+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1a4408dfd0 con 0x7f1a54102530 2024-09-13T02:47:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.940+0000 7f1a58f2e640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 0x7f1a3c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.941+0000 7f1a58f2e640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 0x7f1a3c071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a48000c00 tx=0x7f1a48035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:38.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:38.945+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1a4405b430 con 0x7f1a54102530 2024-09-13T02:47:39.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.105+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1a5404b750 con 0x7f1a54102530 2024-09-13T02:47:39.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.106+0000 7f1a51ffb640 1 -- 172.21.15.100:0/2963468106 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a4405add0 con 0x7f1a54102530 2024-09-13T02:47:39.107 INFO:teuthology.orchestra.run.smithi100.stdout:158913789963 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.107+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 msgr2=0x7f1a3c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.107+0000 7f1a5b993640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 0x7f1a3c071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a48000c00 tx=0x7f1a48035040 comp rx=0 tx=0).stop 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.107+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 msgr2=0x7f1a541132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.107+0000 7f1a5b993640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400bbb0 tx=0x7f1a44009840 comp rx=0 tx=0).stop 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.107+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 shutdown_connections 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f1a3c06ed60 0x7f1a3c071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a54102ed0 0x7f1a541137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 --2- 172.21.15.100:0/2963468106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54102530 0x7f1a541132b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 >> 172.21.15.100:0/2963468106 conn(0x7f1a540f80f0 msgr2=0x7f1a540f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 shutdown_connections 2024-09-13T02:47:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.108+0000 7f1a5b993640 1 -- 172.21.15.100:0/2963468106 wait complete. 2024-09-13T02:47:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:39 smithi100 ceph-mon[27894]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:39 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2963468106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:47:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:39 smithi122 ceph-mon[34559]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:39 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2963468106' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:47:39.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 -- 172.21.15.100:0/888226783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102530 msgr2=0x7f9100102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 --2- 172.21.15.100:0/888226783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102530 0x7f9100102900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90f80048d0 tx=0x7f90f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 -- 172.21.15.100:0/888226783 shutdown_connections 2024-09-13T02:47:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 --2- 172.21.15.100:0/888226783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102ed0 0x7f91000fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 --2- 172.21.15.100:0/888226783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102530 0x7f9100102900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 -- 172.21.15.100:0/888226783 >> 172.21.15.100:0/888226783 conn(0x7f91000f8110 msgr2=0x7f91000fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 -- 172.21.15.100:0/888226783 shutdown_connections 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.884+0000 7f91050b6640 1 -- 172.21.15.100:0/888226783 wait complete. 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 Processor -- start 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 -- start start 2024-09-13T02:47:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102530 0x7f9100113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9100113e40 con 0x7f9100102ed0 2024-09-13T02:47:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f91050b6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910010d1f0 con 0x7f9100102530 2024-09-13T02:47:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f90fe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f90fe59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34188/0 (socket says 172.21.15.100:34188) 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f90fe59c640 1 -- 172.21.15.100:0/37239363 learned_addr learned my addr 172.21.15.100:0/37239363 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.885+0000 7f90fed9d640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102530 0x7f9100113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90fe59c640 1 -- 172.21.15.100:0/37239363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102530 msgr2=0x7f9100113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90fe59c640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102530 0x7f9100113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90fe59c640 1 -- 172.21.15.100:0/37239363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8005040 con 0x7f9100102ed0 2024-09-13T02:47:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90fe59c640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90f400b540 tx=0x7f90f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f400f6f0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910010d4d0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90f400fcf0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f4011e80 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.886+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910010d9f0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.887+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91000fdcb0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.887+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f90f40116b0 con 0x7f9100102ed0 2024-09-13T02:47:39.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.888+0000 7f90e77fe640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 0x7f90e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:39.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.888+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f90f408dc50 con 0x7f9100102ed0 2024-09-13T02:47:39.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.888+0000 7f90fed9d640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 0x7f90e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:39.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.888+0000 7f90fed9d640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 0x7f90e8071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90f80048a0 tx=0x7f90f8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:39.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:39.892+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f90f405acb0 con 0x7f9100102ed0 2024-09-13T02:47:40.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.057+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91000fbd30 con 0x7f9100102ed0 2024-09-13T02:47:40.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.057+0000 7f90e77fe640 1 -- 172.21.15.100:0/37239363 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90f405aad0 con 0x7f9100102ed0 2024-09-13T02:47:40.059 INFO:teuthology.orchestra.run.smithi100.stdout:60129542176 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.059+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 msgr2=0x7f90e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.059+0000 7f91050b6640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 0x7f90e8071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90f80048a0 tx=0x7f90f8035040 comp rx=0 tx=0).stop 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.059+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 msgr2=0x7f91001137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.059+0000 7f91050b6640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90f400b540 tx=0x7f90f40091a0 comp rx=0 tx=0).stop 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 shutdown_connections 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90e806ed60 0x7f90e8071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9100102ed0 0x7f91001137b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 --2- 172.21.15.100:0/37239363 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9100102530 0x7f9100113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 >> 172.21.15.100:0/37239363 conn(0x7f91000f8110 msgr2=0x7f91000f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 shutdown_connections 2024-09-13T02:47:40.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:40.060+0000 7f91050b6640 1 -- 172.21.15.100:0/37239363 wait complete. 2024-09-13T02:47:40.550 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:40 smithi100 ceph-mon[27894]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:40.551 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:40 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/37239363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:47:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:40 smithi122 ceph-mon[34559]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:40.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:40 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/37239363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:47:41.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789960 got 158913789963 for osd.5 2024-09-13T02:47:41.227 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:41.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-09-13T02:47:41.662 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 -- 172.21.15.100:0/2894781392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 msgr2=0x7f9a440fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 --2- 172.21.15.100:0/2894781392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a440fb0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a380048d0 tx=0x7f9a38009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 -- 172.21.15.100:0/2894781392 shutdown_connections 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 --2- 172.21.15.100:0/2894781392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a440fb0f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 --2- 172.21.15.100:0/2894781392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a44102620 0x7f9a441029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 -- 172.21.15.100:0/2894781392 >> 172.21.15.100:0/2894781392 conn(0x7f9a44070ce0 msgr2=0x7f9a440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 -- 172.21.15.100:0/2894781392 shutdown_connections 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.236+0000 7f9a4c549640 1 -- 172.21.15.100:0/2894781392 wait complete. 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 Processor -- start 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 -- start start 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a44102620 0x7f9a44113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44113d10 con 0x7f9a440fac80 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4c549640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4410d150 con 0x7f9a44102620 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:42.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34204/0 (socket says 172.21.15.100:34204) 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 -- 172.21.15.100:0/1879340545 learned_addr learned my addr 172.21.15.100:0/1879340545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 -- 172.21.15.100:0/1879340545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a44102620 msgr2=0x7f9a44113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a44102620 0x7f9a44113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 -- 172.21.15.100:0/1879340545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38005040 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.237+0000 7f9a4a2e5640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c830 tx=0x7f9a40004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.238+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4000a850 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.238+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a4000ae50 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.238+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4410d430 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.238+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a400113a0 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.238+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4410d9d0 con 0x7f9a440fac80 2024-09-13T02:47:42.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.239+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440657b0 con 0x7f9a440fac80 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.239+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9a40012400 con 0x7f9a440fac80 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.240+0000 7f9a36ffd640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 0x7f9a30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.240+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9a4008e080 con 0x7f9a440fac80 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.240+0000 7f9a49ae4640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 0x7f9a30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.240+0000 7f9a49ae4640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 0x7f9a30071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802a530 tx=0x7f9a38009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:42.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.245+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9a4005b560 con 0x7f9a440fac80 2024-09-13T02:47:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.400+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a44074c00 con 0x7f9a440fac80 2024-09-13T02:47:42.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.401+0000 7f9a36ffd640 1 -- 172.21.15.100:0/1879340545 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a4005af00 con 0x7f9a440fac80 2024-09-13T02:47:42.402 INFO:teuthology.orchestra.run.smithi100.stdout:38654705703 2024-09-13T02:47:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 msgr2=0x7f9a30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 0x7f9a30071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a3802a530 tx=0x7f9a38009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 msgr2=0x7f9a441131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:42.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c830 tx=0x7f9a40004430 comp rx=0 tx=0).stop 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 shutdown_connections 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f9a3006ed60 0x7f9a30071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a44102620 0x7f9a44113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 --2- 172.21.15.100:0/1879340545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a440fac80 0x7f9a441131d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 >> 172.21.15.100:0/1879340545 conn(0x7f9a44070ce0 msgr2=0x7f9a44100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 shutdown_connections 2024-09-13T02:47:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:42.403+0000 7f9a4c549640 1 -- 172.21.15.100:0/1879340545 wait complete. 2024-09-13T02:47:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:42 smithi100 ceph-mon[27894]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:42.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:42 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1879340545' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:47:42.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:42 smithi122 ceph-mon[34559]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:42.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:42 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1879340545' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:47:43.020 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705703 for osd.0 2024-09-13T02:47:43.020 DEBUG:teuthology.parallel:result is None 2024-09-13T02:47:43.020 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T02:47:43.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:47:43.265 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:44.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:44 smithi100 ceph-mon[27894]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.892+0000 7fb59fb1e640 1 -- 172.21.15.100:0/3359656694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 msgr2=0x7fb5980fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.892+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/3359656694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb5980fd3d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0048d0 tx=0x7fb58c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- 172.21.15.100:0/3359656694 shutdown_connections 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/3359656694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb5980fd3d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/3359656694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb5980fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- 172.21.15.100:0/3359656694 >> 172.21.15.100:0/3359656694 conn(0x7fb5980723b0 msgr2=0x7fb5980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- 172.21.15.100:0/3359656694 shutdown_connections 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- 172.21.15.100:0/3359656694 wait complete. 2024-09-13T02:47:44.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 Processor -- start 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- start start 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb59810e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59810ee80 con 0x7fb5980fcf80 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59fb1e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59810eff0 con 0x7fb5980fb810 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59d0b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59d0b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34226/0 (socket says 172.21.15.100:34226) 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.893+0000 7fb59d0b9640 1 -- 172.21.15.100:0/860046421 learned_addr learned my addr 172.21.15.100:0/860046421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d8ba640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb59810e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d0b9640 1 -- 172.21.15.100:0/860046421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 msgr2=0x7fb59810e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d0b9640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb59810e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d0b9640 1 -- 172.21.15.100:0/860046421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c005040 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d8ba640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb59810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59d0b9640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb58c003080 tx=0x7fb58c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb58c038070 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb58c0097e0 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb58c03d420 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb598117310 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.894+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5981177a0 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.895+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5980fcbc0 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.895+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb58c030020 con 0x7fb5980fcf80 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.896+0000 7fb5967fc640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 0x7fb580071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.896+0000 7fb59d8ba640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 0x7fb580071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.896+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb58c0ae3a0 con 0x7fb5980fcf80 2024-09-13T02:47:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.896+0000 7fb59d8ba640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 0x7fb580071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb588007fd0 tx=0x7fb5880074f0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:44.900+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb58c07b800 con 0x7fb5980fcf80 2024-09-13T02:47:44.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:44 smithi122 ceph-mon[34559]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:45.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.052+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5980657d0 con 0x7fb58006ed60 2024-09-13T02:47:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.054+0000 7fb5967fc640 1 -- 172.21.15.100:0/860046421 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28003 (secure 0 0 0) 0x7fb5980657d0 con 0x7fb58006ed60 2024-09-13T02:47:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 msgr2=0x7fb580071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 0x7fb580071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb588007fd0 tx=0x7fb5880074f0 comp rx=0 tx=0).stop 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 msgr2=0x7fb59810e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb58c003080 tx=0x7fb58c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 shutdown_connections 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb58006ed60 0x7fb580071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5980fcf80 0x7fb59810e7a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 --2- 172.21.15.100:0/860046421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5980fb810 0x7fb59810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 >> 172.21.15.100:0/860046421 conn(0x7fb5980723b0 msgr2=0x7fb5980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 shutdown_connections 2024-09-13T02:47:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:45.056+0000 7fb59fb1e640 1 -- 172.21.15.100:0/860046421 wait complete. 2024-09-13T02:47:45.697 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-13T02:47:43.541981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787928,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682984,"statfs":{"total":575970213888,"available":574139375616,"internally_reserved":0,"allocated":3866624,"data_stored":2557439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001947"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T02:46:51.169758+0000","last_change":"2024-09-13T02:46:27.111345+0000","last_active":"2024-09-13T02:46:51.169758+0000","last_peered":"2024-09-13T02:46:51.169758+0000","last_clean":"2024-09-13T02:46:51.169758+0000","last_became_active":"2024-09-13T02:46:27.111088+0000","last_became_peered":"2024-09-13T02:46:27.111088+0000","last_unstale":"2024-09-13T02:46:51.169758+0000","last_undegraded":"2024-09-13T02:46:51.169758+0000","last_fullsized":"2024-09-13T02:46:51.169758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:45:40.347362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:45:40.347362+0000","last_clean_scrub_stamp":"2024-09-13T02:45:40.347362+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:27.643260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.505},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297692,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447460,"statfs":{"total":95995035648,"available":95690199040,"internally_reserved":0,"allocated":344064,"data_stored":130505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:46:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.314}]},{"osd":1,"last update":"Fri Sep 13 02:46:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.378},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Sep 13 02:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.498}]},{"osd":4,"last update":"Fri Sep 13 02:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.29399999999999998},"min":{"1min":0.21099999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.253},{"interface":"front","average":{"1min":0.374,"5min":0.31,"15min":0.29899999999999999},"min":{"1min":0.252,"5min":0.191,"15min":0.191},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.29799999999999999}]},{"osd":2,"last update":"Fri Sep 13 02:46:45 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.26400000000000001}]},{"osd":3,"last update":"Fri Sep 13 02:47:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Sep 13 02:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.252,"5min":0.186,"15min":0.186},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.22900000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Sep 13 02:46:44 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.432}]},{"osd":3,"last update":"Fri Sep 13 02:47:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.63},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Sep 13 02:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:47:45.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:47:45.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:45 smithi100 ceph-mon[27894]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:47:45.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:45 smithi122 ceph-mon[34559]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:47:45.942 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:46 smithi100 ceph-mon[27894]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:46 smithi122 ceph-mon[34559]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 -- 172.21.15.100:0/1219724865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 msgr2=0x7fa88c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 --2- 172.21.15.100:0/1219724865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c0fb910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0048d0 tx=0x7fa87c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 -- 172.21.15.100:0/1219724865 shutdown_connections 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 --2- 172.21.15.100:0/1219724865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c0fb910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 --2- 172.21.15.100:0/1219724865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 -- 172.21.15.100:0/1219724865 >> 172.21.15.100:0/1219724865 conn(0x7fa88c0f7060 msgr2=0x7fa88c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:47.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 -- 172.21.15.100:0/1219724865 shutdown_connections 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.500+0000 7fa8947a5640 1 -- 172.21.15.100:0/1219724865 wait complete. 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 Processor -- start 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 -- start start 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c113d00 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa8947a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c113e70 con 0x7fa88c1014e0 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34252/0 (socket says 172.21.15.100:34252) 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 -- 172.21.15.100:0/683718322 learned_addr learned my addr 172.21.15.100:0/683718322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa891d40640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 -- 172.21.15.100:0/683718322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 msgr2=0x7fa88c113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa892541640 1 -- 172.21.15.100:0/683718322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c005040 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.501+0000 7fa891d40640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa892541640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa888002a50 tx=0x7fa888004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa888007c30 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c10d2f0 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa88800f040 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa88800da90 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.502+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c10d890 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.503+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c0fcbe0 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.503+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa88800dd00 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.504+0000 7fa882ffd640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 0x7fa878071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.504+0000 7fa891d40640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 0x7fa878071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.504+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa88808d700 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.504+0000 7fa891d40640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 0x7fa878071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa88c10eac0 tx=0x7fa87c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:47.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.508+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa88804d2a0 con 0x7fa88c0fb4a0 2024-09-13T02:47:47.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.664+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa88c10e870 con 0x7fa87806ed60 2024-09-13T02:47:47.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.666+0000 7fa882ffd640 1 -- 172.21.15.100:0/683718322 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27914 (secure 0 0 0) 0x7fa88c10e870 con 0x7fa87806ed60 2024-09-13T02:47:47.667 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:47.668 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 msgr2=0x7fa878071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 0x7fa878071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa88c10eac0 tx=0x7fa87c035040 comp rx=0 tx=0).stop 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 msgr2=0x7fa88c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa888002a50 tx=0x7fa888004600 comp rx=0 tx=0).stop 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 shutdown_connections 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa87806ed60 0x7fa878071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa88c1014e0 0x7fa88c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 --2- 172.21.15.100:0/683718322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa88c0fb4a0 0x7fa88c1131c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 >> 172.21.15.100:0/683718322 conn(0x7fa88c0f7060 msgr2=0x7fa88c065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 shutdown_connections 2024-09-13T02:47:47.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:47.668+0000 7fa8947a5640 1 -- 172.21.15.100:0/683718322 wait complete. 2024-09-13T02:47:48.403 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T02:47:47.542886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787928,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682984,"statfs":{"total":575970213888,"available":574139375616,"internally_reserved":0,"allocated":3866624,"data_stored":2557439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002266"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T02:46:51.169758+0000","last_change":"2024-09-13T02:46:27.111345+0000","last_active":"2024-09-13T02:46:51.169758+0000","last_peered":"2024-09-13T02:46:51.169758+0000","last_clean":"2024-09-13T02:46:51.169758+0000","last_became_active":"2024-09-13T02:46:27.111088+0000","last_became_peered":"2024-09-13T02:46:27.111088+0000","last_unstale":"2024-09-13T02:46:51.169758+0000","last_undegraded":"2024-09-13T02:46:51.169758+0000","last_fullsized":"2024-09-13T02:46:51.169758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:45:40.347362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:45:40.347362+0000","last_clean_scrub_stamp":"2024-09-13T02:45:40.347362+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:27.643260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.505},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 02:47:31 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297692,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447460,"statfs":{"total":95995035648,"available":95690199040,"internally_reserved":0,"allocated":344064,"data_stored":130505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.23799999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.48799999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 02:47:44 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.372,"15min":0.378},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.502,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36099999999999999,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Sep 13 02:47:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 02:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:47:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.30199999999999999,"15min":0.29399999999999998},"min":{"1min":0.21099999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.31,"15min":0.29899999999999999},"min":{"1min":0.252,"5min":0.191,"15min":0.191},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.223}]},{"osd":2,"last update":"Fri Sep 13 02:47:46 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.36499999999999999,"15min":0.371},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.25}]},{"osd":3,"last update":"Fri Sep 13 02:47:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Sep 13 02:47:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.439},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.252,"5min":0.186,"15min":0.186},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.22900000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 13 02:46:44 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.29599999999999999}]},{"osd":3,"last update":"Fri Sep 13 02:47:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Sep 13 02:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:47:48.404 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T02:47:48.405 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T02:47:48.405 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T02:47:48.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T02:47:48.652 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:48.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:48 smithi100 ceph-mon[27894]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:48.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:48 smithi100 ceph-mon[27894]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:47:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:48 smithi122 ceph-mon[34559]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:48 smithi122 ceph-mon[34559]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:47:50.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 -- 172.21.15.100:0/2949891090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 msgr2=0x7f7ab81018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/2949891090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab81018b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80048d0 tx=0x7f7aa8009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 -- 172.21.15.100:0/2949891090 shutdown_connections 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/2949891090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 0x7f7ab80fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/2949891090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab81018b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 -- 172.21.15.100:0/2949891090 >> 172.21.15.100:0/2949891090 conn(0x7f7ab80f7060 msgr2=0x7f7ab80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 -- 172.21.15.100:0/2949891090 shutdown_connections 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.371+0000 7f7abcfe5640 1 -- 172.21.15.100:0/2949891090 wait complete. 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 Processor -- start 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 -- start start 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 0x7f7ab8112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab8112ce0 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7abcfe5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab810c090 con 0x7f7ab80fb4a0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59376/0 (socket says 172.21.15.100:59376) 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 -- 172.21.15.100:0/880516844 learned_addr learned my addr 172.21.15.100:0/880516844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7ab659c640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 0x7f7ab8112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 -- 172.21.15.100:0/880516844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 msgr2=0x7f7ab8112110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 0x7f7ab8112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 -- 172.21.15.100:0/880516844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8005040 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.372+0000 7f7aaffff640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000b790 tx=0x7f7aa00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.373+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa000c700 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.373+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7aa000cd00 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.373+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab810c370 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.373+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa0015e70 con 0x7f7ab81014e0 2024-09-13T02:47:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.373+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab810c890 con 0x7f7ab81014e0 2024-09-13T02:47:50.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.374+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab80fcbe0 con 0x7f7ab81014e0 2024-09-13T02:47:50.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.374+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7aa0012070 con 0x7f7ab81014e0 2024-09-13T02:47:50.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.375+0000 7f7aaeffd640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 0x7f7aa4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:50.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.375+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7aa008d930 con 0x7f7ab81014e0 2024-09-13T02:47:50.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.375+0000 7f7ab659c640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 0x7f7aa4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:50.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.375+0000 7f7ab659c640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 0x7f7aa4071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8004540 tx=0x7f7aa8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:50.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.379+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7aa005ae10 con 0x7f7ab81014e0 2024-09-13T02:47:50.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.567+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7ab80fac60 con 0x7f7ab81014e0 2024-09-13T02:47:50.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.567+0000 7f7aaeffd640 1 -- 172.21.15.100:0/880516844 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7aa005a7b0 con 0x7f7ab81014e0 2024-09-13T02:47:50.569 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:47:50.569 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 msgr2=0x7f7aa4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 0x7f7aa4071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8004540 tx=0x7f7aa8009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 msgr2=0x7f7ab8112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000b790 tx=0x7f7aa00091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 shutdown_connections 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7aa406ed60 0x7f7aa4071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ab81014e0 0x7f7ab8112650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 --2- 172.21.15.100:0/880516844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ab80fb4a0 0x7f7ab8112110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:50.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 >> 172.21.15.100:0/880516844 conn(0x7f7ab80f7060 msgr2=0x7f7ab80f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 shutdown_connections 2024-09-13T02:47:50.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:50.569+0000 7f7abcfe5640 1 -- 172.21.15.100:0/880516844 wait complete. 2024-09-13T02:47:50.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:50 smithi100 ceph-mon[27894]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:50.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:50 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/880516844' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:47:50.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:50 smithi122 ceph-mon[34559]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:50.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:50 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/880516844' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:47:51.319 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T02:47:51.319 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T02:47:51.320 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:47:51.329 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-13T02:47:51.329 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:47:51.370 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:47:51.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T02:47:51.616 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:51.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:51.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:52.907 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:52 smithi100 ceph-mon[27894]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:52.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:52 smithi122 ceph-mon[34559]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 -- 172.21.15.100:0/878297030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fc720 msgr2=0x7f218c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 --2- 172.21.15.100:0/878297030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fc720 0x7f218c0fcb90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f21780048d0 tx=0x7f2178009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 -- 172.21.15.100:0/878297030 shutdown_connections 2024-09-13T02:47:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 --2- 172.21.15.100:0/878297030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fc720 0x7f218c0fcb90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 --2- 172.21.15.100:0/878297030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fb450 0x7f218c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 -- 172.21.15.100:0/878297030 >> 172.21.15.100:0/878297030 conn(0x7f218c0f6c10 msgr2=0x7f218c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 -- 172.21.15.100:0/878297030 shutdown_connections 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.176+0000 7f2193014640 1 -- 172.21.15.100:0/878297030 wait complete. 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 Processor -- start 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 -- start start 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fc720 0x7f218c10c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c10d3b0 con 0x7f218c0fb450 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2193014640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c10d520 con 0x7f218c0fc720 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2190db0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2190db0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59386/0 (socket says 172.21.15.100:59386) 2024-09-13T02:47:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.177+0000 7f2190db0640 1 -- 172.21.15.100:0/52467799 learned_addr learned my addr 172.21.15.100:0/52467799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f218bfff640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fc720 0x7f218c10c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2190db0640 1 -- 172.21.15.100:0/52467799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fc720 msgr2=0x7f218c10c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2190db0640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fc720 0x7f218c10c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2190db0640 1 -- 172.21.15.100:0/52467799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178005040 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2190db0640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f218000b790 tx=0x7f21800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f218000c700 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f218000cd00 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c10d800 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2180015e80 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.178+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c10dd20 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.179+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c1046e0 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.180+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2180012070 con 0x7f218c0fb450 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.180+0000 7f21897fa640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 0x7f217c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.180+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f218008d6c0 con 0x7f218c0fb450 2024-09-13T02:47:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.180+0000 7f218bfff640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 0x7f217c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.181+0000 7f218bfff640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 0x7f217c071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f218c10bdb0 tx=0x7f2178035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.184+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f218005ab20 con 0x7f218c0fb450 2024-09-13T02:47:53.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.338+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f218c0fa8b0 con 0x7f218c0fb450 2024-09-13T02:47:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.343+0000 7f21897fa640 1 -- 172.21.15.100:0/52467799 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f218005a4c0 con 0x7f218c0fb450 2024-09-13T02:47:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 msgr2=0x7f217c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 0x7f217c071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f218c10bdb0 tx=0x7f2178035040 comp rx=0 tx=0).stop 2024-09-13T02:47:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 msgr2=0x7f218c10c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f218000b790 tx=0x7f21800091d0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 shutdown_connections 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f217c06ed60 0x7f217c071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f218c0fc720 0x7f218c10c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 --2- 172.21.15.100:0/52467799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f218c0fb450 0x7f218c10c000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 >> 172.21.15.100:0/52467799 conn(0x7f218c0f6c10 msgr2=0x7f218c0f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 shutdown_connections 2024-09-13T02:47:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:53.345+0000 7f2193014640 1 -- 172.21.15.100:0/52467799 wait complete. 2024-09-13T02:47:54.135 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:47:54.145 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T02:47:54.145 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:47:54.196 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:47:54.196 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T02:47:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/52467799' entity='client.admin' 2024-09-13T02:47:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:54 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:47:54.446 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/52467799' entity='client.admin' 2024-09-13T02:47:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:54.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:54 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 -- 172.21.15.100:0/640869940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0980ff6c0 msgr2=0x7fe098101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/640869940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0980ff6c0 0x7fe098101aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe0800048d0 tx=0x7fe080009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 -- 172.21.15.100:0/640869940 shutdown_connections 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/640869940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0980ff6c0 0x7fe098101aa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/640869940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe098066710 0x7fe0980ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 -- 172.21.15.100:0/640869940 >> 172.21.15.100:0/640869940 conn(0x7fe0980f6c10 msgr2=0x7fe0980f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 -- 172.21.15.100:0/640869940 shutdown_connections 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.122+0000 7fe09e5a6640 1 -- 172.21.15.100:0/640869940 wait complete. 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 Processor -- start 2024-09-13T02:47:56.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 -- start start 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ff6c0 0x7fe09810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09810dc40 con 0x7fe098066710 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe09e5a6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09810e460 con 0x7fe0980ff6c0 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe097fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe097fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59404/0 (socket says 172.21.15.100:59404) 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.123+0000 7fe097fff640 1 -- 172.21.15.100:0/314886119 learned_addr learned my addr 172.21.15.100:0/314886119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe08ffff640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ff6c0 0x7fe09810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe097fff640 1 -- 172.21.15.100:0/314886119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ff6c0 msgr2=0x7fe09810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe097fff640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ff6c0 0x7fe09810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe097fff640 1 -- 172.21.15.100:0/314886119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080005040 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe097fff640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c7e0 tx=0x7fe0880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08800a820 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09810e6f0 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe08800ae20 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0880113a0 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.124+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09810ec90 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.125+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0980fa8d0 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.125+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe088012400 con 0x7fe098066710 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.126+0000 7fe0957fa640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 0x7fe084071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.126+0000 7fe08ffff640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 0x7fe084071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:56.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.126+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe08808df30 con 0x7fe098066710 2024-09-13T02:47:56.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.126+0000 7fe08ffff640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 0x7fe084071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe080007ac0 tx=0x7fe080035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:56.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.130+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe08805af90 con 0x7fe098066710 2024-09-13T02:47:56.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.301+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe09810f050 con 0x7fe08406ed60 2024-09-13T02:47:56.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.302+0000 7fe0957fa640 1 -- 172.21.15.100:0/314886119 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe09810f050 con 0x7fe08406ed60 2024-09-13T02:47:56.303 INFO:teuthology.orchestra.run.smithi100.stdout:Backend: cephadm 2024-09-13T02:47:56.303 INFO:teuthology.orchestra.run.smithi100.stdout:Available: Yes 2024-09-13T02:47:56.303 INFO:teuthology.orchestra.run.smithi100.stdout:Paused: No 2024-09-13T02:47:56.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 msgr2=0x7fe084071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:56.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 0x7fe084071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe080007ac0 tx=0x7fe080035040 comp rx=0 tx=0).stop 2024-09-13T02:47:56.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 msgr2=0x7fe09810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:56.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c7e0 tx=0x7fe0880043c0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 shutdown_connections 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fe08406ed60 0x7fe084071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0980ff6c0 0x7fe09810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 --2- 172.21.15.100:0/314886119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe098066710 0x7fe09810d0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 >> 172.21.15.100:0/314886119 conn(0x7fe0980f6c10 msgr2=0x7fe0980f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 shutdown_connections 2024-09-13T02:47:56.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:56.304+0000 7fe09e5a6640 1 -- 172.21.15.100:0/314886119 wait complete. 2024-09-13T02:47:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:56 smithi122 ceph-mon[34559]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:56.830 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:56 smithi100 ceph-mon[27894]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:56.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T02:47:57.208 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:57.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:57 smithi100 ceph-mon[27894]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:57.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:57 smithi122 ceph-mon[34559]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:58.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:58 smithi100 ceph-mon[27894]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- 172.21.15.100:0/4156851749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fd7f0 msgr2=0x7eff680fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 --2- 172.21.15.100:0/4156851749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fd7f0 0x7eff680fdc60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0048d0 tx=0x7eff5c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- 172.21.15.100:0/4156851749 shutdown_connections 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 --2- 172.21.15.100:0/4156851749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fd7f0 0x7eff680fdc60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 --2- 172.21.15.100:0/4156851749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fc520 0x7eff680fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- 172.21.15.100:0/4156851749 >> 172.21.15.100:0/4156851749 conn(0x7eff680f7ce0 msgr2=0x7eff680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- 172.21.15.100:0/4156851749 shutdown_connections 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- 172.21.15.100:0/4156851749 wait complete. 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 Processor -- start 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- start start 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fd7f0 0x7eff6810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6810dc10 con 0x7eff680fc520 2024-09-13T02:47:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff70608640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6810e430 con 0x7eff680fd7f0 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.870+0000 7eff6e3a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32930/0 (socket says 172.21.15.100:32930) 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 -- 172.21.15.100:0/1688035022 learned_addr learned my addr 172.21.15.100:0/1688035022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6dba3640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fd7f0 0x7eff6810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 -- 172.21.15.100:0/1688035022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fd7f0 msgr2=0x7eff6810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fd7f0 0x7eff6810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 -- 172.21.15.100:0/1688035022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c005040 con 0x7eff680fc520 2024-09-13T02:47:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff6e3a4640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff5800db00 tx=0x7eff58004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff58017070 con 0x7eff680fc520 2024-09-13T02:47:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6810e6c0 con 0x7eff680fc520 2024-09-13T02:47:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff5800f040 con 0x7eff680fc520 2024-09-13T02:47:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff58003960 con 0x7eff680fc520 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.871+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6810ec60 con 0x7eff680fc520 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.872+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680fb980 con 0x7eff680fc520 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.873+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7eff58003b50 con 0x7eff680fc520 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.873+0000 7eff66ffd640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 0x7eff50071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.873+0000 7eff6dba3640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 0x7eff50071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.873+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff5808de60 con 0x7eff680fc520 2024-09-13T02:47:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.874+0000 7eff6dba3640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 0x7eff50071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff6810ce30 tx=0x7eff5c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:58.877+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7eff5805b2c0 con 0x7eff680fc520 2024-09-13T02:47:58.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:58 smithi122 ceph-mon[34559]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:47:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.038+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff6810efb0 con 0x7eff5006ed60 2024-09-13T02:47:59.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.046+0000 7eff66ffd640 1 -- 172.21.15.100:0/1688035022 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7eff6810efb0 con 0x7eff5006ed60 2024-09-13T02:47:59.047 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:47:59.047 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 2m ago 5m 26.6M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:47:59.047 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (5m) 2m ago 5m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (4m) 68s ago 4m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (3m) 2m ago 4m 77.8M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (6m) 2m ago 6m 438M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (4m) 68s ago 4m 401M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 9b6cea2a7fc4 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (6m) 2m ago 6m 41.4M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (4m) 68s ago 4m 39.4M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 2m ago 5m 15.1M - 1.5.0 0da6a335fe13 0d6356dae8e0 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (4m) 68s ago 4m 16.2M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (3m) 2m ago 3m 35.2M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 2m ago 2m 34.7M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (2m) 2m ago 2m 13.6M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (2m) 68s ago 2m 39.2M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:47:59.048 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (99s) 68s ago 98s 36.8M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (73s) 68s ago 73s 11.7M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (3m) 2m ago 4m 35.4M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 msgr2=0x7eff50071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 0x7eff50071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff6810ce30 tx=0x7eff5c035040 comp rx=0 tx=0).stop 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 msgr2=0x7eff6810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:59.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff5800db00 tx=0x7eff58004e60 comp rx=0 tx=0).stop 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 shutdown_connections 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff5006ed60 0x7eff50071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff680fd7f0 0x7eff6810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 --2- 172.21.15.100:0/1688035022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff680fc520 0x7eff6810d080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 >> 172.21.15.100:0/1688035022 conn(0x7eff680f7ce0 msgr2=0x7eff680f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 shutdown_connections 2024-09-13T02:47:59.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:47:59.048+0000 7eff70608640 1 -- 172.21.15.100:0/1688035022 wait complete. 2024-09-13T02:47:59.664 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T02:47:59.914 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:47:59.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:47:59 smithi100 ceph-mon[27894]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:59.941 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:47:59 smithi122 ceph-mon[34559]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:00.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:00 smithi100 ceph-mon[27894]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:00 smithi122 ceph-mon[34559]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:01.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 -- 172.21.15.100:0/2039847716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fc550 msgr2=0x7eff580fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:01.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/2039847716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fc550 0x7eff580fc960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7eff480048d0 tx=0x7eff48009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 -- 172.21.15.100:0/2039847716 shutdown_connections 2024-09-13T02:48:01.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/2039847716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fd820 0x7eff580fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/2039847716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fc550 0x7eff580fc960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 -- 172.21.15.100:0/2039847716 >> 172.21.15.100:0/2039847716 conn(0x7eff580f7d30 msgr2=0x7eff580fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 -- 172.21.15.100:0/2039847716 shutdown_connections 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.433+0000 7eff5d2c2640 1 -- 172.21.15.100:0/2039847716 wait complete. 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 Processor -- start 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 -- start start 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fc550 0x7eff5810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5810dc30 con 0x7eff580fd820 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff5d2c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5810e450 con 0x7eff580fc550 2024-09-13T02:48:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32944/0 (socket says 172.21.15.100:32944) 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 -- 172.21.15.100:0/998085830 learned_addr learned my addr 172.21.15.100:0/998085830 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff56ffd640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fc550 0x7eff5810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 -- 172.21.15.100:0/998085830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fc550 msgr2=0x7eff5810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fc550 0x7eff5810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 -- 172.21.15.100:0/998085830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48005040 con 0x7eff580fd820 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.434+0000 7eff4e7fc640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff40002a50 tx=0x7eff40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.435+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff40007c30 con 0x7eff580fd820 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.435+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff4000f040 con 0x7eff580fd820 2024-09-13T02:48:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.435+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4000da10 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.435+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5810e6e0 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.435+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5810ec80 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.436+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff580fb9b0 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.436+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7eff4000dc80 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.437+0000 7eff4ffff640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 0x7eff44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.437+0000 7eff56ffd640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 0x7eff44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.437+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff4008d600 con 0x7eff580fd820 2024-09-13T02:48:01.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.437+0000 7eff56ffd640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 0x7eff44071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff4800b020 tx=0x7eff48035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:01.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.441+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7eff4004d2a0 con 0x7eff580fd820 2024-09-13T02:48:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.604+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7eff5810efb0 con 0x7eff4406ed60 2024-09-13T02:48:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.608+0000 7eff4ffff640 1 -- 172.21.15.100:0/998085830 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7eff5810efb0 con 0x7eff4406ed60 2024-09-13T02:48:01.610 INFO:teuthology.orchestra.run.smithi100.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T02:48:01.610 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:crash 2/2 2m ago 5m * 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:mon 2/2 2m ago 5m smithi100:172.21.15.100=smithi100;smithi122:172.21.15.122=smithi122;count:2 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:osd 6 2m ago - 2024-09-13T02:48:01.611 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.610+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 msgr2=0x7eff44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.610+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 0x7eff44071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff4800b020 tx=0x7eff48035040 comp rx=0 tx=0).stop 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 msgr2=0x7eff5810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff40002a50 tx=0x7eff40004600 comp rx=0 tx=0).stop 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 shutdown_connections 2024-09-13T02:48:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7eff4406ed60 0x7eff44071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff580fd820 0x7eff5810d5e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 --2- 172.21.15.100:0/998085830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff580fc550 0x7eff5810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 >> 172.21.15.100:0/998085830 conn(0x7eff580f7d30 msgr2=0x7eff580f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 shutdown_connections 2024-09-13T02:48:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:01.611+0000 7eff5d2c2640 1 -- 172.21.15.100:0/998085830 wait complete. 2024-09-13T02:48:02.337 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T02:48:02.583 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:02.915 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:02 smithi100 ceph-mon[27894]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:02.915 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:02 smithi100 ceph-mon[27894]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:02.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:02 smithi122 ceph-mon[34559]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:02.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:02 smithi122 ceph-mon[34559]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:04.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.289+0000 7ff6410ed640 1 -- 172.21.15.100:0/999826697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fd840 msgr2=0x7ff63c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:04.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.289+0000 7ff6410ed640 1 --2- 172.21.15.100:0/999826697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fd840 0x7ff63c0fdcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff6240048d0 tx=0x7ff624009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 -- 172.21.15.100:0/999826697 shutdown_connections 2024-09-13T02:48:04.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 --2- 172.21.15.100:0/999826697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fd840 0x7ff63c0fdcb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 --2- 172.21.15.100:0/999826697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fc570 0x7ff63c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 -- 172.21.15.100:0/999826697 >> 172.21.15.100:0/999826697 conn(0x7ff63c0f7d30 msgr2=0x7ff63c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 -- 172.21.15.100:0/999826697 shutdown_connections 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 -- 172.21.15.100:0/999826697 wait complete. 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 Processor -- start 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.290+0000 7ff6410ed640 1 -- start start 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fd840 0x7ff63c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c10e4a0 con 0x7ff63c0fc570 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c10e610 con 0x7ff63c0fd840 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32970/0 (socket says 172.21.15.100:32970) 2024-09-13T02:48:04.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 -- 172.21.15.100:0/1557855423 learned_addr learned my addr 172.21.15.100:0/1557855423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63a59c640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fd840 0x7ff63c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 -- 172.21.15.100:0/1557855423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fd840 msgr2=0x7ff63c10d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fd840 0x7ff63c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 -- 172.21.15.100:0/1557855423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624005040 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff63ad9d640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00b790 tx=0x7ff62c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c00c700 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff62c00cd00 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c015e70 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c10e8f0 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.291+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c10ee10 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.292+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c105800 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.293+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff62c012070 con 0x7ff63c0fc570 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.293+0000 7ff6337fe640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 0x7ff628071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.293+0000 7ff63a59c640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 0x7ff628071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.293+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff62c08d9b0 con 0x7ff63c0fc570 2024-09-13T02:48:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.294+0000 7ff63a59c640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 0x7ff628071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff624000c00 tx=0x7ff624009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.297+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff62c05ae10 con 0x7ff63c0fc570 2024-09-13T02:48:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.459+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff63c10f090 con 0x7ff62806ed60 2024-09-13T02:48:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.461+0000 7ff6337fe640 1 -- 172.21.15.100:0/1557855423 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7ff63c10f090 con 0x7ff62806ed60 2024-09-13T02:48:04.463 INFO:teuthology.orchestra.run.smithi100.stdout:HOST ADDR LABELS STATUS 2024-09-13T02:48:04.464 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 172.21.15.100 2024-09-13T02:48:04.464 INFO:teuthology.orchestra.run.smithi100.stdout:smithi122 172.21.15.122 2024-09-13T02:48:04.464 INFO:teuthology.orchestra.run.smithi100.stdout:2 hosts in cluster 2024-09-13T02:48:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 msgr2=0x7ff628071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 0x7ff628071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff624000c00 tx=0x7ff624009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 msgr2=0x7ff63c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00b790 tx=0x7ff62c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 shutdown_connections 2024-09-13T02:48:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff62806ed60 0x7ff628071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff63c0fd840 0x7ff63c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 --2- 172.21.15.100:0/1557855423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63c0fc570 0x7ff63c10d0f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 >> 172.21.15.100:0/1557855423 conn(0x7ff63c0f7d30 msgr2=0x7ff63c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 shutdown_connections 2024-09-13T02:48:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:04.463+0000 7ff6410ed640 1 -- 172.21.15.100:0/1557855423 wait complete. 2024-09-13T02:48:04.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:04 smithi100 ceph-mon[27894]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:04.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:04 smithi122 ceph-mon[34559]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:05.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T02:48:05.327 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:05.746 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:05 smithi100 ceph-mon[27894]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:05.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:05 smithi122 ceph-mon[34559]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:06 smithi100 ceph-mon[27894]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:06 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:06 smithi122 ceph-mon[34559]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:06 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 -- 172.21.15.100:0/783425476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fb450 msgr2=0x7f96740fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 --2- 172.21.15.100:0/783425476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fb450 0x7f96740fb860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96680048d0 tx=0x7f9668009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 -- 172.21.15.100:0/783425476 shutdown_connections 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 --2- 172.21.15.100:0/783425476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fc720 0x7f96740fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 --2- 172.21.15.100:0/783425476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fb450 0x7f96740fb860 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:06.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 -- 172.21.15.100:0/783425476 >> 172.21.15.100:0/783425476 conn(0x7f96740f6c10 msgr2=0x7f96740f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.870+0000 7f967ade7640 1 -- 172.21.15.100:0/783425476 shutdown_connections 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 -- 172.21.15.100:0/783425476 wait complete. 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 Processor -- start 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 -- start start 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fb450 0x7f967410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96740667b0 con 0x7f96740fc720 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f967ade7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674066920 con 0x7f96740fb450 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f9673fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f9673fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32990/0 (socket says 172.21.15.100:32990) 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f9673fff640 1 -- 172.21.15.100:0/1449863585 learned_addr learned my addr 172.21.15.100:0/1449863585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.871+0000 7f9678b83640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fb450 0x7f967410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f9673fff640 1 -- 172.21.15.100:0/1449863585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fb450 msgr2=0x7f967410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:06.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f9673fff640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fb450 0x7f967410fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f9673fff640 1 -- 172.21.15.100:0/1449863585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668005040 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f9673fff640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9660002a50 tx=0x7f9660004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9660007c30 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f966000f040 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f966000da10 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96741128d0 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.872+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9674112e40 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.873+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96740fa8b0 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.874+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f966000dc80 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.874+0000 7f96717fa640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 0x7f9664071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.874+0000 7f9678b83640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 0x7f9664071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.874+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f966008d5c0 con 0x7f96740fc720 2024-09-13T02:48:06.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.875+0000 7f9678b83640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 0x7f9664071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9668000c00 tx=0x7f9668035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:06.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:06.878+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f966004d2a0 con 0x7f96740fc720 2024-09-13T02:48:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.043+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9674100b30 con 0x7f966406ed60 2024-09-13T02:48:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.045+0000 7f96717fa640 1 -- 172.21.15.100:0/1449863585 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f9674100b30 con 0x7f966406ed60 2024-09-13T02:48:07.047 INFO:teuthology.orchestra.run.smithi100.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T02:48:07.047 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T02:48:07.047 INFO:teuthology.orchestra.run.smithi100.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-09-13T02:48:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 msgr2=0x7f9664071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 0x7f9664071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9668000c00 tx=0x7f9668035040 comp rx=0 tx=0).stop 2024-09-13T02:48:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 msgr2=0x7f96741122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9660002a50 tx=0x7f9660004600 comp rx=0 tx=0).stop 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 shutdown_connections 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f966406ed60 0x7f9664071210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96740fc720 0x7f96741122d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 --2- 172.21.15.100:0/1449863585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f96740fb450 0x7f967410fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 >> 172.21.15.100:0/1449863585 conn(0x7f96740f6c10 msgr2=0x7f96740f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 shutdown_connections 2024-09-13T02:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:07.047+0000 7f967ade7640 1 -- 172.21.15.100:0/1449863585 wait complete. 2024-09-13T02:48:07.681 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:48:07.690 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:07.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T02:48:07.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:07 smithi100 ceph-mon[27894]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:07.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:07 smithi122 ceph-mon[34559]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:07.936 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:08 smithi100 ceph-mon[27894]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:09.401 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:08 smithi122 ceph-mon[34559]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 -- 172.21.15.100:0/145149387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fdba0 msgr2=0x7f92400fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 --2- 172.21.15.100:0/145149387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fdba0 0x7f92400fdfb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f92300048d0 tx=0x7f9230009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 -- 172.21.15.100:0/145149387 shutdown_connections 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 --2- 172.21.15.100:0/145149387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fe4f0 0x7f92400fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 --2- 172.21.15.100:0/145149387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fdba0 0x7f92400fdfb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 -- 172.21.15.100:0/145149387 >> 172.21.15.100:0/145149387 conn(0x7f92400f63a0 msgr2=0x7f92400f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 -- 172.21.15.100:0/145149387 shutdown_connections 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.445+0000 7f9246625640 1 -- 172.21.15.100:0/145149387 wait complete. 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 Processor -- start 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 -- start start 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fdba0 0x7f924010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924010dc70 con 0x7f92400fe4f0 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f9246625640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924010e490 con 0x7f92400fdba0 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52986/0 (socket says 172.21.15.100:52986) 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 -- 172.21.15.100:0/1280732317 learned_addr learned my addr 172.21.15.100:0/1280732317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923ffff640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fdba0 0x7f924010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:09.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 -- 172.21.15.100:0/1280732317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fdba0 msgr2=0x7f924010d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fdba0 0x7f924010d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.446+0000 7f923f7fe640 1 -- 172.21.15.100:0/1280732317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230005040 con 0x7f92400fe4f0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f923f7fe640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9234002870 tx=0x7f9234004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9234007c30 con 0x7f92400fe4f0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f923400f040 con 0x7f92400fe4f0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924010e720 con 0x7f92400fe4f0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92340095b0 con 0x7f92400fe4f0 2024-09-13T02:48:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.447+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924010ecc0 con 0x7f92400fe4f0 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.448+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92400fa040 con 0x7f92400fe4f0 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.448+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9234009710 con 0x7f92400fe4f0 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.449+0000 7f923cff9640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 0x7f9228071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.449+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f923408d570 con 0x7f92400fe4f0 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.449+0000 7f923ffff640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 0x7f9228071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.449+0000 7f923ffff640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 0x7f9228071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9230007ac0 tx=0x7f9230035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.453+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f923404d2a0 con 0x7f92400fe4f0 2024-09-13T02:48:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:09.633+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f924010f040 con 0x7f922806ed60 2024-09-13T02:48:10.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:10 smithi100 ceph-mon[27894]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:10.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:10 smithi100 ceph-mon[27894]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:10.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:10 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:48:10.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:10 smithi122 ceph-mon[34559]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:10.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:10 smithi122 ceph-mon[34559]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:10.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:10 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:48:11.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.669+0000 7f923cff9640 1 -- 172.21.15.100:0/1280732317 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f924010f040 con 0x7f922806ed60 2024-09-13T02:48:11.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.672+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 msgr2=0x7f9228071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:11.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.672+0000 7f9246625640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 0x7f9228071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9230007ac0 tx=0x7f9230035040 comp rx=0 tx=0).stop 2024-09-13T02:48:11.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.672+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 msgr2=0x7f924010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9234002870 tx=0x7f9234004600 comp rx=0 tx=0).stop 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 shutdown_connections 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f922806ed60 0x7f9228071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92400fe4f0 0x7f924010d620 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 --2- 172.21.15.100:0/1280732317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92400fdba0 0x7f924010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 >> 172.21.15.100:0/1280732317 conn(0x7f92400f63a0 msgr2=0x7f92400f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 shutdown_connections 2024-09-13T02:48:11.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:11.673+0000 7f9246625640 1 -- 172.21.15.100:0/1280732317 wait complete. 2024-09-13T02:48:11.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:11 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:48:11.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:11 smithi100 ceph-mon[27894]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T02:48:11.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:11 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:48:11.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:11 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[27890]: 2024-09-13T02:48:11.655+0000 7f7948615640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:48:11.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:11 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:48:11.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:11 smithi122 ceph-mon[34559]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T02:48:11.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:11 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:48:12.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:48:12.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: pgmap v172: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:12.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: fsmap cephfs:0 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:12.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:12.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:12.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:12.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:12.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:12 smithi100 ceph-mon[27894]: Deploying daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:48:12.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: pgmap v172: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: fsmap cephfs:0 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:48:12.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:12.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:12 smithi122 ceph-mon[34559]: Deploying daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:48:13.196 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:13.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:13 smithi100 ceph-mon[27894]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:48:13.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:13 smithi122 ceph-mon[34559]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:48:14.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:14 smithi100 ceph-mon[27894]: pgmap v176: 65 pgs: 35 active+clean, 7 creating+peering, 23 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:14.820 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:14 smithi100 ceph-mon[27894]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T02:48:14.820 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:14 smithi100 ceph-mon[27894]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:48:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:14 smithi122 ceph-mon[34559]: pgmap v176: 65 pgs: 35 active+clean, 7 creating+peering, 23 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:14 smithi122 ceph-mon[34559]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T02:48:14.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:14 smithi122 ceph-mon[34559]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:48:15.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- 172.21.15.100:0/1953139707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 msgr2=0x7fda900fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:15.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 --2- 172.21.15.100:0/1953139707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda900fcb70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda780048d0 tx=0x7fda78009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- 172.21.15.100:0/1953139707 shutdown_connections 2024-09-13T02:48:15.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 --2- 172.21.15.100:0/1953139707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda900fcb70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 --2- 172.21.15.100:0/1953139707 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 0x7fda900fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- 172.21.15.100:0/1953139707 >> 172.21.15.100:0/1953139707 conn(0x7fda900f6c10 msgr2=0x7fda900f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- 172.21.15.100:0/1953139707 shutdown_connections 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- 172.21.15.100:0/1953139707 wait complete. 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 Processor -- start 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.693+0000 7fda9513d640 1 -- start start 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda9513d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 0x7fda9010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda9513d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda9513d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90065cf0 con 0x7fda900fc700 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda9513d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90065e60 con 0x7fda900fb430 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53004/0 (socket says 172.21.15.100:53004) 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 -- 172.21.15.100:0/45469289 learned_addr learned my addr 172.21.15.100:0/45469289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:15.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8ed9d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 0x7fda9010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 -- 172.21.15.100:0/45469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 msgr2=0x7fda9010fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 0x7fda9010fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 -- 172.21.15.100:0/45469289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78005040 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda8e59c640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda78003080 tx=0x7fda78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda78038070 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.694+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda7802abd0 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.695+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda90112950 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.695+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7803e670 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.695+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda90112e70 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.696+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda900fa890 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.696+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fda78030020 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.696+0000 7fda877fe640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 0x7fda7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.697+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fda780ae420 con 0x7fda900fc700 2024-09-13T02:48:15.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.697+0000 7fda8ed9d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 0x7fda7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:15.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.697+0000 7fda8ed9d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 0x7fda7c071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda90065950 tx=0x7fda88009780 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:15.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.701+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda7807b670 con 0x7fda900fc700 2024-09-13T02:48:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.893+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda90113130 con 0x7fda900fc700 2024-09-13T02:48:15.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.894+0000 7fda877fe640 1 -- 172.21.15.100:0/45469289 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fda7807b010 con 0x7fda900fc700 2024-09-13T02:48:15.895 INFO:teuthology.orchestra.run.smithi100.stdout:e2 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 2 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:48:11.656032+0000 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:48:15.896 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 0 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:in 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:up {} 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:48:15.897 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 0 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 msgr2=0x7fda7c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 0x7fda7c071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda90065950 tx=0x7fda88009780 comp rx=0 tx=0).stop 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 msgr2=0x7fda90112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda78003080 tx=0x7fda78009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 shutdown_connections 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda7c06ed60 0x7fda7c071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda900fc700 0x7fda90112350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 --2- 172.21.15.100:0/45469289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda900fb430 0x7fda9010fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 >> 172.21.15.100:0/45469289 conn(0x7fda900f6c10 msgr2=0x7fda900f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 shutdown_connections 2024-09-13T02:48:15.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:15.896+0000 7fda9513d640 1 -- 172.21.15.100:0/45469289 wait complete. 2024-09-13T02:48:16.513 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:48:16.522 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:16.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T02:48:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: pgmap v178: 65 pgs: 53 active+clean, 7 creating+peering, 5 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/45469289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: Deploying daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:48:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: daemon mds.cephfs.smithi100.slkwfs assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: Cluster is now healthy 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6826/781877866,v1:172.21.15.100:6827/781877866] up:boot 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:creating} 2024-09-13T02:48:16.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:48:16.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:16 smithi122 ceph-mon[34559]: daemon mds.cephfs.smithi100.slkwfs is now active in filesystem cephfs as rank 0 2024-09-13T02:48:16.770 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: pgmap v178: 65 pgs: 53 active+clean, 7 creating+peering, 5 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/45469289' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:16.891 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: Deploying daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: daemon mds.cephfs.smithi100.slkwfs assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: Cluster is now healthy 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6826/781877866,v1:172.21.15.100:6827/781877866] up:boot 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:creating} 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:48:16.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:16 smithi100 ceph-mon[27894]: daemon mds.cephfs.smithi100.slkwfs is now active in filesystem cephfs as rank 0 2024-09-13T02:48:18.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 -- 172.21.15.100:0/2295195935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fc520 msgr2=0x7f19e80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 --2- 172.21.15.100:0/2295195935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fc520 0x7f19e80fc930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19d80048d0 tx=0x7f19d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 -- 172.21.15.100:0/2295195935 shutdown_connections 2024-09-13T02:48:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 --2- 172.21.15.100:0/2295195935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fd7f0 0x7f19e80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 --2- 172.21.15.100:0/2295195935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fc520 0x7f19e80fc930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 -- 172.21.15.100:0/2295195935 >> 172.21.15.100:0/2295195935 conn(0x7f19e80f7ce0 msgr2=0x7f19e80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 -- 172.21.15.100:0/2295195935 shutdown_connections 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.371+0000 7f19eda87640 1 -- 172.21.15.100:0/2295195935 wait complete. 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 Processor -- start 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 -- start start 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fc520 0x7f19e8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e806fff0 con 0x7f19e80fd7f0 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19eda87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8070130 con 0x7f19e80fc520 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47378/0 (socket says 172.21.15.100:47378) 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19e6ffd640 1 -- 172.21.15.100:0/881224908 learned_addr learned my addr 172.21.15.100:0/881224908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.372+0000 7f19e77fe640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fc520 0x7f19e8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:18.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.373+0000 7f19e6ffd640 1 -- 172.21.15.100:0/881224908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fc520 msgr2=0x7f19e8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:18.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.373+0000 7f19e6ffd640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fc520 0x7f19e8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.373+0000 7f19e6ffd640 1 -- 172.21.15.100:0/881224908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8005040 con 0x7f19e80fd7f0 2024-09-13T02:48:18.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.373+0000 7f19e6ffd640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00eb70 tx=0x7f19dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:18.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.375+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc007c30 con 0x7f19e80fd7f0 2024-09-13T02:48:18.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.375+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80703b0 con 0x7f19e80fd7f0 2024-09-13T02:48:18.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.375+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e8115100 con 0x7f19e80fd7f0 2024-09-13T02:48:18.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.375+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19dc00f040 con 0x7f19e80fd7f0 2024-09-13T02:48:18.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.375+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19dc00ca60 con 0x7f19e80fd7f0 2024-09-13T02:48:18.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.376+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4005240 con 0x7f19e80fd7f0 2024-09-13T02:48:18.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.376+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f19dc00cbc0 con 0x7f19e80fd7f0 2024-09-13T02:48:18.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.377+0000 7f19cffff640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 0x7f19d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.377+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f19dc08dcc0 con 0x7f19e80fd7f0 2024-09-13T02:48:18.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.377+0000 7f19e77fe640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 0x7f19d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:18.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.377+0000 7f19e77fe640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 0x7f19d0071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19d8000c00 tx=0x7f19d8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:18.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.381+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f19dc05ae90 con 0x7f19e80fd7f0 2024-09-13T02:48:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:18 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6826/781877866,v1:172.21.15.100:6827/781877866] up:active 2024-09-13T02:48:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:18 smithi100 ceph-mon[27894]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 2024-09-13T02:48:18.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:18 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6826/781877866,v1:172.21.15.100:6827/781877866] up:active 2024-09-13T02:48:18.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:18 smithi122 ceph-mon[34559]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 2024-09-13T02:48:18.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:18.579+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f19d4005a70 con 0x7f19e80fd7f0 2024-09-13T02:48:19.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.163+0000 7f19cffff640 1 -- 172.21.15.100:0/881224908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f19dc05a830 con 0x7f19e80fd7f0 2024-09-13T02:48:19.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 347 B/s wr, 0 op/s 2024-09-13T02:48:19.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.165 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:19.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:19.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:19.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:19 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/881224908' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:48:19.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 msgr2=0x7f19d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 0x7f19d0071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19d8000c00 tx=0x7f19d8035040 comp rx=0 tx=0).stop 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 msgr2=0x7f19e806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00eb70 tx=0x7f19dc00b040 comp rx=0 tx=0).stop 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 shutdown_connections 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f19d006ed60 0x7f19d0071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19e80fd7f0 0x7f19e806fa60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 --2- 172.21.15.100:0/881224908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19e80fc520 0x7f19e8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 >> 172.21.15.100:0/881224908 conn(0x7f19e80f7ce0 msgr2=0x7f19e80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:19.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 shutdown_connections 2024-09-13T02:48:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:19.166+0000 7f19eda87640 1 -- 172.21.15.100:0/881224908 wait complete. 2024-09-13T02:48:19.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 347 B/s wr, 0 op/s 2024-09-13T02:48:19.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:19.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:19 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/881224908' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:48:19.931 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:48:19.942 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:19.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-13T02:48:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: Deploying daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:48:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:48:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:boot 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/881224908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: daemon mds.cephfs.smithi122.wmvyfe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 1 up:standby 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:creating} 2024-09-13T02:48:20.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:20 smithi122 ceph-mon[34559]: daemon mds.cephfs.smithi122.wmvyfe is now active in filesystem cephfs as rank 1 2024-09-13T02:48:20.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: Deploying daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:48:20.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:48:20.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:boot 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/881224908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: daemon mds.cephfs.smithi122.wmvyfe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 1 up:standby 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:creating} 2024-09-13T02:48:20.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:20 smithi100 ceph-mon[27894]: daemon mds.cephfs.smithi122.wmvyfe is now active in filesystem cephfs as rank 1 2024-09-13T02:48:20.531 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:21.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:21 smithi100 ceph-mon[27894]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2024-09-13T02:48:21.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:21 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:active 2024-09-13T02:48:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:21 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2024-09-13T02:48:21.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:21 smithi122 ceph-mon[34559]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2024-09-13T02:48:21.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:21 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:active 2024-09-13T02:48:21.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:21 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2024-09-13T02:48:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- 172.21.15.100:0/674624477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 msgr2=0x7fb0200fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 --2- 172.21.15.100:0/674624477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb0200fb860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0140048d0 tx=0x7fb014009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- 172.21.15.100:0/674624477 shutdown_connections 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 --2- 172.21.15.100:0/674624477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0200fc720 0x7fb0200fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 --2- 172.21.15.100:0/674624477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb0200fb860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- 172.21.15.100:0/674624477 >> 172.21.15.100:0/674624477 conn(0x7fb0200f6c10 msgr2=0x7fb0200f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- 172.21.15.100:0/674624477 shutdown_connections 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- 172.21.15.100:0/674624477 wait complete. 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 Processor -- start 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.200+0000 7fb026fb6640 1 -- start start 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb026fb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb026fb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0200fc720 0x7fb02010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:22.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb026fb6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02010dc10 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb026fb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02010e430 con 0x7fb0200fc720 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47390/0 (socket says 172.21.15.100:47390) 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 -- 172.21.15.100:0/3181221286 learned_addr learned my addr 172.21.15.100:0/3181221286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 -- 172.21.15.100:0/3181221286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0200fc720 msgr2=0x7fb02010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0200fc720 0x7fb02010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 -- 172.21.15.100:0/3181221286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014005040 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb024d52640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb014003080 tx=0x7fb014009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb014038070 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02010e660 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb01402abd0 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.201+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01403e670 con 0x7fb0200fb450 2024-09-13T02:48:22.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.202+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02010ec00 con 0x7fb0200fb450 2024-09-13T02:48:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.202+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0200fa8b0 con 0x7fb0200fb450 2024-09-13T02:48:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.203+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb014030020 con 0x7fb0200fb450 2024-09-13T02:48:22.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.203+0000 7fb01d7fa640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 0x7fb010075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:22.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.204+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb0140ae590 con 0x7fb0200fb450 2024-09-13T02:48:22.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.204+0000 7fb01ffff640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 0x7fb010075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:22.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.204+0000 7fb01ffff640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 0x7fb010075620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb02010ce30 tx=0x7fb00c007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.208+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb01407b6b0 con 0x7fb0200fb450 2024-09-13T02:48:22.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.403+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb02004b720 con 0x7fb0200fb450 2024-09-13T02:48:22.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.551+0000 7fb01d7fa640 1 -- 172.21.15.100:0/3181221286 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb01407b050 con 0x7fb0200fb450 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 msgr2=0x7fb010075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 0x7fb010075620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb02010ce30 tx=0x7fb00c007cb0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 msgr2=0x7fb02010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb014003080 tx=0x7fb014009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 shutdown_connections 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb010073170 0x7fb010075620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0200fc720 0x7fb02010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.553+0000 7fb026fb6640 1 --2- 172.21.15.100:0/3181221286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0200fb450 0x7fb02010d080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.554+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 >> 172.21.15.100:0/3181221286 conn(0x7fb0200f6c10 msgr2=0x7fb020066170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:22.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.554+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 shutdown_connections 2024-09-13T02:48:22.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:22.554+0000 7fb026fb6640 1 -- 172.21.15.100:0/3181221286 wait complete. 2024-09-13T02:48:22.585 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:22.585 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:22.585 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:22 smithi100 ceph-mon[27894]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-13T02:48:22.585 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:22 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3181221286' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T02:48:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:22 smithi122 ceph-mon[34559]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-13T02:48:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:22 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3181221286' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-13T02:48:23.319 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:48:23.334 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:23.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-13T02:48:23.583 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3181221286' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:23 smithi122 ceph-mon[34559]: Deploying daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:48:23.888 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3181221286' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:23.889 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:23 smithi100 ceph-mon[27894]: Deploying daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:48:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T02:48:24.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T02:48:24.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: Cluster is now healthy 2024-09-13T02:48:24.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:boot 2024-09-13T02:48:24.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 1 up:standby 2024-09-13T02:48:24.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:24 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:48:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T02:48:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T02:48:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: Cluster is now healthy 2024-09-13T02:48:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:boot 2024-09-13T02:48:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 1 up:standby 2024-09-13T02:48:24.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:24 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:48:25.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 -- 172.21.15.100:0/1039932608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c066790 msgr2=0x7f914c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:25.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 --2- 172.21.15.100:0/1039932608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c066790 0x7f914c0ff160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f913c0048d0 tx=0x7f913c009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 -- 172.21.15.100:0/1039932608 shutdown_connections 2024-09-13T02:48:25.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 --2- 172.21.15.100:0/1039932608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c0ff6a0 0x7f914c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 --2- 172.21.15.100:0/1039932608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c066790 0x7f914c0ff160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 -- 172.21.15.100:0/1039932608 >> 172.21.15.100:0/1039932608 conn(0x7f914c0f6c10 msgr2=0x7f914c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 -- 172.21.15.100:0/1039932608 shutdown_connections 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.074+0000 7f91508c2640 1 -- 172.21.15.100:0/1039932608 wait complete. 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 Processor -- start 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 -- start start 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 0x7f914c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c10dcb0 con 0x7f914c0ff6a0 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f91508c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c10e480 con 0x7f914c066790 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f9149d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:25.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f914a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 0x7f914c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f9149d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47432/0 (socket says 172.21.15.100:47432) 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f914a59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 0x7f914c10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:43984/0 (socket says 172.21.15.100:43984) 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.075+0000 7f9149d9b640 1 -- 172.21.15.100:0/1134973659 learned_addr learned my addr 172.21.15.100:0/1134973659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f9149d9b640 1 -- 172.21.15.100:0/1134973659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 msgr2=0x7f914c10d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f9149d9b640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 0x7f914c10d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f9149d9b640 1 -- 172.21.15.100:0/1134973659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c005040 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f9149d9b640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9140002a50 tx=0x7f9140004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9140007c30 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c10e710 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f914000f040 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f914000da10 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.076+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c10ecb0 con 0x7f914c0ff6a0 2024-09-13T02:48:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.077+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c0fa8b0 con 0x7f914c0ff6a0 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.077+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f914000dc80 con 0x7f914c0ff6a0 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.078+0000 7f913affd640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 0x7f9134071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.078+0000 7f914a59c640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 0x7f9134071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.078+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f914008d940 con 0x7f914c0ff6a0 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.078+0000 7f914a59c640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 0x7f9134071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f913c000c00 tx=0x7f913c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:25.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.082+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f914004d2a0 con 0x7f914c0ff6a0 2024-09-13T02:48:25.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.274+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f914c04b720 con 0x7f914c0ff6a0 2024-09-13T02:48:25.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.561+0000 7f913affd640 1 -- 172.21.15.100:0/1134973659 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v10) v1 ==== 133+0+0 (secure 0 0 0) 0x7f914c04b720 con 0x7f914c0ff6a0 2024-09-13T02:48:25.563 INFO:teuthology.orchestra.run.smithi100.stderr:inline data disabled 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 msgr2=0x7f9134071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 0x7f9134071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f913c000c00 tx=0x7f913c035040 comp rx=0 tx=0).stop 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 msgr2=0x7f914c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9140002a50 tx=0x7f9140004600 comp rx=0 tx=0).stop 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 shutdown_connections 2024-09-13T02:48:25.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f913406ed60 0x7f9134071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f914c0ff6a0 0x7f914c10d660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 --2- 172.21.15.100:0/1134973659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f914c066790 0x7f914c10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 >> 172.21.15.100:0/1134973659 conn(0x7f914c0f6c10 msgr2=0x7f914c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.563+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 shutdown_connections 2024-09-13T02:48:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:25.564+0000 7f91508c2640 1 -- 172.21.15.100:0/1134973659 wait complete. 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1134973659' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:25 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1134973659' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:25 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:26.228 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:48:26.240 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:26.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:48:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:26 smithi122 ceph-mon[34559]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-13T02:48:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:26 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:boot 2024-09-13T02:48:26.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:26 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1134973659' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T02:48:26.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:26 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:26.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:26 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:48:26.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:26 smithi100 ceph-mon[27894]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-13T02:48:26.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:26 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:boot 2024-09-13T02:48:26.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:26 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1134973659' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T02:48:26.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:26 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:26.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:26 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:48:26.947 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:27 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:27.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:27.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:27.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:27 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:28.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-13T02:48:29.013 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:standby 2024-09-13T02:48:29.013 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:active 2024-09-13T02:48:29.013 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: Dropping low affinity active daemon mds.cephfs.smithi100.slkwfs in favor of higher affinity standby. 2024-09-13T02:48:29.013 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: Replacing daemon mds.cephfs.smithi100.slkwfs as rank 0 with standby daemon mds.cephfs.smithi100.ciqoxn 2024-09-13T02:48:29.014 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:48:29.014 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:29.014 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:48:29.014 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:28 smithi100 ceph-mon[27894]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:replay,1=cephfs.smithi122.wmvyfe=up:active} 1 up:standby 2024-09-13T02:48:29.015 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-13T02:48:29.015 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:standby 2024-09-13T02:48:29.015 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] up:active 2024-09-13T02:48:29.015 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: Dropping low affinity active daemon mds.cephfs.smithi100.slkwfs in favor of higher affinity standby. 2024-09-13T02:48:29.015 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: Replacing daemon mds.cephfs.smithi100.slkwfs as rank 0 with standby daemon mds.cephfs.smithi100.ciqoxn 2024-09-13T02:48:29.016 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:48:29.016 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:29.016 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:48:29.016 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:28 smithi122 ceph-mon[34559]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:replay,1=cephfs.smithi122.wmvyfe=up:active} 1 up:standby 2024-09-13T02:48:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- 172.21.15.100:0/1874203047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 msgr2=0x7f082c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 --2- 172.21.15.100:0/1874203047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c0fb840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08200048d0 tx=0x7f0820009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- 172.21.15.100:0/1874203047 shutdown_connections 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 --2- 172.21.15.100:0/1874203047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 0x7f082c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 --2- 172.21.15.100:0/1874203047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c0fb840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- 172.21.15.100:0/1874203047 >> 172.21.15.100:0/1874203047 conn(0x7f082c0f6c10 msgr2=0x7f082c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- 172.21.15.100:0/1874203047 shutdown_connections 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- 172.21.15.100:0/1874203047 wait complete. 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 Processor -- start 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.243+0000 7f083371f640 1 -- start start 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 0x7f082c1122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c065c80 con 0x7f082c0fb430 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c065df0 con 0x7f082c0fc700 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33030/0 (socket says 172.21.15.100:33030) 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 -- 172.21.15.100:0/4076161801 learned_addr learned my addr 172.21.15.100:0/4076161801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f0830cba640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 0x7f082c1122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 -- 172.21.15.100:0/4076161801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 msgr2=0x7f082c1122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 0x7f082c1122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 -- 172.21.15.100:0/4076161801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820005040 con 0x7f082c0fb430 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f08314bb640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08200043d0 tx=0x7f0820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0820038070 con 0x7f082c0fb430 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f082002ae90 con 0x7f082c0fb430 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c112830 con 0x7f082c0fb430 2024-09-13T02:48:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f082003e670 con 0x7f082c0fb430 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.244+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c112dd0 con 0x7f082c0fb430 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.245+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c0fa890 con 0x7f082c0fb430 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.246+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0820030020 con 0x7f082c0fb430 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.246+0000 7f081dffb640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 0x7f0818071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.246+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f08200ae3c0 con 0x7f082c0fb430 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.246+0000 7f0830cba640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 0x7f0818071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.247+0000 7f0830cba640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 0x7f0818071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0828004ed0 tx=0x7f082800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.250+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f082007b540 con 0x7f082c0fb430 2024-09-13T02:48:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.445+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f082c113120 con 0x7f082c0fb430 2024-09-13T02:48:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.445+0000 7f081dffb640 1 -- 172.21.15.100:0/4076161801 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1812 (secure 0 0 0) 0x7f082007aee0 con 0x7f082c0fb430 2024-09-13T02:48:29.447 INFO:teuthology.orchestra.run.smithi100.stdout:e13 2024-09-13T02:48:29.447 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:48:29.447 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 13 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:48:28.584693+0000 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:48:29.448 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:48:29.449 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:resolve seq 3 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:29.450 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:29.451 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:48:29.451 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:29.451 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:48:29.451 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 msgr2=0x7f0818071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 0x7f0818071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0828004ed0 tx=0x7f082800b040 comp rx=0 tx=0).stop 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 msgr2=0x7f082c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08200043d0 tx=0x7f0820009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 shutdown_connections 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f081806ed60 0x7f0818071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f082c0fc700 0x7f082c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 --2- 172.21.15.100:0/4076161801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f082c0fb430 0x7f082c10fda0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 >> 172.21.15.100:0/4076161801 conn(0x7f082c0f6c10 msgr2=0x7f082c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 shutdown_connections 2024-09-13T02:48:29.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:29.447+0000 7f083371f640 1 -- 172.21.15.100:0/4076161801 wait complete. 2024-09-13T02:48:29.739 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:29 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:resolve 2024-09-13T02:48:29.739 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:29 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] up:boot 2024-09-13T02:48:29.739 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:29 smithi100 ceph-mon[27894]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:resolve,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:29.740 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:29 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:48:29.740 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:29 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/4076161801' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:48:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:29 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:resolve 2024-09-13T02:48:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:29 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] up:boot 2024-09-13T02:48:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:29 smithi122 ceph-mon[34559]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:resolve,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:29 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:48:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:29 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/4076161801' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:48:30.550 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T02:48:30.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:30 smithi100 ceph-mon[27894]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T02:48:30.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:30 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:reconnect 2024-09-13T02:48:30.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:30 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:standby 2024-09-13T02:48:30.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:30 smithi100 ceph-mon[27894]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:reconnect,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:30 smithi122 ceph-mon[34559]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 819 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T02:48:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:30 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:reconnect 2024-09-13T02:48:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:30 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:standby 2024-09-13T02:48:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:30 smithi122 ceph-mon[34559]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:reconnect,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:31.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:31 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:rejoin 2024-09-13T02:48:31.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:31 smithi100 ceph-mon[27894]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:rejoin,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:31.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:31 smithi100 ceph-mon[27894]: daemon mds.cephfs.smithi100.ciqoxn is now active in filesystem cephfs as rank 0 2024-09-13T02:48:31.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:31 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:rejoin 2024-09-13T02:48:31.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:31 smithi122 ceph-mon[34559]: fsmap cephfs:2/2 {0=cephfs.smithi100.ciqoxn=up:rejoin,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:31.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:31 smithi122 ceph-mon[34559]: daemon mds.cephfs.smithi100.ciqoxn is now active in filesystem cephfs as rank 0 2024-09-13T02:48:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:32 smithi100 ceph-mon[27894]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 4 op/s 2024-09-13T02:48:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:32 smithi100 ceph-mon[27894]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:48:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:32 smithi100 ceph-mon[27894]: Cluster is now healthy 2024-09-13T02:48:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:32 smithi100 ceph-mon[27894]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:active 2024-09-13T02:48:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:32 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:32.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:32 smithi122 ceph-mon[34559]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 4 op/s 2024-09-13T02:48:32.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:32 smithi122 ceph-mon[34559]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:48:32.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:32 smithi122 ceph-mon[34559]: Cluster is now healthy 2024-09-13T02:48:32.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:32 smithi122 ceph-mon[34559]: mds.? [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] up:active 2024-09-13T02:48:32.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:32 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- 172.21.15.100:0/3674954085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fc520 msgr2=0x7f23d00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 --2- 172.21.15.100:0/3674954085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fc520 0x7f23d00fc930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f23c00048d0 tx=0x7f23c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- 172.21.15.100:0/3674954085 shutdown_connections 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 --2- 172.21.15.100:0/3674954085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fd7f0 0x7f23d00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 --2- 172.21.15.100:0/3674954085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fc520 0x7f23d00fc930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- 172.21.15.100:0/3674954085 >> 172.21.15.100:0/3674954085 conn(0x7f23d00f7ce0 msgr2=0x7f23d00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- 172.21.15.100:0/3674954085 shutdown_connections 2024-09-13T02:48:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- 172.21.15.100:0/3674954085 wait complete. 2024-09-13T02:48:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 Processor -- start 2024-09-13T02:48:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- start start 2024-09-13T02:48:33.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fc520 0x7f23d010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d010dc10 con 0x7f23d00fd7f0 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23d4c73640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d010e430 con 0x7f23d00fc520 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23cdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23cdd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33040/0 (socket says 172.21.15.100:33040) 2024-09-13T02:48:33.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.532+0000 7f23cdd9b640 1 -- 172.21.15.100:0/753653288 learned_addr learned my addr 172.21.15.100:0/753653288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23ce59c640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fc520 0x7f23d010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23cdd9b640 1 -- 172.21.15.100:0/753653288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fc520 msgr2=0x7f23d010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23cdd9b640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fc520 0x7f23d010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23cdd9b640 1 -- 172.21.15.100:0/753653288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0005040 con 0x7f23d00fd7f0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23cdd9b640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23c4002a50 tx=0x7f23c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c4007c30 con 0x7f23d00fd7f0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d010e6c0 con 0x7f23d00fd7f0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f23c400f040 con 0x7f23d00fd7f0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c400dad0 con 0x7f23d00fd7f0 2024-09-13T02:48:33.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.533+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d010ec60 con 0x7f23d00fd7f0 2024-09-13T02:48:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.534+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d00fb980 con 0x7f23d00fd7f0 2024-09-13T02:48:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.535+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f23c400dc30 con 0x7f23d00fd7f0 2024-09-13T02:48:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.535+0000 7f23beffd640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 0x7f23b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.535+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f23c408e020 con 0x7f23d00fd7f0 2024-09-13T02:48:33.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.535+0000 7f23ce59c640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 0x7f23b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:33.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.536+0000 7f23ce59c640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 0x7f23b8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f23c000b020 tx=0x7f23c0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:33.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.539+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f23c405b0f0 con 0x7f23d00fd7f0 2024-09-13T02:48:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.739+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23d004b720 con 0x7f23d00fd7f0 2024-09-13T02:48:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.740+0000 7f23beffd640 1 -- 172.21.15.100:0/753653288 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f23c405aa90 con 0x7f23d00fd7f0 2024-09-13T02:48:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-09-13T02:48:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 msgr2=0x7f23b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 0x7f23b8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f23c000b020 tx=0x7f23c0035040 comp rx=0 tx=0).stop 2024-09-13T02:48:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 msgr2=0x7f23d010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f23c4002a50 tx=0x7f23c4004600 comp rx=0 tx=0).stop 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 shutdown_connections 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f23b806ed60 0x7f23b8071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23d00fd7f0 0x7f23d010d5c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 --2- 172.21.15.100:0/753653288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f23d00fc520 0x7f23d010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 >> 172.21.15.100:0/753653288 conn(0x7f23d00f7ce0 msgr2=0x7f23d00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 shutdown_connections 2024-09-13T02:48:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:33.742+0000 7f23d4c73640 1 -- 172.21.15.100:0/753653288 wait complete. 2024-09-13T02:48:33.752 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:48:34.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:48:34.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:34.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:34 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/753653288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:48:34.792 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:34.793 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:34 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/753653288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:48:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 -- 172.21.15.100:0/4197906501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fd800 msgr2=0x7fccdc0fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/4197906501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fd800 0x7fccdc0fdc70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccc40048d0 tx=0x7fccc4009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 -- 172.21.15.100:0/4197906501 shutdown_connections 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/4197906501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fd800 0x7fccdc0fdc70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/4197906501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fc530 0x7fccdc0fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 -- 172.21.15.100:0/4197906501 >> 172.21.15.100:0/4197906501 conn(0x7fccdc0f7d10 msgr2=0x7fccdc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 -- 172.21.15.100:0/4197906501 shutdown_connections 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 -- 172.21.15.100:0/4197906501 wait complete. 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.587+0000 7fcce0b9b640 1 Processor -- start 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fcce0b9b640 1 -- start start 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fcce0b9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fcce0b9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 0x7fccdc10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fcce0b9b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc10dc30 con 0x7fccdc0fc530 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fcce0b9b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc10e450 con 0x7fccdc0fd800 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33052/0 (socket says 172.21.15.100:33052) 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 -- 172.21.15.100:0/2550967902 learned_addr learned my addr 172.21.15.100:0/2550967902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccd9d9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 0x7fccdc10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 -- 172.21.15.100:0/2550967902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 msgr2=0x7fccdc10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 0x7fccdc10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 -- 172.21.15.100:0/2550967902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4005040 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccd9d9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 0x7fccdc10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccda59c640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c790 tx=0x7fccd40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd400a820 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.588+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fccd400ae20 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.589+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc10e6e0 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.589+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccd40113a0 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.589+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc10ec80 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.589+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0fb990 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.590+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fccd4012400 con 0x7fccdc0fc530 2024-09-13T02:48:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.590+0000 7fccd2ffd640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 0x7fccc8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:36.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.590+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fccd408e350 con 0x7fccdc0fc530 2024-09-13T02:48:36.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.590+0000 7fccd9d9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 0x7fccc8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:36.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.591+0000 7fccd9d9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 0x7fccc8071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccc400b020 tx=0x7fccc4009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:36.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.594+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fccd405b4a0 con 0x7fccdc0fc530 2024-09-13T02:48:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:36 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:36 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:36 smithi100 ceph-mon[27894]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:36 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:36 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:36 smithi122 ceph-mon[34559]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:36.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.827+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fccdc04b720 con 0x7fccdc0fc530 2024-09-13T02:48:36.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.827+0000 7fccd2ffd640 1 -- 172.21.15.100:0/2550967902 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+100 (secure 0 0 0) 0x7fccd405ae40 con 0x7fccdc0fc530 2024-09-13T02:48:36.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 msgr2=0x7fccc8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 0x7fccc8071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccc400b020 tx=0x7fccc4009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 msgr2=0x7fccdc10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c790 tx=0x7fccd40043c0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 shutdown_connections 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fccc806ed60 0x7fccc8071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccdc0fd800 0x7fccdc10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 --2- 172.21.15.100:0/2550967902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccdc0fc530 0x7fccdc10d0a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 >> 172.21.15.100:0/2550967902 conn(0x7fccdc0f7d10 msgr2=0x7fccdc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 shutdown_connections 2024-09-13T02:48:36.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:36.829+0000 7fcce0b9b640 1 -- 172.21.15.100:0/2550967902 wait complete. 2024-09-13T02:48:36.839 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:48:37.424 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T02:48:37.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T02:48:37.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:37.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:37.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:37 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2550967902' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:48:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:37 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2550967902' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:48:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:38.849 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:38 smithi100 ceph-mon[27894]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:38 smithi122 ceph-mon[34559]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:40.903 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:40 smithi100 ceph-mon[27894]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:40.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:40 smithi122 ceph-mon[34559]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T02:48:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- 172.21.15.100:0/2148133427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102530 msgr2=0x7fcbb0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 --2- 172.21.15.100:0/2148133427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102530 0x7fcbb0102900 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcba00048d0 tx=0x7fcba0009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- 172.21.15.100:0/2148133427 shutdown_connections 2024-09-13T02:48:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 --2- 172.21.15.100:0/2148133427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102ed0 0x7fcbb00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 --2- 172.21.15.100:0/2148133427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102530 0x7fcbb0102900 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- 172.21.15.100:0/2148133427 >> 172.21.15.100:0/2148133427 conn(0x7fcbb00f80f0 msgr2=0x7fcbb00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- 172.21.15.100:0/2148133427 shutdown_connections 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- 172.21.15.100:0/2148133427 wait complete. 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 Processor -- start 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.981+0000 7fcbb6060640 1 -- start start 2024-09-13T02:48:41.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 0x7fcbb0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0113d50 con 0x7fcbb0102ed0 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb010d190 con 0x7fcbb0102530 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57788/0 (socket says 172.21.15.100:57788) 2024-09-13T02:48:41.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 -- 172.21.15.100:0/1535547974 learned_addr learned my addr 172.21.15.100:0/1535547974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaf7fe640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 0x7fcbb0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 -- 172.21.15.100:0/1535547974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 msgr2=0x7fcbb0113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 0x7fcbb0113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 -- 172.21.15.100:0/1535547974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0005040 con 0x7fcbb0102ed0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaf7fe640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 0x7fcbb0113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbaeffd640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c740 tx=0x7fcba40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba4012810 con 0x7fcbb0102ed0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb010d470 con 0x7fcbb0102ed0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcba4012e10 con 0x7fcbb0102ed0 2024-09-13T02:48:41.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba400a370 con 0x7fcbb0102ed0 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.982+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb010da10 con 0x7fcbb0102ed0 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.983+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb00fdcb0 con 0x7fcbb0102ed0 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.984+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcba4012970 con 0x7fcbb0102ed0 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.984+0000 7fcb97fff640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 0x7fcb98071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.984+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcba408e770 con 0x7fcbb0102ed0 2024-09-13T02:48:41.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.984+0000 7fcbaf7fe640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 0x7fcb98071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:41.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.985+0000 7fcbaf7fe640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 0x7fcb98071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007ac0 tx=0x7fcba0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:41.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:40.988+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcba405b840 con 0x7fcbb0102ed0 2024-09-13T02:48:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.185+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbb010e880 con 0x7fcbb0102ed0 2024-09-13T02:48:41.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.186+0000 7fcb97fff640 1 -- 172.21.15.100:0/1535547974 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fcba40102e0 con 0x7fcbb0102ed0 2024-09-13T02:48:41.189 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:48:41.189 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:48:31.603145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-13T02:48:41.189 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-09-13T02:48:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 msgr2=0x7fcb98071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 0x7fcb98071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007ac0 tx=0x7fcba0035040 comp rx=0 tx=0).stop 2024-09-13T02:48:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 msgr2=0x7fcbb0113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:41.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c740 tx=0x7fcba40043c0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 shutdown_connections 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fcb9806ed60 0x7fcb98071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb0102ed0 0x7fcbb0113750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 --2- 172.21.15.100:0/1535547974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcbb0102530 0x7fcbb0113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 >> 172.21.15.100:0/1535547974 conn(0x7fcbb00f80f0 msgr2=0x7fcbb00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 shutdown_connections 2024-09-13T02:48:41.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:41.188+0000 7fcbb6060640 1 -- 172.21.15.100:0/1535547974 wait complete. 2024-09-13T02:48:41.894 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:41 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1535547974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:48:41.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:41 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1535547974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:48:42.228 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-13T02:48:42.229 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T02:48:42.256 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T02:48:42.257 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T02:48:42.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:42.257 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-13T02:48:42.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:42.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-13T02:48:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-09-13T02:48:42.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:48:42.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:42.345 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-13T02:48:42.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:42.365 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-09-13T02:48:42.439 INFO:teuthology.orchestra.run.smithi122.stderr:Cannot find device "ceph-brx" 2024-09-13T02:48:42.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:48:42.441 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T02:48:42.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:48:42.441 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:42.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:48:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T02:48:42.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:42.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:42 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:42.694 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:42.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T02:48:42.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:42.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:42.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:42.816 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:42.816 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:42 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- 172.21.15.100:0/2426146749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 msgr2=0x7f2f9c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 --2- 172.21.15.100:0/2426146749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c0fbbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0048d0 tx=0x7f2f8c009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- 172.21.15.100:0/2426146749 shutdown_connections 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 --2- 172.21.15.100:0/2426146749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 0x7f2f9c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 --2- 172.21.15.100:0/2426146749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c0fbbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- 172.21.15.100:0/2426146749 >> 172.21.15.100:0/2426146749 conn(0x7f2f9c0723b0 msgr2=0x7f2f9c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- 172.21.15.100:0/2426146749 shutdown_connections 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- 172.21.15.100:0/2426146749 wait complete. 2024-09-13T02:48:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 Processor -- start 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.380+0000 7f2fa3222640 1 -- start start 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa3222640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa3222640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 0x7f2f9c10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa3222640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c10ed00 con 0x7f2f9c0fb810 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa3222640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c10ee70 con 0x7f2f9c0fcf80 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57796/0 (socket says 172.21.15.100:57796) 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 -- 172.21.15.100:0/1366868144 learned_addr learned my addr 172.21.15.100:0/1366868144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 0x7f2f9c10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 -- 172.21.15.100:0/1366868144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 msgr2=0x7f2f9c10e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 0x7f2f9c10e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 -- 172.21.15.100:0/1366868144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c005040 con 0x7f2f9c0fb810 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa0fbe640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c003080 tx=0x7f2f8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f8c038070 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.381+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c1171e0 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.382+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f8c0097e0 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.382+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f8c03d420 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.382+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c117640 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.383+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9c0fcbc0 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.383+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2f8c030020 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.384+0000 7f2f997fa640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 0x7f2f84071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.384+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 0x7f2f84071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.384+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2f8c0ae800 con 0x7f2f9c0fb810 2024-09-13T02:48:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.384+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 0x7f2f84071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c065980 tx=0x7f2f90009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.388+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2f8c07b8d0 con 0x7f2f9c0fb810 2024-09-13T02:48:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.580+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f9c065730 con 0x7f2f9c0fb810 2024-09-13T02:48:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.580+0000 7f2f997fa640 1 -- 172.21.15.100:0/1366868144 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2f8c07b270 con 0x7f2f9c0fb810 2024-09-13T02:48:44.583 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:48:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 msgr2=0x7f2f84071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 0x7f2f84071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c065980 tx=0x7f2f90009040 comp rx=0 tx=0).stop 2024-09-13T02:48:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 msgr2=0x7f2f9c10e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c003080 tx=0x7f2f8c009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 shutdown_connections 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2f8406ed60 0x7f2f84071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f9c0fcf80 0x7f2f9c10e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 --2- 172.21.15.100:0/1366868144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f9c0fb810 0x7f2f9c10e170 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 >> 172.21.15.100:0/1366868144 conn(0x7f2f9c0723b0 msgr2=0x7f2f9c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 shutdown_connections 2024-09-13T02:48:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:44.582+0000 7f2fa3222640 1 -- 172.21.15.100:0/1366868144 wait complete. 2024-09-13T02:48:44.880 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:44 smithi122 ceph-mon[34559]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T02:48:44.880 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:44 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1366868144' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:48:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:44 smithi100 ceph-mon[27894]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-13T02:48:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:44 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1366868144' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:48:45.262 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:48:45.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:45.263 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-13T02:48:45.280 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:48:45.280 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:48:45.280 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:45.281 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:48:45.282 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-09-13T02:48:45.282 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-13T02:48:45.282 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:45.282 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:48:45.282 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:45.282 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-13T02:48:45.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:48:45.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-13T02:48:45.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-13T02:48:45.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:48:45.283 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-13T02:48:45.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:45.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:45.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:45.483 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:48:45.507 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-13T02:48:45.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:45.509 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-13T02:48:45.584 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-13T02:48:45.584 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:48:45.584 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:48:45.584 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:48:45.584 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:48:45.585 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-13T02:48:45.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:45.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:45.915 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-13T02:48:45.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:45.932 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-13T02:48:45.988 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:45.988 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-13T02:48:45.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:48:45.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T02:48:45.988 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-13T02:48:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.108 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T02:48:46.108 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:46.108 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T02:48:46.109 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-13T02:48:46.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:46.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.236 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:46.236 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-13T02:48:46.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-13T02:48:46.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:48:46.237 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-13T02:48:46.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:48:46.313 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:46.327 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:48:46.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:48:46.328 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:46.383 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T02:48:46.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:46.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:48:46.510 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:48:46.510 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:48:46.510 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-13T02:48:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:48:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:48:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-13T02:48:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.122:3300" 2024-09-13T02:48:46.627 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:48:46.632 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:48:46.632 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:48:46.632 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-09-13T02:48:46.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.122:3300" 2024-09-13T02:48:46.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:48:46.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.122:6789" 2024-09-13T02:48:46.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.122:6789:/ 2024-09-13T02:48:46.633 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=84e01cde-7179-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T02:48:46.634 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T02:48:46.634 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-09-13T02:48:46.634 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T02:48:46.634 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T02:48:46.635 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T02:48:46.635 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T02:48:46.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:46.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:46.673 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:46 smithi122 ceph-mon[34559]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:48:46.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:46.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.775 INFO:teuthology.orchestra.run.smithi100.stdout:client24289 2024-09-13T02:48:46.775 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:48:46.775 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T02:48:46.792 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:46.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:46.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.894 INFO:teuthology.orchestra.run.smithi100.stdout:client24289 2024-09-13T02:48:46.894 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:46.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:46 smithi100 ceph-mon[27894]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T02:48:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:46.957 INFO:teuthology.orchestra.run.smithi100.stdout:client24289 2024-09-13T02:48:46.957 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84e01cde-7179-11ef-bceb-c7b262605968.client24289/status') 2024-09-13T02:48:47.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.24289 (3)172.21.15.100:0/2880732361 2024-09-13T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-09-13T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-09-13T02:48:47.059 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-09-13T02:48:47.060 INFO:teuthology.orchestra.run.smithi100.stderr:72 bytes copied, 2.165e-05 s, 3.3 MB/s 2024-09-13T02:48:47.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:47.066 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T02:48:47.067 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:48:47.067 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:47.067 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:48:47.313 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:48.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:48 smithi100 ceph-mon[27894]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-13T02:48:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 -- 172.21.15.100:0/4215637924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 msgr2=0x7f2e88102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 --2- 172.21.15.100:0/4215637924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88102940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2e780048d0 tx=0x7f2e78009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 -- 172.21.15.100:0/4215637924 shutdown_connections 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 --2- 172.21.15.100:0/4215637924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e880fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 --2- 172.21.15.100:0/4215637924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88102940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.924+0000 7f2e8d084640 1 -- 172.21.15.100:0/4215637924 >> 172.21.15.100:0/4215637924 conn(0x7f2e880f8110 msgr2=0x7f2e880fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 -- 172.21.15.100:0/4215637924 shutdown_connections 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 -- 172.21.15.100:0/4215637924 wait complete. 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 Processor -- start 2024-09-13T02:48:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 -- start start 2024-09-13T02:48:48.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:48.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.925+0000 7f2e8d084640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e88113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:48.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e8d084640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88113d50 con 0x7f2e88102570 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e8d084640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8810d190 con 0x7f2e88102f10 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37444/0 (socket says 172.21.15.100:37444) 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 -- 172.21.15.100:0/1668118967 learned_addr learned my addr 172.21.15.100:0/1668118967 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e7e59c640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e88113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 -- 172.21.15.100:0/1668118967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 msgr2=0x7f2e88113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e88113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 -- 172.21.15.100:0/1668118967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78005040 con 0x7f2e88102570 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e7e59c640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e88113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e86d9d640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e78000c00 tx=0x7f2e78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e78038070 con 0x7f2e88102570 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8810d410 con 0x7f2e88102570 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e7802ade0 con 0x7f2e88102570 2024-09-13T02:48:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e7802c7e0 con 0x7f2e88102570 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.926+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8810d950 con 0x7f2e88102570 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.927+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e880fdcf0 con 0x7f2e88102570 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.928+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2e78030020 con 0x7f2e88102570 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.928+0000 7f2e7ffff640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 0x7f2e74071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.928+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2e780ade60 con 0x7f2e88102570 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.928+0000 7f2e7e59c640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 0x7f2e74071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:48.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.929+0000 7f2e7e59c640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 0x7f2e74071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e8810ead0 tx=0x7f2e7000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:48.932+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e7807afe0 con 0x7f2e88102570 2024-09-13T02:48:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:48 smithi122 ceph-mon[34559]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-13T02:48:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.124+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e8804b7b0 con 0x7f2e88102570 2024-09-13T02:48:49.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.125+0000 7f2e7ffff640 1 -- 172.21.15.100:0/1668118967 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2e7807a980 con 0x7f2e88102570 2024-09-13T02:48:49.126 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:48:49.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 msgr2=0x7f2e74071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 0x7f2e74071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e8810ead0 tx=0x7f2e7000b040 comp rx=0 tx=0).stop 2024-09-13T02:48:49.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 msgr2=0x7f2e88113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:49.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e78000c00 tx=0x7f2e78009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 shutdown_connections 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f2e7406ed60 0x7f2e74071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e88102f10 0x7f2e88113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 --2- 172.21.15.100:0/1668118967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e88102570 0x7f2e88113210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 >> 172.21.15.100:0/1668118967 conn(0x7f2e880f8110 msgr2=0x7f2e880f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 shutdown_connections 2024-09-13T02:48:49.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:49.128+0000 7f2e8d084640 1 -- 172.21.15.100:0/1668118967 wait complete. 2024-09-13T02:48:49.726 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:49 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1668118967' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi122.front.sepia.ceph.com 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:49.750 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:48:49.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:48:49.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:48:49.751 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:48:49.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:49.751 DEBUG:teuthology.orchestra.run.smithi122:> ip addr 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 ::1/128 scope host 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e4 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:49.771 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f0 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:d8:d9:e5 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: altname enp7s0f1 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:14 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: link/ether 0c:c4:7a:8f:d5:15 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: inet 172.21.15.122/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft 42314sec preferred_lft 42314sec 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: inet6 fe80::ec4:7aff:fe8f:d515/64 scope link noprefixroute 2024-09-13T02:48:49.772 INFO:teuthology.orchestra.run.smithi122.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:48:49.773 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr flush dev ceph-brx 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set ceph-brx up 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:48:49.773 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-13T02:48:49.864 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:49 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1668118967' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:48:49.985 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:49.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:49.992 DEBUG:teuthology.orchestra.run.smithi122:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:48:50.018 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-09-13T02:48:50.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:50.019 DEBUG:teuthology.orchestra.run.smithi122:> route 2024-09-13T02:48:50.091 INFO:teuthology.orchestra.run.smithi122.stdout:Kernel IP routing table 2024-09-13T02:48:50.091 INFO:teuthology.orchestra.run.smithi122.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:48:50.091 INFO:teuthology.orchestra.run.smithi122.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:48:50.091 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:48:50.091 INFO:teuthology.orchestra.run.smithi122.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:48:50.091 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:50.091 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-13T02:48:50.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:48:50.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:48:50.092 DEBUG:teuthology.orchestra.run.smithi122:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:48:50.092 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-13T02:48:50.179 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:50.405 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:50.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:50.412 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-13T02:48:50.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:50.427 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list-id 2024-09-13T02:48:50.483 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:50.483 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-13T02:48:50.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:48:50.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T02:48:50.483 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-13T02:48:50.571 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:50.596 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:50.602 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T02:48:50.602 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:50.602 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T02:48:50.603 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-13T02:48:50.652 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:50.706 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:50 smithi122 ceph-mon[34559]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T02:48:50.744 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:50.751 DEBUG:teuthology.orchestra.run.smithi122:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:48:50.751 DEBUG:teuthology.orchestra.run.smithi122:> set -e 2024-09-13T02:48:50.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set brx.0 up 2024-09-13T02:48:50.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:48:50.751 DEBUG:teuthology.orchestra.run.smithi122:> ') 2024-09-13T02:48:50.799 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:50.826 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:50.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:48:50.833 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:50.848 INFO:teuthology.orchestra.run.smithi122.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:48:50.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:48:50.849 DEBUG:teuthology.orchestra.run.smithi122:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:50.904 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T02:48:50.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:50.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:48:50.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:50 smithi100 ceph-mon[27894]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T02:48:51.015 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:48:51.016 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:48:51.016 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-09-13T02:48:51.147 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:48:51.147 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:48:51.147 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-09-13T02:48:51.148 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.122:3300" 2024-09-13T02:48:51.148 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:invalid new device string format 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.122:3300" 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.122:6789" 2024-09-13T02:48:51.152 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.122:6789:/ 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=84e01cde-7179-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: You just mounted a file system that supports labels which does not 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T02:48:51.153 INFO:teuthology.orchestra.run.smithi122.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T02:48:51.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T02:48:51.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:48:51.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:51.180 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:51.269 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:51.271 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:51.276 INFO:teuthology.orchestra.run.smithi122.stdout:client14508 2024-09-13T02:48:51.277 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:48:51.277 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T02:48:51.294 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:51.382 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:51.383 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:51.389 INFO:teuthology.orchestra.run.smithi122.stdout:client14508 2024-09-13T02:48:51.389 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:48:51.437 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:48:51.438 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:51.445 INFO:teuthology.orchestra.run.smithi122.stdout:client14508 2024-09-13T02:48:51.445 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/84e01cde-7179-11ef-bceb-c7b262605968.client14508/status') 2024-09-13T02:48:51.493 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:48:51.503 INFO:teuthology.orchestra.run.smithi122.stdout:instance: client.14508 (3)172.21.15.122:0/793709049 2024-09-13T02:48:51.503 INFO:teuthology.orchestra.run.smithi122.stdout:blocklisted: false 2024-09-13T02:48:51.503 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records in 2024-09-13T02:48:51.503 INFO:teuthology.orchestra.run.smithi122.stderr:0+1 records out 2024-09-13T02:48:51.503 INFO:teuthology.orchestra.run.smithi122.stderr:71 bytes copied, 2.2312e-05 s, 3.2 MB/s 2024-09-13T02:48:51.504 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T02:48:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:48:51.510 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:48:51.523 INFO:teuthology.task.print:**** done client 2024-09-13T02:48:51.523 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T02:48:51.568 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T02:48:51.568 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:48:51.568 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:48:51.569 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:51.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-13T02:48:51.570 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:48:51.570 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T02:48:51.575 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:48:51.575 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T02:48:51.575 INFO:tasks.workunit:timeout=3h 2024-09-13T02:48:51.575 INFO:tasks.workunit:cleanup=True 2024-09-13T02:48:51.576 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:51.595 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:51.595 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T02:48:51.595 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 81h/129d Inode: 1 Links: 2 2024-09-13T02:48:51.595 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:48:51.596 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T02:48:51.596 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:48:51.596 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-13 02:48:16.153274488 +0000 2024-09-13T02:48:51.596 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-13 02:48:46.663838839 +0000 2024-09-13T02:48:51.596 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-13 02:48:16.153274488 +0000 2024-09-13T02:48:51.596 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T02:48:51.596 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T02:48:51.666 DEBUG:teuthology.orchestra.run.smithi122:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 02:48:51.659709533 +0000 2024-09-13T02:48:51.683 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 02:48:51.659709533 +0000 2024-09-13T02:48:51.684 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 02:48:16.153274488 +0000 2024-09-13T02:48:51.684 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T02:48:51.684 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T02:48:51.744 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:51 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:51.751 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:48:51.752 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:48:51.768 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T02:48:51.807 INFO:tasks.workunit.client.1.smithi122.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T02:48:51.842 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:51.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:51 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:52.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:52 smithi100 ceph-mon[27894]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T02:48:52.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:52 smithi122 ceph-mon[34559]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T02:48:53.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 -- 172.21.15.100:0/769315358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fb450 msgr2=0x7fde940fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 --2- 172.21.15.100:0/769315358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fb450 0x7fde940fb860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fde840048d0 tx=0x7fde84009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 -- 172.21.15.100:0/769315358 shutdown_connections 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 --2- 172.21.15.100:0/769315358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fc720 0x7fde940fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 --2- 172.21.15.100:0/769315358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fb450 0x7fde940fb860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 -- 172.21.15.100:0/769315358 >> 172.21.15.100:0/769315358 conn(0x7fde940f6c10 msgr2=0x7fde940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 -- 172.21.15.100:0/769315358 shutdown_connections 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.440+0000 7fde98884640 1 -- 172.21.15.100:0/769315358 wait complete. 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 Processor -- start 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 -- start start 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fb450 0x7fde940ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fc720 0x7fde940fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940fe080 con 0x7fde940fc720 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde98884640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940fe1c0 con 0x7fde940fb450 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde91d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fc720 0x7fde940fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde91d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fc720 0x7fde940fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37464/0 (socket says 172.21.15.100:37464) 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde91d9b640 1 -- 172.21.15.100:0/419987709 learned_addr learned my addr 172.21.15.100:0/419987709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.441+0000 7fde9259c640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fb450 0x7fde940ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde91d9b640 1 -- 172.21.15.100:0/419987709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fb450 msgr2=0x7fde940ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde91d9b640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fb450 0x7fde940ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde91d9b640 1 -- 172.21.15.100:0/419987709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84005040 con 0x7fde940fc720 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde9259c640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde940fb450 0x7fde940ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde91d9b640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde940fc720 0x7fde940fda60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fde8800b790 tx=0x7fde880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde8800c700 con 0x7fde940fc720 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde8800cd00 con 0x7fde940fc720 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde98884640 1 -- 172.21.15.100:0/419987709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940fe4a0 con 0x7fde940fc720 2024-09-13T02:48:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde88015e70 con 0x7fde940fc720 2024-09-13T02:48:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.442+0000 7fde98884640 1 -- 172.21.15.100:0/419987709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde94115150 con 0x7fde940fc720 2024-09-13T02:48:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.443+0000 7fde98884640 1 -- 172.21.15.100:0/419987709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde940fa8b0 con 0x7fde940fc720 2024-09-13T02:48:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.444+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fde88012070 con 0x7fde940fc720 2024-09-13T02:48:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.444+0000 7fde82ffd640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fde7c06ed60 0x7fde7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.444+0000 7fde9259c640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fde7c06ed60 0x7fde7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.444+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fde8808dd50 con 0x7fde940fc720 2024-09-13T02:48:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.444+0000 7fde9259c640 1 --2- 172.21.15.100:0/419987709 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fde7c06ed60 0x7fde7c071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde8400b020 tx=0x7fde84009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:53.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.448+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fde8805ae20 con 0x7fde940fc720 2024-09-13T02:48:53.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.604+0000 7fde98884640 1 -- 172.21.15.100:0/419987709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fde94104040 con 0x7fde940fc720 2024-09-13T02:48:53.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:53.604+0000 7fde82ffd640 1 -- 172.21.15.100:0/419987709 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7fde8805a7c0 con 0x7fde940fc720 2024-09-13T02:48:53.606 INFO:teuthology.orchestra.run.smithi100.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-13T02:48:54.190 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:48:54.191 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:48:54.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T02:48:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:54.911 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:54 smithi100 ceph-mon[27894]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T02:48:54.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:54 smithi122 ceph-mon[34559]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/778359169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 msgr2=0x7fb0d40fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/778359169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d40fb880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40048d0 tx=0x7fb0c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/778359169 shutdown_connections 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/778359169 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0d40fc740 0x7fb0d40fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/778359169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d40fb880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/778359169 >> 172.21.15.100:0/778359169 conn(0x7fb0d40f6c30 msgr2=0x7fb0d40f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/778359169 shutdown_connections 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.056+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/778359169 wait complete. 2024-09-13T02:48:56.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 Processor -- start 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 -- start start 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0d40fc740 0x7fb0d4112380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4066750 con 0x7fb0d40fb470 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d8a1c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40668c0 con 0x7fb0d40fc740 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37492/0 (socket says 172.21.15.100:37492) 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 -- 172.21.15.100:0/305095990 learned_addr learned my addr 172.21.15.100:0/305095990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 -- 172.21.15.100:0/305095990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0d40fc740 msgr2=0x7fb0d4112380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0d40fc740 0x7fb0d4112380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.057+0000 7fb0d259c640 1 -- 172.21.15.100:0/305095990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4005040 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0d259c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4000c00 tx=0x7fb0c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c4038070 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0c402ae90 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c403d420 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d41128c0 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.058+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d4112dd0 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.059+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40fa8d0 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.059+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb0c4030020 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.060+0000 7fb0c2ffd640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.060+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb0c40ae980 con 0x7fb0d40fb470 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.060+0000 7fb0d1d9b640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.060+0000 7fb0d1d9b640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 0x7fb0bc071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8004a50 tx=0x7fb0c8007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:56.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.064+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb0c407ba50 con 0x7fb0d40fb470 2024-09-13T02:48:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.222+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fb0d404b720 con 0x7fb0d40fb470 2024-09-13T02:48:56.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.223+0000 7fb0c2ffd640 1 -- 172.21.15.100:0/305095990 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb0c407b3f0 con 0x7fb0d40fb470 2024-09-13T02:48:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 msgr2=0x7fb0bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 0x7fb0bc071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8004a50 tx=0x7fb0c8007cb0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 msgr2=0x7fb0d410fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4000c00 tx=0x7fb0c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 shutdown_connections 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb0bc06ed60 0x7fb0bc071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb0d40fc740 0x7fb0d4112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 --2- 172.21.15.100:0/305095990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0d40fb470 0x7fb0d410fe30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 >> 172.21.15.100:0/305095990 conn(0x7fb0d40f6c30 msgr2=0x7fb0d40f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 shutdown_connections 2024-09-13T02:48:56.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:56.225+0000 7fb0d8a1c640 1 -- 172.21.15.100:0/305095990 wait complete. 2024-09-13T02:48:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:56 smithi122 ceph-mon[34559]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T02:48:56.821 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:56 smithi100 ceph-mon[27894]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-13T02:48:56.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T02:48:57.089 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 -- 172.21.15.100:0/466613039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 msgr2=0x7fd0640fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 --2- 172.21.15.100:0/466613039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd0640fdc60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0540048d0 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 -- 172.21.15.100:0/466613039 shutdown_connections 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 --2- 172.21.15.100:0/466613039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd0640fdc60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 --2- 172.21.15.100:0/466613039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd0640fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.779+0000 7fd06b81b640 1 -- 172.21.15.100:0/466613039 >> 172.21.15.100:0/466613039 conn(0x7fd0640f7ce0 msgr2=0x7fd0640fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 -- 172.21.15.100:0/466613039 shutdown_connections 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 -- 172.21.15.100:0/466613039 wait complete. 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 Processor -- start 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 -- start start 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd06410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06410dbe0 con 0x7fd0640fd7f0 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd06b81b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06410e400 con 0x7fd0640fc520 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd068db6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd068db6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40180/0 (socket says 172.21.15.100:40180) 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.780+0000 7fd068db6640 1 -- 172.21.15.100:0/3289780348 learned_addr learned my addr 172.21.15.100:0/3289780348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd0695b7640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd06410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd068db6640 1 -- 172.21.15.100:0/3289780348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 msgr2=0x7fd06410d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd068db6640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd06410d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd068db6640 1 -- 172.21.15.100:0/3289780348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054005040 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd0695b7640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd06410d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd068db6640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd0540043d0 tx=0x7fd054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd054038070 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd05402ae90 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06410e630 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05403e670 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.781+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06410ebd0 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.782+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0640fb980 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.783+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd054030020 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.783+0000 7fd059ffb640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 0x7fd050071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.783+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd0540ae470 con 0x7fd0640fd7f0 2024-09-13T02:48:58.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.783+0000 7fd0695b7640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 0x7fd050071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:58.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.784+0000 7fd0695b7640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 0x7fd050071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd060004d80 tx=0x7fd06000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:58.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.787+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd05407b540 con 0x7fd0640fd7f0 2024-09-13T02:48:58.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:48:58 smithi100 ceph-mon[27894]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T02:48:58.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:48:58 smithi122 ceph-mon[34559]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T02:48:58.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.941+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd06410ee90 con 0x7fd0640fd7f0 2024-09-13T02:48:58.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.942+0000 7fd059ffb640 1 -- 172.21.15.100:0/3289780348 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd05407aee0 con 0x7fd0640fd7f0 2024-09-13T02:48:58.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 msgr2=0x7fd050071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 0x7fd050071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd060004d80 tx=0x7fd06000b040 comp rx=0 tx=0).stop 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 msgr2=0x7fd06410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd0540043d0 tx=0x7fd054009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 shutdown_connections 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd05006ed60 0x7fd050071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0640fd7f0 0x7fd06410d590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 --2- 172.21.15.100:0/3289780348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd0640fc520 0x7fd06410d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 >> 172.21.15.100:0/3289780348 conn(0x7fd0640f7ce0 msgr2=0x7fd0640f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 shutdown_connections 2024-09-13T02:48:58.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:48:58.944+0000 7fd06b81b640 1 -- 172.21.15.100:0/3289780348 wait complete. 2024-09-13T02:48:59.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T02:48:59.887 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:49:00.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:00 smithi100 ceph-mon[27894]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T02:49:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:00 smithi122 ceph-mon[34559]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T02:49:01.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- 172.21.15.100:0/243047786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fd830 msgr2=0x7f58c00fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 --2- 172.21.15.100:0/243047786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fd830 0x7f58c00fdca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f58b40048d0 tx=0x7f58b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- 172.21.15.100:0/243047786 shutdown_connections 2024-09-13T02:49:01.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 --2- 172.21.15.100:0/243047786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fd830 0x7f58c00fdca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 --2- 172.21.15.100:0/243047786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fc560 0x7f58c00fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- 172.21.15.100:0/243047786 >> 172.21.15.100:0/243047786 conn(0x7f58c00f7d40 msgr2=0x7f58c00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- 172.21.15.100:0/243047786 shutdown_connections 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- 172.21.15.100:0/243047786 wait complete. 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 Processor -- start 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- start start 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fd830 0x7f58c006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c0070030 con 0x7f58c00fc560 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58c4911640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c0070170 con 0x7f58c00fd830 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58be59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.661+0000 7f58be59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40198/0 (socket says 172.21.15.100:40198) 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58be59c640 1 -- 172.21.15.100:0/2090783353 learned_addr learned my addr 172.21.15.100:0/2090783353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:01.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58bdd9b640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fd830 0x7f58c006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58be59c640 1 -- 172.21.15.100:0/2090783353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fd830 msgr2=0x7f58c006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58be59c640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fd830 0x7f58c006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58be59c640 1 -- 172.21.15.100:0/2090783353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4005040 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58be59c640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f58b000b790 tx=0x7f58b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b000c700 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58b000cd00 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c0070450 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b0015e80 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.662+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c0115170 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.663+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c00fb9c0 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.664+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f58b0012070 con 0x7f58c00fc560 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.664+0000 7f58aeffd640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 0x7f58a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.664+0000 7f58bdd9b640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 0x7f58a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:01.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.664+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f58b008d980 con 0x7f58c00fc560 2024-09-13T02:49:01.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.665+0000 7f58bdd9b640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 0x7f58a8071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58b4000c00 tx=0x7f58b4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:01.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.668+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f58b005aad0 con 0x7f58c00fc560 2024-09-13T02:49:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.822+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f58c004b720 con 0x7f58c00fc560 2024-09-13T02:49:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.823+0000 7f58aeffd640 1 -- 172.21.15.100:0/2090783353 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f58b005a470 con 0x7f58c00fc560 2024-09-13T02:49:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 msgr2=0x7f58a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 0x7f58a8071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58b4000c00 tx=0x7f58b4035040 comp rx=0 tx=0).stop 2024-09-13T02:49:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 msgr2=0x7f58c0071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f58b000b790 tx=0x7f58b00091d0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 shutdown_connections 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f58a806ed60 0x7f58a8071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58c00fd830 0x7f58c006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 --2- 172.21.15.100:0/2090783353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c00fc560 0x7f58c0071520 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 >> 172.21.15.100:0/2090783353 conn(0x7f58c00f7d40 msgr2=0x7f58c00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 shutdown_connections 2024-09-13T02:49:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:01.825+0000 7f58c4911640 1 -- 172.21.15.100:0/2090783353 wait complete. 2024-09-13T02:49:02.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T02:49:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:49:02.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:02 smithi100 ceph-mon[27894]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T02:49:02.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:02 smithi122 ceph-mon[34559]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 -- 172.21.15.100:0/3936532030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 msgr2=0x7ff6800fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 --2- 172.21.15.100:0/3936532030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff6800fdcb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff6740048d0 tx=0x7ff674009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 -- 172.21.15.100:0/3936532030 shutdown_connections 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 --2- 172.21.15.100:0/3936532030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff6800fdcb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 --2- 172.21.15.100:0/3936532030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 0x7ff6800fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 -- 172.21.15.100:0/3936532030 >> 172.21.15.100:0/3936532030 conn(0x7ff6800f7d30 msgr2=0x7ff6800fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 -- 172.21.15.100:0/3936532030 shutdown_connections 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.475+0000 7ff6862b5640 1 -- 172.21.15.100:0/3936532030 wait complete. 2024-09-13T02:49:04.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 Processor -- start 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 -- start start 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 0x7ff680071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff680070080 con 0x7ff6800fd840 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff6862b5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800701c0 con 0x7ff6800fc570 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40214/0 (socket says 172.21.15.100:40214) 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff67f7fe640 1 -- 172.21.15.100:0/1797007705 learned_addr learned my addr 172.21.15.100:0/1797007705 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.476+0000 7ff67ffff640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 0x7ff680071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67f7fe640 1 -- 172.21.15.100:0/1797007705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 msgr2=0x7ff680071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67f7fe640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 0x7ff680071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67f7fe640 1 -- 172.21.15.100:0/1797007705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674005040 con 0x7ff6800fd840 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67f7fe640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff674003080 tx=0x7ff674009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff674038070 con 0x7ff6800fd840 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff680070440 con 0x7ff6800fd840 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff67402abd0 con 0x7ff6800fd840 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff67403e670 con 0x7ff6800fd840 2024-09-13T02:49:04.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.477+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff680115120 con 0x7ff6800fd840 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.478+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800fb9d0 con 0x7ff6800fd840 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.479+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff674030020 con 0x7ff6800fd840 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.479+0000 7ff67cff9640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 0x7ff668071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.479+0000 7ff67ffff640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 0x7ff668071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.479+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff6740ae530 con 0x7ff6800fd840 2024-09-13T02:49:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.480+0000 7ff67ffff640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 0x7ff668071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff680071320 tx=0x7ff670009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:04.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.483+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff67407b6b0 con 0x7ff6800fd840 2024-09-13T02:49:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.654+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}) v1 -- 0x7ff680101ca0 con 0x7ff66806ed60 2024-09-13T02:49:04.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.658+0000 7ff67cff9640 1 -- 172.21.15.100:0/1797007705 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff680101ca0 con 0x7ff66806ed60 2024-09-13T02:49:04.659 INFO:teuthology.orchestra.run.smithi100.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 msgr2=0x7ff668071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 0x7ff668071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff680071320 tx=0x7ff670009120 comp rx=0 tx=0).stop 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 msgr2=0x7ff68006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff674003080 tx=0x7ff674009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 shutdown_connections 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7ff66806ed60 0x7ff668071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6800fd840 0x7ff68006fa60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 --2- 172.21.15.100:0/1797007705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6800fc570 0x7ff680071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 >> 172.21.15.100:0/1797007705 conn(0x7ff6800f7d30 msgr2=0x7ff6800f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 shutdown_connections 2024-09-13T02:49:04.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:04.661+0000 7ff6862b5640 1 -- 172.21.15.100:0/1797007705 wait complete. 2024-09-13T02:49:04.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:04 smithi100 ceph-mon[27894]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T02:49:04.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:04 smithi122 ceph-mon[34559]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-13T02:49:05.436 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:49:05.436 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T02:49:05.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T02:49:05.685 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:05 smithi100 ceph-mon[27894]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:05.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:05 smithi122 ceph-mon[34559]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:49:07.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:07 smithi100 ceph-mon[27894]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:07.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3066177650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fc520 msgr2=0x7f22b00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3066177650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fc520 0x7f22b00fc930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22a00048d0 tx=0x7f22a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3066177650 shutdown_connections 2024-09-13T02:49:07.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3066177650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fd7f0 0x7f22b00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3066177650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fc520 0x7f22b00fc930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3066177650 >> 172.21.15.100:0/3066177650 conn(0x7f22b00f7ce0 msgr2=0x7f22b00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3066177650 shutdown_connections 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.426+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3066177650 wait complete. 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 Processor -- start 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 -- start start 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fc520 0x7f22b01136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0114240 con 0x7f22b00fd7f0 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22b4ab8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0114a60 con 0x7f22b00fc520 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22add9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22add9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40232/0 (socket says 172.21.15.100:40232) 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22add9b640 1 -- 172.21.15.100:0/3916583436 learned_addr learned my addr 172.21.15.100:0/3916583436 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.427+0000 7f22ae59c640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fc520 0x7f22b01136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22add9b640 1 -- 172.21.15.100:0/3916583436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fc520 msgr2=0x7f22b01136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22add9b640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fc520 0x7f22b01136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22add9b640 1 -- 172.21.15.100:0/3916583436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0005040 con 0x7f22b00fd7f0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22add9b640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22a4002a50 tx=0x7f22a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a4007c30 con 0x7f22b00fd7f0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b0114cf0 con 0x7f22b00fd7f0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22a400f040 con 0x7f22b00fd7f0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a400da10 con 0x7f22b00fd7f0 2024-09-13T02:49:07.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.428+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b0115290 con 0x7f22b00fd7f0 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.429+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b00fb980 con 0x7f22b00fd7f0 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.430+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f22a400dc80 con 0x7f22b00fd7f0 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.430+0000 7f229effd640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 0x7f2298071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.430+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f22a408d9e0 con 0x7f22b00fd7f0 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.430+0000 7f22ae59c640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 0x7f2298071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.431+0000 7f22ae59c640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 0x7f2298071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22a000b020 tx=0x7f22a0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:07 smithi122 ceph-mon[34559]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:07.440 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:07.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.435+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f22a405ac20 con 0x7f22b00fd7f0 2024-09-13T02:49:07.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.637+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22b0104fc0 con 0x7f229806ed60 2024-09-13T02:49:07.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.638+0000 7f229effd640 1 -- 172.21.15.100:0/3916583436 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f22b0104fc0 con 0x7f229806ed60 2024-09-13T02:49:07.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 msgr2=0x7f2298071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 0x7f2298071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22a000b020 tx=0x7f22a0035040 comp rx=0 tx=0).stop 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 msgr2=0x7f22b0113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22a4002a50 tx=0x7f22a4004600 comp rx=0 tx=0).stop 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 shutdown_connections 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f229806ed60 0x7f2298071210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22b00fd7f0 0x7f22b0113bf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 --2- 172.21.15.100:0/3916583436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22b00fc520 0x7f22b01136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 >> 172.21.15.100:0/3916583436 conn(0x7f22b00f7ce0 msgr2=0x7f22b00f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 shutdown_connections 2024-09-13T02:49:07.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.641+0000 7f22b4ab8640 1 -- 172.21.15.100:0/3916583436 wait complete. 2024-09-13T02:49:07.653 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:49:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- 172.21.15.100:0/2251014990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fd7f0 msgr2=0x7f7e400fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 --2- 172.21.15.100:0/2251014990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fd7f0 0x7f7e400fdc60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0048d0 tx=0x7f7e2c009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- 172.21.15.100:0/2251014990 shutdown_connections 2024-09-13T02:49:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 --2- 172.21.15.100:0/2251014990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fd7f0 0x7f7e400fdc60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 --2- 172.21.15.100:0/2251014990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fc520 0x7f7e400fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- 172.21.15.100:0/2251014990 >> 172.21.15.100:0/2251014990 conn(0x7f7e400f7ce0 msgr2=0x7f7e400fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- 172.21.15.100:0/2251014990 shutdown_connections 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- 172.21.15.100:0/2251014990 wait complete. 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 Processor -- start 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.737+0000 7f7e471b9640 1 -- start start 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e471b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e471b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fd7f0 0x7f7e4010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e471b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4010dbf0 con 0x7f7e400fc520 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e471b9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4010e410 con 0x7f7e400fd7f0 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40244/0 (socket says 172.21.15.100:40244) 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 -- 172.21.15.100:0/967913116 learned_addr learned my addr 172.21.15.100:0/967913116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:07.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e3ffff640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fd7f0 0x7f7e4010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 -- 172.21.15.100:0/967913116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fd7f0 msgr2=0x7f7e4010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fd7f0 0x7f7e4010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.738+0000 7f7e44f55640 1 -- 172.21.15.100:0/967913116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c005040 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e44f55640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400eb70 tx=0x7f7e3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e34007c30 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e3400f040 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e340094e0 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4010e640 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.739+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4010ebe0 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.740+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400fb980 con 0x7f7e400fc520 2024-09-13T02:49:07.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.741+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7e34009640 con 0x7f7e400fc520 2024-09-13T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.742+0000 7f7e3d7fa640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 0x7f7e30071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.742+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7e3408dc60 con 0x7f7e400fc520 2024-09-13T02:49:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.742+0000 7f7e3ffff640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 0x7f7e30071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:07.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.742+0000 7f7e3ffff640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 0x7f7e30071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e4010ce10 tx=0x7f7e2c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.746+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7e3405ae60 con 0x7f7e400fc520 2024-09-13T02:49:07.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.957+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e4010efd0 con 0x7f7e3006ed50 2024-09-13T02:49:07.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.958+0000 7f7e3d7fa640 1 -- 172.21.15.100:0/967913116 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7e4010efd0 con 0x7f7e3006ed50 2024-09-13T02:49:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.960+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 msgr2=0x7f7e30071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.960+0000 7f7e471b9640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 0x7f7e30071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e4010ce10 tx=0x7f7e2c035040 comp rx=0 tx=0).stop 2024-09-13T02:49:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.960+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 msgr2=0x7f7e4010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.960+0000 7f7e471b9640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400eb70 tx=0x7f7e3400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 shutdown_connections 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7e3006ed50 0x7f7e30071200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e400fd7f0 0x7f7e4010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 --2- 172.21.15.100:0/967913116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400fc520 0x7f7e4010d060 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 >> 172.21.15.100:0/967913116 conn(0x7f7e400f7ce0 msgr2=0x7f7e400f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 shutdown_connections 2024-09-13T02:49:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:07.961+0000 7f7e471b9640 1 -- 172.21.15.100:0/967913116 wait complete. 2024-09-13T02:49:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3859698237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 msgr2=0x7fb954101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3859698237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb954101a60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb9480048d0 tx=0x7fb948009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3859698237 shutdown_connections 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3859698237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb954101a60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3859698237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb9540ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3859698237 >> 172.21.15.100:0/3859698237 conn(0x7fb9540f6c10 msgr2=0x7fb9540f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3859698237 shutdown_connections 2024-09-13T02:49:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.051+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3859698237 wait complete. 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 Processor -- start 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 -- start start 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb95410f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95410fde0 con 0x7fb9540ff680 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb95a3e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb954110600 con 0x7fb954065c40 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb95410f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb953fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.052+0000 7fb953fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:44750/0 (socket says 172.21.15.100:44750) 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb953fff640 1 -- 172.21.15.100:0/3601696764 learned_addr learned my addr 172.21.15.100:0/3601696764 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb953fff640 1 -- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 msgr2=0x7fb95410f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb953fff640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb95410f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb953fff640 1 -- 172.21.15.100:0/3601696764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948005040 con 0x7fb954065c40 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb9537fe640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb95410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb953fff640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb94400eb70 tx=0x7fb94400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb944007c30 con 0x7fb954065c40 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb954110890 con 0x7fb954065c40 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb94400f040 con 0x7fb954065c40 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9440095c0 con 0x7fb954065c40 2024-09-13T02:49:08.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.053+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb954110e30 con 0x7fb954065c40 2024-09-13T02:49:08.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.055+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9540fa890 con 0x7fb954065c40 2024-09-13T02:49:08.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.055+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb94400c710 con 0x7fb954065c40 2024-09-13T02:49:08.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.056+0000 7fb950ff9640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 0x7fb93c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.056+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb94408e420 con 0x7fb954065c40 2024-09-13T02:49:08.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.056+0000 7fb9537fe640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 0x7fb93c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.056+0000 7fb9537fe640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 0x7fb93c071200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb95410f000 tx=0x7fb948035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.060+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb94405b4f0 con 0x7fb954065c40 2024-09-13T02:49:08.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.256+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9541111c0 con 0x7fb93c06ed50 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.266+0000 7fb950ff9640 1 -- 172.21.15.100:0/3601696764 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb9541111c0 con 0x7fb93c06ed50 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 25s ago 6m 25.7M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (6m) 25s ago 6m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (5m) 32s ago 5m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 25s ago 6m 85.9M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (46s) 25s ago 45s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (53s) 25s ago 52s 10.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:49:08.268 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (43s) 32s ago 42s 14.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (50s) 32s ago 49s 15.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (7m) 25s ago 7m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (5m) 32s ago 5m 402M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 9b6cea2a7fc4 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (7m) 25s ago 7m 45.3M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (5m) 32s ago 5m 36.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 25s ago 6m 15.1M - 1.5.0 0da6a335fe13 0d6356dae8e0 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (5m) 32s ago 5m 16.2M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 25s ago 4m 45.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (4m) 25s ago 4m 44.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 25s ago 3m 44.6M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (3m) 32s ago 3m 45.2M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (2m) 32s ago 2m 43.0M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:49:08.269 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (2m) 32s ago 2m 42.6M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:49:08.270 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 25s ago 5m 54.4M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:49:08.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 msgr2=0x7fb93c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 0x7fb93c071200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb95410f000 tx=0x7fb948035040 comp rx=0 tx=0).stop 2024-09-13T02:49:08.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 msgr2=0x7fb95410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb94400eb70 tx=0x7fb94400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 shutdown_connections 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb93c06ed50 0x7fb93c071200 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9540ff680 0x7fb95410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 --2- 172.21.15.100:0/3601696764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb954065c40 0x7fb95410f250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 >> 172.21.15.100:0/3601696764 conn(0x7fb9540f6c10 msgr2=0x7fb9540fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 shutdown_connections 2024-09-13T02:49:08.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.269+0000 7fb95a3e1640 1 -- 172.21.15.100:0/3601696764 wait complete. 2024-09-13T02:49:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 -- 172.21.15.100:0/1145509062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 msgr2=0x7f90c40fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 --2- 172.21.15.100:0/1145509062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c40fbe50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f90b40048d0 tx=0x7f90b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 -- 172.21.15.100:0/1145509062 shutdown_connections 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 --2- 172.21.15.100:0/1145509062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 0x7f90c40fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 --2- 172.21.15.100:0/1145509062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c40fbe50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 -- 172.21.15.100:0/1145509062 >> 172.21.15.100:0/1145509062 conn(0x7f90c40f6390 msgr2=0x7f90c40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 -- 172.21.15.100:0/1145509062 shutdown_connections 2024-09-13T02:49:08.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.356+0000 7f90c928c640 1 -- 172.21.15.100:0/1145509062 wait complete. 2024-09-13T02:49:08.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 Processor -- start 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 -- start start 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 0x7f90c41100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40fb400 con 0x7f90c40fba40 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c928c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40fb570 con 0x7f90c40fc390 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57700/0 (socket says 172.21.15.100:57700) 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c2ffd640 1 -- 172.21.15.100:0/2869485605 learned_addr learned my addr 172.21.15.100:0/2869485605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.357+0000 7f90c27fc640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 0x7f90c41100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c2ffd640 1 -- 172.21.15.100:0/2869485605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 msgr2=0x7f90c41100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c2ffd640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 0x7f90c41100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c2ffd640 1 -- 172.21.15.100:0/2869485605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4005040 con 0x7f90c40fba40 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c2ffd640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90b40048a0 tx=0x7f90b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b4038070 con 0x7f90c40fba40 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c4110620 con 0x7f90c40fba40 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90b4009800 con 0x7f90c40fba40 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b403e670 con 0x7f90c40fba40 2024-09-13T02:49:08.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.358+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c4110bc0 con 0x7f90c40fba40 2024-09-13T02:49:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.360+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c40fa010 con 0x7f90c40fba40 2024-09-13T02:49:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.360+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f90b4030020 con 0x7f90c40fba40 2024-09-13T02:49:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.361+0000 7f90ab7fe640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 0x7f90ac071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.361+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f90b40ae1d0 con 0x7f90c40fba40 2024-09-13T02:49:08.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.361+0000 7f90c27fc640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 0x7f90ac071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.362+0000 7f90c27fc640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 0x7f90ac071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009af0 tx=0x7f90b800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.366+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f90b407b3d0 con 0x7f90c40fba40 2024-09-13T02:49:08.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.627+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90c4110e60 con 0x7f90c40fba40 2024-09-13T02:49:08.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.627+0000 7f90ab7fe640 1 -- 172.21.15.100:0/2869485605 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f90b407ad70 con 0x7f90c40fba40 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:49:08.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:08.630 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:49:08.630 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:49:08.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:49:08.630 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.629+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 msgr2=0x7f90ac071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.629+0000 7f90c928c640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 0x7f90ac071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009af0 tx=0x7f90b800b040 comp rx=0 tx=0).stop 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.629+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 msgr2=0x7f90c410db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.629+0000 7f90c928c640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90b40048a0 tx=0x7f90b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 shutdown_connections 2024-09-13T02:49:08.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f90ac06ed50 0x7f90ac071200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f90c40fc390 0x7f90c41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 --2- 172.21.15.100:0/2869485605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c40fba40 0x7f90c410db90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 >> 172.21.15.100:0/2869485605 conn(0x7f90c40f6390 msgr2=0x7f90c40f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 shutdown_connections 2024-09-13T02:49:08.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.630+0000 7f90c928c640 1 -- 172.21.15.100:0/2869485605 wait complete. 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 -- 172.21.15.100:0/3827783259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 msgr2=0x7fa5180fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 --2- 172.21.15.100:0/3827783259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa5180fdad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa5100048d0 tx=0x7fa510009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 -- 172.21.15.100:0/3827783259 shutdown_connections 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 --2- 172.21.15.100:0/3827783259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa5180fdad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 --2- 172.21.15.100:0/3827783259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa5180fc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 -- 172.21.15.100:0/3827783259 >> 172.21.15.100:0/3827783259 conn(0x7fa5180f7b50 msgr2=0x7fa5180f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 -- 172.21.15.100:0/3827783259 shutdown_connections 2024-09-13T02:49:08.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.719+0000 7fa51f59e640 1 -- 172.21.15.100:0/3827783259 wait complete. 2024-09-13T02:49:08.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 Processor -- start 2024-09-13T02:49:08.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 -- start start 2024-09-13T02:49:08.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa51810d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51810da80 con 0x7fa5180fd660 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51f59e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51810e1c0 con 0x7fa5180fc390 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:40160/0 (socket says 172.21.15.100:40160) 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51e59c640 1 -- 172.21.15.100:0/2953583498 learned_addr learned my addr 172.21.15.100:0/2953583498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.720+0000 7fa51dd9b640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa51810d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51e59c640 1 -- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 msgr2=0x7fa51810d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51e59c640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa51810d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51e59c640 1 -- 172.21.15.100:0/2953583498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510005040 con 0x7fa5180fc390 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51e59c640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00eb70 tx=0x7fa50c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c007c30 con 0x7fa5180fc390 2024-09-13T02:49:08.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa50c00f040 con 0x7fa5180fc390 2024-09-13T02:49:08.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51810e3f0 con 0x7fa5180fc390 2024-09-13T02:49:08.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50c009420 con 0x7fa5180fc390 2024-09-13T02:49:08.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.721+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51810e990 con 0x7fa5180fc390 2024-09-13T02:49:08.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.722+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51805ed70 con 0x7fa5180fc390 2024-09-13T02:49:08.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.723+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fa50c009690 con 0x7fa5180fc390 2024-09-13T02:49:08.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.723+0000 7fa50affd640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 0x7fa504071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:08.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.724+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa50c08df20 con 0x7fa5180fc390 2024-09-13T02:49:08.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.724+0000 7fa51dd9b640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 0x7fa504071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:08.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.724+0000 7fa51dd9b640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 0x7fa504071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa510004540 tx=0x7fa510035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:08.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.727+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa50c05b160 con 0x7fa5180fc390 2024-09-13T02:49:08.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.960+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa51804b720 con 0x7fa5180fc390 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.960+0000 7fa50affd640 1 -- 172.21.15.100:0/2953583498 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1824 (secure 0 0 0) 0x7fa50c05ab00 con 0x7fa5180fc390 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:e16 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:49:08.962 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 16 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:48:31.603145+0000 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:08.963 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:08.964 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:08.965 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:08.965 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:49:08.965 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:08.965 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:08.965 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 msgr2=0x7fa504071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 0x7fa504071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa510004540 tx=0x7fa510035040 comp rx=0 tx=0).stop 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 msgr2=0x7fa51810cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00eb70 tx=0x7fa50c00b040 comp rx=0 tx=0).stop 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 shutdown_connections 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa50406ed60 0x7fa504071210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5180fd660 0x7fa51810d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 --2- 172.21.15.100:0/2953583498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5180fc390 0x7fa51810cef0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 >> 172.21.15.100:0/2953583498 conn(0x7fa5180f7b50 msgr2=0x7fa5180f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 shutdown_connections 2024-09-13T02:49:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:08.963+0000 7fa51f59e640 1 -- 172.21.15.100:0/2953583498 wait complete. 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- 172.21.15.100:0/1461337165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 msgr2=0x7f084c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 --2- 172.21.15.100:0/1461337165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c0fdc60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f08340048d0 tx=0x7f0834009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- 172.21.15.100:0/1461337165 shutdown_connections 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 --2- 172.21.15.100:0/1461337165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c0fdc60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 --2- 172.21.15.100:0/1461337165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- 172.21.15.100:0/1461337165 >> 172.21.15.100:0/1461337165 conn(0x7f084c0f7ce0 msgr2=0x7f084c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- 172.21.15.100:0/1461337165 shutdown_connections 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- 172.21.15.100:0/1461337165 wait complete. 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 Processor -- start 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.054+0000 7f08514ea640 1 -- start start 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f08514ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f08514ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f08514ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c10dc10 con 0x7f084c0fd7f0 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f08514ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c10e430 con 0x7f084c0fc520 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:40190/0 (socket says 172.21.15.100:40190) 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 -- 172.21.15.100:0/2375469489 learned_addr learned my addr 172.21.15.100:0/2375469489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:09.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f0843fff640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 -- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 msgr2=0x7f084c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 -- 172.21.15.100:0/2375469489 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834005040 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.055+0000 7f084affd640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f083c00eb70 tx=0x7f083c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.056+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083c007c30 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.056+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f083c00f040 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.056+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c10e660 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.056+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083c009420 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.056+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c10ec00 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.057+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c0fb980 con 0x7f084c0fc520 2024-09-13T02:49:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.057+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f083c009690 con 0x7f084c0fc520 2024-09-13T02:49:09.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.058+0000 7f08437fe640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 0x7f0838071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.058+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f083c08df20 con 0x7f084c0fc520 2024-09-13T02:49:09.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.058+0000 7f0843fff640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 0x7f0838071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.058+0000 7f0843fff640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 0x7f0838071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0834007ac0 tx=0x7f0834035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.062+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f083c05b160 con 0x7f084c0fc520 2024-09-13T02:49:09.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.271+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f084c10ef30 con 0x7f083806ed60 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: from='client.24309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2869485605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:49:09.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:09 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2953583498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.272+0000 7f08437fe640 1 -- 172.21.15.100:0/2375469489 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f084c10ef30 con 0x7f083806ed60 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "", 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a image", 2024-09-13T02:49:09.274 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:49:09.275 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:49:09.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 msgr2=0x7f0838071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 0x7f0838071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0834007ac0 tx=0x7f0834035040 comp rx=0 tx=0).stop 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 msgr2=0x7f084c10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f083c00eb70 tx=0x7f083c00b040 comp rx=0 tx=0).stop 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 shutdown_connections 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f083806ed60 0x7f0838071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f084c0fd7f0 0x7f084c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 --2- 172.21.15.100:0/2375469489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f084c0fc520 0x7f084c10d080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 >> 172.21.15.100:0/2375469489 conn(0x7f084c0f7ce0 msgr2=0x7f084c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 shutdown_connections 2024-09-13T02:49:09.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.275+0000 7f08514ea640 1 -- 172.21.15.100:0/2375469489 wait complete. 2024-09-13T02:49:09.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.368+0000 7effbb83f640 1 -- 172.21.15.100:0/3773243884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fd810 msgr2=0x7effb40fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.368+0000 7effbb83f640 1 --2- 172.21.15.100:0/3773243884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fd810 0x7effb40fdc80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7effa40048d0 tx=0x7effa4009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 -- 172.21.15.100:0/3773243884 shutdown_connections 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 --2- 172.21.15.100:0/3773243884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fd810 0x7effb40fdc80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 --2- 172.21.15.100:0/3773243884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fc540 0x7effb40fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 -- 172.21.15.100:0/3773243884 >> 172.21.15.100:0/3773243884 conn(0x7effb40f7ce0 msgr2=0x7effb40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 -- 172.21.15.100:0/3773243884 shutdown_connections 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 -- 172.21.15.100:0/3773243884 wait complete. 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.369+0000 7effbb83f640 1 Processor -- start 2024-09-13T02:49:09.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effbb83f640 1 -- start start 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effbb83f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effbb83f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 0x7effb410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effbb83f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb410dc30 con 0x7effb40fc540 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effbb83f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb410e450 con 0x7effb40fd810 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57750/0 (socket says 172.21.15.100:57750) 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 -- 172.21.15.100:0/813037391 learned_addr learned my addr 172.21.15.100:0/813037391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb8dda640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 0x7effb410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 -- 172.21.15.100:0/813037391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 msgr2=0x7effb410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 0x7effb410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb95db640 1 -- 172.21.15.100:0/813037391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4005040 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.370+0000 7effb8dda640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 0x7effb410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effb95db640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effb000eb70 tx=0x7effb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb0007c30 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7effb000f040 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb0009420 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb410e680 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.371+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb410ebd0 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.372+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40fb9a0 con 0x7effb40fc540 2024-09-13T02:49:09.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.373+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7effb0009690 con 0x7effb40fc540 2024-09-13T02:49:09.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.374+0000 7effa9ffb640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:09.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.374+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7effb008de90 con 0x7effb40fc540 2024-09-13T02:49:09.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.374+0000 7effb8dda640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:09.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.374+0000 7effb8dda640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 0x7effa0071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb410ce50 tx=0x7effa4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:09.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.379+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7effb005b010 con 0x7effb40fc540 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: from='client.24309 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2869485605' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:49:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:09 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2953583498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.649+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effb404b720 con 0x7effb40fc540 2024-09-13T02:49:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.650+0000 7effa9ffb640 1 -- 172.21.15.100:0/813037391 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7effb0019020 con 0x7effb40fc540 2024-09-13T02:49:09.651 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.652+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 msgr2=0x7effa0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.652+0000 7effbb83f640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 0x7effa0071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb410ce50 tx=0x7effa4035040 comp rx=0 tx=0).stop 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.652+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 msgr2=0x7effb410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.652+0000 7effbb83f640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7effb000eb70 tx=0x7effb000b040 comp rx=0 tx=0).stop 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 shutdown_connections 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7effa006ed60 0x7effa0071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb40fd810 0x7effb410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 --2- 172.21.15.100:0/813037391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb40fc540 0x7effb410d0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 >> 172.21.15.100:0/813037391 conn(0x7effb40f7ce0 msgr2=0x7effb40f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:09.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 shutdown_connections 2024-09-13T02:49:09.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:09.653+0000 7effbb83f640 1 -- 172.21.15.100:0/813037391 wait complete. 2024-09-13T02:49:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:10 smithi100 ceph-mon[27894]: from='client.24321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:10 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/813037391' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:49:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:10 smithi122 ceph-mon[34559]: from='client.24321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:10 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/813037391' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:49:11.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:11 smithi100 ceph-mon[27894]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:11 smithi122 ceph-mon[34559]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:13.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:13 smithi100 ceph-mon[27894]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:13.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:13 smithi122 ceph-mon[34559]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:15 smithi100 ceph-mon[27894]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:15.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:15 smithi122 ceph-mon[34559]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:17 smithi100 ceph-mon[27894]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:17 smithi122 ceph-mon[34559]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:19.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:19 smithi100 ceph-mon[27894]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:19.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:19 smithi122 ceph-mon[34559]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:21.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:21 smithi100 ceph-mon[27894]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:21.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:21 smithi122 ceph-mon[34559]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:22.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:22.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:23.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:23 smithi100 ceph-mon[27894]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:23.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:23 smithi122 ceph-mon[34559]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:25.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:25 smithi100 ceph-mon[27894]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:25.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:25 smithi122 ceph-mon[34559]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:27 smithi100 ceph-mon[27894]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:27.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:27 smithi122 ceph-mon[34559]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:29.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:29 smithi100 ceph-mon[27894]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:29 smithi122 ceph-mon[34559]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:31.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:31 smithi100 ceph-mon[27894]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T02:49:31.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:31 smithi122 ceph-mon[34559]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-13T02:49:33.346 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:33 smithi100 ceph-mon[27894]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:33 smithi122 ceph-mon[34559]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:49:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:49:35.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:35.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:35.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:35 smithi100 ceph-mon[27894]: Upgrade: Need to upgrade myself (mgr.smithi100.lhjyck) 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:49:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:35 smithi122 ceph-mon[34559]: Upgrade: Need to upgrade myself (mgr.smithi100.lhjyck) 2024-09-13T02:49:36.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:36 smithi100 ceph-mon[27894]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi122 2024-09-13T02:49:36.427 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:36 smithi122 ceph-mon[34559]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi122 2024-09-13T02:49:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:37 smithi100 ceph-mon[27894]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:37 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:37 smithi122 ceph-mon[34559]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:49:37.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:37 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:39 smithi100 ceph-mon[27894]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T02:49:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:39 smithi122 ceph-mon[34559]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 -- 172.21.15.100:0/809286209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 msgr2=0x7f01d80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 --2- 172.21.15.100:0/809286209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d80fcb70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01c0004950 tx=0x7f01c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 -- 172.21.15.100:0/809286209 shutdown_connections 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 --2- 172.21.15.100:0/809286209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d80fcb70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 --2- 172.21.15.100:0/809286209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 0x7f01d80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 -- 172.21.15.100:0/809286209 >> 172.21.15.100:0/809286209 conn(0x7f01d80f6c10 msgr2=0x7f01d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 -- 172.21.15.100:0/809286209 shutdown_connections 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.776+0000 7f01dcf75640 1 -- 172.21.15.100:0/809286209 wait complete. 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 Processor -- start 2024-09-13T02:49:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 -- start start 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 0x7f01d810f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d810fdd0 con 0x7f01d80fc700 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.777+0000 7f01dcf75640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81105f0 con 0x7f01d80fb430 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01d659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 0x7f01d810f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52422/0 (socket says 172.21.15.100:52422) 2024-09-13T02:49:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 -- 172.21.15.100:0/2455408704 learned_addr learned my addr 172.21.15.100:0/2455408704 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 -- 172.21.15.100:0/2455408704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 msgr2=0x7f01d810f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 0x7f01d810f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 -- 172.21.15.100:0/2455408704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0005040 con 0x7f01d80fc700 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.778+0000 7f01cffff640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f01c00049b0 tx=0x7f01c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.779+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c0034a60 con 0x7f01d80fc700 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.779+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f01c0034bc0 con 0x7f01d80fc700 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.779+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c003d700 con 0x7f01d80fc700 2024-09-13T02:49:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.779+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d8110820 con 0x7f01d80fc700 2024-09-13T02:49:39.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.779+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d8110dc0 con 0x7f01d80fc700 2024-09-13T02:49:39.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.780+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d80fa890 con 0x7f01d80fc700 2024-09-13T02:49:39.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.782+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f01c003d860 con 0x7f01d80fc700 2024-09-13T02:49:39.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.782+0000 7f01ceffd640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 0x7f01c40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:39.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.782+0000 7f01d659c640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 0x7f01c40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:39.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.782+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f01c00adbf0 con 0x7f01d80fc700 2024-09-13T02:49:39.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.783+0000 7f01d659c640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 0x7f01c40712d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01c8004a70 tx=0x7f01c800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:39.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.787+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f01c0076f70 con 0x7f01d80fc700 2024-09-13T02:49:39.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.975+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d8111190 con 0x7f01c406ee20 2024-09-13T02:49:39.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.977+0000 7f01ceffd640 1 -- 172.21.15.100:0/2455408704 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f01d8111190 con 0x7f01c406ee20 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 msgr2=0x7f01c40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 0x7f01c40712d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01c8004a70 tx=0x7f01c800b040 comp rx=0 tx=0).stop 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 msgr2=0x7f01d810f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f01c00049b0 tx=0x7f01c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 shutdown_connections 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f01c406ee20 0x7f01c40712d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d80fc700 0x7f01d810f780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 --2- 172.21.15.100:0/2455408704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f01d80fb430 0x7f01d810f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 >> 172.21.15.100:0/2455408704 conn(0x7f01d80f6c10 msgr2=0x7f01d80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:39.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.980+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 shutdown_connections 2024-09-13T02:49:39.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:39.982+0000 7f01dcf75640 1 -- 172.21.15.100:0/2455408704 wait complete. 2024-09-13T02:49:39.994 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:49:40.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 -- 172.21.15.100:0/231614403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40fc700 msgr2=0x7f86b40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86abfff640 1 -- 172.21.15.100:0/231614403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a402a9f0 con 0x7f86b40fc700 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 --2- 172.21.15.100:0/231614403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40fc700 0x7f86b40fcb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86a40048d0 tx=0x7f86a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 -- 172.21.15.100:0/231614403 shutdown_connections 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 --2- 172.21.15.100:0/231614403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40fc700 0x7f86b40fcb70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 --2- 172.21.15.100:0/231614403 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.068+0000 7f86bb75e640 1 -- 172.21.15.100:0/231614403 >> 172.21.15.100:0/231614403 conn(0x7f86b40f6c10 msgr2=0x7f86b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.069+0000 7f86bb75e640 1 -- 172.21.15.100:0/231614403 shutdown_connections 2024-09-13T02:49:40.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.069+0000 7f86bb75e640 1 -- 172.21.15.100:0/231614403 wait complete. 2024-09-13T02:49:40.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.070+0000 7f86bb75e640 1 Processor -- start 2024-09-13T02:49:40.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.070+0000 7f86bb75e640 1 -- start start 2024-09-13T02:49:40.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.070+0000 7f86bb75e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.070+0000 7f86bb75e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 0x7f86b410d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86b94fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86b94fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:48126/0 (socket says 172.21.15.100:48126) 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86b94fa640 1 -- 172.21.15.100:0/3969022127 learned_addr learned my addr 172.21.15.100:0/3969022127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b410caa0 con 0x7f86b410c5e0 2024-09-13T02:49:40.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b410cbe0 con 0x7f86b40fb430 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86b8cf9640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 0x7f86b410d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.071+0000 7f86b94fa640 1 -- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 msgr2=0x7f86b410d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.072+0000 7f86b94fa640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 0x7f86b410d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.072+0000 7f86b94fa640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4005040 con 0x7f86b40fb430 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.072+0000 7f86b8cf9640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 0x7f86b410d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:49:40.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.072+0000 7f86b94fa640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86b000eb70 tx=0x7f86b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.072+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b0007c30 con 0x7f86b40fb430 2024-09-13T02:49:40.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.073+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86b000f040 con 0x7f86b40fb430 2024-09-13T02:49:40.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.073+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b410d9f0 con 0x7f86b40fb430 2024-09-13T02:49:40.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.073+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b410df10 con 0x7f86b40fb430 2024-09-13T02:49:40.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.073+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b00094e0 con 0x7f86b40fb430 2024-09-13T02:49:40.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.075+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b40fa890 con 0x7f86b40fb430 2024-09-13T02:49:40.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.076+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f86b0009640 con 0x7f86b40fb430 2024-09-13T02:49:40.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.076+0000 7f86a9ffb640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 0x7f86a0071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.076+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f86b008df00 con 0x7f86b40fb430 2024-09-13T02:49:40.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.077+0000 7f86b8cf9640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 0x7f86a0071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.077+0000 7f86b8cf9640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 0x7f86a0071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009040 tx=0x7f86a4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.085+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86b005b110 con 0x7f86b40fb430 2024-09-13T02:49:40.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.286+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b4103fb0 con 0x7f86a006eda0 2024-09-13T02:49:40.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.287+0000 7f86a9ffb640 1 -- 172.21.15.100:0/3969022127 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f86b4103fb0 con 0x7f86a006eda0 2024-09-13T02:49:40.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 msgr2=0x7f86a0071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 0x7f86a0071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009040 tx=0x7f86a4035040 comp rx=0 tx=0).stop 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 msgr2=0x7f86b410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86b000eb70 tx=0x7f86b000b040 comp rx=0 tx=0).stop 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 shutdown_connections 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f86a006eda0 0x7f86a0071250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b410c5e0 0x7f86b410d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 --2- 172.21.15.100:0/3969022127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86b40fb430 0x7f86b410c0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.289+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 >> 172.21.15.100:0/3969022127 conn(0x7f86b40f6c10 msgr2=0x7f86b40f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.290+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 shutdown_connections 2024-09-13T02:49:40.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.290+0000 7f86bb75e640 1 -- 172.21.15.100:0/3969022127 wait complete. 2024-09-13T02:49:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 -- 172.21.15.100:0/2424902744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6148065c40 msgr2=0x7f61480ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 --2- 172.21.15.100:0/2424902744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6148065c40 0x7f61480ff140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61380048d0 tx=0x7f6138009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 -- 172.21.15.100:0/2424902744 shutdown_connections 2024-09-13T02:49:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 --2- 172.21.15.100:0/2424902744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f6148101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 --2- 172.21.15.100:0/2424902744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6148065c40 0x7f61480ff140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.376+0000 7f614d5bb640 1 -- 172.21.15.100:0/2424902744 >> 172.21.15.100:0/2424902744 conn(0x7f61480f6c10 msgr2=0x7f61480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.379+0000 7f614d5bb640 1 -- 172.21.15.100:0/2424902744 shutdown_connections 2024-09-13T02:49:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.379+0000 7f614d5bb640 1 -- 172.21.15.100:0/2424902744 wait complete. 2024-09-13T02:49:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 Processor -- start 2024-09-13T02:49:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 -- start start 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f614810d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614810dc20 con 0x7f614810d760 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.380+0000 7f614d5bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614810dd60 con 0x7f61480ff680 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52464/0 (socket says 172.21.15.100:52464) 2024-09-13T02:49:40.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 -- 172.21.15.100:0/1847011253 learned_addr learned my addr 172.21.15.100:0/1847011253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:40.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f6146ffd640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f614810d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 -- 172.21.15.100:0/1847011253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 msgr2=0x7f614810d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f614810d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 -- 172.21.15.100:0/1847011253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138005040 con 0x7f614810d760 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f6146ffd640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f614810d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.381+0000 7f61467fc640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f613c00eb70 tx=0x7f613c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.382+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c007c30 con 0x7f614810d760 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.382+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f613c00f040 con 0x7f614810d760 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.382+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614810eb70 con 0x7f614810d760 2024-09-13T02:49:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.382+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614810f110 con 0x7f614810d760 2024-09-13T02:49:40.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.383+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c00c880 con 0x7f614810d760 2024-09-13T02:49:40.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.383+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6148105760 con 0x7f614810d760 2024-09-13T02:49:40.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.385+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f613c0092a0 con 0x7f614810d760 2024-09-13T02:49:40.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.386+0000 7f612f7fe640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 0x7f6130071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.386+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f613c08e380 con 0x7f614810d760 2024-09-13T02:49:40.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.386+0000 7f6146ffd640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 0x7f6130071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.387+0000 7f6146ffd640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 0x7f6130071250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6138009040 tx=0x7f6138035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.391+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f613c05b430 con 0x7f614810d760 2024-09-13T02:49:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.709+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6148100fc0 con 0x7f613006eda0 2024-09-13T02:49:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.725+0000 7f612f7fe640 1 -- 172.21.15.100:0/1847011253 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6148100fc0 con 0x7f613006eda0 2024-09-13T02:49:40.727 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:49:40.727 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 58s ago 6m 25.7M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (7m) 58s ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (6m) 65s ago 6m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 58s ago 6m 85.9M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (78s) 58s ago 77s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (85s) 58s ago 84s 10.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (75s) 65s ago 75s 14.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (82s) 65s ago 82s 15.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (8m) 58s ago 8m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:49:40.728 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (5m) 65s ago 5m 402M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 9b6cea2a7fc4 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (8m) 58s ago 8m 45.3M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (5m) 65s ago 5m 36.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 58s ago 6m 15.1M - 1.5.0 0da6a335fe13 0d6356dae8e0 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (5m) 65s ago 5m 16.2M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (5m) 58s ago 5m 45.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (4m) 58s ago 4m 44.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (4m) 58s ago 4m 44.6M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (3m) 65s ago 3m 45.2M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (3m) 65s ago 3m 43.0M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:49:40.729 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (2m) 65s ago 2m 42.6M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:49:40.730 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 58s ago 6m 54.4M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.727+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 msgr2=0x7f6130071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.727+0000 7f614d5bb640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 0x7f6130071250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6138009040 tx=0x7f6138035040 comp rx=0 tx=0).stop 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.727+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 msgr2=0x7f614810e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.727+0000 7f614d5bb640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f613c00eb70 tx=0x7f613c00b040 comp rx=0 tx=0).stop 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 shutdown_connections 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f613006eda0 0x7f6130071250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f614810d760 0x7f614810e5d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 --2- 172.21.15.100:0/1847011253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f61480ff680 0x7f614810d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 >> 172.21.15.100:0/1847011253 conn(0x7f61480f6c10 msgr2=0x7f61480f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 shutdown_connections 2024-09-13T02:49:40.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.728+0000 7f614d5bb640 1 -- 172.21.15.100:0/1847011253 wait complete. 2024-09-13T02:49:40.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.808+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/1549117586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 msgr2=0x7fd9b0101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.808+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/1549117586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b0101550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00048d0 tx=0x7fd9a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.808+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/1549117586 shutdown_connections 2024-09-13T02:49:40.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.808+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/1549117586 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b0103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.808+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/1549117586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b0101550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.809+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/1549117586 >> 172.21.15.100:0/1549117586 conn(0x7fd9b00f6b80 msgr2=0x7fd9b00f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:40.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.809+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/1549117586 shutdown_connections 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.809+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/1549117586 wait complete. 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.810+0000 7fd9b4a5c640 1 Processor -- start 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.810+0000 7fd9b4a5c640 1 -- start start 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.810+0000 7fd9b4a5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.810+0000 7fd9b4a5c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b010f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.810+0000 7fd9ae59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9ae59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52482/0 (socket says 172.21.15.100:52482) 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9ae59c640 1 -- 172.21.15.100:0/3002793832 learned_addr learned my addr 172.21.15.100:0/3002793832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b010fdc0 con 0x7fd9b0065be0 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9add9b640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b010f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b01105e0 con 0x7fd9b0101a90 2024-09-13T02:49:40.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9add9b640 1 -- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 msgr2=0x7fd9b010f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9add9b640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9add9b640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0005040 con 0x7fd9b0101a90 2024-09-13T02:49:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.811+0000 7fd9ae59c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:49:40.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd9add9b640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b010f770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400eb40 tx=0x7fd9a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a4007c30 con 0x7fd9b0101a90 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b0110810 con 0x7fd9b0101a90 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd9a400f040 con 0x7fd9b0101a90 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a40094a0 con 0x7fd9b0101a90 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.812+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0110d30 con 0x7fd9b0101a90 2024-09-13T02:49:40.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.813+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b005ed70 con 0x7fd9b0101a90 2024-09-13T02:49:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.814+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd9a4009600 con 0x7fd9b0101a90 2024-09-13T02:49:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.814+0000 7fd99effd640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 0x7fd998071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.815+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd9a408dce0 con 0x7fd9b0101a90 2024-09-13T02:49:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.815+0000 7fd9ae59c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 0x7fd998071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:40.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.815+0000 7fd9ae59c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 0x7fd998071200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0003080 tx=0x7fd9a0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:40.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:40.823+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd9a405aee0 con 0x7fd9b0101a90 2024-09-13T02:49:41.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.192+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9b0111040 con 0x7fd9b0101a90 2024-09-13T02:49:41.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.193+0000 7fd99effd640 1 -- 172.21.15.100:0/3002793832 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fd9a40192a0 con 0x7fd9b0101a90 2024-09-13T02:49:41.194 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:49:41.194 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:49:41.195 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:49:41.196 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:49:41.196 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 msgr2=0x7fd998071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 0x7fd998071200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0003080 tx=0x7fd9a0035040 comp rx=0 tx=0).stop 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 msgr2=0x7fd9b010f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b010f770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400eb40 tx=0x7fd9a400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 shutdown_connections 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fd99806ed50 0x7fd998071200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9b0101a90 0x7fd9b010f770 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400eb40 tx=0x7fd9a400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 --2- 172.21.15.100:0/3002793832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9b0065be0 0x7fd9b010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.196+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 >> 172.21.15.100:0/3002793832 conn(0x7fd9b00f6b80 msgr2=0x7fd9b00f6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.197+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 shutdown_connections 2024-09-13T02:49:41.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.197+0000 7fd9b4a5c640 1 -- 172.21.15.100:0/3002793832 wait complete. 2024-09-13T02:49:41.324 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:41 smithi100 ceph-mon[27894]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T02:49:41.325 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:41 smithi100 ceph-mon[27894]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:41.325 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:41 smithi100 ceph-mon[27894]: from='client.24333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:41.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 -- 172.21.15.100:0/902900260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 msgr2=0x7fda400fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 --2- 172.21.15.100:0/902900260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda400fce10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda30004950 tx=0x7fda30009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 -- 172.21.15.100:0/902900260 shutdown_connections 2024-09-13T02:49:41.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 --2- 172.21.15.100:0/902900260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda400fd350 0x7fda400fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 --2- 172.21.15.100:0/902900260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda400fce10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 -- 172.21.15.100:0/902900260 >> 172.21.15.100:0/902900260 conn(0x7fda400f6390 msgr2=0x7fda400f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:41.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 -- 172.21.15.100:0/902900260 shutdown_connections 2024-09-13T02:49:41.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.323+0000 7fda449cf640 1 -- 172.21.15.100:0/902900260 wait complete. 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 Processor -- start 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 -- start start 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda400fd350 0x7fda4010f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4010fea0 con 0x7fda400fca00 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda449cf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda401106c0 con 0x7fda400fd350 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.324+0000 7fda3e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52498/0 (socket says 172.21.15.100:52498) 2024-09-13T02:49:41.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 -- 172.21.15.100:0/1145037077 learned_addr learned my addr 172.21.15.100:0/1145037077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 -- 172.21.15.100:0/1145037077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda400fd350 msgr2=0x7fda4010f850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda400fd350 0x7fda4010f850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 -- 172.21.15.100:0/1145037077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30005040 con 0x7fda400fca00 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda3e59c640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda30034750 tx=0x7fda30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.325+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda30034a60 con 0x7fda400fca00 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.326+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda401108f0 con 0x7fda400fca00 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.326+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda30034bc0 con 0x7fda400fca00 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.326+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3003d770 con 0x7fda400fca00 2024-09-13T02:49:41.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.326+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda40110e90 con 0x7fda400fca00 2024-09-13T02:49:41.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.328+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fda3003d8d0 con 0x7fda400fca00 2024-09-13T02:49:41.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.328+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda400fa010 con 0x7fda400fca00 2024-09-13T02:49:41.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.329+0000 7fda2effd640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 0x7fda28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.329+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fda300aeca0 con 0x7fda400fca00 2024-09-13T02:49:41.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.329+0000 7fda3dd9b640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 0x7fda28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:41.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.330+0000 7fda3dd9b640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 0x7fda28071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda4010f0c0 tx=0x7fda3400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:41.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.337+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda3007be90 con 0x7fda400fca00 2024-09-13T02:49:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:41 smithi122 ceph-mon[34559]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-13T02:49:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:41 smithi122 ceph-mon[34559]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:41 smithi122 ceph-mon[34559]: from='client.24333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.734+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda401111f0 con 0x7fda400fca00 2024-09-13T02:49:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.735+0000 7fda2effd640 1 -- 172.21.15.100:0/1145037077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1824 (secure 0 0 0) 0x7fda30043020 con 0x7fda400fca00 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:e16 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 16 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:48:31.603145+0000 2024-09-13T02:49:41.737 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:49:41.738 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:41.739 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:49:41.740 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-09-13T02:49:41.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 msgr2=0x7fda28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 0x7fda28071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda4010f0c0 tx=0x7fda3400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 msgr2=0x7fda4010f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda30034750 tx=0x7fda30009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 shutdown_connections 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fda2806ed60 0x7fda28071210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda400fd350 0x7fda4010f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 --2- 172.21.15.100:0/1145037077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda400fca00 0x7fda4010f310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 >> 172.21.15.100:0/1145037077 conn(0x7fda400f6390 msgr2=0x7fda400f7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 shutdown_connections 2024-09-13T02:49:41.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.738+0000 7fda449cf640 1 -- 172.21.15.100:0/1145037077 wait complete. 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 -- 172.21.15.100:0/3708502139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fb420 msgr2=0x7f306c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 --2- 172.21.15.100:0/3708502139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fb420 0x7f306c0fb830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f30680048d0 tx=0x7f3068009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 -- 172.21.15.100:0/3708502139 shutdown_connections 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 --2- 172.21.15.100:0/3708502139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c0fc6f0 0x7f306c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 --2- 172.21.15.100:0/3708502139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fb420 0x7f306c0fb830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.861+0000 7f30733e4640 1 -- 172.21.15.100:0/3708502139 >> 172.21.15.100:0/3708502139 conn(0x7f306c0f6c00 msgr2=0x7f306c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.862+0000 7f30733e4640 1 -- 172.21.15.100:0/3708502139 shutdown_connections 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.862+0000 7f30733e4640 1 -- 172.21.15.100:0/3708502139 wait complete. 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 Processor -- start 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 -- start start 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fc6f0 0x7f306c10c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c10cab0 con 0x7f306c0fc6f0 2024-09-13T02:49:41.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f30733e4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c10cbf0 con 0x7f306c10c5f0 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f307097f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f307097f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:48170/0 (socket says 172.21.15.100:48170) 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.863+0000 7f307097f640 1 -- 172.21.15.100:0/1723956317 learned_addr learned my addr 172.21.15.100:0/1723956317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.864+0000 7f3071180640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fc6f0 0x7f306c10c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.864+0000 7f307097f640 1 -- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fc6f0 msgr2=0x7f306c10c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.864+0000 7f307097f640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fc6f0 0x7f306c10c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:41.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.864+0000 7f307097f640 1 -- 172.21.15.100:0/1723956317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068005040 con 0x7f306c10c5f0 2024-09-13T02:49:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.864+0000 7f307097f640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f305c004e50 tx=0x7f305c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.865+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305c007e10 con 0x7f306c10c5f0 2024-09-13T02:49:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.865+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c10da60 con 0x7f306c10c5f0 2024-09-13T02:49:41.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.865+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f305c009570 con 0x7f306c10c5f0 2024-09-13T02:49:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.866+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305c00de20 con 0x7f306c10c5f0 2024-09-13T02:49:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.866+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c10e000 con 0x7f306c10c5f0 2024-09-13T02:49:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.867+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0fa880 con 0x7f306c10c5f0 2024-09-13T02:49:41.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.868+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f305c0096e0 con 0x7f306c10c5f0 2024-09-13T02:49:41.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.868+0000 7f3061ffb640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 0x7f3058071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:41.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.869+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f305c090180 con 0x7f306c10c5f0 2024-09-13T02:49:41.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.869+0000 7f3071180640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 0x7f3058071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:41.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.869+0000 7f3071180640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 0x7f3058071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30680048a0 tx=0x7f3068035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:41.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:41.876+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f305c059490 con 0x7f306c10c5f0 2024-09-13T02:49:42.097 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:42 smithi100 ceph-mon[27894]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:42.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.137+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f306c103fe0 con 0x7f305806ed50 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.139+0000 7f3061ffb640 1 -- 172.21.15.100:0/1723956317 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f306c103fe0 con 0x7f305806ed50 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T02:49:42.140 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi122", 2024-09-13T02:49:42.141 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:49:42.141 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:49:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 msgr2=0x7f3058071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 0x7f3058071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30680048a0 tx=0x7f3068035040 comp rx=0 tx=0).stop 2024-09-13T02:49:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 msgr2=0x7f306c10d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f305c004e50 tx=0x7f305c004600 comp rx=0 tx=0).stop 2024-09-13T02:49:42.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 shutdown_connections 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f305806ed50 0x7f3058071200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f306c10c5f0 0x7f306c10d460 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 --2- 172.21.15.100:0/1723956317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f306c0fc6f0 0x7f306c10c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 >> 172.21.15.100:0/1723956317 conn(0x7f306c0f6c00 msgr2=0x7f306c0f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 shutdown_connections 2024-09-13T02:49:42.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.141+0000 7f30733e4640 1 -- 172.21.15.100:0/1723956317 wait complete. 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 -- 172.21.15.100:0/4247408572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 msgr2=0x7f11840fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 --2- 172.21.15.100:0/4247408572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f11840fdc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11780048d0 tx=0x7f1178009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 -- 172.21.15.100:0/4247408572 shutdown_connections 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 --2- 172.21.15.100:0/4247408572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f11840fdc60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 --2- 172.21.15.100:0/4247408572 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 0x7f11840fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.222+0000 7f1188bc5640 1 -- 172.21.15.100:0/4247408572 >> 172.21.15.100:0/4247408572 conn(0x7f11840f7ce0 msgr2=0x7f11840fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:42.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.223+0000 7f1188bc5640 1 -- 172.21.15.100:0/4247408572 shutdown_connections 2024-09-13T02:49:42.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.223+0000 7f1188bc5640 1 -- 172.21.15.100:0/4247408572 wait complete. 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.223+0000 7f1188bc5640 1 Processor -- start 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.223+0000 7f1188bc5640 1 -- start start 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1188bc5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 0x7f118410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1188bc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1188bc5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118410dc10 con 0x7f11840fd7f0 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1188bc5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118410e430 con 0x7f11840fc520 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52542/0 (socket says 172.21.15.100:52542) 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 -- 172.21.15.100:0/3258988326 learned_addr learned my addr 172.21.15.100:0/3258988326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:49:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f118259c640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 0x7f118410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 -- 172.21.15.100:0/3258988326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 msgr2=0x7f118410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 0x7f118410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.224+0000 7f1181d9b640 1 -- 172.21.15.100:0/3258988326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178005040 con 0x7f11840fd7f0 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1181d9b640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11780048a0 tx=0x7f1178009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1178038070 con 0x7f11840fd7f0 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1178004290 con 0x7f11840fd7f0 2024-09-13T02:49:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118410e660 con 0x7f11840fd7f0 2024-09-13T02:49:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118410eb40 con 0x7f11840fd7f0 2024-09-13T02:49:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.225+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1178033660 con 0x7f11840fd7f0 2024-09-13T02:49:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.226+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11840fb980 con 0x7f11840fd7f0 2024-09-13T02:49:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.227+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1178030020 con 0x7f11840fd7f0 2024-09-13T02:49:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.227+0000 7f1172ffd640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 0x7f116c075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.227+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f11780ae280 con 0x7f11840fd7f0 2024-09-13T02:49:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.228+0000 7f118259c640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 0x7f116c075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.228+0000 7f118259c640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 0x7f116c075620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1174009af0 tx=0x7f117400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.235+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f117807b480 con 0x7f11840fd7f0 2024-09-13T02:49:42.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:42 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3002793832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:49:42.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:42 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1145037077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:42.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:42 smithi122 ceph-mon[34559]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:42.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:42 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3002793832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:49:42.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:42 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1145037077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:49:42.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.475+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f118404b720 con 0x7f11840fd7f0 2024-09-13T02:49:42.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.476+0000 7f1172ffd640 1 -- 172.21.15.100:0/3258988326 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f117802c870 con 0x7f11840fd7f0 2024-09-13T02:49:42.477 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 msgr2=0x7f116c075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 0x7f116c075620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1174009af0 tx=0x7f117400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 msgr2=0x7f118410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11780048a0 tx=0x7f1178009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 shutdown_connections 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f116c073170 0x7f116c075620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11840fd7f0 0x7f118410d5c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 --2- 172.21.15.100:0/3258988326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11840fc520 0x7f118410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:42.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.478+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 >> 172.21.15.100:0/3258988326 conn(0x7f11840f7ce0 msgr2=0x7f11840f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:42.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.479+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 shutdown_connections 2024-09-13T02:49:42.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:49:42.479+0000 7f1188bc5640 1 -- 172.21.15.100:0/3258988326 wait complete. 2024-09-13T02:49:43.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:43 smithi100 ceph-mon[27894]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:43.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:43 smithi100 ceph-mon[27894]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:43.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:43 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3258988326' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:49:43.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:43 smithi122 ceph-mon[34559]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:49:43.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:43 smithi122 ceph-mon[34559]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:43.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:43 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3258988326' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:49:45.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:45 smithi100 ceph-mon[27894]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:45.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:45 smithi122 ceph-mon[34559]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:47 smithi100 ceph-mon[27894]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:47 smithi122 ceph-mon[34559]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:49 smithi100 ceph-mon[27894]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:49.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:49 smithi122 ceph-mon[34559]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T02:49:51.081 INFO:tasks.workunit.client.1.smithi122.stderr:Updating files: 91% (11744/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-13T02:49:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:51 smithi100 ceph-mon[27894]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:51.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:51 smithi122 ceph-mon[34559]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:51.491 INFO:tasks.workunit.client.1.smithi122.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:49:51.491 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr: git switch -c 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.492 INFO:tasks.workunit.client.1.smithi122.stderr:Or undo this operation with: 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr: git switch - 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr: 2024-09-13T02:49:51.493 INFO:tasks.workunit.client.1.smithi122.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:49:51.498 DEBUG:teuthology.orchestra.run.smithi122:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T02:49:51.689 INFO:tasks.workunit.client.1.smithi122.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:49:51.691 INFO:tasks.workunit.client.1.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:49:51.691 INFO:tasks.workunit.client.1.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:49:52.410 INFO:tasks.workunit.client.1.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:49:52.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:52 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:52.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:52 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:52.494 INFO:tasks.workunit.client.1.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:49:52.540 INFO:tasks.workunit.client.1.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:49:52.542 INFO:tasks.workunit.client.1.smithi122.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:49:52.542 INFO:tasks.workunit.client.1.smithi122.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:49:52.584 INFO:tasks.workunit.client.1.smithi122.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:49:52.587 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T02:49:52.587 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T02:49:52.604 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T02:49:52.605 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:49:52.605 DEBUG:teuthology.orchestra.run.smithi122:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T02:49:52.668 INFO:tasks.workunit.client.1.smithi122.stderr:+ mkdir -p fsstress 2024-09-13T02:49:52.670 INFO:tasks.workunit.client.1.smithi122.stderr:+ pushd fsstress 2024-09-13T02:49:52.670 INFO:tasks.workunit.client.1.smithi122.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:49:52.670 INFO:tasks.workunit.client.1.smithi122.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:49:53.202 INFO:tasks.workunit.client.1.smithi122.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:49:53.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:53 smithi100 ceph-mon[27894]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:53 smithi122 ceph-mon[34559]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:49:53.596 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2024-09-13T02:49:53.597 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.598 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2024-09-13T02:49:53.598 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.598 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:49:53.598 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-13T02:49:53.598 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:49:53.603 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T02:49:53.666 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:49:53.669 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:49:53.669 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:49:55.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:55 smithi100 ceph-mon[27894]: pgmap v228: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-13T02:49:55.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:55 smithi122 ceph-mon[34559]: pgmap v228: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-13T02:49:57.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:57 smithi100 ceph-mon[27894]: pgmap v229: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-13T02:49:57.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:57 smithi122 ceph-mon[34559]: pgmap v229: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-13T02:49:58.479 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:49:58.615 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:49:58.658 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:49:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:49:58.660 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:49:58.700 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:49:58.703 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T02:49:58.703 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T02:49:58.721 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T02:49:58.722 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:49:58.722 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T02:49:58.784 INFO:tasks.workunit.client.0.smithi100.stderr:+ mkdir -p fsstress 2024-09-13T02:49:58.786 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd fsstress 2024-09-13T02:49:58.787 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:49:58.787 INFO:tasks.workunit.client.0.smithi100.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:49:59.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:49:59 smithi100 ceph-mon[27894]: pgmap v230: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s wr, 0 op/s 2024-09-13T02:49:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:49:59 smithi122 ceph-mon[34559]: pgmap v230: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s wr, 0 op/s 2024-09-13T02:50:00.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:00 smithi100 ceph-mon[27894]: overall HEALTH_OK 2024-09-13T02:50:00.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:00 smithi122 ceph-mon[34559]: overall HEALTH_OK 2024-09-13T02:50:01.149 INFO:tasks.workunit.client.0.smithi100.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:50:01.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:01 smithi100 ceph-mon[27894]: pgmap v231: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 169 op/s 2024-09-13T02:50:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:01 smithi122 ceph-mon[34559]: pgmap v231: 65 pgs: 65 active+clean; 30 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 169 op/s 2024-09-13T02:50:03.405 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:03 smithi122 ceph-mon[34559]: pgmap v232: 65 pgs: 65 active+clean; 46 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 266 op/s 2024-09-13T02:50:03.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:03.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:50:03.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:50:03.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:03 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:03.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:03 smithi100 ceph-mon[27894]: pgmap v232: 65 pgs: 65 active+clean; 46 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 266 op/s 2024-09-13T02:50:03.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:03.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:50:03.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:50:03.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:03 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:04.421 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:04 smithi122 ceph-mon[34559]: Upgrade: Updating mgr.smithi122.ptcenr 2024-09-13T02:50:04.422 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:04 smithi122 ceph-mon[34559]: Deploying daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:50:04.422 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:04 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:50:04.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:04 smithi100 ceph-mon[27894]: Upgrade: Updating mgr.smithi122.ptcenr 2024-09-13T02:50:04.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:04 smithi100 ceph-mon[27894]: Deploying daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:50:04.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:04 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:50:05.314 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:05 smithi122 ceph-mon[34559]: pgmap v233: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s wr, 350 op/s 2024-09-13T02:50:05.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:05 smithi100 ceph-mon[27894]: pgmap v233: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s wr, 350 op/s 2024-09-13T02:50:07.332 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:07 smithi122 ceph-mon[34559]: pgmap v234: 65 pgs: 65 active+clean; 68 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.8 MiB/s wr, 359 op/s 2024-09-13T02:50:07.333 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:07.333 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:07.333 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:07.333 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:07 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:07.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:07 smithi100 ceph-mon[27894]: pgmap v234: 65 pgs: 65 active+clean; 68 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.8 MiB/s wr, 359 op/s 2024-09-13T02:50:07.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:07.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:07.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:07.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:07 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:09.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:09 smithi100 ceph-mon[27894]: pgmap v235: 65 pgs: 65 active+clean; 69 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 375 op/s 2024-09-13T02:50:09.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:09 smithi122 ceph-mon[34559]: pgmap v235: 65 pgs: 65 active+clean; 69 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 375 op/s 2024-09-13T02:50:11.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:11 smithi100 ceph-mon[27894]: pgmap v236: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 453 op/s 2024-09-13T02:50:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:11 smithi122 ceph-mon[34559]: pgmap v236: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 453 op/s 2024-09-13T02:50:11.609 INFO:tasks.workunit.client.1.smithi122.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:50:11.610 INFO:tasks.workunit.client.1.smithi122.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:50:11.610 INFO:tasks.workunit.client.1.smithi122.stderr:+ make 2024-09-13T02:50:11.798 INFO:tasks.workunit.client.1.smithi122.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:50:12.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:12 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:50:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:12 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 -- 172.21.15.100:0/1355565743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988108200 msgr2=0x7f5988108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 --2- 172.21.15.100:0/1355565743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988108200 0x7f5988108670 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f59700048d0 tx=0x7f5970009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 -- 172.21.15.100:0/1355565743 shutdown_connections 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 --2- 172.21.15.100:0/1355565743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988108200 0x7f5988108670 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 --2- 172.21.15.100:0/1355565743 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988106f30 0x7f5988107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 -- 172.21.15.100:0/1355565743 >> 172.21.15.100:0/1355565743 conn(0x7f5988066e00 msgr2=0x7f5988067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:12.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 -- 172.21.15.100:0/1355565743 shutdown_connections 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.565+0000 7f598e062640 1 -- 172.21.15.100:0/1355565743 wait complete. 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 Processor -- start 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 -- start start 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988108200 0x7f5988117fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988118600 con 0x7f5988106f30 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f598e062640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988118e20 con 0x7f5988108200 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38772/0 (socket says 172.21.15.100:38772) 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 -- 172.21.15.100:0/3665383831 learned_addr learned my addr 172.21.15.100:0/3665383831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:12.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f597ffff640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988108200 0x7f5988117fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 -- 172.21.15.100:0/3665383831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988108200 msgr2=0x7f5988117fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988108200 0x7f5988117fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 -- 172.21.15.100:0/3665383831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970005040 con 0x7f5988106f30 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.566+0000 7f59877fe640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f597800ece0 tx=0x7f597800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.567+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f597800ee40 con 0x7f5988106f30 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.567+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59881190b0 con 0x7f5988106f30 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.567+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f597800f040 con 0x7f5988106f30 2024-09-13T02:50:12.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.567+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5978009580 con 0x7f5988106f30 2024-09-13T02:50:12.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.567+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5988119650 con 0x7f5988106f30 2024-09-13T02:50:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.568+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5988068a00 con 0x7f5988106f30 2024-09-13T02:50:12.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.568+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f597800ccc0 con 0x7f5988106f30 2024-09-13T02:50:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.569+0000 7f5984ff9640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 0x7f5974070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.569+0000 7f597ffff640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 0x7f5974070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.569+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f597808e260 con 0x7f5988106f30 2024-09-13T02:50:12.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.569+0000 7f597ffff640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 0x7f5974070a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5988117820 tx=0x7f5970035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:12.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.573+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f597805b3d0 con 0x7f5988106f30 2024-09-13T02:50:12.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.782+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59881199d0 con 0x7f597406e5c0 2024-09-13T02:50:12.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.783+0000 7f5984ff9640 1 -- 172.21.15.100:0/3665383831 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f59881199d0 con 0x7f597406e5c0 2024-09-13T02:50:12.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 msgr2=0x7f5974070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 0x7f5974070a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5988117820 tx=0x7f5970035040 comp rx=0 tx=0).stop 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 msgr2=0x7f5988117a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f597800ece0 tx=0x7f597800b040 comp rx=0 tx=0).stop 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 shutdown_connections 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f597406e5c0 0x7f5974070a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5988108200 0x7f5988117fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 --2- 172.21.15.100:0/3665383831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988106f30 0x7f5988117a70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 >> 172.21.15.100:0/3665383831 conn(0x7f5988066e00 msgr2=0x7f5988105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 shutdown_connections 2024-09-13T02:50:12.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.785+0000 7f598e062640 1 -- 172.21.15.100:0/3665383831 wait complete. 2024-09-13T02:50:12.795 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:50:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3964824916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fc720 msgr2=0x7f34b40fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3964824916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fc720 0x7f34b40fcb90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f34a40048d0 tx=0x7f34a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3964824916 shutdown_connections 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3964824916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fc720 0x7f34b40fcb90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3964824916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fb450 0x7f34b40fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.869+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3964824916 >> 172.21.15.100:0/3964824916 conn(0x7f34b40f6c10 msgr2=0x7f34b40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3964824916 shutdown_connections 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3964824916 wait complete. 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 Processor -- start 2024-09-13T02:50:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 -- start start 2024-09-13T02:50:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fc720 0x7f34b410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b410dc90 con 0x7f34b40fb450 2024-09-13T02:50:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34bc6f9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b410e4b0 con 0x7f34b40fc720 2024-09-13T02:50:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34ba495640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34ba495640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38790/0 (socket says 172.21.15.100:38790) 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34ba495640 1 -- 172.21.15.100:0/3842743762 learned_addr learned my addr 172.21.15.100:0/3842743762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.870+0000 7f34b9c94640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fc720 0x7f34b410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34ba495640 1 -- 172.21.15.100:0/3842743762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fc720 msgr2=0x7f34b410d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34ba495640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fc720 0x7f34b410d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34ba495640 1 -- 172.21.15.100:0/3842743762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4005040 con 0x7f34b40fb450 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34ba495640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f34b000eb70 tx=0x7f34b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b0007c30 con 0x7f34b40fb450 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b410e6e0 con 0x7f34b40fb450 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34b000f040 con 0x7f34b40fb450 2024-09-13T02:50:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34b000ca60 con 0x7f34b40fb450 2024-09-13T02:50:12.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.871+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b410ec80 con 0x7f34b40fb450 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.872+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b40fa8b0 con 0x7f34b40fb450 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.873+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f34b000cbc0 con 0x7f34b40fb450 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.873+0000 7f34aaffd640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 0x7f34a0070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.873+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f34b008d7e0 con 0x7f34b40fb450 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.873+0000 7f34b9c94640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 0x7f34a0070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.873+0000 7f34b9c94640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 0x7f34a0070a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34b410ceb0 tx=0x7f34a4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:12.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:12.877+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f34b005a960 con 0x7f34b40fb450 2024-09-13T02:50:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.059+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b4104020 con 0x7f34a006e5c0 2024-09-13T02:50:13.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.060+0000 7f34aaffd640 1 -- 172.21.15.100:0/3842743762 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f34a4039040 con 0x7f34a006e5c0 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 msgr2=0x7f34a0070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 0x7f34a0070a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34b410ceb0 tx=0x7f34a4035040 comp rx=0 tx=0).stop 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 msgr2=0x7f34b410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f34b000eb70 tx=0x7f34b000b040 comp rx=0 tx=0).stop 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 shutdown_connections 2024-09-13T02:50:13.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f34a006e5c0 0x7f34a0070a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34b40fc720 0x7f34b410d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 --2- 172.21.15.100:0/3842743762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34b40fb450 0x7f34b410d100 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 >> 172.21.15.100:0/3842743762 conn(0x7f34b40f6c10 msgr2=0x7f34b40660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 shutdown_connections 2024-09-13T02:50:13.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.062+0000 7f34bc6f9640 1 -- 172.21.15.100:0/3842743762 wait complete. 2024-09-13T02:50:13.117 INFO:tasks.workunit.client.1.smithi122.stderr:++ readlink -f fsstress 2024-09-13T02:50:13.118 INFO:tasks.workunit.client.1.smithi122.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:50:13.118 INFO:tasks.workunit.client.1.smithi122.stderr:+ popd 2024-09-13T02:50:13.118 INFO:tasks.workunit.client.1.smithi122.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:50:13.119 INFO:tasks.workunit.client.1.smithi122.stderr:+ popd 2024-09-13T02:50:13.119 INFO:tasks.workunit.client.1.smithi122.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:50:13.119 INFO:tasks.workunit.client.1.smithi122.stderr:++ mktemp -d -p . 2024-09-13T02:50:13.120 INFO:tasks.workunit.client.1.smithi122.stderr:+ T=./tmp.5rUVjpaYX2 2024-09-13T02:50:13.120 INFO:tasks.workunit.client.1.smithi122.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.5rUVjpaYX2 -l 1 -n 1000 -p 10 -v 2024-09-13T02:50:13.121 INFO:tasks.workunit.client.1.smithi122.stdout:seed = 1726116661 2024-09-13T02:50:13.123 INFO:tasks.workunit.client.1.smithi122.stdout:0/0: dwrite - no filename 2024-09-13T02:50:13.123 INFO:tasks.workunit.client.1.smithi122.stdout:0/1: rename - no filename 2024-09-13T02:50:13.123 INFO:tasks.workunit.client.1.smithi122.stdout:0/2: truncate - no filename 2024-09-13T02:50:13.123 INFO:tasks.workunit.client.1.smithi122.stdout:1/0: rename - no filename 2024-09-13T02:50:13.124 INFO:tasks.workunit.client.1.smithi122.stdout:1/1: chown . 122096 1 2024-09-13T02:50:13.124 INFO:tasks.workunit.client.1.smithi122.stdout:0/3: creat f0 x:0 0 0 2024-09-13T02:50:13.124 INFO:tasks.workunit.client.1.smithi122.stdout:2/0: dread - no filename 2024-09-13T02:50:13.124 INFO:tasks.workunit.client.1.smithi122.stdout:2/1: write - no filename 2024-09-13T02:50:13.124 INFO:tasks.workunit.client.1.smithi122.stdout:2/2: write - no filename 2024-09-13T02:50:13.125 INFO:tasks.workunit.client.1.smithi122.stdout:1/2: creat f0 x:0 0 0 2024-09-13T02:50:13.125 INFO:tasks.workunit.client.1.smithi122.stdout:0/4: mkdir d1 0 2024-09-13T02:50:13.125 INFO:tasks.workunit.client.1.smithi122.stdout:0/5: chown f0 1741918 1 2024-09-13T02:50:13.126 INFO:tasks.workunit.client.1.smithi122.stdout:3/0: read - no filename 2024-09-13T02:50:13.126 INFO:tasks.workunit.client.1.smithi122.stdout:2/3: mkdir d0 0 2024-09-13T02:50:13.126 INFO:tasks.workunit.client.1.smithi122.stdout:2/4: dread - no filename 2024-09-13T02:50:13.126 INFO:tasks.workunit.client.1.smithi122.stdout:2/5: rename d0 to d0/d1 22 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:2/6: write - no filename 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:4/0: dwrite - no filename 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:4/1: fsync - no filename 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:3/1: symlink l0 0 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:3/2: write - no filename 2024-09-13T02:50:13.127 INFO:tasks.workunit.client.1.smithi122.stdout:3/3: dread - no filename 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:2/7: mknod d0/c2 0 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:2/8: dwrite - no filename 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:5/0: truncate - no filename 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:5/1: dread - no filename 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:5/2: unlink - no file 2024-09-13T02:50:13.128 INFO:tasks.workunit.client.1.smithi122.stdout:5/3: dwrite - no filename 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:4/2: creat f0 x:0 0 0 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:4/3: dread - f0 zero size 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:4/4: truncate f0 215265 0 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:3/4: unlink l0 0 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:3/5: dread - no filename 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:3/6: write - no filename 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:3/7: dread - no filename 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:2/9: symlink d0/l3 0 2024-09-13T02:50:13.130 INFO:tasks.workunit.client.1.smithi122.stdout:2/10: dread - no filename 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/4: mkdir d0 0 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/5: rename d0 to d0/d1 22 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/6: link - no file 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/7: write - no filename 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/8: fdatasync - no filename 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/9: chown d0 880267600 1 2024-09-13T02:50:13.131 INFO:tasks.workunit.client.1.smithi122.stdout:4/5: symlink l1 0 2024-09-13T02:50:13.132 INFO:tasks.workunit.client.1.smithi122.stdout:4/6: creat f2 x:0 0 0 2024-09-13T02:50:13.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/8: mkdir d1 0 2024-09-13T02:50:13.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/9: write - no filename 2024-09-13T02:50:13.133 INFO:tasks.workunit.client.1.smithi122.stdout:2/11: creat d0/f4 x:0 0 0 2024-09-13T02:50:13.133 INFO:tasks.workunit.client.1.smithi122.stdout:2/12: dread - d0/f4 zero size 2024-09-13T02:50:13.133 INFO:tasks.workunit.client.1.smithi122.stdout:2/13: stat d0/f4 0 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:6/0: creat f0 x:0 0 0 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:7/0: dwrite - no filename 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:5/10: mkdir d0/d2 0 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:7/1: dwrite - no filename 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:5/11: dwrite - no filename 2024-09-13T02:50:13.136 INFO:tasks.workunit.client.1.smithi122.stdout:7/2: dread - no filename 2024-09-13T02:50:13.137 INFO:tasks.workunit.client.1.smithi122.stdout:3/10: rmdir d1 0 2024-09-13T02:50:13.138 INFO:tasks.workunit.client.1.smithi122.stdout:2/14: unlink d0/c2 0 2024-09-13T02:50:13.139 INFO:tasks.workunit.client.1.smithi122.stdout:2/15: write d0/f4 [529387,122196] 0 2024-09-13T02:50:13.139 INFO:tasks.workunit.client.1.smithi122.stdout:5/12: mknod d0/c3 0 2024-09-13T02:50:13.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/3: symlink l0 0 2024-09-13T02:50:13.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/4: write - no filename 2024-09-13T02:50:13.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/0: dread - no filename 2024-09-13T02:50:13.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/1: write - no filename 2024-09-13T02:50:13.141 INFO:tasks.workunit.client.1.smithi122.stdout:8/2: dwrite - no filename 2024-09-13T02:50:13.141 INFO:tasks.workunit.client.1.smithi122.stdout:3/11: creat f2 x:0 0 0 2024-09-13T02:50:13.141 INFO:tasks.workunit.client.1.smithi122.stdout:3/12: creat f3 x:0 0 0 2024-09-13T02:50:13.143 INFO:tasks.workunit.client.1.smithi122.stdout:5/13: unlink d0/c3 0 2024-09-13T02:50:13.143 INFO:tasks.workunit.client.1.smithi122.stdout:5/14: chown d0 11807 1 2024-09-13T02:50:13.143 INFO:tasks.workunit.client.1.smithi122.stdout:7/5: link l0 l1 0 2024-09-13T02:50:13.144 INFO:tasks.workunit.client.1.smithi122.stdout:9/0: dwrite - no filename 2024-09-13T02:50:13.144 INFO:tasks.workunit.client.1.smithi122.stdout:9/1: dwrite - no filename 2024-09-13T02:50:13.145 INFO:tasks.workunit.client.1.smithi122.stdout:9/2: dwrite - no filename 2024-09-13T02:50:13.145 INFO:tasks.workunit.client.1.smithi122.stdout:9/3: dread - no filename 2024-09-13T02:50:13.145 INFO:tasks.workunit.client.1.smithi122.stdout:8/3: creat f0 x:0 0 0 2024-09-13T02:50:13.145 INFO:tasks.workunit.client.1.smithi122.stdout:8/4: readlink - no filename 2024-09-13T02:50:13.146 INFO:tasks.workunit.client.1.smithi122.stdout:8/5: rmdir - no directory 2024-09-13T02:50:13.146 INFO:tasks.workunit.client.1.smithi122.stdout:8/6: readlink - no filename 2024-09-13T02:50:13.146 INFO:tasks.workunit.client.1.smithi122.stdout:8/7: write f0 [712120,114064] 0 2024-09-13T02:50:13.147 INFO:tasks.workunit.client.1.smithi122.stdout:5/15: creat d0/d2/f4 x:0 0 0 2024-09-13T02:50:13.147 INFO:tasks.workunit.client.1.smithi122.stdout:5/16: write d0/d2/f4 [78725,2828] 0 2024-09-13T02:50:13.147 INFO:tasks.workunit.client.1.smithi122.stdout:5/17: rename d0/d2 to d0/d2/d5 22 2024-09-13T02:50:13.147 INFO:tasks.workunit.client.1.smithi122.stdout:7/6: stat l1 0 2024-09-13T02:50:13.147 INFO:tasks.workunit.client.1.smithi122.stdout:7/7: dread - no filename 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/8: dread - no filename 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/9: truncate - no filename 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/10: chown l1 0 1 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/11: dwrite - no filename 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:9/4: mknod c0 0 2024-09-13T02:50:13.148 INFO:tasks.workunit.client.1.smithi122.stdout:9/5: write - no filename 2024-09-13T02:50:13.149 INFO:tasks.workunit.client.1.smithi122.stdout:9/6: readlink - no filename 2024-09-13T02:50:13.149 INFO:tasks.workunit.client.1.smithi122.stdout:9/7: write - no filename 2024-09-13T02:50:13.149 INFO:tasks.workunit.client.1.smithi122.stdout:9/8: fsync - no filename 2024-09-13T02:50:13.149 INFO:tasks.workunit.client.1.smithi122.stdout:9/9: dwrite - no filename 2024-09-13T02:50:13.149 INFO:tasks.workunit.client.1.smithi122.stdout:7/12: rename l0 to l2 0 2024-09-13T02:50:13.151 INFO:tasks.workunit.client.1.smithi122.stdout:9/10: creat f1 x:0 0 0 2024-09-13T02:50:13.151 INFO:tasks.workunit.client.1.smithi122.stdout:9/11: creat f2 x:0 0 0 2024-09-13T02:50:13.151 INFO:tasks.workunit.client.1.smithi122.stdout:9/12: creat f3 x:0 0 0 2024-09-13T02:50:13.151 INFO:tasks.workunit.client.1.smithi122.stdout:9/13: readlink - no filename 2024-09-13T02:50:13.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/13: stat l2 0 2024-09-13T02:50:13.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/14: dread - no filename 2024-09-13T02:50:13.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/15: fsync - no filename 2024-09-13T02:50:13.153 INFO:tasks.workunit.client.1.smithi122.stdout:7/16: read - no filename 2024-09-13T02:50:13.156 INFO:tasks.workunit.client.1.smithi122.stdout:7/17: mknod c3 0 2024-09-13T02:50:13.157 INFO:tasks.workunit.client.1.smithi122.stdout:7/18: mkdir d4 0 2024-09-13T02:50:13.157 INFO:tasks.workunit.client.1.smithi122.stdout:7/19: dread - no filename 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 -- 172.21.15.100:0/1893831914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 msgr2=0x7f85b80fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 --2- 172.21.15.100:0/1893831914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b80fc990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f85b00048d0 tx=0x7f85b0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 -- 172.21.15.100:0/1893831914 shutdown_connections 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 --2- 172.21.15.100:0/1893831914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b80fdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 --2- 172.21.15.100:0/1893831914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b80fc990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 -- 172.21.15.100:0/1893831914 >> 172.21.15.100:0/1893831914 conn(0x7f85b80f7d60 msgr2=0x7f85b80fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 -- 172.21.15.100:0/1893831914 shutdown_connections 2024-09-13T02:50:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.156+0000 7f85bdd36640 1 -- 172.21.15.100:0/1893831914 wait complete. 2024-09-13T02:50:13.159 INFO:tasks.workunit.client.1.smithi122.stdout:7/20: mkdir d4/d5 0 2024-09-13T02:50:13.159 INFO:tasks.workunit.client.1.smithi122.stdout:7/21: read - no filename 2024-09-13T02:50:13.159 INFO:tasks.workunit.client.1.smithi122.stdout:7/22: dread - no filename 2024-09-13T02:50:13.159 INFO:tasks.workunit.client.1.smithi122.stdout:7/23: rmdir d4 39 2024-09-13T02:50:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.157+0000 7f85bdd36640 1 Processor -- start 2024-09-13T02:50:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.157+0000 7f85bdd36640 1 -- start start 2024-09-13T02:50:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85bdd36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85bdd36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85bdd36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b810dbf0 con 0x7f85b80fc580 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85bdd36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b810e410 con 0x7f85b80fd850 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85b6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85b6ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:51254/0 (socket says 172.21.15.100:51254) 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.158+0000 7f85b6ffd640 1 -- 172.21.15.100:0/59215847 learned_addr learned my addr 172.21.15.100:0/59215847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.159+0000 7f85b77fe640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.159+0000 7f85b6ffd640 1 -- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 msgr2=0x7f85b810d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.159+0000 7f85b6ffd640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b810d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.159+0000 7f85b6ffd640 1 -- 172.21.15.100:0/59215847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0005040 con 0x7f85b80fd850 2024-09-13T02:50:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.159+0000 7f85b77fe640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.160+0000 7f85b6ffd640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85a000ecb0 tx=0x7f85a000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.162 INFO:tasks.workunit.client.1.smithi122.stdout:7/24: symlink d4/l6 0 2024-09-13T02:50:13.162 INFO:tasks.workunit.client.1.smithi122.stdout:7/25: chown l1 0 1 2024-09-13T02:50:13.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/26: dwrite - no filename 2024-09-13T02:50:13.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/27: creat d4/d5/f7 x:0 0 0 2024-09-13T02:50:13.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.166+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a000cb30 con 0x7f85b80fd850 2024-09-13T02:50:13.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.166+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b810e6a0 con 0x7f85b80fd850 2024-09-13T02:50:13.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.166+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b810ec40 con 0x7f85b80fd850 2024-09-13T02:50:13.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.166+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85a000f040 con 0x7f85b80fd850 2024-09-13T02:50:13.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.166+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a0009730 con 0x7f85b80fd850 2024-09-13T02:50:13.168 INFO:tasks.workunit.client.1.smithi122.stdout:0/6: dwrite f0 [0,4194304] 0 2024-09-13T02:50:13.168 INFO:tasks.workunit.client.1.smithi122.stdout:1/3: dwrite f0 [0,4194304] 0 2024-09-13T02:50:13.168 INFO:tasks.workunit.client.1.smithi122.stdout:0/7: fdatasync f0 0 2024-09-13T02:50:13.168 INFO:tasks.workunit.client.1.smithi122.stdout:1/4: creat f1 x:0 0 0 2024-09-13T02:50:13.169 INFO:tasks.workunit.client.1.smithi122.stdout:1/5: chown f1 0 1 2024-09-13T02:50:13.169 INFO:tasks.workunit.client.1.smithi122.stdout:1/6: rmdir - no directory 2024-09-13T02:50:13.169 INFO:tasks.workunit.client.1.smithi122.stdout:1/7: dread - f1 zero size 2024-09-13T02:50:13.169 INFO:tasks.workunit.client.1.smithi122.stdout:1/8: creat f2 x:0 0 0 2024-09-13T02:50:13.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.167+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b80fb9e0 con 0x7f85b80fd850 2024-09-13T02:50:13.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.168+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f85a0007890 con 0x7f85b80fd850 2024-09-13T02:50:13.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.169+0000 7f85affff640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 0x7f85a4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.169+0000 7f85b77fe640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 0x7f85a4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.169+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f85a008e250 con 0x7f85b80fd850 2024-09-13T02:50:13.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.170+0000 7f85b77fe640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 0x7f85a4070a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.171 INFO:tasks.workunit.client.1.smithi122.stdout:0/8: mknod d1/c2 0 2024-09-13T02:50:13.171 INFO:tasks.workunit.client.1.smithi122.stdout:0/9: fdatasync f0 0 2024-09-13T02:50:13.174 INFO:tasks.workunit.client.1.smithi122.stdout:0/10: symlink d1/l3 0 2024-09-13T02:50:13.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.174+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f85a005b380 con 0x7f85b80fd850 2024-09-13T02:50:13.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/11: mkdir d1/d4 0 2024-09-13T02:50:13.177 INFO:tasks.workunit.client.1.smithi122.stdout:0/12: mkdir d1/d5 0 2024-09-13T02:50:13.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/13: rename d1/c2 to d1/d4/c6 0 2024-09-13T02:50:13.181 INFO:tasks.workunit.client.1.smithi122.stdout:3/13: dwrite f2 [0,4194304] 0 2024-09-13T02:50:13.190 INFO:tasks.workunit.client.1.smithi122.stdout:9/14: dwrite f3 [0,4194304] 0 2024-09-13T02:50:13.190 INFO:tasks.workunit.client.1.smithi122.stdout:4/7: dwrite f2 [0,4194304] 0 2024-09-13T02:50:13.191 INFO:tasks.workunit.client.1.smithi122.stdout:4/8: rmdir - no directory 2024-09-13T02:50:13.191 INFO:tasks.workunit.client.1.smithi122.stdout:9/15: creat f4 x:0 0 0 2024-09-13T02:50:13.191 INFO:tasks.workunit.client.1.smithi122.stdout:4/9: creat f3 x:0 0 0 2024-09-13T02:50:13.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/1: dwrite f0 [0,4194304] 0 2024-09-13T02:50:13.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/2: stat f0 0 2024-09-13T02:50:13.196 INFO:tasks.workunit.client.1.smithi122.stdout:5/18: fsync d0/d2/f4 0 2024-09-13T02:50:13.197 INFO:tasks.workunit.client.1.smithi122.stdout:2/16: getdents d0 0 2024-09-13T02:50:13.201 INFO:tasks.workunit.client.1.smithi122.stdout:8/8: getdents . 0 2024-09-13T02:50:13.206 INFO:tasks.workunit.client.1.smithi122.stdout:3/14: mkdir d4 0 2024-09-13T02:50:13.214 INFO:tasks.workunit.client.1.smithi122.stdout:4/10: mknod c4 0 2024-09-13T02:50:13.218 INFO:tasks.workunit.client.1.smithi122.stdout:6/3: symlink l1 0 2024-09-13T02:50:13.222 INFO:tasks.workunit.client.1.smithi122.stdout:8/9: creat f1 x:0 0 0 2024-09-13T02:50:13.222 INFO:tasks.workunit.client.1.smithi122.stdout:7/28: rename d4/d5 to d4/d8 0 2024-09-13T02:50:13.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:13 smithi100 ceph-mon[27894]: pgmap v237: 65 pgs: 65 active+clean; 101 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 285 op/s 2024-09-13T02:50:13.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:13 smithi100 ceph-mon[27894]: mgrmap e20: smithi100.lhjyck(active, since 6m), standbys: smithi122.ptcenr 2024-09-13T02:50:13.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:13 smithi122 ceph-mon[34559]: pgmap v237: 65 pgs: 65 active+clean; 101 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 285 op/s 2024-09-13T02:50:13.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:13 smithi122 ceph-mon[34559]: mgrmap e20: smithi100.lhjyck(active, since 6m), standbys: smithi122.ptcenr 2024-09-13T02:50:13.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/11: truncate f2 3485604 0 2024-09-13T02:50:13.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/12: dread - f3 zero size 2024-09-13T02:50:13.488 INFO:tasks.workunit.client.1.smithi122.stdout:9/16: getdents . 0 2024-09-13T02:50:13.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.553+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85b810f030 con 0x7f85a406e5c0 2024-09-13T02:50:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.574+0000 7f85affff640 1 -- 172.21.15.100:0/59215847 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f85b810f030 con 0x7f85a406e5c0 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (6m) 91s ago 7m 25.7M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (7m) 91s ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (6m) 98s ago 6m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 91s ago 7m 85.9M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (111s) 91s ago 110s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (118s) 91s ago 117s 10.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (108s) 98s ago 108s 14.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (115s) 98s ago 115s 15.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (8m) 91s ago 8m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:50:13.576 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 starting - - - - 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (8m) 91s ago 8m 45.3M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (6m) 98s ago 6m 36.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 91s ago 7m 15.1M - 1.5.0 0da6a335fe13 0d6356dae8e0 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (6m) 98s ago 6m 16.2M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (5m) 91s ago 5m 45.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (5m) 91s ago 5m 44.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (4m) 91s ago 4m 44.6M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (4m) 98s ago 4m 45.2M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (3m) 98s ago 3m 43.0M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (3m) 98s ago 3m 42.6M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:50:13.577 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 91s ago 6m 54.4M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:50:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.578+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 msgr2=0x7f85a4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.578+0000 7f85bdd36640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 0x7f85a4070a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000c00 tx=0x7f85b0035040 comp rx=0 tx=0).stop 2024-09-13T02:50:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.578+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 msgr2=0x7f85b810d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.578+0000 7f85bdd36640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85a000ecb0 tx=0x7f85a000b040 comp rx=0 tx=0).stop 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 shutdown_connections 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f85a406e5c0 0x7f85a4070a70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85b80fd850 0x7f85b810d5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 --2- 172.21.15.100:0/59215847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b80fc580 0x7f85b810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 >> 172.21.15.100:0/59215847 conn(0x7f85b80f7d60 msgr2=0x7f85b80f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:13.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 shutdown_connections 2024-09-13T02:50:13.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.580+0000 7f85bdd36640 1 -- 172.21.15.100:0/59215847 wait complete. 2024-09-13T02:50:13.616 INFO:tasks.workunit.client.1.smithi122.stdout:5/19: read d0/d2/f4 [4972,63446] 0 2024-09-13T02:50:13.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.745+0000 7fc410568640 1 -- 172.21.15.100:0/3846671716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806e540 msgr2=0x7fc408108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.745+0000 7fc410568640 1 --2- 172.21.15.100:0/3846671716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806e540 0x7fc408108730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80048d0 tx=0x7fc3f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.747+0000 7fc410568640 1 -- 172.21.15.100:0/3846671716 shutdown_connections 2024-09-13T02:50:13.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.747+0000 7fc410568640 1 --2- 172.21.15.100:0/3846671716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806e540 0x7fc408108730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.747+0000 7fc410568640 1 --2- 172.21.15.100:0/3846671716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40806dbf0 0x7fc40806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.747+0000 7fc410568640 1 -- 172.21.15.100:0/3846671716 >> 172.21.15.100:0/3846671716 conn(0x7fc408069560 msgr2=0x7fc40806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:13.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.747+0000 7fc410568640 1 -- 172.21.15.100:0/3846671716 shutdown_connections 2024-09-13T02:50:13.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.748+0000 7fc410568640 1 -- 172.21.15.100:0/3846671716 wait complete. 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.749+0000 7fc410568640 1 Processor -- start 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.749+0000 7fc410568640 1 -- start start 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.749+0000 7fc410568640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc410568640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40806e540 0x7fc408111d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc410568640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4081133d0 con 0x7fc40806e540 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc410568640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408112280 con 0x7fc40806dbf0 2024-09-13T02:50:13.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:51276/0 (socket says 172.21.15.100:51276) 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 -- 172.21.15.100:0/3797238229 learned_addr learned my addr 172.21.15.100:0/3797238229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 -- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40806e540 msgr2=0x7fc408111d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40806e540 0x7fc408111d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.750+0000 7fc40e304640 1 -- 172.21.15.100:0/3797238229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8005040 con 0x7fc40806dbf0 2024-09-13T02:50:13.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc40e304640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40400eb70 tx=0x7fc40400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc404007c30 con 0x7fc40806dbf0 2024-09-13T02:50:13.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc40400f040 con 0x7fc40806dbf0 2024-09-13T02:50:13.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc404009550 con 0x7fc40806dbf0 2024-09-13T02:50:13.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc408112500 con 0x7fc40806dbf0 2024-09-13T02:50:13.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.751+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40812a3f0 con 0x7fc40806dbf0 2024-09-13T02:50:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.756+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fc404009730 con 0x7fc40806dbf0 2024-09-13T02:50:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.756+0000 7fc3feffd640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 0x7fc3f4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.756+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc40408d750 con 0x7fc40806dbf0 2024-09-13T02:50:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.757+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec005240 con 0x7fc40806dbf0 2024-09-13T02:50:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.757+0000 7fc40db03640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 0x7fc3f4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.760+0000 7fc40db03640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 0x7fc3f4070c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3f802a620 tx=0x7fc3f8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:13.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:13.768+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc40405a930 con 0x7fc40806dbf0 2024-09-13T02:50:13.844 INFO:tasks.workunit.client.1.smithi122.stdout:4/13: mknod c5 0 2024-09-13T02:50:13.845 INFO:tasks.workunit.client.1.smithi122.stdout:9/17: mknod c5 0 2024-09-13T02:50:13.846 INFO:tasks.workunit.client.1.smithi122.stdout:9/18: write f1 [67541,28779] 0 2024-09-13T02:50:13.924 INFO:tasks.workunit.client.1.smithi122.stdout:0/14: dread f0 [0,4194304] 0 2024-09-13T02:50:14.170 INFO:tasks.workunit.client.1.smithi122.stdout:7/29: dwrite d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:14.172 INFO:tasks.workunit.client.1.smithi122.stdout:3/15: dwrite f3 [0,4194304] 0 2024-09-13T02:50:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.235+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3ec005d00 con 0x7fc40806dbf0 2024-09-13T02:50:14.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.237+0000 7fc3feffd640 1 -- 172.21.15.100:0/3797238229 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fc404019070 con 0x7fc40806dbf0 2024-09-13T02:50:14.238 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:50:14.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:14.240 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:50:14.240 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:50:14.240 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:50:14.240 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:50:14.240 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:50:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.242+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 msgr2=0x7fc3f4070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.242+0000 7fc410568640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 0x7fc3f4070c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc3f802a620 tx=0x7fc3f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.242+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 msgr2=0x7fc408111800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.242+0000 7fc410568640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40400eb70 tx=0x7fc40400b040 comp rx=0 tx=0).stop 2024-09-13T02:50:14.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.246+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 shutdown_connections 2024-09-13T02:50:14.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.246+0000 7fc410568640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fc3f406e7a0 0x7fc3f4070c50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.246+0000 7fc410568640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40806e540 0x7fc408111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.246+0000 7fc410568640 1 --2- 172.21.15.100:0/3797238229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc40806dbf0 0x7fc408111800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.246+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 >> 172.21.15.100:0/3797238229 conn(0x7fc408069560 msgr2=0x7fc408106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:14.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.249+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 shutdown_connections 2024-09-13T02:50:14.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.252+0000 7fc410568640 1 -- 172.21.15.100:0/3797238229 wait complete. 2024-09-13T02:50:14.401 INFO:tasks.workunit.client.1.smithi122.stdout:5/20: unlink d0/d2/f4 0 2024-09-13T02:50:14.401 INFO:tasks.workunit.client.1.smithi122.stdout:5/21: dwrite - no filename 2024-09-13T02:50:14.401 INFO:tasks.workunit.client.1.smithi122.stdout:5/22: truncate - no filename 2024-09-13T02:50:14.401 INFO:tasks.workunit.client.1.smithi122.stdout:5/23: unlink - no file 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/24: truncate - no filename 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/25: link - no file 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/26: readlink - no filename 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/27: chown d0/d2 250428 1 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/28: dread - no filename 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/29: chown d0/d2 41 1 2024-09-13T02:50:14.402 INFO:tasks.workunit.client.1.smithi122.stdout:5/30: chown d0 22 1 2024-09-13T02:50:14.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.406+0000 7fb06ade8640 1 -- 172.21.15.100:0/4089202815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 msgr2=0x7fb06406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.406+0000 7fb06ade8640 1 --2- 172.21.15.100:0/4089202815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb06406e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb0540048d0 tx=0x7fb054009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.408+0000 7fb06ade8640 1 -- 172.21.15.100:0/4089202815 shutdown_connections 2024-09-13T02:50:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.408+0000 7fb06ade8640 1 --2- 172.21.15.100:0/4089202815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 0x7fb064108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.408+0000 7fb06ade8640 1 --2- 172.21.15.100:0/4089202815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb06406e000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.408+0000 7fb06ade8640 1 -- 172.21.15.100:0/4089202815 >> 172.21.15.100:0/4089202815 conn(0x7fb064069560 msgr2=0x7fb06406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:14.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.410+0000 7fb06ade8640 1 -- 172.21.15.100:0/4089202815 shutdown_connections 2024-09-13T02:50:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.413+0000 7fb06ade8640 1 -- 172.21.15.100:0/4089202815 wait complete. 2024-09-13T02:50:14.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.414+0000 7fb06ade8640 1 Processor -- start 2024-09-13T02:50:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.418+0000 7fb06ade8640 1 -- start start 2024-09-13T02:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.418+0000 7fb06ade8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.418+0000 7fb06ade8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 0x7fb064113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.418+0000 7fb06ade8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064114240 con 0x7fb06406dbf0 2024-09-13T02:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.418+0000 7fb06ade8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064114a10 con 0x7fb06406e540 2024-09-13T02:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.420+0000 7fb068b84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.420+0000 7fb068b84640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38840/0 (socket says 172.21.15.100:38840) 2024-09-13T02:50:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.420+0000 7fb068b84640 1 -- 172.21.15.100:0/3229964186 learned_addr learned my addr 172.21.15.100:0/3229964186 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.420+0000 7fb063fff640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 0x7fb064113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.423+0000 7fb068b84640 1 -- 172.21.15.100:0/3229964186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 msgr2=0x7fb064113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.423+0000 7fb068b84640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 0x7fb064113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.423+0000 7fb068b84640 1 -- 172.21.15.100:0/3229964186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054005040 con 0x7fb06406dbf0 2024-09-13T02:50:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.424+0000 7fb068b84640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0540043d0 tx=0x7fb054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:14.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.424+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb054038070 con 0x7fb06406dbf0 2024-09-13T02:50:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.424+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb05402ae90 con 0x7fb06406dbf0 2024-09-13T02:50:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.424+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05403e670 con 0x7fb06406dbf0 2024-09-13T02:50:14.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.424+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb064114c40 con 0x7fb06406dbf0 2024-09-13T02:50:14.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.425+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0641151e0 con 0x7fb06406dbf0 2024-09-13T02:50:14.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.428+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06406d1b0 con 0x7fb06406dbf0 2024-09-13T02:50:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.429+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fb054030020 con 0x7fb06406dbf0 2024-09-13T02:50:14.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.429+0000 7fb0617fa640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 0x7fb04c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.430+0000 7fb063fff640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 0x7fb04c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:14.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.430+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb0540add30 con 0x7fb06406dbf0 2024-09-13T02:50:14.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.431+0000 7fb063fff640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 0x7fb04c070c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb064113460 tx=0x7fb05c004d00 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:14.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:14 smithi122 ceph-mon[34559]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:14.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:14 smithi122 ceph-mon[34559]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:14.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.439+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb05407ae60 con 0x7fb06406dbf0 2024-09-13T02:50:14.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:14 smithi100 ceph-mon[27894]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:14.441 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:14 smithi100 ceph-mon[27894]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:14.604 INFO:tasks.workunit.client.1.smithi122.stdout:4/14: write f2 [2557126,60026] 0 2024-09-13T02:50:14.697 INFO:tasks.workunit.client.1.smithi122.stdout:3/16: dread f2 [0,4194304] 0 2024-09-13T02:50:14.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/17: truncate d0/f4 587726 0 2024-09-13T02:50:14.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/18: chown d0 3528877 1 2024-09-13T02:50:14.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/19: write d0/f4 [882285,12477] 0 2024-09-13T02:50:14.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/20: write d0/f4 [1820234,11632] 0 2024-09-13T02:50:14.790 INFO:tasks.workunit.client.1.smithi122.stdout:6/4: write f0 [3924110,40898] 0 2024-09-13T02:50:14.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.848+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb064115510 con 0x7fb06406dbf0 2024-09-13T02:50:14.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.849+0000 7fb0617fa640 1 -- 172.21.15.100:0/3229964186 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fb05407a800 con 0x7fb06406dbf0 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:e17 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:50:14.851 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 17 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:03.128315+0000 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:50:14.852 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:50:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:14.854 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-09-13T02:50:14.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 msgr2=0x7fb04c070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 0x7fb04c070c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb064113460 tx=0x7fb05c004d00 comp rx=0 tx=0).stop 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 msgr2=0x7fb0641136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0540043d0 tx=0x7fb054009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 shutdown_connections 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fb04c06e7a0 0x7fb04c070c50 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb064113460 tx=0x7fb05c004d00 comp rx=0 tx=0).stop 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb06406e540 0x7fb064113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 --2- 172.21.15.100:0/3229964186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb06406dbf0 0x7fb0641136b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:14.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.856+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 >> 172.21.15.100:0/3229964186 conn(0x7fb064069560 msgr2=0x7fb0641068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:14.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.860+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 shutdown_connections 2024-09-13T02:50:14.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:14.860+0000 7fb06ade8640 1 -- 172.21.15.100:0/3229964186 wait complete. 2024-09-13T02:50:14.960 INFO:tasks.workunit.client.1.smithi122.stdout:6/5: dread f0 [0,4194304] 0 2024-09-13T02:50:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.006+0000 7f310182a640 1 -- 172.21.15.100:0/435472870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06dbf0 msgr2=0x7f30fc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.006+0000 7f310182a640 1 --2- 172.21.15.100:0/435472870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06dbf0 0x7f30fc06e000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0048d0 tx=0x7f30ec009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.009+0000 7f310182a640 1 -- 172.21.15.100:0/435472870 shutdown_connections 2024-09-13T02:50:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.009+0000 7f310182a640 1 --2- 172.21.15.100:0/435472870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06e540 0x7f30fc108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.009+0000 7f310182a640 1 --2- 172.21.15.100:0/435472870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06dbf0 0x7f30fc06e000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.009+0000 7f310182a640 1 -- 172.21.15.100:0/435472870 >> 172.21.15.100:0/435472870 conn(0x7f30fc069560 msgr2=0x7f30fc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:15.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.010+0000 7f310182a640 1 -- 172.21.15.100:0/435472870 shutdown_connections 2024-09-13T02:50:15.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.013+0000 7f310182a640 1 -- 172.21.15.100:0/435472870 wait complete. 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.014+0000 7f310182a640 1 Processor -- start 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.014+0000 7f310182a640 1 -- start start 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f310182a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 0x7f30fc11bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f310182a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 0x7f30fc11c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f310182a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc11d280 con 0x7f30fc06dbf0 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f310182a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc11d3f0 con 0x7f30fc06e540 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f30faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 0x7f30fc11bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f30faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 0x7f30fc11bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38860/0 (socket says 172.21.15.100:38860) 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f30faffd640 1 -- 172.21.15.100:0/903396195 learned_addr learned my addr 172.21.15.100:0/903396195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.015+0000 7f30fa7fc640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 0x7f30fc11c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.016+0000 7f30fa7fc640 1 -- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 msgr2=0x7f30fc11bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.016+0000 7f30fa7fc640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 0x7f30fc11bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.016+0000 7f30fa7fc640 1 -- 172.21.15.100:0/903396195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec005040 con 0x7f30fc06e540 2024-09-13T02:50:15.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.017+0000 7f30fa7fc640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 0x7f30fc11c410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30f000b4e0 tx=0x7f30f0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.018+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f000f6f0 con 0x7f30fc06e540 2024-09-13T02:50:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.018+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30f000fcf0 con 0x7f30fc06e540 2024-09-13T02:50:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.019+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f0011e70 con 0x7f30fc06e540 2024-09-13T02:50:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.019+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc11d6d0 con 0x7f30fc06e540 2024-09-13T02:50:15.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.019+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc11dba0 con 0x7f30fc06e540 2024-09-13T02:50:15.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.021+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc06d1b0 con 0x7f30fc06e540 2024-09-13T02:50:15.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.025+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f30f0011620 con 0x7f30fc06e540 2024-09-13T02:50:15.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.026+0000 7f30e37fe640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 0x7f30e4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.026+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f30f008d9d0 con 0x7f30fc06e540 2024-09-13T02:50:15.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.029+0000 7f30faffd640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 0x7f30e4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.032+0000 7f30faffd640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 0x7f30e4070c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000c00 tx=0x7f30ec035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:15.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.034+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f30f005ab00 con 0x7f30fc06e540 2024-09-13T02:50:15.126 INFO:tasks.workunit.client.1.smithi122.stdout:9/19: dwrite f3 [0,4194304] 0 2024-09-13T02:50:15.126 INFO:tasks.workunit.client.1.smithi122.stdout:9/20: rmdir - no directory 2024-09-13T02:50:15.145 INFO:tasks.workunit.client.1.smithi122.stdout:4/15: dwrite f2 [0,4194304] 0 2024-09-13T02:50:15.145 INFO:tasks.workunit.client.1.smithi122.stdout:4/16: fdatasync f2 0 2024-09-13T02:50:15.247 INFO:tasks.workunit.client.1.smithi122.stdout:3/17: dwrite f2 [4194304,4194304] 0 2024-09-13T02:50:15.247 INFO:tasks.workunit.client.1.smithi122.stdout:3/18: getdents d4 0 2024-09-13T02:50:15.251 INFO:tasks.workunit.client.1.smithi122.stdout:4/17: write f2 [2474536,54364] 0 2024-09-13T02:50:15.278 INFO:tasks.workunit.client.1.smithi122.stdout:4/18: dread f2 [0,4194304] 0 2024-09-13T02:50:15.278 INFO:tasks.workunit.client.1.smithi122.stdout:4/19: chown l1 66992601 1 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.410+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30fc11de80 con 0x7f30e406e7a0 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.412+0000 7f30e37fe640 1 -- 172.21.15.100:0/903396195 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f30fc11de80 con 0x7f30e406e7a0 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "", 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:50:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:50:15.415 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:50:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.416+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 msgr2=0x7f30e4070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.416+0000 7f310182a640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 0x7f30e4070c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000c00 tx=0x7f30ec035040 comp rx=0 tx=0).stop 2024-09-13T02:50:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.416+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 msgr2=0x7f30fc11c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.416+0000 7f310182a640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 0x7f30fc11c410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30f000b4e0 tx=0x7f30f0009120 comp rx=0 tx=0).stop 2024-09-13T02:50:15.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.418+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 shutdown_connections 2024-09-13T02:50:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.418+0000 7f310182a640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f30e406e7a0 0x7f30e4070c50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.418+0000 7f310182a640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30fc06e540 0x7f30fc11c410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.418+0000 7f310182a640 1 --2- 172.21.15.100:0/903396195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc06dbf0 0x7f30fc11bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.418+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 >> 172.21.15.100:0/903396195 conn(0x7f30fc069560 msgr2=0x7f30fc106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:15.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.419+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 shutdown_connections 2024-09-13T02:50:15.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.420+0000 7f310182a640 1 -- 172.21.15.100:0/903396195 wait complete. 2024-09-13T02:50:15.540 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:15 smithi122 ceph-mon[34559]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:15.541 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:15 smithi122 ceph-mon[34559]: pgmap v238: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 213 op/s 2024-09-13T02:50:15.541 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:15 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3797238229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:50:15.541 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:15 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3229964186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 -- 172.21.15.100:0/2772634927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fc6f0 msgr2=0x7f91f00fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 --2- 172.21.15.100:0/2772634927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fc6f0 0x7f91f00fcb60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004810 tx=0x7f91e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:15 smithi100 ceph-mon[27894]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:15.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:15 smithi100 ceph-mon[27894]: pgmap v238: 65 pgs: 65 active+clean; 123 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 213 op/s 2024-09-13T02:50:15.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:15 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3797238229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:50:15.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:15 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3229964186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 -- 172.21.15.100:0/2772634927 shutdown_connections 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 --2- 172.21.15.100:0/2772634927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fc6f0 0x7f91f00fcb60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 --2- 172.21.15.100:0/2772634927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fb420 0x7f91f00fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.554+0000 7f91f7341640 1 -- 172.21.15.100:0/2772634927 >> 172.21.15.100:0/2772634927 conn(0x7f91f00f6c00 msgr2=0x7f91f00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.555+0000 7f91f7341640 1 -- 172.21.15.100:0/2772634927 shutdown_connections 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.555+0000 7f91f7341640 1 -- 172.21.15.100:0/2772634927 wait complete. 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.555+0000 7f91f7341640 1 Processor -- start 2024-09-13T02:50:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.555+0000 7f91f7341640 1 -- start start 2024-09-13T02:50:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f7341640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f7341640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fc6f0 0x7f91f01146f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f7341640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f010dc50 con 0x7f91f00fc6f0 2024-09-13T02:50:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f7341640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0066460 con 0x7f91f00fb420 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f48dc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fc6f0 0x7f91f01146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:51336/0 (socket says 172.21.15.100:51336) 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 -- 172.21.15.100:0/3793664991 learned_addr learned my addr 172.21.15.100:0/3793664991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 -- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fc6f0 msgr2=0x7f91f01146f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fc6f0 0x7f91f01146f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.556+0000 7f91f50dd640 1 -- 172.21.15.100:0/3793664991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e4005040 con 0x7f91f00fb420 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.557+0000 7f91f50dd640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91e000eb40 tx=0x7f91e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.557+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e0007c30 con 0x7f91f00fb420 2024-09-13T02:50:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.557+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f00666e0 con 0x7f91f00fb420 2024-09-13T02:50:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.558+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f0114f90 con 0x7f91f00fb420 2024-09-13T02:50:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.558+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f91e000f040 con 0x7f91f00fb420 2024-09-13T02:50:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.558+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e000cb40 con 0x7f91f00fb420 2024-09-13T02:50:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.559+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc005240 con 0x7f91f00fb420 2024-09-13T02:50:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.560+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f91e0009700 con 0x7f91f00fb420 2024-09-13T02:50:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.561+0000 7f91edffb640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 0x7f91d8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.561+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f91e008d520 con 0x7f91f00fb420 2024-09-13T02:50:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.561+0000 7f91f48dc640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 0x7f91d8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.561+0000 7f91f48dc640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 0x7f91d8070b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004480 tx=0x7f91e4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:15.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.568+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f91e005a7c0 con 0x7f91f00fb420 2024-09-13T02:50:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.811+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91dc0054f0 con 0x7f91f00fb420 2024-09-13T02:50:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.812+0000 7f91edffb640 1 -- 172.21.15.100:0/3793664991 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f91e005a160 con 0x7f91f00fb420 2024-09-13T02:50:15.813 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:50:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 msgr2=0x7f91d8070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 0x7f91d8070b80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91e4004480 tx=0x7f91e4035040 comp rx=0 tx=0).stop 2024-09-13T02:50:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 msgr2=0x7f91f01121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f91e000eb40 tx=0x7f91e000b040 comp rx=0 tx=0).stop 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 shutdown_connections 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f91d806e6d0 0x7f91d8070b80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91f00fc6f0 0x7f91f01146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 --2- 172.21.15.100:0/3793664991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91f00fb420 0x7f91f01121a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 >> 172.21.15.100:0/3793664991 conn(0x7f91f00f6c00 msgr2=0x7f91f00f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 shutdown_connections 2024-09-13T02:50:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:15.814+0000 7f91f7341640 1 -- 172.21.15.100:0/3793664991 wait complete. 2024-09-13T02:50:15.834 INFO:tasks.workunit.client.1.smithi122.stdout:0/15: symlink d1/l7 0 2024-09-13T02:50:16.428 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:16 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3793664991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:50:16.474 INFO:tasks.workunit.client.1.smithi122.stdout:7/30: rename d4/l6 to d4/d8/l9 0 2024-09-13T02:50:16.497 INFO:tasks.workunit.client.1.smithi122.stdout:7/31: dwrite d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:16 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3793664991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:50:16.988 INFO:tasks.workunit.client.1.smithi122.stdout:2/21: creat d0/f5 x:0 0 0 2024-09-13T02:50:17.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/6: symlink l2 0 2024-09-13T02:50:17.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/7: stat l1 0 2024-09-13T02:50:17.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/8: creat f3 x:0 0 0 2024-09-13T02:50:17.065 INFO:tasks.workunit.client.1.smithi122.stdout:6/9: dread f0 [0,4194304] 0 2024-09-13T02:50:17.083 INFO:tasks.workunit.client.1.smithi122.stdout:6/10: dwrite f0 [0,4194304] 0 2024-09-13T02:50:17.126 INFO:tasks.workunit.client.1.smithi122.stdout:9/21: creat f6 x:0 0 0 2024-09-13T02:50:17.126 INFO:tasks.workunit.client.1.smithi122.stdout:9/22: chown c5 302 1 2024-09-13T02:50:17.183 INFO:tasks.workunit.client.1.smithi122.stdout:3/19: mkdir d4/d5 0 2024-09-13T02:50:17.191 INFO:tasks.workunit.client.1.smithi122.stdout:4/20: rename c4 to c6 0 2024-09-13T02:50:17.196 INFO:tasks.workunit.client.1.smithi122.stdout:4/21: dread f2 [0,4194304] 0 2024-09-13T02:50:17.198 INFO:tasks.workunit.client.1.smithi122.stdout:0/16: mknod d1/d5/c8 0 2024-09-13T02:50:17.199 INFO:tasks.workunit.client.1.smithi122.stdout:5/31: getdents d0 0 2024-09-13T02:50:17.200 INFO:tasks.workunit.client.1.smithi122.stdout:5/32: readlink - no filename 2024-09-13T02:50:17.200 INFO:tasks.workunit.client.1.smithi122.stdout:5/33: readlink - no filename 2024-09-13T02:50:17.200 INFO:tasks.workunit.client.1.smithi122.stdout:5/34: dwrite - no filename 2024-09-13T02:50:17.200 INFO:tasks.workunit.client.1.smithi122.stdout:5/35: creat d0/d2/f6 x:0 0 0 2024-09-13T02:50:17.200 INFO:tasks.workunit.client.1.smithi122.stdout:2/22: mknod d0/c6 0 2024-09-13T02:50:17.201 INFO:tasks.workunit.client.1.smithi122.stdout:2/23: dread - d0/f5 zero size 2024-09-13T02:50:17.201 INFO:tasks.workunit.client.1.smithi122.stdout:2/24: fdatasync d0/f5 0 2024-09-13T02:50:17.202 INFO:tasks.workunit.client.1.smithi122.stdout:6/11: link f0 f4 0 2024-09-13T02:50:17.203 INFO:tasks.workunit.client.1.smithi122.stdout:9/23: mknod c7 0 2024-09-13T02:50:17.204 INFO:tasks.workunit.client.1.smithi122.stdout:3/20: mkdir d4/d6 0 2024-09-13T02:50:17.204 INFO:tasks.workunit.client.1.smithi122.stdout:3/21: stat d4 0 2024-09-13T02:50:17.207 INFO:tasks.workunit.client.1.smithi122.stdout:0/17: rename d1/d4 to d1/d5/d9 0 2024-09-13T02:50:17.207 INFO:tasks.workunit.client.1.smithi122.stdout:6/12: mkdir d5 0 2024-09-13T02:50:17.209 INFO:tasks.workunit.client.1.smithi122.stdout:0/18: stat d1/d5/d9/c6 0 2024-09-13T02:50:17.210 INFO:tasks.workunit.client.1.smithi122.stdout:5/36: rename d0/d2/f6 to d0/f7 0 2024-09-13T02:50:17.211 INFO:tasks.workunit.client.1.smithi122.stdout:0/19: mkdir d1/d5/d9/da 0 2024-09-13T02:50:17.212 INFO:tasks.workunit.client.1.smithi122.stdout:5/37: creat d0/f8 x:0 0 0 2024-09-13T02:50:17.213 INFO:tasks.workunit.client.1.smithi122.stdout:0/20: unlink d1/d5/c8 0 2024-09-13T02:50:17.214 INFO:tasks.workunit.client.1.smithi122.stdout:5/38: mknod d0/c9 0 2024-09-13T02:50:17.214 INFO:tasks.workunit.client.1.smithi122.stdout:5/39: truncate d0/f7 166562 0 2024-09-13T02:50:17.217 INFO:tasks.workunit.client.1.smithi122.stdout:0/21: creat d1/d5/d9/da/fb x:0 0 0 2024-09-13T02:50:17.217 INFO:tasks.workunit.client.1.smithi122.stdout:0/22: rename d1/d5 to d1/d5/d9/da/dc 22 2024-09-13T02:50:17.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/25: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:17.218 INFO:tasks.workunit.client.1.smithi122.stdout:5/40: mkdir d0/da 0 2024-09-13T02:50:17.218 INFO:tasks.workunit.client.1.smithi122.stdout:6/13: write f0 [3134723,100187] 0 2024-09-13T02:50:17.218 INFO:tasks.workunit.client.1.smithi122.stdout:6/14: truncate f3 826025 0 2024-09-13T02:50:17.219 INFO:tasks.workunit.client.1.smithi122.stdout:0/23: creat d1/d5/fd x:0 0 0 2024-09-13T02:50:17.219 INFO:tasks.workunit.client.1.smithi122.stdout:0/24: truncate d1/d5/fd 973076 0 2024-09-13T02:50:17.222 INFO:tasks.workunit.client.1.smithi122.stdout:6/15: rename f0 to d5/f6 0 2024-09-13T02:50:17.224 INFO:tasks.workunit.client.1.smithi122.stdout:0/25: unlink d1/l3 0 2024-09-13T02:50:17.226 INFO:tasks.workunit.client.1.smithi122.stdout:0/26: mknod d1/ce 0 2024-09-13T02:50:17.231 INFO:tasks.workunit.client.1.smithi122.stdout:9/24: dwrite f6 [0,4194304] 0 2024-09-13T02:50:17.232 INFO:tasks.workunit.client.1.smithi122.stdout:3/22: dwrite f3 [0,4194304] 0 2024-09-13T02:50:17.232 INFO:tasks.workunit.client.1.smithi122.stdout:3/23: readlink - no filename 2024-09-13T02:50:17.240 INFO:tasks.workunit.client.1.smithi122.stdout:9/25: read f3 [2748151,66731] 0 2024-09-13T02:50:17.241 INFO:tasks.workunit.client.1.smithi122.stdout:9/26: mkdir d8 0 2024-09-13T02:50:17.241 INFO:tasks.workunit.client.1.smithi122.stdout:9/27: getdents d8 0 2024-09-13T02:50:17.242 INFO:tasks.workunit.client.1.smithi122.stdout:9/28: creat d8/f9 x:0 0 0 2024-09-13T02:50:17.242 INFO:tasks.workunit.client.1.smithi122.stdout:9/29: symlink d8/la 0 2024-09-13T02:50:17.243 INFO:tasks.workunit.client.1.smithi122.stdout:9/30: mknod d8/cb 0 2024-09-13T02:50:17.243 INFO:tasks.workunit.client.1.smithi122.stdout:9/31: write d8/f9 [548727,27107] 0 2024-09-13T02:50:17.247 INFO:tasks.workunit.client.1.smithi122.stdout:3/24: dwrite f3 [0,4194304] 0 2024-09-13T02:50:17.249 INFO:tasks.workunit.client.1.smithi122.stdout:3/25: creat d4/f7 x:0 0 0 2024-09-13T02:50:17.250 INFO:tasks.workunit.client.1.smithi122.stdout:3/26: rename f2 to d4/d6/f8 0 2024-09-13T02:50:17.258 INFO:tasks.workunit.client.1.smithi122.stdout:9/32: dwrite f1 [0,4194304] 0 2024-09-13T02:50:17.258 INFO:tasks.workunit.client.1.smithi122.stdout:9/33: fdatasync f2 0 2024-09-13T02:50:17.262 INFO:tasks.workunit.client.1.smithi122.stdout:3/27: write f3 [1704748,80869] 0 2024-09-13T02:50:17.262 INFO:tasks.workunit.client.1.smithi122.stdout:3/28: write d4/f7 [781889,1226] 0 2024-09-13T02:50:17.269 INFO:tasks.workunit.client.1.smithi122.stdout:3/29: write d4/d6/f8 [5655090,89442] 0 2024-09-13T02:50:17.275 INFO:tasks.workunit.client.1.smithi122.stdout:9/34: dwrite f4 [0,4194304] 0 2024-09-13T02:50:17.294 INFO:tasks.workunit.client.1.smithi122.stdout:3/30: dwrite d4/d6/f8 [0,4194304] 0 2024-09-13T02:50:17.295 INFO:tasks.workunit.client.1.smithi122.stdout:3/31: unlink d4/f7 0 2024-09-13T02:50:17.298 INFO:tasks.workunit.client.1.smithi122.stdout:3/32: dread d4/d6/f8 [4194304,4194304] 0 2024-09-13T02:50:17.317 INFO:tasks.workunit.client.1.smithi122.stdout:3/33: dwrite f3 [4194304,4194304] 0 2024-09-13T02:50:17.317 INFO:tasks.workunit.client.1.smithi122.stdout:3/34: mkdir d4/d9 0 2024-09-13T02:50:17.407 INFO:tasks.workunit.client.1.smithi122.stdout:4/22: getdents . 0 2024-09-13T02:50:17.412 INFO:tasks.workunit.client.1.smithi122.stdout:4/23: dread f2 [0,4194304] 0 2024-09-13T02:50:17.412 INFO:tasks.workunit.client.1.smithi122.stdout:4/24: write f0 [28767,96915] 0 2024-09-13T02:50:17.413 INFO:tasks.workunit.client.1.smithi122.stdout:5/41: fsync d0/f7 0 2024-09-13T02:50:17.413 INFO:tasks.workunit.client.1.smithi122.stdout:5/42: write d0/f7 [152147,98563] 0 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/25: symlink l7 0 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/26: rmdir - no directory 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/27: write f3 [420600,60112] 0 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/28: read f0 [185098,107589] 0 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/29: write f2 [4357545,55210] 0 2024-09-13T02:50:17.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/30: write f2 [4889989,87221] 0 2024-09-13T02:50:17.415 INFO:tasks.workunit.client.1.smithi122.stdout:4/31: write f3 [827044,89359] 0 2024-09-13T02:50:17.417 INFO:tasks.workunit.client.1.smithi122.stdout:6/16: fsync f4 0 2024-09-13T02:50:17.419 INFO:tasks.workunit.client.1.smithi122.stdout:2/26: truncate d0/f4 2396623 0 2024-09-13T02:50:17.419 INFO:tasks.workunit.client.1.smithi122.stdout:2/27: write d0/f5 [793142,78057] 0 2024-09-13T02:50:17.421 INFO:tasks.workunit.client.1.smithi122.stdout:9/35: getdents d8 0 2024-09-13T02:50:17.421 INFO:tasks.workunit.client.1.smithi122.stdout:9/36: readlink d8/la 0 2024-09-13T02:50:17.422 INFO:tasks.workunit.client.1.smithi122.stdout:3/35: fsync d4/d6/f8 0 2024-09-13T02:50:17.423 INFO:tasks.workunit.client.1.smithi122.stdout:9/37: rename d8/cb to d8/cc 0 2024-09-13T02:50:17.424 INFO:tasks.workunit.client.1.smithi122.stdout:3/36: creat d4/d6/fa x:0 0 0 2024-09-13T02:50:17.427 INFO:tasks.workunit.client.1.smithi122.stdout:9/38: symlink d8/ld 0 2024-09-13T02:50:17.428 INFO:tasks.workunit.client.1.smithi122.stdout:3/37: getdents d4 0 2024-09-13T02:50:17.428 INFO:tasks.workunit.client.1.smithi122.stdout:9/39: rmdir d8 39 2024-09-13T02:50:17.431 INFO:tasks.workunit.client.1.smithi122.stdout:5/43: dwrite d0/f8 [0,4194304] 0 2024-09-13T02:50:17.431 INFO:tasks.workunit.client.1.smithi122.stdout:5/44: creat d0/fb x:0 0 0 2024-09-13T02:50:17.431 INFO:tasks.workunit.client.1.smithi122.stdout:5/45: creat d0/fc x:0 0 0 2024-09-13T02:50:17.431 INFO:tasks.workunit.client.1.smithi122.stdout:5/46: truncate d0/fc 254535 0 2024-09-13T02:50:17.433 INFO:tasks.workunit.client.1.smithi122.stdout:5/47: symlink d0/da/ld 0 2024-09-13T02:50:17.434 INFO:tasks.workunit.client.1.smithi122.stdout:5/48: chown d0/f7 2020 1 2024-09-13T02:50:17.434 INFO:tasks.workunit.client.1.smithi122.stdout:2/28: write d0/f4 [3384965,15422] 0 2024-09-13T02:50:17.435 INFO:tasks.workunit.client.1.smithi122.stdout:5/49: dread d0/fc [0,4194304] 0 2024-09-13T02:50:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:17 smithi122 ceph-mon[34559]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:17 smithi122 ceph-mon[34559]: pgmap v239: 65 pgs: 65 active+clean; 147 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 266 op/s 2024-09-13T02:50:17.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/32: truncate f2 552308 0 2024-09-13T02:50:17.438 INFO:tasks.workunit.client.1.smithi122.stdout:5/50: unlink d0/fb 0 2024-09-13T02:50:17.438 INFO:tasks.workunit.client.1.smithi122.stdout:6/17: dwrite f3 [0,4194304] 0 2024-09-13T02:50:17.439 INFO:tasks.workunit.client.1.smithi122.stdout:2/29: getdents d0 0 2024-09-13T02:50:17.443 INFO:tasks.workunit.client.1.smithi122.stdout:5/51: mknod d0/da/ce 0 2024-09-13T02:50:17.443 INFO:tasks.workunit.client.1.smithi122.stdout:5/52: stat d0/da/ce 0 2024-09-13T02:50:17.443 INFO:tasks.workunit.client.1.smithi122.stdout:5/53: chown d0/da 7583092 1 2024-09-13T02:50:17.443 INFO:tasks.workunit.client.1.smithi122.stdout:5/54: chown d0/da 6 1 2024-09-13T02:50:17.443 INFO:tasks.workunit.client.1.smithi122.stdout:5/55: dread d0/fc [0,4194304] 0 2024-09-13T02:50:17.444 INFO:tasks.workunit.client.1.smithi122.stdout:5/56: dread d0/fc [0,4194304] 0 2024-09-13T02:50:17.445 INFO:tasks.workunit.client.1.smithi122.stdout:6/18: mknod d5/c7 0 2024-09-13T02:50:17.446 INFO:tasks.workunit.client.1.smithi122.stdout:9/40: dwrite f6 [4194304,4194304] 0 2024-09-13T02:50:17.446 INFO:tasks.workunit.client.1.smithi122.stdout:4/33: rename f2 to f8 0 2024-09-13T02:50:17.447 INFO:tasks.workunit.client.1.smithi122.stdout:6/19: creat d5/f8 x:0 0 0 2024-09-13T02:50:17.447 INFO:tasks.workunit.client.1.smithi122.stdout:6/20: fsync f4 0 2024-09-13T02:50:17.447 INFO:tasks.workunit.client.1.smithi122.stdout:6/21: chown l1 432576 1 2024-09-13T02:50:17.448 INFO:tasks.workunit.client.1.smithi122.stdout:6/22: creat d5/f9 x:0 0 0 2024-09-13T02:50:17.449 INFO:tasks.workunit.client.1.smithi122.stdout:4/34: mknod c9 0 2024-09-13T02:50:17.449 INFO:tasks.workunit.client.1.smithi122.stdout:4/35: chown f3 247490 1 2024-09-13T02:50:17.451 INFO:tasks.workunit.client.1.smithi122.stdout:6/23: symlink d5/la 0 2024-09-13T02:50:17.452 INFO:tasks.workunit.client.1.smithi122.stdout:9/41: mknod d8/ce 0 2024-09-13T02:50:17.453 INFO:tasks.workunit.client.1.smithi122.stdout:2/30: dread d0/f4 [0,4194304] 0 2024-09-13T02:50:17.453 INFO:tasks.workunit.client.1.smithi122.stdout:2/31: write d0/f5 [1231551,91587] 0 2024-09-13T02:50:17.454 INFO:tasks.workunit.client.1.smithi122.stdout:4/36: creat fa x:0 0 0 2024-09-13T02:50:17.455 INFO:tasks.workunit.client.1.smithi122.stdout:6/24: mkdir d5/db 0 2024-09-13T02:50:17.457 INFO:tasks.workunit.client.1.smithi122.stdout:5/57: write d0/f8 [2505128,1852] 0 2024-09-13T02:50:17.457 INFO:tasks.workunit.client.1.smithi122.stdout:5/58: creat d0/ff x:0 0 0 2024-09-13T02:50:17.457 INFO:tasks.workunit.client.1.smithi122.stdout:4/37: unlink c6 0 2024-09-13T02:50:17.457 INFO:tasks.workunit.client.1.smithi122.stdout:4/38: dread - fa zero size 2024-09-13T02:50:17.459 INFO:tasks.workunit.client.1.smithi122.stdout:6/25: mkdir d5/db/dc 0 2024-09-13T02:50:17.459 INFO:tasks.workunit.client.1.smithi122.stdout:6/26: chown d5/f9 2 1 2024-09-13T02:50:17.459 INFO:tasks.workunit.client.1.smithi122.stdout:6/27: write d5/f6 [4834374,109201] 0 2024-09-13T02:50:17.462 INFO:tasks.workunit.client.1.smithi122.stdout:5/59: rename d0/c9 to d0/d2/c10 0 2024-09-13T02:50:17.462 INFO:tasks.workunit.client.1.smithi122.stdout:5/60: chown d0/ff 119262555 1 2024-09-13T02:50:17.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/39: mknod cb 0 2024-09-13T02:50:17.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/40: dread - fa zero size 2024-09-13T02:50:17.465 INFO:tasks.workunit.client.1.smithi122.stdout:5/61: unlink d0/fc 0 2024-09-13T02:50:17.467 INFO:tasks.workunit.client.1.smithi122.stdout:2/32: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:17.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/41: rename c9 to cc 0 2024-09-13T02:50:17.469 INFO:tasks.workunit.client.1.smithi122.stdout:5/62: mknod d0/c11 0 2024-09-13T02:50:17.469 INFO:tasks.workunit.client.1.smithi122.stdout:5/63: write d0/f8 [5020747,67754] 0 2024-09-13T02:50:17.469 INFO:tasks.workunit.client.1.smithi122.stdout:4/42: dread f8 [0,4194304] 0 2024-09-13T02:50:17.469 INFO:tasks.workunit.client.1.smithi122.stdout:9/42: truncate f6 6592081 0 2024-09-13T02:50:17.483 INFO:tasks.workunit.client.1.smithi122.stdout:9/43: write f4 [4133180,56097] 0 2024-09-13T02:50:17.483 INFO:tasks.workunit.client.1.smithi122.stdout:9/44: chown f6 1323575 1 2024-09-13T02:50:17.485 INFO:tasks.workunit.client.1.smithi122.stdout:9/45: creat d8/ff x:0 0 0 2024-09-13T02:50:17.486 INFO:tasks.workunit.client.1.smithi122.stdout:9/46: creat d8/f10 x:0 0 0 2024-09-13T02:50:17.489 INFO:tasks.workunit.client.1.smithi122.stdout:9/47: unlink f3 0 2024-09-13T02:50:17.489 INFO:tasks.workunit.client.1.smithi122.stdout:9/48: dread - f2 zero size 2024-09-13T02:50:17.489 INFO:tasks.workunit.client.1.smithi122.stdout:9/49: chown d8/f9 21 1 2024-09-13T02:50:17.495 INFO:tasks.workunit.client.1.smithi122.stdout:6/28: dwrite f4 [4194304,4194304] 0 2024-09-13T02:50:17.496 INFO:tasks.workunit.client.1.smithi122.stdout:6/29: write d5/f9 [58701,58035] 0 2024-09-13T02:50:17.497 INFO:tasks.workunit.client.1.smithi122.stdout:6/30: mkdir d5/dd 0 2024-09-13T02:50:17.497 INFO:tasks.workunit.client.1.smithi122.stdout:6/31: getdents d5/dd 0 2024-09-13T02:50:17.503 INFO:tasks.workunit.client.1.smithi122.stdout:5/64: dwrite d0/ff [0,4194304] 0 2024-09-13T02:50:17.505 INFO:tasks.workunit.client.1.smithi122.stdout:5/65: getdents d0/d2 0 2024-09-13T02:50:17.505 INFO:tasks.workunit.client.1.smithi122.stdout:5/66: read d0/f8 [915189,70295] 0 2024-09-13T02:50:17.515 INFO:tasks.workunit.client.1.smithi122.stdout:2/33: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:17.516 INFO:tasks.workunit.client.1.smithi122.stdout:2/34: mknod d0/c7 0 2024-09-13T02:50:17.517 INFO:tasks.workunit.client.1.smithi122.stdout:4/43: dwrite f8 [0,4194304] 0 2024-09-13T02:50:17.517 INFO:tasks.workunit.client.1.smithi122.stdout:4/44: rmdir - no directory 2024-09-13T02:50:17.519 INFO:tasks.workunit.client.1.smithi122.stdout:6/32: dwrite d5/f8 [0,4194304] 0 2024-09-13T02:50:17.519 INFO:tasks.workunit.client.1.smithi122.stdout:9/50: dwrite f2 [0,4194304] 0 2024-09-13T02:50:17.519 INFO:tasks.workunit.client.1.smithi122.stdout:9/51: stat f2 0 2024-09-13T02:50:17.519 INFO:tasks.workunit.client.1.smithi122.stdout:9/52: chown d8 48823 1 2024-09-13T02:50:17.519 INFO:tasks.workunit.client.1.smithi122.stdout:6/33: write d5/f9 [1037943,39481] 0 2024-09-13T02:50:17.520 INFO:tasks.workunit.client.1.smithi122.stdout:6/34: readlink l1 0 2024-09-13T02:50:17.520 INFO:tasks.workunit.client.1.smithi122.stdout:2/35: fdatasync d0/f5 0 2024-09-13T02:50:17.526 INFO:tasks.workunit.client.1.smithi122.stdout:6/35: rename d5/f6 to d5/fe 0 2024-09-13T02:50:17.531 INFO:tasks.workunit.client.1.smithi122.stdout:9/53: write f6 [2210455,89167] 0 2024-09-13T02:50:17.531 INFO:tasks.workunit.client.1.smithi122.stdout:9/54: chown d8 309221571 1 2024-09-13T02:50:17.531 INFO:tasks.workunit.client.1.smithi122.stdout:9/55: chown d8/f9 147551 1 2024-09-13T02:50:17.534 INFO:tasks.workunit.client.1.smithi122.stdout:5/67: dread d0/f8 [0,4194304] 0 2024-09-13T02:50:17.535 INFO:tasks.workunit.client.1.smithi122.stdout:5/68: creat d0/d2/f12 x:0 0 0 2024-09-13T02:50:17.537 INFO:tasks.workunit.client.1.smithi122.stdout:5/69: unlink d0/c11 0 2024-09-13T02:50:17.539 INFO:tasks.workunit.client.1.smithi122.stdout:5/70: link d0/f7 d0/d2/f13 0 2024-09-13T02:50:17.539 INFO:tasks.workunit.client.1.smithi122.stdout:5/71: stat d0/f8 0 2024-09-13T02:50:17.540 INFO:tasks.workunit.client.1.smithi122.stdout:5/72: mknod d0/da/c14 0 2024-09-13T02:50:17.542 INFO:tasks.workunit.client.1.smithi122.stdout:5/73: rename d0/d2/c10 to d0/da/c15 0 2024-09-13T02:50:17.544 INFO:tasks.workunit.client.1.smithi122.stdout:5/74: rename d0/f8 to d0/da/f16 0 2024-09-13T02:50:17.551 INFO:tasks.workunit.client.1.smithi122.stdout:4/45: dwrite f8 [0,4194304] 0 2024-09-13T02:50:17.553 INFO:tasks.workunit.client.1.smithi122.stdout:4/46: getdents . 0 2024-09-13T02:50:17.553 INFO:tasks.workunit.client.1.smithi122.stdout:4/47: write fa [292052,24440] 0 2024-09-13T02:50:17.553 INFO:tasks.workunit.client.1.smithi122.stdout:4/48: creat fd x:0 0 0 2024-09-13T02:50:17.554 INFO:tasks.workunit.client.1.smithi122.stdout:4/49: symlink le 0 2024-09-13T02:50:17.557 INFO:tasks.workunit.client.1.smithi122.stdout:2/36: dwrite d0/f5 [0,4194304] 0 2024-09-13T02:50:17.557 INFO:tasks.workunit.client.1.smithi122.stdout:2/37: fdatasync d0/f5 0 2024-09-13T02:50:17.557 INFO:tasks.workunit.client.1.smithi122.stdout:2/38: rmdir d0 39 2024-09-13T02:50:17.558 INFO:tasks.workunit.client.1.smithi122.stdout:2/39: mknod d0/c8 0 2024-09-13T02:50:17.559 INFO:tasks.workunit.client.1.smithi122.stdout:2/40: link d0/c8 d0/c9 0 2024-09-13T02:50:17.559 INFO:tasks.workunit.client.1.smithi122.stdout:6/36: dwrite f3 [0,4194304] 0 2024-09-13T02:50:17.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/41: link d0/c6 d0/ca 0 2024-09-13T02:50:17.561 INFO:tasks.workunit.client.1.smithi122.stdout:9/56: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:50:17.561 INFO:tasks.workunit.client.1.smithi122.stdout:9/57: write f6 [850508,104915] 0 2024-09-13T02:50:17.561 INFO:tasks.workunit.client.1.smithi122.stdout:4/50: dread f3 [0,4194304] 0 2024-09-13T02:50:17.562 INFO:tasks.workunit.client.1.smithi122.stdout:2/42: mknod d0/cb 0 2024-09-13T02:50:17.562 INFO:tasks.workunit.client.1.smithi122.stdout:6/37: mkdir d5/dd/df 0 2024-09-13T02:50:17.565 INFO:tasks.workunit.client.1.smithi122.stdout:4/51: mknod cf 0 2024-09-13T02:50:17.565 INFO:tasks.workunit.client.1.smithi122.stdout:4/52: write f0 [737522,63147] 0 2024-09-13T02:50:17.565 INFO:tasks.workunit.client.1.smithi122.stdout:4/53: chown l7 3846569 1 2024-09-13T02:50:17.565 INFO:tasks.workunit.client.1.smithi122.stdout:4/54: fdatasync fd 0 2024-09-13T02:50:17.565 INFO:tasks.workunit.client.1.smithi122.stdout:4/55: creat f10 x:0 0 0 2024-09-13T02:50:17.570 INFO:tasks.workunit.client.1.smithi122.stdout:4/56: mkdir d11 0 2024-09-13T02:50:17.570 INFO:tasks.workunit.client.1.smithi122.stdout:4/57: read - fd zero size 2024-09-13T02:50:17.573 INFO:tasks.workunit.client.1.smithi122.stdout:5/75: truncate d0/da/f16 112750 0 2024-09-13T02:50:17.574 INFO:tasks.workunit.client.1.smithi122.stdout:5/76: mkdir d0/d17 0 2024-09-13T02:50:17.574 INFO:tasks.workunit.client.1.smithi122.stdout:5/77: dread - d0/d2/f12 zero size 2024-09-13T02:50:17.576 INFO:tasks.workunit.client.1.smithi122.stdout:4/58: dread fa [0,4194304] 0 2024-09-13T02:50:17.576 INFO:tasks.workunit.client.1.smithi122.stdout:4/59: stat le 0 2024-09-13T02:50:17.576 INFO:tasks.workunit.client.1.smithi122.stdout:4/60: truncate f10 412760 0 2024-09-13T02:50:17.577 INFO:tasks.workunit.client.1.smithi122.stdout:5/78: creat d0/d17/f18 x:0 0 0 2024-09-13T02:50:17.577 INFO:tasks.workunit.client.1.smithi122.stdout:9/58: write d8/f10 [1896882,104817] 0 2024-09-13T02:50:17.577 INFO:tasks.workunit.client.1.smithi122.stdout:4/61: mknod d11/c12 0 2024-09-13T02:50:17.577 INFO:tasks.workunit.client.1.smithi122.stdout:4/62: chown d11/c12 12965 1 2024-09-13T02:50:17.577 INFO:tasks.workunit.client.1.smithi122.stdout:4/63: chown cc 2361 1 2024-09-13T02:50:17.578 INFO:tasks.workunit.client.1.smithi122.stdout:5/79: rename d0/ff to d0/da/f19 0 2024-09-13T02:50:17.578 INFO:tasks.workunit.client.1.smithi122.stdout:4/64: dread fa [0,4194304] 0 2024-09-13T02:50:17.578 INFO:tasks.workunit.client.1.smithi122.stdout:4/65: fdatasync fd 0 2024-09-13T02:50:17.579 INFO:tasks.workunit.client.1.smithi122.stdout:9/59: readlink d8/la 0 2024-09-13T02:50:17.579 INFO:tasks.workunit.client.1.smithi122.stdout:9/60: truncate d8/f9 1375410 0 2024-09-13T02:50:17.579 INFO:tasks.workunit.client.1.smithi122.stdout:9/61: chown d8/la 168939808 1 2024-09-13T02:50:17.580 INFO:tasks.workunit.client.1.smithi122.stdout:5/80: unlink d0/d2/f12 0 2024-09-13T02:50:17.580 INFO:tasks.workunit.client.1.smithi122.stdout:5/81: fsync d0/d2/f13 0 2024-09-13T02:50:17.580 INFO:tasks.workunit.client.1.smithi122.stdout:5/82: creat d0/f1a x:0 0 0 2024-09-13T02:50:17.580 INFO:tasks.workunit.client.1.smithi122.stdout:5/83: write d0/d2/f13 [793437,112207] 0 2024-09-13T02:50:17.580 INFO:tasks.workunit.client.1.smithi122.stdout:5/84: stat d0/da 0 2024-09-13T02:50:17.581 INFO:tasks.workunit.client.1.smithi122.stdout:4/66: mkdir d11/d13 0 2024-09-13T02:50:17.581 INFO:tasks.workunit.client.1.smithi122.stdout:4/67: write fa [471080,71581] 0 2024-09-13T02:50:17.583 INFO:tasks.workunit.client.1.smithi122.stdout:4/68: mkdir d11/d13/d14 0 2024-09-13T02:50:17.584 INFO:tasks.workunit.client.1.smithi122.stdout:2/43: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:17.584 INFO:tasks.workunit.client.1.smithi122.stdout:2/44: fdatasync d0/f5 0 2024-09-13T02:50:17.584 INFO:tasks.workunit.client.1.smithi122.stdout:9/62: symlink d8/l11 0 2024-09-13T02:50:17.585 INFO:tasks.workunit.client.1.smithi122.stdout:4/69: mknod d11/d13/d14/c15 0 2024-09-13T02:50:17.585 INFO:tasks.workunit.client.1.smithi122.stdout:2/45: creat d0/fc x:0 0 0 2024-09-13T02:50:17.586 INFO:tasks.workunit.client.1.smithi122.stdout:6/38: dwrite d5/fe [8388608,4194304] 0 2024-09-13T02:50:17.586 INFO:tasks.workunit.client.1.smithi122.stdout:6/39: readlink l2 0 2024-09-13T02:50:17.587 INFO:tasks.workunit.client.1.smithi122.stdout:9/63: unlink c5 0 2024-09-13T02:50:17.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/64: fsync f4 0 2024-09-13T02:50:17.589 INFO:tasks.workunit.client.1.smithi122.stdout:4/70: unlink f8 0 2024-09-13T02:50:17.590 INFO:tasks.workunit.client.1.smithi122.stdout:6/40: mknod d5/dd/df/c10 0 2024-09-13T02:50:17.590 INFO:tasks.workunit.client.1.smithi122.stdout:6/41: stat d5/la 0 2024-09-13T02:50:17.591 INFO:tasks.workunit.client.1.smithi122.stdout:5/85: dread d0/da/f19 [0,4194304] 0 2024-09-13T02:50:17.592 INFO:tasks.workunit.client.1.smithi122.stdout:5/86: write d0/d2/f13 [1656313,56038] 0 2024-09-13T02:50:17.592 INFO:tasks.workunit.client.1.smithi122.stdout:5/87: creat d0/d2/f1b x:0 0 0 2024-09-13T02:50:17.592 INFO:tasks.workunit.client.1.smithi122.stdout:4/71: creat d11/d13/d14/f16 x:0 0 0 2024-09-13T02:50:17.593 INFO:tasks.workunit.client.1.smithi122.stdout:6/42: mkdir d5/d11 0 2024-09-13T02:50:17.593 INFO:tasks.workunit.client.1.smithi122.stdout:6/43: read d5/fe [741141,68646] 0 2024-09-13T02:50:17.594 INFO:tasks.workunit.client.1.smithi122.stdout:5/88: mkdir d0/d1c 0 2024-09-13T02:50:17.594 INFO:tasks.workunit.client.1.smithi122.stdout:5/89: chown d0/da/f19 306 1 2024-09-13T02:50:17.595 INFO:tasks.workunit.client.1.smithi122.stdout:6/44: mknod d5/c12 0 2024-09-13T02:50:17.596 INFO:tasks.workunit.client.1.smithi122.stdout:6/45: creat d5/dd/df/f13 x:0 0 0 2024-09-13T02:50:17.596 INFO:tasks.workunit.client.1.smithi122.stdout:6/46: chown l1 1431870 1 2024-09-13T02:50:17.596 INFO:tasks.workunit.client.1.smithi122.stdout:6/47: getdents d5/dd 0 2024-09-13T02:50:17.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/48: write d5/dd/df/f13 [753730,47901] 0 2024-09-13T02:50:17.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/49: write d5/f9 [1377650,85041] 0 2024-09-13T02:50:17.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/50: fdatasync f3 0 2024-09-13T02:50:17.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/51: creat d5/db/f14 x:0 0 0 2024-09-13T02:50:17.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/52: link l1 d5/db/l15 0 2024-09-13T02:50:17.599 INFO:tasks.workunit.client.1.smithi122.stdout:6/53: readlink l1 0 2024-09-13T02:50:17.599 INFO:tasks.workunit.client.1.smithi122.stdout:6/54: symlink d5/db/l16 0 2024-09-13T02:50:17.599 INFO:tasks.workunit.client.1.smithi122.stdout:6/55: write d5/db/f14 [248952,96112] 0 2024-09-13T02:50:17.605 INFO:tasks.workunit.client.1.smithi122.stdout:6/56: dread d5/fe [0,4194304] 0 2024-09-13T02:50:17.606 INFO:tasks.workunit.client.1.smithi122.stdout:6/57: unlink d5/c12 0 2024-09-13T02:50:17.668 INFO:tasks.workunit.client.1.smithi122.stdout:9/65: rmdir d8 39 2024-09-13T02:50:17.672 INFO:tasks.workunit.client.1.smithi122.stdout:4/72: rmdir d11/d13/d14 39 2024-09-13T02:50:17.674 INFO:tasks.workunit.client.1.smithi122.stdout:4/73: rename d11/d13/d14/c15 to d11/c17 0 2024-09-13T02:50:17.674 INFO:tasks.workunit.client.1.smithi122.stdout:4/74: stat fa 0 2024-09-13T02:50:17.674 INFO:tasks.workunit.client.1.smithi122.stdout:4/75: mknod d11/d13/c18 0 2024-09-13T02:50:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:17 smithi100 ceph-mon[27894]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:17 smithi100 ceph-mon[27894]: pgmap v239: 65 pgs: 65 active+clean; 147 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 266 op/s 2024-09-13T02:50:17.676 INFO:tasks.workunit.client.1.smithi122.stdout:4/76: unlink c5 0 2024-09-13T02:50:17.679 INFO:tasks.workunit.client.1.smithi122.stdout:6/58: truncate f3 2469761 0 2024-09-13T02:50:17.679 INFO:tasks.workunit.client.1.smithi122.stdout:4/77: dread fa [0,4194304] 0 2024-09-13T02:50:17.682 INFO:tasks.workunit.client.1.smithi122.stdout:9/66: dwrite f6 [0,4194304] 0 2024-09-13T02:50:17.684 INFO:tasks.workunit.client.1.smithi122.stdout:9/67: link d8/la d8/l12 0 2024-09-13T02:50:17.687 INFO:tasks.workunit.client.1.smithi122.stdout:9/68: mknod d8/c13 0 2024-09-13T02:50:17.687 INFO:tasks.workunit.client.1.smithi122.stdout:6/59: dread d5/f9 [0,4194304] 0 2024-09-13T02:50:17.687 INFO:tasks.workunit.client.1.smithi122.stdout:6/60: fsync d5/f8 0 2024-09-13T02:50:17.687 INFO:tasks.workunit.client.1.smithi122.stdout:6/61: creat d5/db/f17 x:0 0 0 2024-09-13T02:50:17.687 INFO:tasks.workunit.client.1.smithi122.stdout:9/69: rmdir d8 39 2024-09-13T02:50:17.688 INFO:tasks.workunit.client.1.smithi122.stdout:6/62: symlink d5/dd/l18 0 2024-09-13T02:50:17.689 INFO:tasks.workunit.client.1.smithi122.stdout:9/70: rmdir d8 39 2024-09-13T02:50:17.696 INFO:tasks.workunit.client.1.smithi122.stdout:6/63: dread f4 [8388608,4194304] 0 2024-09-13T02:50:17.696 INFO:tasks.workunit.client.1.smithi122.stdout:6/64: truncate d5/dd/df/f13 1166246 0 2024-09-13T02:50:17.697 INFO:tasks.workunit.client.1.smithi122.stdout:6/65: chown d5/db/f14 957788216 1 2024-09-13T02:50:17.700 INFO:tasks.workunit.client.1.smithi122.stdout:9/71: dread f2 [0,4194304] 0 2024-09-13T02:50:17.701 INFO:tasks.workunit.client.1.smithi122.stdout:6/66: write d5/f9 [909553,99592] 0 2024-09-13T02:50:17.701 INFO:tasks.workunit.client.1.smithi122.stdout:9/72: creat d8/f14 x:0 0 0 2024-09-13T02:50:17.701 INFO:tasks.workunit.client.1.smithi122.stdout:9/73: chown d8/cc 7 1 2024-09-13T02:50:17.701 INFO:tasks.workunit.client.1.smithi122.stdout:6/67: mknod d5/db/dc/c19 0 2024-09-13T02:50:17.703 INFO:tasks.workunit.client.1.smithi122.stdout:9/74: symlink d8/l15 0 2024-09-13T02:50:17.703 INFO:tasks.workunit.client.1.smithi122.stdout:9/75: write d8/f14 [326391,68761] 0 2024-09-13T02:50:17.703 INFO:tasks.workunit.client.1.smithi122.stdout:9/76: chown d8/f10 158 1 2024-09-13T02:50:17.708 INFO:tasks.workunit.client.1.smithi122.stdout:6/68: write f3 [475404,68174] 0 2024-09-13T02:50:17.711 INFO:tasks.workunit.client.1.smithi122.stdout:9/77: dread f1 [0,4194304] 0 2024-09-13T02:50:17.716 INFO:tasks.workunit.client.1.smithi122.stdout:9/78: write f1 [1565628,108350] 0 2024-09-13T02:50:17.717 INFO:tasks.workunit.client.1.smithi122.stdout:9/79: mkdir d8/d16 0 2024-09-13T02:50:17.717 INFO:tasks.workunit.client.1.smithi122.stdout:9/80: dread - d8/ff zero size 2024-09-13T02:50:17.718 INFO:tasks.workunit.client.1.smithi122.stdout:9/81: link d8/la d8/l17 0 2024-09-13T02:50:17.721 INFO:tasks.workunit.client.1.smithi122.stdout:6/69: dwrite d5/f8 [0,4194304] 0 2024-09-13T02:50:17.721 INFO:tasks.workunit.client.1.smithi122.stdout:6/70: chown d5/db/l15 499171541 1 2024-09-13T02:50:17.722 INFO:tasks.workunit.client.1.smithi122.stdout:9/82: fsync f1 0 2024-09-13T02:50:17.722 INFO:tasks.workunit.client.1.smithi122.stdout:9/83: write f2 [5218793,4081] 0 2024-09-13T02:50:17.722 INFO:tasks.workunit.client.1.smithi122.stdout:6/71: unlink l1 0 2024-09-13T02:50:17.723 INFO:tasks.workunit.client.1.smithi122.stdout:6/72: mkdir d5/dd/df/d1a 0 2024-09-13T02:50:17.724 INFO:tasks.workunit.client.1.smithi122.stdout:6/73: creat d5/db/f1b x:0 0 0 2024-09-13T02:50:17.724 INFO:tasks.workunit.client.1.smithi122.stdout:6/74: getdents d5/dd/df/d1a 0 2024-09-13T02:50:17.724 INFO:tasks.workunit.client.1.smithi122.stdout:9/84: symlink d8/l18 0 2024-09-13T02:50:17.725 INFO:tasks.workunit.client.1.smithi122.stdout:6/75: mkdir d5/db/dc/d1c 0 2024-09-13T02:50:17.726 INFO:tasks.workunit.client.1.smithi122.stdout:9/85: mkdir d8/d16/d19 0 2024-09-13T02:50:17.727 INFO:tasks.workunit.client.1.smithi122.stdout:9/86: creat d8/f1a x:0 0 0 2024-09-13T02:50:17.742 INFO:tasks.workunit.client.1.smithi122.stdout:6/76: dwrite d5/db/f17 [0,4194304] 0 2024-09-13T02:50:17.744 INFO:tasks.workunit.client.1.smithi122.stdout:6/77: creat d5/db/dc/d1c/f1d x:0 0 0 2024-09-13T02:50:17.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/78: truncate f4 9104217 0 2024-09-13T02:50:17.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/79: fdatasync d5/f8 0 2024-09-13T02:50:17.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/80: read d5/f9 [481200,45796] 0 2024-09-13T02:50:17.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/81: getdents d5/d11 0 2024-09-13T02:50:17.749 INFO:tasks.workunit.client.1.smithi122.stdout:9/87: dwrite f4 [0,4194304] 0 2024-09-13T02:50:17.749 INFO:tasks.workunit.client.1.smithi122.stdout:6/82: fsync d5/f9 0 2024-09-13T02:50:17.750 INFO:tasks.workunit.client.1.smithi122.stdout:9/88: creat d8/d16/f1b x:0 0 0 2024-09-13T02:50:17.750 INFO:tasks.workunit.client.1.smithi122.stdout:9/89: write f1 [2061847,22288] 0 2024-09-13T02:50:17.753 INFO:tasks.workunit.client.1.smithi122.stdout:9/90: unlink d8/ld 0 2024-09-13T02:50:17.753 INFO:tasks.workunit.client.1.smithi122.stdout:6/83: getdents d5/dd/df 0 2024-09-13T02:50:17.754 INFO:tasks.workunit.client.1.smithi122.stdout:9/91: mknod d8/d16/c1c 0 2024-09-13T02:50:17.755 INFO:tasks.workunit.client.1.smithi122.stdout:6/84: symlink d5/d11/l1e 0 2024-09-13T02:50:17.755 INFO:tasks.workunit.client.1.smithi122.stdout:6/85: write f4 [310900,55929] 0 2024-09-13T02:50:17.756 INFO:tasks.workunit.client.1.smithi122.stdout:6/86: creat d5/d11/f1f x:0 0 0 2024-09-13T02:50:17.761 INFO:tasks.workunit.client.1.smithi122.stdout:6/87: truncate f4 5857009 0 2024-09-13T02:50:17.762 INFO:tasks.workunit.client.1.smithi122.stdout:6/88: write d5/db/f1b [547248,8597] 0 2024-09-13T02:50:17.763 INFO:tasks.workunit.client.1.smithi122.stdout:6/89: creat d5/dd/df/f20 x:0 0 0 2024-09-13T02:50:17.764 INFO:tasks.workunit.client.1.smithi122.stdout:6/90: write d5/dd/df/f20 [845621,83402] 0 2024-09-13T02:50:17.772 INFO:tasks.workunit.client.1.smithi122.stdout:9/92: dwrite d8/f9 [0,4194304] 0 2024-09-13T02:50:17.774 INFO:tasks.workunit.client.1.smithi122.stdout:9/93: mkdir d8/d16/d1d 0 2024-09-13T02:50:17.779 INFO:tasks.workunit.client.1.smithi122.stdout:6/91: dwrite d5/d11/f1f [0,4194304] 0 2024-09-13T02:50:17.794 INFO:tasks.workunit.client.1.smithi122.stdout:9/94: dwrite f2 [0,4194304] 0 2024-09-13T02:50:17.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/95: dwrite d8/d16/f1b [0,4194304] 0 2024-09-13T02:50:17.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/96: fdatasync d8/f1a 0 2024-09-13T02:50:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:19 smithi100 ceph-mon[27894]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 689 KiB/s rd, 8.7 MiB/s wr, 397 op/s 2024-09-13T02:50:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:19 smithi122 ceph-mon[34559]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 689 KiB/s rd, 8.7 MiB/s wr, 397 op/s 2024-09-13T02:50:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:21 smithi100 ceph-mon[27894]: pgmap v241: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.1 MiB/s rd, 24 MiB/s wr, 995 op/s 2024-09-13T02:50:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:21 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:21 smithi122 ceph-mon[34559]: pgmap v241: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.1 MiB/s rd, 24 MiB/s wr, 995 op/s 2024-09-13T02:50:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:21 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:21 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:22 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:22 smithi100 ceph-mon[27894]: pgmap v242: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 24 MiB/s wr, 945 op/s 2024-09-13T02:50:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:22 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:22.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:22 smithi122 ceph-mon[34559]: pgmap v242: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 24 MiB/s wr, 945 op/s 2024-09-13T02:50:23.616 INFO:tasks.workunit.client.0.smithi100.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:50:23.622 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:50:23.623 INFO:tasks.workunit.client.0.smithi100.stderr:+ make 2024-09-13T02:50:23.709 INFO:tasks.workunit.client.0.smithi100.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:50:23.953 INFO:tasks.workunit.client.0.smithi100.stderr:++ readlink -f fsstress 2024-09-13T02:50:23.954 INFO:tasks.workunit.client.0.smithi100.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:50:23.954 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2024-09-13T02:50:23.955 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:50:23.955 INFO:tasks.workunit.client.0.smithi100.stderr:+ popd 2024-09-13T02:50:23.955 INFO:tasks.workunit.client.0.smithi100.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:50:23.956 INFO:tasks.workunit.client.0.smithi100.stderr:++ mktemp -d -p . 2024-09-13T02:50:23.957 INFO:tasks.workunit.client.0.smithi100.stderr:+ T=./tmp.W5horMtAlU 2024-09-13T02:50:23.957 INFO:tasks.workunit.client.0.smithi100.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.W5horMtAlU -l 1 -n 1000 -p 10 -v 2024-09-13T02:50:23.958 INFO:tasks.workunit.client.0.smithi100.stdout:seed = 1726822322 2024-09-13T02:50:23.984 INFO:tasks.workunit.client.0.smithi100.stdout:0/0: rmdir - no directory 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:0/1: write - no filename 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/0: chown . 0 1 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:1/1: rename - no filename 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:0/2: mknod c0 0 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:0/3: fdatasync - no filename 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:0/4: write - no filename 2024-09-13T02:50:23.985 INFO:tasks.workunit.client.0.smithi100.stdout:0/5: dwrite - no filename 2024-09-13T02:50:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:1/2: mknod c0 0 2024-09-13T02:50:24.035 INFO:tasks.workunit.client.0.smithi100.stdout:0/6: creat f1 x:0 0 0 2024-09-13T02:50:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:2/0: mkdir d0 0 2024-09-13T02:50:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:2/1: write - no filename 2024-09-13T02:50:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:2/2: dread - no filename 2024-09-13T02:50:24.036 INFO:tasks.workunit.client.0.smithi100.stdout:2/3: unlink - no file 2024-09-13T02:50:24.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/3: creat f1 x:0 0 0 2024-09-13T02:50:24.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/4: write f1 [335060,40028] 0 2024-09-13T02:50:24.037 INFO:tasks.workunit.client.0.smithi100.stdout:0/7: mkdir d2 0 2024-09-13T02:50:24.037 INFO:tasks.workunit.client.0.smithi100.stdout:0/8: write f1 [502609,12215] 0 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/0: rename - no filename 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/1: chown . 1011749 1 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/2: rename - no filename 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/3: read - no filename 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/4: truncate - no filename 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/5: write - no filename 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/0: symlink l0 0 2024-09-13T02:50:24.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/1: write - no filename 2024-09-13T02:50:24.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/2: stat l0 0 2024-09-13T02:50:24.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/3: dwrite - no filename 2024-09-13T02:50:24.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/4: dwrite - no filename 2024-09-13T02:50:24.039 INFO:tasks.workunit.client.0.smithi100.stdout:2/4: creat d0/f1 x:0 0 0 2024-09-13T02:50:24.040 INFO:tasks.workunit.client.0.smithi100.stdout:1/5: symlink l2 0 2024-09-13T02:50:24.040 INFO:tasks.workunit.client.0.smithi100.stdout:1/6: write f1 [227927,56173] 0 2024-09-13T02:50:24.040 INFO:tasks.workunit.client.0.smithi100.stdout:0/9: rename f1 to d2/f3 0 2024-09-13T02:50:24.040 INFO:tasks.workunit.client.0.smithi100.stdout:5/0: truncate - no filename 2024-09-13T02:50:24.041 INFO:tasks.workunit.client.0.smithi100.stdout:4/6: creat f0 x:0 0 0 2024-09-13T02:50:24.041 INFO:tasks.workunit.client.0.smithi100.stdout:4/7: write f0 [446330,28911] 0 2024-09-13T02:50:24.041 INFO:tasks.workunit.client.0.smithi100.stdout:3/5: creat f1 x:0 0 0 2024-09-13T02:50:24.042 INFO:tasks.workunit.client.0.smithi100.stdout:1/7: link l2 l3 0 2024-09-13T02:50:24.043 INFO:tasks.workunit.client.0.smithi100.stdout:0/10: symlink d2/l4 0 2024-09-13T02:50:24.044 INFO:tasks.workunit.client.0.smithi100.stdout:6/0: link - no file 2024-09-13T02:50:24.044 INFO:tasks.workunit.client.0.smithi100.stdout:6/1: chown . 12 1 2024-09-13T02:50:24.044 INFO:tasks.workunit.client.0.smithi100.stdout:6/2: fsync - no filename 2024-09-13T02:50:24.044 INFO:tasks.workunit.client.0.smithi100.stdout:6/3: readlink - no filename 2024-09-13T02:50:24.046 INFO:tasks.workunit.client.0.smithi100.stdout:5/1: creat f0 x:0 0 0 2024-09-13T02:50:24.046 INFO:tasks.workunit.client.0.smithi100.stdout:5/2: chown f0 745 1 2024-09-13T02:50:24.047 INFO:tasks.workunit.client.0.smithi100.stdout:3/6: rename f1 to f2 0 2024-09-13T02:50:24.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/7: creat f3 x:0 0 0 2024-09-13T02:50:24.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/8: creat f4 x:0 0 0 2024-09-13T02:50:24.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/9: creat f5 x:0 0 0 2024-09-13T02:50:24.052 INFO:tasks.workunit.client.0.smithi100.stdout:6/4: creat f0 x:0 0 0 2024-09-13T02:50:24.052 INFO:tasks.workunit.client.0.smithi100.stdout:6/5: write f0 [996143,35386] 0 2024-09-13T02:50:24.053 INFO:tasks.workunit.client.0.smithi100.stdout:5/3: mknod c1 0 2024-09-13T02:50:24.053 INFO:tasks.workunit.client.0.smithi100.stdout:5/4: readlink - no filename 2024-09-13T02:50:24.053 INFO:tasks.workunit.client.0.smithi100.stdout:5/5: creat f2 x:0 0 0 2024-09-13T02:50:24.059 INFO:tasks.workunit.client.0.smithi100.stdout:8/0: rmdir - no directory 2024-09-13T02:50:24.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/1: truncate - no filename 2024-09-13T02:50:24.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/2: stat - no entries 2024-09-13T02:50:24.060 INFO:tasks.workunit.client.0.smithi100.stdout:7/0: creat f0 x:0 0 0 2024-09-13T02:50:24.060 INFO:tasks.workunit.client.0.smithi100.stdout:7/1: chown f0 31 1 2024-09-13T02:50:24.061 INFO:tasks.workunit.client.0.smithi100.stdout:6/6: symlink l1 0 2024-09-13T02:50:24.061 INFO:tasks.workunit.client.0.smithi100.stdout:6/7: creat f2 x:0 0 0 2024-09-13T02:50:24.061 INFO:tasks.workunit.client.0.smithi100.stdout:6/8: chown l1 8123 1 2024-09-13T02:50:24.063 INFO:tasks.workunit.client.0.smithi100.stdout:5/6: symlink l3 0 2024-09-13T02:50:24.063 INFO:tasks.workunit.client.0.smithi100.stdout:2/5: fsync d0/f1 0 2024-09-13T02:50:24.065 INFO:tasks.workunit.client.0.smithi100.stdout:8/3: mknod c0 0 2024-09-13T02:50:24.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/4: readlink - no filename 2024-09-13T02:50:24.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/5: dread - no filename 2024-09-13T02:50:24.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/6: rmdir - no directory 2024-09-13T02:50:24.066 INFO:tasks.workunit.client.0.smithi100.stdout:8/7: chown c0 33346 1 2024-09-13T02:50:24.067 INFO:tasks.workunit.client.0.smithi100.stdout:0/11: link d2/f3 d2/f5 0 2024-09-13T02:50:24.068 INFO:tasks.workunit.client.0.smithi100.stdout:4/8: dwrite f0 [0,4194304] 0 2024-09-13T02:50:24.068 INFO:tasks.workunit.client.0.smithi100.stdout:4/9: creat f1 x:0 0 0 2024-09-13T02:50:24.068 INFO:tasks.workunit.client.0.smithi100.stdout:1/8: dwrite f1 [0,4194304] 0 2024-09-13T02:50:24.069 INFO:tasks.workunit.client.0.smithi100.stdout:6/9: symlink l3 0 2024-09-13T02:50:24.070 INFO:tasks.workunit.client.0.smithi100.stdout:5/7: rename f2 to f4 0 2024-09-13T02:50:24.081 INFO:tasks.workunit.client.0.smithi100.stdout:7/2: dwrite f0 [0,4194304] 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/8: creat f1 x:0 0 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/0: creat f0 x:0 0 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:1/9: mknod c4 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/10: symlink l4 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/9: creat f2 x:0 0 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/10: readlink - no filename 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/1: stat f0 0 2024-09-13T02:50:24.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/2: stat f0 0 2024-09-13T02:50:24.101 INFO:tasks.workunit.client.0.smithi100.stdout:3/10: getdents . 0 2024-09-13T02:50:24.101 INFO:tasks.workunit.client.0.smithi100.stdout:3/11: read - f2 zero size 2024-09-13T02:50:24.101 INFO:tasks.workunit.client.0.smithi100.stdout:9/3: readlink - no filename 2024-09-13T02:50:24.101 INFO:tasks.workunit.client.0.smithi100.stdout:8/11: write f2 [153947,83629] 0 2024-09-13T02:50:24.101 INFO:tasks.workunit.client.0.smithi100.stdout:9/4: fsync f0 0 2024-09-13T02:50:24.107 INFO:tasks.workunit.client.0.smithi100.stdout:2/6: getdents d0 0 2024-09-13T02:50:24.107 INFO:tasks.workunit.client.0.smithi100.stdout:2/7: rename d0 to d0/d2 22 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/11: unlink f0 0 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:3/12: symlink l6 0 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/5: mknod c1 0 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/6: truncate f0 368904 0 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/12: creat f5 x:0 0 0 2024-09-13T02:50:24.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/13: dread - f5 zero size 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/8: creat d0/f3 x:0 0 0 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/9: creat d0/f4 x:0 0 0 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/10: truncate d0/f4 112626 0 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/11: chown d0/f3 12 1 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/12: creat d0/f5 x:0 0 0 2024-09-13T02:50:24.127 INFO:tasks.workunit.client.0.smithi100.stdout:2/13: write d0/f1 [1008732,5185] 0 2024-09-13T02:50:24.135 INFO:tasks.workunit.client.0.smithi100.stdout:9/7: mknod c2 0 2024-09-13T02:50:24.266 INFO:tasks.workunit.client.0.smithi100.stdout:5/8: dwrite f4 [0,4194304] 0 2024-09-13T02:50:24.451 INFO:tasks.workunit.client.0.smithi100.stdout:0/12: dread d2/f5 [0,4194304] 0 2024-09-13T02:50:24.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/3: dread f0 [0,4194304] 0 2024-09-13T02:50:24.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/4: creat f1 x:0 0 0 2024-09-13T02:50:24.667 INFO:tasks.workunit.client.0.smithi100.stdout:8/12: dwrite f2 [0,4194304] 0 2024-09-13T02:50:24.667 INFO:tasks.workunit.client.0.smithi100.stdout:8/13: creat f3 x:0 0 0 2024-09-13T02:50:24.743 INFO:tasks.workunit.client.0.smithi100.stdout:0/13: dread d2/f3 [0,4194304] 0 2024-09-13T02:50:24.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/8: dread f0 [0,4194304] 0 2024-09-13T02:50:24.747 INFO:tasks.workunit.client.0.smithi100.stdout:9/9: write f0 [1300751,98853] 0 2024-09-13T02:50:24.832 INFO:tasks.workunit.client.0.smithi100.stdout:9/10: fsync f0 0 2024-09-13T02:50:24.879 INFO:tasks.workunit.client.0.smithi100.stdout:3/13: dwrite f4 [0,4194304] 0 2024-09-13T02:50:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:24 smithi100 ceph-mon[27894]: pgmap v243: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 25 MiB/s wr, 963 op/s 2024-09-13T02:50:24.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:24 smithi122 ceph-mon[34559]: pgmap v243: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 25 MiB/s wr, 963 op/s 2024-09-13T02:50:25.162 INFO:tasks.workunit.client.0.smithi100.stdout:1/10: truncate f1 3435696 0 2024-09-13T02:50:25.162 INFO:tasks.workunit.client.0.smithi100.stdout:1/11: creat f5 x:0 0 0 2024-09-13T02:50:25.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/5: write f0 [2215454,4065] 0 2024-09-13T02:50:25.269 INFO:tasks.workunit.client.0.smithi100.stdout:6/14: dwrite f5 [0,4194304] 0 2024-09-13T02:50:25.282 INFO:tasks.workunit.client.0.smithi100.stdout:7/6: dwrite f1 [0,4194304] 0 2024-09-13T02:50:25.290 INFO:tasks.workunit.client.0.smithi100.stdout:6/15: dwrite f2 [0,4194304] 0 2024-09-13T02:50:25.299 INFO:tasks.workunit.client.0.smithi100.stdout:6/16: dread f2 [0,4194304] 0 2024-09-13T02:50:25.299 INFO:tasks.workunit.client.0.smithi100.stdout:6/17: readlink l1 0 2024-09-13T02:50:25.303 INFO:tasks.workunit.client.0.smithi100.stdout:6/18: dread f2 [0,4194304] 0 2024-09-13T02:50:25.349 INFO:tasks.workunit.client.0.smithi100.stdout:2/14: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:25.350 INFO:tasks.workunit.client.0.smithi100.stdout:5/9: dwrite f0 [0,4194304] 0 2024-09-13T02:50:25.357 INFO:tasks.workunit.client.0.smithi100.stdout:5/10: write f0 [2904231,53997] 0 2024-09-13T02:50:25.704 INFO:tasks.workunit.client.0.smithi100.stdout:0/14: creat d2/f6 x:0 0 0 2024-09-13T02:50:25.705 INFO:tasks.workunit.client.0.smithi100.stdout:0/15: dread - d2/f6 zero size 2024-09-13T02:50:25.705 INFO:tasks.workunit.client.0.smithi100.stdout:0/16: write d2/f3 [1558307,41306] 0 2024-09-13T02:50:25.705 INFO:tasks.workunit.client.0.smithi100.stdout:0/17: dread - d2/f6 zero size 2024-09-13T02:50:25.787 INFO:tasks.workunit.client.0.smithi100.stdout:9/11: rename c1 to c3 0 2024-09-13T02:50:25.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/12: dwrite f0 [0,4194304] 0 2024-09-13T02:50:25.945 INFO:tasks.workunit.client.0.smithi100.stdout:1/12: read f1 [1908580,106122] 0 2024-09-13T02:50:25.946 INFO:tasks.workunit.client.0.smithi100.stdout:1/13: fdatasync f5 0 2024-09-13T02:50:25.946 INFO:tasks.workunit.client.0.smithi100.stdout:1/14: write f1 [1886924,7258] 0 2024-09-13T02:50:26.030 INFO:tasks.workunit.client.0.smithi100.stdout:7/7: mknod c2 0 2024-09-13T02:50:26.030 INFO:tasks.workunit.client.0.smithi100.stdout:7/8: readlink - no filename 2024-09-13T02:50:26.031 INFO:tasks.workunit.client.0.smithi100.stdout:7/9: fsync f0 0 2024-09-13T02:50:26.032 INFO:tasks.workunit.client.0.smithi100.stdout:7/10: write f0 [2623297,73852] 0 2024-09-13T02:50:26.040 INFO:tasks.workunit.client.0.smithi100.stdout:7/11: dread f1 [0,4194304] 0 2024-09-13T02:50:26.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/15: rename d0/f5 to d0/f6 0 2024-09-13T02:50:26.510 INFO:tasks.workunit.client.0.smithi100.stdout:5/11: truncate f4 2567507 0 2024-09-13T02:50:26.511 INFO:tasks.workunit.client.0.smithi100.stdout:2/16: dread d0/f1 [0,4194304] 0 2024-09-13T02:50:26.513 INFO:tasks.workunit.client.0.smithi100.stdout:8/14: link f3 f4 0 2024-09-13T02:50:26.513 INFO:tasks.workunit.client.0.smithi100.stdout:8/15: creat f5 x:0 0 0 2024-09-13T02:50:26.513 INFO:tasks.workunit.client.0.smithi100.stdout:8/16: creat f6 x:0 0 0 2024-09-13T02:50:26.514 INFO:tasks.workunit.client.0.smithi100.stdout:8/17: dread - f1 zero size 2024-09-13T02:50:26.514 INFO:tasks.workunit.client.0.smithi100.stdout:0/18: mknod d2/c7 0 2024-09-13T02:50:26.514 INFO:tasks.workunit.client.0.smithi100.stdout:0/19: fsync d2/f6 0 2024-09-13T02:50:26.515 INFO:tasks.workunit.client.0.smithi100.stdout:9/13: unlink f0 0 2024-09-13T02:50:26.516 INFO:tasks.workunit.client.0.smithi100.stdout:0/20: fsync d2/f3 0 2024-09-13T02:50:26.518 INFO:tasks.workunit.client.0.smithi100.stdout:1/15: symlink l6 0 2024-09-13T02:50:26.518 INFO:tasks.workunit.client.0.smithi100.stdout:1/16: dread - f5 zero size 2024-09-13T02:50:26.518 INFO:tasks.workunit.client.0.smithi100.stdout:6/19: getdents . 0 2024-09-13T02:50:26.519 INFO:tasks.workunit.client.0.smithi100.stdout:7/12: mkdir d3 0 2024-09-13T02:50:26.520 INFO:tasks.workunit.client.0.smithi100.stdout:5/12: mknod c5 0 2024-09-13T02:50:26.521 INFO:tasks.workunit.client.0.smithi100.stdout:2/17: mknod d0/c7 0 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/14: link c2 c4 0 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/15: chown c2 12696282 1 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/16: write - no filename 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/17: creat f5 x:0 0 0 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/18: rmdir - no directory 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/19: write f5 [104761,113898] 0 2024-09-13T02:50:26.525 INFO:tasks.workunit.client.0.smithi100.stdout:7/13: dread f1 [0,4194304] 0 2024-09-13T02:50:26.526 INFO:tasks.workunit.client.0.smithi100.stdout:7/14: fsync f0 0 2024-09-13T02:50:26.526 INFO:tasks.workunit.client.0.smithi100.stdout:7/15: chown f0 49523 1 2024-09-13T02:50:26.526 INFO:tasks.workunit.client.0.smithi100.stdout:3/14: link l0 l7 0 2024-09-13T02:50:26.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/17: rename f5 to f7 0 2024-09-13T02:50:26.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/18: creat f8 x:0 0 0 2024-09-13T02:50:26.528 INFO:tasks.workunit.client.0.smithi100.stdout:1/19: write f1 [4453130,128470] 0 2024-09-13T02:50:26.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/20: mknod c6 0 2024-09-13T02:50:26.530 INFO:tasks.workunit.client.0.smithi100.stdout:5/13: unlink c5 0 2024-09-13T02:50:26.530 INFO:tasks.workunit.client.0.smithi100.stdout:2/18: rename d0/c7 to d0/c8 0 2024-09-13T02:50:26.533 INFO:tasks.workunit.client.0.smithi100.stdout:8/18: dwrite f2 [0,4194304] 0 2024-09-13T02:50:26.534 INFO:tasks.workunit.client.0.smithi100.stdout:9/20: symlink l6 0 2024-09-13T02:50:26.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/15: stat f5 0 2024-09-13T02:50:26.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/16: readlink l0 0 2024-09-13T02:50:26.537 INFO:tasks.workunit.client.0.smithi100.stdout:1/20: mknod c9 0 2024-09-13T02:50:26.538 INFO:tasks.workunit.client.0.smithi100.stdout:6/21: rename f5 to f7 0 2024-09-13T02:50:26.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/17: creat f8 x:0 0 0 2024-09-13T02:50:26.543 INFO:tasks.workunit.client.0.smithi100.stdout:5/14: dread f0 [0,4194304] 0 2024-09-13T02:50:26.544 INFO:tasks.workunit.client.0.smithi100.stdout:3/18: fdatasync f2 0 2024-09-13T02:50:26.546 INFO:tasks.workunit.client.0.smithi100.stdout:5/15: symlink l6 0 2024-09-13T02:50:26.557 INFO:tasks.workunit.client.0.smithi100.stdout:7/16: dwrite f1 [0,4194304] 0 2024-09-13T02:50:26.557 INFO:tasks.workunit.client.0.smithi100.stdout:2/19: dwrite d0/f1 [0,4194304] 0 2024-09-13T02:50:26.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/20: symlink d0/l9 0 2024-09-13T02:50:26.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/21: fsync d0/f1 0 2024-09-13T02:50:26.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/22: dread - d0/f3 zero size 2024-09-13T02:50:26.561 INFO:tasks.workunit.client.0.smithi100.stdout:2/23: symlink d0/la 0 2024-09-13T02:50:26.561 INFO:tasks.workunit.client.0.smithi100.stdout:2/24: chown d0/f1 0 1 2024-09-13T02:50:26.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/17: dread f1 [0,4194304] 0 2024-09-13T02:50:26.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/18: mknod d3/c4 0 2024-09-13T02:50:26.567 INFO:tasks.workunit.client.0.smithi100.stdout:7/19: mkdir d3/d5 0 2024-09-13T02:50:26.568 INFO:tasks.workunit.client.0.smithi100.stdout:7/20: link d3/c4 d3/c6 0 2024-09-13T02:50:26.583 INFO:tasks.workunit.client.0.smithi100.stdout:7/21: dwrite f0 [0,4194304] 0 2024-09-13T02:50:26.590 INFO:tasks.workunit.client.0.smithi100.stdout:7/22: write f0 [1442117,53677] 0 2024-09-13T02:50:26.590 INFO:tasks.workunit.client.0.smithi100.stdout:7/23: write f0 [4301987,84043] 0 2024-09-13T02:50:26.590 INFO:tasks.workunit.client.0.smithi100.stdout:7/24: chown d3 93 1 2024-09-13T02:50:26.595 INFO:tasks.workunit.client.0.smithi100.stdout:7/25: dread f1 [0,4194304] 0 2024-09-13T02:50:26.595 INFO:tasks.workunit.client.0.smithi100.stdout:7/26: write f0 [2101766,5094] 0 2024-09-13T02:50:26.596 INFO:tasks.workunit.client.0.smithi100.stdout:7/27: link c2 d3/d5/c7 0 2024-09-13T02:50:26.596 INFO:tasks.workunit.client.0.smithi100.stdout:7/28: chown d3 18901174 1 2024-09-13T02:50:26.596 INFO:tasks.workunit.client.0.smithi100.stdout:7/29: readlink - no filename 2024-09-13T02:50:26.596 INFO:tasks.workunit.client.0.smithi100.stdout:7/30: mknod d3/d5/c8 0 2024-09-13T02:50:26.597 INFO:tasks.workunit.client.0.smithi100.stdout:7/31: symlink d3/l9 0 2024-09-13T02:50:26.602 INFO:tasks.workunit.client.0.smithi100.stdout:6/22: truncate f2 188305 0 2024-09-13T02:50:26.602 INFO:tasks.workunit.client.0.smithi100.stdout:6/23: chown c6 2029 1 2024-09-13T02:50:26.610 INFO:tasks.workunit.client.0.smithi100.stdout:6/24: write f7 [511305,33460] 0 2024-09-13T02:50:26.611 INFO:tasks.workunit.client.0.smithi100.stdout:6/25: link l1 l8 0 2024-09-13T02:50:26.612 INFO:tasks.workunit.client.0.smithi100.stdout:6/26: stat l8 0 2024-09-13T02:50:26.622 INFO:tasks.workunit.client.0.smithi100.stdout:7/32: dwrite f1 [0,4194304] 0 2024-09-13T02:50:26.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/33: link f0 d3/fa 0 2024-09-13T02:50:26.624 INFO:tasks.workunit.client.0.smithi100.stdout:7/34: truncate f1 4910545 0 2024-09-13T02:50:26.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/35: dread d3/fa [0,4194304] 0 2024-09-13T02:50:26.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/36: readlink d3/l9 0 2024-09-13T02:50:26.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/37: write d3/fa [3950572,76554] 0 2024-09-13T02:50:26.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/38: write d3/fa [3590753,51337] 0 2024-09-13T02:50:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:26 smithi122 ceph-mon[34559]: pgmap v244: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.8 MiB/s rd, 24 MiB/s wr, 994 op/s 2024-09-13T02:50:26.745 INFO:tasks.workunit.client.0.smithi100.stdout:4/10: sync 2024-09-13T02:50:26.745 INFO:tasks.workunit.client.0.smithi100.stdout:4/11: dread - f1 zero size 2024-09-13T02:50:26.746 INFO:tasks.workunit.client.0.smithi100.stdout:4/12: rename f1 to f2 0 2024-09-13T02:50:26.747 INFO:tasks.workunit.client.0.smithi100.stdout:4/13: mkdir d3 0 2024-09-13T02:50:26.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/14: chown d3 131 1 2024-09-13T02:50:26.751 INFO:tasks.workunit.client.0.smithi100.stdout:8/19: getdents . 0 2024-09-13T02:50:26.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/20: creat f7 x:0 0 0 2024-09-13T02:50:26.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/21: creat f8 x:0 0 0 2024-09-13T02:50:26.754 INFO:tasks.workunit.client.0.smithi100.stdout:8/22: read - f4 zero size 2024-09-13T02:50:26.754 INFO:tasks.workunit.client.0.smithi100.stdout:1/21: fsync f7 0 2024-09-13T02:50:26.754 INFO:tasks.workunit.client.0.smithi100.stdout:1/22: dread - f7 zero size 2024-09-13T02:50:26.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/23: stat l3 0 2024-09-13T02:50:26.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/24: chown f7 100 1 2024-09-13T02:50:26.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/25: write f1 [4648789,31291] 0 2024-09-13T02:50:26.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/26: rmdir - no directory 2024-09-13T02:50:26.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/27: chown l6 0 1 2024-09-13T02:50:26.756 INFO:tasks.workunit.client.0.smithi100.stdout:8/23: rename f7 to f9 0 2024-09-13T02:50:26.757 INFO:tasks.workunit.client.0.smithi100.stdout:2/25: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T02:50:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/28: link c9 ca 0 2024-09-13T02:50:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/21: fsync f5 0 2024-09-13T02:50:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/29: fdatasync f1 0 2024-09-13T02:50:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/30: fsync f7 0 2024-09-13T02:50:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:8/24: mknod ca 0 2024-09-13T02:50:26.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/22: symlink l7 0 2024-09-13T02:50:26.763 INFO:tasks.workunit.client.0.smithi100.stdout:1/31: mknod cb 0 2024-09-13T02:50:26.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/32: link ca cc 0 2024-09-13T02:50:26.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/33: rmdir - no directory 2024-09-13T02:50:26.766 INFO:tasks.workunit.client.0.smithi100.stdout:1/34: creat fd x:0 0 0 2024-09-13T02:50:26.767 INFO:tasks.workunit.client.0.smithi100.stdout:8/25: rename f4 to fb 0 2024-09-13T02:50:26.767 INFO:tasks.workunit.client.0.smithi100.stdout:8/26: dread - fb zero size 2024-09-13T02:50:26.770 INFO:tasks.workunit.client.0.smithi100.stdout:1/35: mkdir de 0 2024-09-13T02:50:26.779 INFO:tasks.workunit.client.0.smithi100.stdout:4/15: link f2 d3/f4 0 2024-09-13T02:50:26.779 INFO:tasks.workunit.client.0.smithi100.stdout:4/16: chown f0 2 1 2024-09-13T02:50:26.779 INFO:tasks.workunit.client.0.smithi100.stdout:4/17: chown f2 200700 1 2024-09-13T02:50:26.780 INFO:tasks.workunit.client.0.smithi100.stdout:8/27: rename f9 to fc 0 2024-09-13T02:50:26.790 INFO:tasks.workunit.client.0.smithi100.stdout:2/26: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T02:50:26.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/23: dwrite f5 [0,4194304] 0 2024-09-13T02:50:26.790 INFO:tasks.workunit.client.0.smithi100.stdout:1/36: dwrite f8 [0,4194304] 0 2024-09-13T02:50:26.791 INFO:tasks.workunit.client.0.smithi100.stdout:2/27: truncate d0/f1 3844245 0 2024-09-13T02:50:26.794 INFO:tasks.workunit.client.0.smithi100.stdout:9/24: symlink l8 0 2024-09-13T02:50:26.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/28: getdents . 0 2024-09-13T02:50:26.795 INFO:tasks.workunit.client.0.smithi100.stdout:8/29: dread - f1 zero size 2024-09-13T02:50:26.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/28: mkdir d0/db 0 2024-09-13T02:50:26.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/29: dread - d0/f6 zero size 2024-09-13T02:50:26.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/30: rename d0 to d0/dc 22 2024-09-13T02:50:26.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/31: dread - d0/f3 zero size 2024-09-13T02:50:26.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/32: chown d0/f1 0 1 2024-09-13T02:50:26.804 INFO:tasks.workunit.client.0.smithi100.stdout:9/25: truncate f5 2331609 0 2024-09-13T02:50:26.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/26: creat f9 x:0 0 0 2024-09-13T02:50:26.806 INFO:tasks.workunit.client.0.smithi100.stdout:9/27: mknod ca 0 2024-09-13T02:50:26.807 INFO:tasks.workunit.client.0.smithi100.stdout:9/28: creat fb x:0 0 0 2024-09-13T02:50:26.807 INFO:tasks.workunit.client.0.smithi100.stdout:2/33: rmdir d0 39 2024-09-13T02:50:26.807 INFO:tasks.workunit.client.0.smithi100.stdout:2/34: dread - d0/f3 zero size 2024-09-13T02:50:26.816 INFO:tasks.workunit.client.0.smithi100.stdout:1/37: dwrite f1 [0,4194304] 0 2024-09-13T02:50:26.816 INFO:tasks.workunit.client.0.smithi100.stdout:1/38: chown ca 668 1 2024-09-13T02:50:26.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/30: dwrite f8 [0,4194304] 0 2024-09-13T02:50:26.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/39: link f8 de/ff 0 2024-09-13T02:50:26.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/40: chown de/ff 32 1 2024-09-13T02:50:26.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/31: symlink ld 0 2024-09-13T02:50:26.821 INFO:tasks.workunit.client.0.smithi100.stdout:8/32: rename ca to ce 0 2024-09-13T02:50:26.822 INFO:tasks.workunit.client.0.smithi100.stdout:8/33: mkdir df 0 2024-09-13T02:50:26.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/34: symlink df/l10 0 2024-09-13T02:50:26.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/35: dread - f3 zero size 2024-09-13T02:50:26.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/36: chown fc 10102 1 2024-09-13T02:50:26.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/37: truncate f6 202081 0 2024-09-13T02:50:26.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/35: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T02:50:26.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/36: getdents d0/db 0 2024-09-13T02:50:26.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/37: fdatasync d0/f3 0 2024-09-13T02:50:26.834 INFO:tasks.workunit.client.0.smithi100.stdout:9/29: dwrite f5 [0,4194304] 0 2024-09-13T02:50:26.834 INFO:tasks.workunit.client.0.smithi100.stdout:9/30: write fb [183451,25094] 0 2024-09-13T02:50:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/31: fdatasync fb 0 2024-09-13T02:50:26.836 INFO:tasks.workunit.client.0.smithi100.stdout:8/38: truncate f2 3617988 0 2024-09-13T02:50:26.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/39: link df/l10 df/l11 0 2024-09-13T02:50:26.839 INFO:tasks.workunit.client.0.smithi100.stdout:9/32: getdents . 0 2024-09-13T02:50:26.839 INFO:tasks.workunit.client.0.smithi100.stdout:9/33: fdatasync f5 0 2024-09-13T02:50:26.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/34: dread fb [0,4194304] 0 2024-09-13T02:50:26.841 INFO:tasks.workunit.client.0.smithi100.stdout:2/38: write d0/f1 [3208416,59822] 0 2024-09-13T02:50:26.842 INFO:tasks.workunit.client.0.smithi100.stdout:2/39: getdents d0 0 2024-09-13T02:50:26.846 INFO:tasks.workunit.client.0.smithi100.stdout:2/40: truncate d0/f1 1316747 0 2024-09-13T02:50:26.854 INFO:tasks.workunit.client.0.smithi100.stdout:9/35: dwrite f5 [0,4194304] 0 2024-09-13T02:50:26.856 INFO:tasks.workunit.client.0.smithi100.stdout:9/36: creat fc x:0 0 0 2024-09-13T02:50:26.856 INFO:tasks.workunit.client.0.smithi100.stdout:9/37: write fb [470640,86551] 0 2024-09-13T02:50:26.856 INFO:tasks.workunit.client.0.smithi100.stdout:9/38: mkdir dd 0 2024-09-13T02:50:26.858 INFO:tasks.workunit.client.0.smithi100.stdout:2/41: truncate d0/f1 630146 0 2024-09-13T02:50:26.858 INFO:tasks.workunit.client.0.smithi100.stdout:2/42: chown d0/f6 14172293 1 2024-09-13T02:50:26.858 INFO:tasks.workunit.client.0.smithi100.stdout:9/39: creat dd/fe x:0 0 0 2024-09-13T02:50:26.858 INFO:tasks.workunit.client.0.smithi100.stdout:9/40: write f9 [654842,50331] 0 2024-09-13T02:50:26.858 INFO:tasks.workunit.client.0.smithi100.stdout:9/41: truncate dd/fe 505047 0 2024-09-13T02:50:26.859 INFO:tasks.workunit.client.0.smithi100.stdout:9/42: creat dd/ff x:0 0 0 2024-09-13T02:50:26.859 INFO:tasks.workunit.client.0.smithi100.stdout:9/43: truncate dd/ff 930525 0 2024-09-13T02:50:26.859 INFO:tasks.workunit.client.0.smithi100.stdout:9/44: write fc [638051,48406] 0 2024-09-13T02:50:26.859 INFO:tasks.workunit.client.0.smithi100.stdout:2/43: creat d0/db/fd x:0 0 0 2024-09-13T02:50:26.862 INFO:tasks.workunit.client.0.smithi100.stdout:9/45: rmdir dd 39 2024-09-13T02:50:26.867 INFO:tasks.workunit.client.0.smithi100.stdout:9/46: dread fb [0,4194304] 0 2024-09-13T02:50:26.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/44: dwrite d0/f3 [0,4194304] 0 2024-09-13T02:50:26.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/45: write d0/f3 [76698,11027] 0 2024-09-13T02:50:26.883 INFO:tasks.workunit.client.0.smithi100.stdout:2/46: stat d0/f3 0 2024-09-13T02:50:26.884 INFO:tasks.workunit.client.0.smithi100.stdout:2/47: creat d0/fe x:0 0 0 2024-09-13T02:50:26.884 INFO:tasks.workunit.client.0.smithi100.stdout:2/48: creat d0/db/ff x:0 0 0 2024-09-13T02:50:26.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/49: dwrite d0/fe [0,4194304] 0 2024-09-13T02:50:26.901 INFO:tasks.workunit.client.0.smithi100.stdout:2/50: symlink d0/db/l10 0 2024-09-13T02:50:26.914 INFO:tasks.workunit.client.0.smithi100.stdout:2/51: dwrite d0/db/ff [0,4194304] 0 2024-09-13T02:50:26.917 INFO:tasks.workunit.client.0.smithi100.stdout:2/52: rmdir d0/db 39 2024-09-13T02:50:26.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:26 smithi100 ceph-mon[27894]: pgmap v244: 65 pgs: 65 active+clean; 317 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.8 MiB/s rd, 24 MiB/s wr, 994 op/s 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:5/16: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/40: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:1/41: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:2/53: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:4/18: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/41: chown f6 816 1 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:0/21: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:7/39: sync 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/42: dread - fc zero size 2024-09-13T02:50:27.288 INFO:tasks.workunit.client.0.smithi100.stdout:9/47: sync 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:5/17: write f0 [5063689,76124] 0 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:3/19: sync 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/48: write fb [1481876,48920] 0 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/49: write dd/fe [520771,48208] 0 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/50: chown dd 295801 1 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:6/27: sync 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:6/28: write f7 [1624344,11452] 0 2024-09-13T02:50:27.289 INFO:tasks.workunit.client.0.smithi100.stdout:7/40: mkdir d3/db 0 2024-09-13T02:50:27.290 INFO:tasks.workunit.client.0.smithi100.stdout:2/54: dread d0/f1 [0,4194304] 0 2024-09-13T02:50:27.290 INFO:tasks.workunit.client.0.smithi100.stdout:2/55: write d0/f6 [891646,47088] 0 2024-09-13T02:50:27.290 INFO:tasks.workunit.client.0.smithi100.stdout:2/56: truncate d0/f6 1241307 0 2024-09-13T02:50:27.291 INFO:tasks.workunit.client.0.smithi100.stdout:8/43: mknod df/c12 0 2024-09-13T02:50:27.291 INFO:tasks.workunit.client.0.smithi100.stdout:4/19: symlink d3/l5 0 2024-09-13T02:50:27.291 INFO:tasks.workunit.client.0.smithi100.stdout:8/44: truncate f6 586133 0 2024-09-13T02:50:27.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/41: unlink f1 0 2024-09-13T02:50:27.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/42: stat d3/l9 0 2024-09-13T02:50:27.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/57: truncate d0/fe 155521 0 2024-09-13T02:50:27.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/58: stat d0/db 0 2024-09-13T02:50:27.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/59: truncate d0/f3 4819486 0 2024-09-13T02:50:27.295 INFO:tasks.workunit.client.0.smithi100.stdout:7/43: creat d3/fc x:0 0 0 2024-09-13T02:50:27.298 INFO:tasks.workunit.client.0.smithi100.stdout:2/60: unlink d0/db/l10 0 2024-09-13T02:50:27.300 INFO:tasks.workunit.client.0.smithi100.stdout:7/44: write f0 [4175023,22785] 0 2024-09-13T02:50:27.300 INFO:tasks.workunit.client.0.smithi100.stdout:9/51: write fb [1263815,78478] 0 2024-09-13T02:50:27.302 INFO:tasks.workunit.client.0.smithi100.stdout:1/42: dread f8 [0,4194304] 0 2024-09-13T02:50:27.302 INFO:tasks.workunit.client.0.smithi100.stdout:2/61: rename d0/f3 to d0/f11 0 2024-09-13T02:50:27.307 INFO:tasks.workunit.client.0.smithi100.stdout:9/52: creat dd/f10 x:0 0 0 2024-09-13T02:50:27.307 INFO:tasks.workunit.client.0.smithi100.stdout:4/20: write f0 [635838,121931] 0 2024-09-13T02:50:27.307 INFO:tasks.workunit.client.0.smithi100.stdout:4/21: dread - f2 zero size 2024-09-13T02:50:27.307 INFO:tasks.workunit.client.0.smithi100.stdout:4/22: chown f0 1639797 1 2024-09-13T02:50:27.311 INFO:tasks.workunit.client.0.smithi100.stdout:8/45: dread f8 [0,4194304] 0 2024-09-13T02:50:27.311 INFO:tasks.workunit.client.0.smithi100.stdout:8/46: stat fc 0 2024-09-13T02:50:27.312 INFO:tasks.workunit.client.0.smithi100.stdout:8/47: mkdir df/d13 0 2024-09-13T02:50:27.313 INFO:tasks.workunit.client.0.smithi100.stdout:8/48: creat df/d13/f14 x:0 0 0 2024-09-13T02:50:27.316 INFO:tasks.workunit.client.0.smithi100.stdout:8/49: mknod df/d13/c15 0 2024-09-13T02:50:27.316 INFO:tasks.workunit.client.0.smithi100.stdout:8/50: creat df/d13/f16 x:0 0 0 2024-09-13T02:50:27.318 INFO:tasks.workunit.client.0.smithi100.stdout:3/20: dwrite f8 [0,4194304] 0 2024-09-13T02:50:27.318 INFO:tasks.workunit.client.0.smithi100.stdout:3/21: dread - f5 zero size 2024-09-13T02:50:27.319 INFO:tasks.workunit.client.0.smithi100.stdout:0/22: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:50:27.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/29: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.322 INFO:tasks.workunit.client.0.smithi100.stdout:7/45: rmdir d3 39 2024-09-13T02:50:27.324 INFO:tasks.workunit.client.0.smithi100.stdout:3/22: read - f3 zero size 2024-09-13T02:50:27.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/43: dread f1 [0,4194304] 0 2024-09-13T02:50:27.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/44: fdatasync fd 0 2024-09-13T02:50:27.326 INFO:tasks.workunit.client.0.smithi100.stdout:0/23: symlink d2/l8 0 2024-09-13T02:50:27.327 INFO:tasks.workunit.client.0.smithi100.stdout:6/30: mknod c9 0 2024-09-13T02:50:27.328 INFO:tasks.workunit.client.0.smithi100.stdout:2/62: link d0/fe d0/db/f12 0 2024-09-13T02:50:27.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/46: link d3/c4 d3/d5/cd 0 2024-09-13T02:50:27.329 INFO:tasks.workunit.client.0.smithi100.stdout:7/47: chown d3/l9 64 1 2024-09-13T02:50:27.329 INFO:tasks.workunit.client.0.smithi100.stdout:1/45: getdents de 0 2024-09-13T02:50:27.329 INFO:tasks.workunit.client.0.smithi100.stdout:0/24: mkdir d2/d9 0 2024-09-13T02:50:27.331 INFO:tasks.workunit.client.0.smithi100.stdout:0/25: link d2/f6 d2/fa 0 2024-09-13T02:50:27.331 INFO:tasks.workunit.client.0.smithi100.stdout:2/63: getdents d0 0 2024-09-13T02:50:27.332 INFO:tasks.workunit.client.0.smithi100.stdout:2/64: truncate d0/f6 1503532 0 2024-09-13T02:50:27.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/46: write de/ff [2272509,14923] 0 2024-09-13T02:50:27.335 INFO:tasks.workunit.client.0.smithi100.stdout:3/23: dread f4 [0,4194304] 0 2024-09-13T02:50:27.335 INFO:tasks.workunit.client.0.smithi100.stdout:3/24: write f3 [534285,9517] 0 2024-09-13T02:50:27.335 INFO:tasks.workunit.client.0.smithi100.stdout:9/53: dwrite f9 [0,4194304] 0 2024-09-13T02:50:27.336 INFO:tasks.workunit.client.0.smithi100.stdout:1/47: rename c4 to de/c10 0 2024-09-13T02:50:27.336 INFO:tasks.workunit.client.0.smithi100.stdout:4/23: dwrite d3/f4 [0,4194304] 0 2024-09-13T02:50:27.337 INFO:tasks.workunit.client.0.smithi100.stdout:4/24: chown d3/f4 911997178 1 2024-09-13T02:50:27.341 INFO:tasks.workunit.client.0.smithi100.stdout:1/48: creat de/f11 x:0 0 0 2024-09-13T02:50:27.343 INFO:tasks.workunit.client.0.smithi100.stdout:3/25: link f2 f9 0 2024-09-13T02:50:27.343 INFO:tasks.workunit.client.0.smithi100.stdout:3/26: truncate f3 644697 0 2024-09-13T02:50:27.343 INFO:tasks.workunit.client.0.smithi100.stdout:0/26: write d2/f3 [108751,98899] 0 2024-09-13T02:50:27.343 INFO:tasks.workunit.client.0.smithi100.stdout:0/27: stat c0 0 2024-09-13T02:50:27.344 INFO:tasks.workunit.client.0.smithi100.stdout:8/51: getdents df/d13 0 2024-09-13T02:50:27.346 INFO:tasks.workunit.client.0.smithi100.stdout:6/31: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.346 INFO:tasks.workunit.client.0.smithi100.stdout:4/25: mkdir d3/d6 0 2024-09-13T02:50:27.352 INFO:tasks.workunit.client.0.smithi100.stdout:9/54: rmdir dd 39 2024-09-13T02:50:27.356 INFO:tasks.workunit.client.0.smithi100.stdout:0/28: creat d2/d9/fb x:0 0 0 2024-09-13T02:50:27.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/52: mkdir df/d13/d17 0 2024-09-13T02:50:27.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/53: write fc [395992,94325] 0 2024-09-13T02:50:27.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/54: dread - f3 zero size 2024-09-13T02:50:27.359 INFO:tasks.workunit.client.0.smithi100.stdout:4/26: symlink d3/l7 0 2024-09-13T02:50:27.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/55: symlink dd/l11 0 2024-09-13T02:50:27.360 INFO:tasks.workunit.client.0.smithi100.stdout:9/56: fsync dd/fe 0 2024-09-13T02:50:27.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/27: mknod ca 0 2024-09-13T02:50:27.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/28: dread - f5 zero size 2024-09-13T02:50:27.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/29: readlink l0 0 2024-09-13T02:50:27.361 INFO:tasks.workunit.client.0.smithi100.stdout:3/30: read - f9 zero size 2024-09-13T02:50:27.362 INFO:tasks.workunit.client.0.smithi100.stdout:8/55: mkdir df/d13/d17/d18 0 2024-09-13T02:50:27.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/27: unlink d3/l7 0 2024-09-13T02:50:27.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/31: creat fb x:0 0 0 2024-09-13T02:50:27.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/48: dwrite d3/fa [0,4194304] 0 2024-09-13T02:50:27.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/49: chown c2 1 1 2024-09-13T02:50:27.366 INFO:tasks.workunit.client.0.smithi100.stdout:8/56: creat df/d13/f19 x:0 0 0 2024-09-13T02:50:27.367 INFO:tasks.workunit.client.0.smithi100.stdout:4/28: mknod d3/c8 0 2024-09-13T02:50:27.368 INFO:tasks.workunit.client.0.smithi100.stdout:7/50: creat d3/d5/fe x:0 0 0 2024-09-13T02:50:27.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/57: unlink f1 0 2024-09-13T02:50:27.370 INFO:tasks.workunit.client.0.smithi100.stdout:1/49: dwrite f1 [0,4194304] 0 2024-09-13T02:50:27.371 INFO:tasks.workunit.client.0.smithi100.stdout:7/51: rename d3/d5/cd to d3/cf 0 2024-09-13T02:50:27.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/32: dwrite f7 [0,4194304] 0 2024-09-13T02:50:27.372 INFO:tasks.workunit.client.0.smithi100.stdout:6/33: fdatasync f2 0 2024-09-13T02:50:27.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/52: symlink d3/d5/l10 0 2024-09-13T02:50:27.377 INFO:tasks.workunit.client.0.smithi100.stdout:7/53: fdatasync d3/fc 0 2024-09-13T02:50:27.378 INFO:tasks.workunit.client.0.smithi100.stdout:7/54: creat d3/f11 x:0 0 0 2024-09-13T02:50:27.378 INFO:tasks.workunit.client.0.smithi100.stdout:7/55: write d3/f11 [741318,119485] 0 2024-09-13T02:50:27.379 INFO:tasks.workunit.client.0.smithi100.stdout:0/29: getdents d2/d9 0 2024-09-13T02:50:27.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/30: rename d2/c7 to d2/d9/cc 0 2024-09-13T02:50:27.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/31: chown d2/fa 31537016 1 2024-09-13T02:50:27.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/32: dread - d2/f6 zero size 2024-09-13T02:50:27.383 INFO:tasks.workunit.client.0.smithi100.stdout:0/33: mkdir d2/dd 0 2024-09-13T02:50:27.384 INFO:tasks.workunit.client.0.smithi100.stdout:6/34: read f2 [2059748,72807] 0 2024-09-13T02:50:27.384 INFO:tasks.workunit.client.0.smithi100.stdout:6/35: fsync f2 0 2024-09-13T02:50:27.384 INFO:tasks.workunit.client.0.smithi100.stdout:9/57: getdents dd 0 2024-09-13T02:50:27.384 INFO:tasks.workunit.client.0.smithi100.stdout:9/58: fsync dd/f10 0 2024-09-13T02:50:27.384 INFO:tasks.workunit.client.0.smithi100.stdout:9/59: dread dd/ff [0,4194304] 0 2024-09-13T02:50:27.385 INFO:tasks.workunit.client.0.smithi100.stdout:0/34: unlink d2/f6 0 2024-09-13T02:50:27.386 INFO:tasks.workunit.client.0.smithi100.stdout:9/60: creat dd/f12 x:0 0 0 2024-09-13T02:50:27.386 INFO:tasks.workunit.client.0.smithi100.stdout:9/61: write dd/f10 [87997,43890] 0 2024-09-13T02:50:27.386 INFO:tasks.workunit.client.0.smithi100.stdout:9/62: write fb [994845,1121] 0 2024-09-13T02:50:27.387 INFO:tasks.workunit.client.0.smithi100.stdout:9/63: rename l8 to dd/l13 0 2024-09-13T02:50:27.387 INFO:tasks.workunit.client.0.smithi100.stdout:9/64: chown ca 9240614 1 2024-09-13T02:50:27.388 INFO:tasks.workunit.client.0.smithi100.stdout:9/65: symlink dd/l14 0 2024-09-13T02:50:27.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/66: write fc [213464,68320] 0 2024-09-13T02:50:27.390 INFO:tasks.workunit.client.0.smithi100.stdout:9/67: creat dd/f15 x:0 0 0 2024-09-13T02:50:27.391 INFO:tasks.workunit.client.0.smithi100.stdout:3/32: dwrite f8 [4194304,4194304] 0 2024-09-13T02:50:27.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/56: dread f0 [0,4194304] 0 2024-09-13T02:50:27.392 INFO:tasks.workunit.client.0.smithi100.stdout:8/58: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.394 INFO:tasks.workunit.client.0.smithi100.stdout:9/68: rename c2 to dd/c16 0 2024-09-13T02:50:27.394 INFO:tasks.workunit.client.0.smithi100.stdout:9/69: read fb [547196,75422] 0 2024-09-13T02:50:27.395 INFO:tasks.workunit.client.0.smithi100.stdout:7/57: dread d3/fa [0,4194304] 0 2024-09-13T02:50:27.396 INFO:tasks.workunit.client.0.smithi100.stdout:6/36: write f7 [2786347,44056] 0 2024-09-13T02:50:27.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/33: creat fc x:0 0 0 2024-09-13T02:50:27.400 INFO:tasks.workunit.client.0.smithi100.stdout:6/37: fdatasync f7 0 2024-09-13T02:50:27.400 INFO:tasks.workunit.client.0.smithi100.stdout:6/38: chown c9 2 1 2024-09-13T02:50:27.401 INFO:tasks.workunit.client.0.smithi100.stdout:8/59: creat df/f1a x:0 0 0 2024-09-13T02:50:27.401 INFO:tasks.workunit.client.0.smithi100.stdout:8/60: truncate fb 439253 0 2024-09-13T02:50:27.402 INFO:tasks.workunit.client.0.smithi100.stdout:0/35: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:27.402 INFO:tasks.workunit.client.0.smithi100.stdout:7/58: rmdir d3/db 0 2024-09-13T02:50:27.403 INFO:tasks.workunit.client.0.smithi100.stdout:1/50: truncate de/ff 521624 0 2024-09-13T02:50:27.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/39: rename c9 to ca 0 2024-09-13T02:50:27.407 INFO:tasks.workunit.client.0.smithi100.stdout:9/70: dread fb [0,4194304] 0 2024-09-13T02:50:27.407 INFO:tasks.workunit.client.0.smithi100.stdout:9/71: stat dd/f15 0 2024-09-13T02:50:27.407 INFO:tasks.workunit.client.0.smithi100.stdout:8/61: symlink df/d13/d17/d18/l1b 0 2024-09-13T02:50:27.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/36: creat d2/dd/fe x:0 0 0 2024-09-13T02:50:27.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/59: symlink d3/l12 0 2024-09-13T02:50:27.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/60: truncate d3/fc 321998 0 2024-09-13T02:50:27.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/61: readlink d3/d5/l10 0 2024-09-13T02:50:27.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/62: chown d3/d5/c7 451 1 2024-09-13T02:50:27.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/72: unlink dd/l14 0 2024-09-13T02:50:27.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/73: write dd/f10 [397378,118897] 0 2024-09-13T02:50:27.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/62: write df/d13/f14 [429260,92359] 0 2024-09-13T02:50:27.420 INFO:tasks.workunit.client.0.smithi100.stdout:3/34: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.423 INFO:tasks.workunit.client.0.smithi100.stdout:8/63: link c0 df/d13/d17/d18/c1c 0 2024-09-13T02:50:27.424 INFO:tasks.workunit.client.0.smithi100.stdout:3/35: dread f4 [0,4194304] 0 2024-09-13T02:50:27.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/51: dwrite fd [0,4194304] 0 2024-09-13T02:50:27.433 INFO:tasks.workunit.client.0.smithi100.stdout:8/64: mknod df/d13/c1d 0 2024-09-13T02:50:27.434 INFO:tasks.workunit.client.0.smithi100.stdout:8/65: write fb [151123,10023] 0 2024-09-13T02:50:27.435 INFO:tasks.workunit.client.0.smithi100.stdout:9/74: truncate dd/f10 277784 0 2024-09-13T02:50:27.439 INFO:tasks.workunit.client.0.smithi100.stdout:9/75: dread dd/fe [0,4194304] 0 2024-09-13T02:50:27.439 INFO:tasks.workunit.client.0.smithi100.stdout:9/76: write dd/f15 [329964,102694] 0 2024-09-13T02:50:27.439 INFO:tasks.workunit.client.0.smithi100.stdout:1/52: dread fd [0,4194304] 0 2024-09-13T02:50:27.440 INFO:tasks.workunit.client.0.smithi100.stdout:1/53: mkdir de/d12 0 2024-09-13T02:50:27.440 INFO:tasks.workunit.client.0.smithi100.stdout:1/54: truncate f7 328336 0 2024-09-13T02:50:27.441 INFO:tasks.workunit.client.0.smithi100.stdout:1/55: symlink de/d12/l13 0 2024-09-13T02:50:27.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/40: dwrite f7 [4194304,4194304] 0 2024-09-13T02:50:27.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/41: chown l1 865222104 1 2024-09-13T02:50:27.442 INFO:tasks.workunit.client.0.smithi100.stdout:1/56: mkdir de/d14 0 2024-09-13T02:50:27.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/77: dread fb [0,4194304] 0 2024-09-13T02:50:27.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/78: stat dd 0 2024-09-13T02:50:27.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/79: readlink l6 0 2024-09-13T02:50:27.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/80: read dd/ff [876849,31116] 0 2024-09-13T02:50:27.445 INFO:tasks.workunit.client.0.smithi100.stdout:9/81: dread fb [0,4194304] 0 2024-09-13T02:50:27.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/36: dwrite f8 [4194304,4194304] 0 2024-09-13T02:50:27.447 INFO:tasks.workunit.client.0.smithi100.stdout:0/37: dwrite d2/fa [0,4194304] 0 2024-09-13T02:50:27.449 INFO:tasks.workunit.client.0.smithi100.stdout:6/42: symlink lb 0 2024-09-13T02:50:27.449 INFO:tasks.workunit.client.0.smithi100.stdout:6/43: fdatasync f2 0 2024-09-13T02:50:27.451 INFO:tasks.workunit.client.0.smithi100.stdout:8/66: dwrite df/d13/f16 [0,4194304] 0 2024-09-13T02:50:27.452 INFO:tasks.workunit.client.0.smithi100.stdout:1/57: unlink cb 0 2024-09-13T02:50:27.455 INFO:tasks.workunit.client.0.smithi100.stdout:6/44: dread f7 [0,4194304] 0 2024-09-13T02:50:27.455 INFO:tasks.workunit.client.0.smithi100.stdout:6/45: readlink lb 0 2024-09-13T02:50:27.460 INFO:tasks.workunit.client.0.smithi100.stdout:8/67: mknod df/c1e 0 2024-09-13T02:50:27.460 INFO:tasks.workunit.client.0.smithi100.stdout:6/46: dread f2 [0,4194304] 0 2024-09-13T02:50:27.461 INFO:tasks.workunit.client.0.smithi100.stdout:3/37: symlink ld 0 2024-09-13T02:50:27.463 INFO:tasks.workunit.client.0.smithi100.stdout:3/38: creat fe x:0 0 0 2024-09-13T02:50:27.463 INFO:tasks.workunit.client.0.smithi100.stdout:9/82: dwrite fc [0,4194304] 0 2024-09-13T02:50:27.464 INFO:tasks.workunit.client.0.smithi100.stdout:5/18: sync 2024-09-13T02:50:27.465 INFO:tasks.workunit.client.0.smithi100.stdout:3/39: unlink f5 0 2024-09-13T02:50:27.465 INFO:tasks.workunit.client.0.smithi100.stdout:3/40: chown f4 3 1 2024-09-13T02:50:27.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/58: write f1 [2573697,92020] 0 2024-09-13T02:50:27.469 INFO:tasks.workunit.client.0.smithi100.stdout:3/41: truncate f2 2580554 0 2024-09-13T02:50:27.469 INFO:tasks.workunit.client.0.smithi100.stdout:6/47: dread f2 [0,4194304] 0 2024-09-13T02:50:27.469 INFO:tasks.workunit.client.0.smithi100.stdout:3/42: write fc [504043,119279] 0 2024-09-13T02:50:27.470 INFO:tasks.workunit.client.0.smithi100.stdout:9/83: rmdir dd 39 2024-09-13T02:50:27.471 INFO:tasks.workunit.client.0.smithi100.stdout:6/48: getdents . 0 2024-09-13T02:50:27.472 INFO:tasks.workunit.client.0.smithi100.stdout:9/84: truncate dd/fe 383262 0 2024-09-13T02:50:27.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/38: dwrite d2/dd/fe [0,4194304] 0 2024-09-13T02:50:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/85: mknod dd/c17 0 2024-09-13T02:50:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:9/86: write dd/f10 [866809,72070] 0 2024-09-13T02:50:27.474 INFO:tasks.workunit.client.0.smithi100.stdout:8/68: write df/d13/f16 [3528708,112473] 0 2024-09-13T02:50:27.476 INFO:tasks.workunit.client.0.smithi100.stdout:9/87: dread dd/ff [0,4194304] 0 2024-09-13T02:50:27.477 INFO:tasks.workunit.client.0.smithi100.stdout:5/19: dread f4 [0,4194304] 0 2024-09-13T02:50:27.478 INFO:tasks.workunit.client.0.smithi100.stdout:5/20: truncate f4 3183272 0 2024-09-13T02:50:27.480 INFO:tasks.workunit.client.0.smithi100.stdout:0/39: getdents d2 0 2024-09-13T02:50:27.482 INFO:tasks.workunit.client.0.smithi100.stdout:5/21: mknod c7 0 2024-09-13T02:50:27.482 INFO:tasks.workunit.client.0.smithi100.stdout:6/49: dread f7 [4194304,4194304] 0 2024-09-13T02:50:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/22: write f0 [4380434,51395] 0 2024-09-13T02:50:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/23: write f0 [948264,20812] 0 2024-09-13T02:50:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/24: creat f8 x:0 0 0 2024-09-13T02:50:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:5/25: creat f9 x:0 0 0 2024-09-13T02:50:27.484 INFO:tasks.workunit.client.0.smithi100.stdout:0/40: unlink d2/f3 0 2024-09-13T02:50:27.486 INFO:tasks.workunit.client.0.smithi100.stdout:6/50: creat fc x:0 0 0 2024-09-13T02:50:27.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/88: truncate dd/fe 463458 0 2024-09-13T02:50:27.488 INFO:tasks.workunit.client.0.smithi100.stdout:9/89: chown dd/fe 7 1 2024-09-13T02:50:27.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/65: sync 2024-09-13T02:50:27.491 INFO:tasks.workunit.client.0.smithi100.stdout:2/66: fdatasync d0/f6 0 2024-09-13T02:50:27.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/26: unlink f0 0 2024-09-13T02:50:27.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/27: truncate f8 881758 0 2024-09-13T02:50:27.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/28: creat fa x:0 0 0 2024-09-13T02:50:27.493 INFO:tasks.workunit.client.0.smithi100.stdout:5/29: stat l6 0 2024-09-13T02:50:27.494 INFO:tasks.workunit.client.0.smithi100.stdout:5/30: truncate f9 947242 0 2024-09-13T02:50:27.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/67: write d0/f6 [1266675,43882] 0 2024-09-13T02:50:27.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/68: write d0/f1 [1588419,54295] 0 2024-09-13T02:50:27.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/69: write d0/f11 [5109805,48140] 0 2024-09-13T02:50:27.494 INFO:tasks.workunit.client.0.smithi100.stdout:2/70: write d0/db/fd [655991,57386] 0 2024-09-13T02:50:27.495 INFO:tasks.workunit.client.0.smithi100.stdout:0/41: symlink d2/dd/lf 0 2024-09-13T02:50:27.495 INFO:tasks.workunit.client.0.smithi100.stdout:0/42: creat d2/dd/f10 x:0 0 0 2024-09-13T02:50:27.496 INFO:tasks.workunit.client.0.smithi100.stdout:9/90: getdents dd 0 2024-09-13T02:50:27.498 INFO:tasks.workunit.client.0.smithi100.stdout:2/71: unlink d0/db/fd 0 2024-09-13T02:50:27.499 INFO:tasks.workunit.client.0.smithi100.stdout:2/72: write d0/f11 [4652461,110156] 0 2024-09-13T02:50:27.499 INFO:tasks.workunit.client.0.smithi100.stdout:2/73: fdatasync d0/db/f12 0 2024-09-13T02:50:27.500 INFO:tasks.workunit.client.0.smithi100.stdout:0/43: creat d2/f11 x:0 0 0 2024-09-13T02:50:27.504 INFO:tasks.workunit.client.0.smithi100.stdout:3/43: dwrite f8 [4194304,4194304] 0 2024-09-13T02:50:27.507 INFO:tasks.workunit.client.0.smithi100.stdout:3/44: link ld lf 0 2024-09-13T02:50:27.507 INFO:tasks.workunit.client.0.smithi100.stdout:3/45: chown fe 0 1 2024-09-13T02:50:27.510 INFO:tasks.workunit.client.0.smithi100.stdout:2/74: read d0/db/ff [2932754,126171] 0 2024-09-13T02:50:27.521 INFO:tasks.workunit.client.0.smithi100.stdout:2/75: read d0/fe [147178,112089] 0 2024-09-13T02:50:27.521 INFO:tasks.workunit.client.0.smithi100.stdout:2/76: stat d0/db/ff 0 2024-09-13T02:50:27.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/59: dwrite f1 [4194304,4194304] 0 2024-09-13T02:50:27.524 INFO:tasks.workunit.client.0.smithi100.stdout:2/77: link d0/la d0/db/l13 0 2024-09-13T02:50:27.524 INFO:tasks.workunit.client.0.smithi100.stdout:2/78: chown d0/l9 344861 1 2024-09-13T02:50:27.525 INFO:tasks.workunit.client.0.smithi100.stdout:1/60: truncate fd 3844726 0 2024-09-13T02:50:27.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/51: dwrite fc [0,4194304] 0 2024-09-13T02:50:27.527 INFO:tasks.workunit.client.0.smithi100.stdout:1/61: mknod de/c15 0 2024-09-13T02:50:27.528 INFO:tasks.workunit.client.0.smithi100.stdout:9/91: write dd/fe [722162,125469] 0 2024-09-13T02:50:27.530 INFO:tasks.workunit.client.0.smithi100.stdout:5/31: dwrite f8 [0,4194304] 0 2024-09-13T02:50:27.530 INFO:tasks.workunit.client.0.smithi100.stdout:0/44: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:27.531 INFO:tasks.workunit.client.0.smithi100.stdout:6/52: rename lb to ld 0 2024-09-13T02:50:27.531 INFO:tasks.workunit.client.0.smithi100.stdout:5/32: fsync f9 0 2024-09-13T02:50:27.531 INFO:tasks.workunit.client.0.smithi100.stdout:3/46: dwrite fc [0,4194304] 0 2024-09-13T02:50:27.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/47: truncate fc 4503798 0 2024-09-13T02:50:27.533 INFO:tasks.workunit.client.0.smithi100.stdout:9/92: mknod dd/c18 0 2024-09-13T02:50:27.538 INFO:tasks.workunit.client.0.smithi100.stdout:6/53: mknod ce 0 2024-09-13T02:50:27.539 INFO:tasks.workunit.client.0.smithi100.stdout:6/54: chown ca 45 1 2024-09-13T02:50:27.540 INFO:tasks.workunit.client.0.smithi100.stdout:1/62: dwrite de/f11 [0,4194304] 0 2024-09-13T02:50:27.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/79: getdents d0/db 0 2024-09-13T02:50:27.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/80: fdatasync d0/db/ff 0 2024-09-13T02:50:27.548 INFO:tasks.workunit.client.0.smithi100.stdout:6/55: write fc [16821,23048] 0 2024-09-13T02:50:27.549 INFO:tasks.workunit.client.0.smithi100.stdout:9/93: link dd/fe dd/f19 0 2024-09-13T02:50:27.549 INFO:tasks.workunit.client.0.smithi100.stdout:9/94: truncate dd/f12 422720 0 2024-09-13T02:50:27.553 INFO:tasks.workunit.client.0.smithi100.stdout:5/33: truncate f9 494749 0 2024-09-13T02:50:27.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/81: link d0/c8 d0/c14 0 2024-09-13T02:50:27.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/82: chown d0/db/ff 309375221 1 2024-09-13T02:50:27.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/56: symlink lf 0 2024-09-13T02:50:27.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/57: write f2 [3731270,81715] 0 2024-09-13T02:50:27.556 INFO:tasks.workunit.client.0.smithi100.stdout:3/48: mkdir d10 0 2024-09-13T02:50:27.559 INFO:tasks.workunit.client.0.smithi100.stdout:5/34: mkdir db 0 2024-09-13T02:50:27.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/83: creat d0/f15 x:0 0 0 2024-09-13T02:50:27.560 INFO:tasks.workunit.client.0.smithi100.stdout:2/84: read d0/db/f12 [19117,65734] 0 2024-09-13T02:50:27.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/49: creat d10/f11 x:0 0 0 2024-09-13T02:50:27.564 INFO:tasks.workunit.client.0.smithi100.stdout:5/35: mknod db/cc 0 2024-09-13T02:50:27.565 INFO:tasks.workunit.client.0.smithi100.stdout:2/85: creat d0/db/f16 x:0 0 0 2024-09-13T02:50:27.565 INFO:tasks.workunit.client.0.smithi100.stdout:2/86: write d0/f4 [8701645,22721] 0 2024-09-13T02:50:27.567 INFO:tasks.workunit.client.0.smithi100.stdout:9/95: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:50:27.567 INFO:tasks.workunit.client.0.smithi100.stdout:5/36: write f9 [1242532,59355] 0 2024-09-13T02:50:27.569 INFO:tasks.workunit.client.0.smithi100.stdout:1/63: dwrite fd [4194304,4194304] 0 2024-09-13T02:50:27.570 INFO:tasks.workunit.client.0.smithi100.stdout:9/96: creat dd/f1a x:0 0 0 2024-09-13T02:50:27.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/37: mknod db/cd 0 2024-09-13T02:50:27.571 INFO:tasks.workunit.client.0.smithi100.stdout:6/58: getdents . 0 2024-09-13T02:50:27.581 INFO:tasks.workunit.client.0.smithi100.stdout:5/38: mkdir db/de 0 2024-09-13T02:50:27.581 INFO:tasks.workunit.client.0.smithi100.stdout:9/97: dread dd/f15 [0,4194304] 0 2024-09-13T02:50:27.592 INFO:tasks.workunit.client.0.smithi100.stdout:9/98: write f5 [3471059,5520] 0 2024-09-13T02:50:27.600 INFO:tasks.workunit.client.0.smithi100.stdout:3/50: dwrite f4 [0,4194304] 0 2024-09-13T02:50:27.600 INFO:tasks.workunit.client.0.smithi100.stdout:3/51: creat d10/f12 x:0 0 0 2024-09-13T02:50:27.600 INFO:tasks.workunit.client.0.smithi100.stdout:3/52: stat l6 0 2024-09-13T02:50:27.600 INFO:tasks.workunit.client.0.smithi100.stdout:0/45: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:50:27.601 INFO:tasks.workunit.client.0.smithi100.stdout:2/87: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T02:50:27.602 INFO:tasks.workunit.client.0.smithi100.stdout:1/64: dwrite de/ff [0,4194304] 0 2024-09-13T02:50:27.604 INFO:tasks.workunit.client.0.smithi100.stdout:3/53: rename l0 to d10/l13 0 2024-09-13T02:50:27.604 INFO:tasks.workunit.client.0.smithi100.stdout:3/54: read - fe zero size 2024-09-13T02:50:27.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/99: dread f9 [0,4194304] 0 2024-09-13T02:50:27.609 INFO:tasks.workunit.client.0.smithi100.stdout:1/65: mknod de/d12/c16 0 2024-09-13T02:50:27.613 INFO:tasks.workunit.client.0.smithi100.stdout:3/55: mknod d10/c14 0 2024-09-13T02:50:27.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/29: sync 2024-09-13T02:50:27.614 INFO:tasks.workunit.client.0.smithi100.stdout:7/63: sync 2024-09-13T02:50:27.614 INFO:tasks.workunit.client.0.smithi100.stdout:2/88: rmdir d0/db 39 2024-09-13T02:50:27.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/66: rename de/ff to de/d12/f17 0 2024-09-13T02:50:27.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/67: chown de/d12/l13 47 1 2024-09-13T02:50:27.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/68: fdatasync f1 0 2024-09-13T02:50:27.619 INFO:tasks.workunit.client.0.smithi100.stdout:7/64: symlink d3/d5/l13 0 2024-09-13T02:50:27.619 INFO:tasks.workunit.client.0.smithi100.stdout:7/65: dread - d3/d5/fe zero size 2024-09-13T02:50:27.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/89: creat d0/db/f17 x:0 0 0 2024-09-13T02:50:27.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/90: fdatasync d0/db/f17 0 2024-09-13T02:50:27.620 INFO:tasks.workunit.client.0.smithi100.stdout:2/91: creat d0/f18 x:0 0 0 2024-09-13T02:50:27.621 INFO:tasks.workunit.client.0.smithi100.stdout:7/66: mknod d3/d5/c14 0 2024-09-13T02:50:27.622 INFO:tasks.workunit.client.0.smithi100.stdout:7/67: dread d3/fc [0,4194304] 0 2024-09-13T02:50:27.622 INFO:tasks.workunit.client.0.smithi100.stdout:7/68: chown d3/fa 13752 1 2024-09-13T02:50:27.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/69: getdents d3 0 2024-09-13T02:50:27.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/70: readlink d3/l12 0 2024-09-13T02:50:27.623 INFO:tasks.workunit.client.0.smithi100.stdout:7/71: write d3/fa [4497321,109627] 0 2024-09-13T02:50:27.625 INFO:tasks.workunit.client.0.smithi100.stdout:7/72: unlink d3/d5/c14 0 2024-09-13T02:50:27.626 INFO:tasks.workunit.client.0.smithi100.stdout:6/59: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/60: fdatasync f7 0 2024-09-13T02:50:27.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/56: fsync d10/f12 0 2024-09-13T02:50:27.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/57: creat d10/f15 x:0 0 0 2024-09-13T02:50:27.633 INFO:tasks.workunit.client.0.smithi100.stdout:8/69: sync 2024-09-13T02:50:27.635 INFO:tasks.workunit.client.0.smithi100.stdout:8/70: symlink df/d13/d17/l1f 0 2024-09-13T02:50:27.639 INFO:tasks.workunit.client.0.smithi100.stdout:6/61: write f2 [414199,28451] 0 2024-09-13T02:50:27.639 INFO:tasks.workunit.client.0.smithi100.stdout:6/62: readlink l1 0 2024-09-13T02:50:27.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/69: getdents de/d12 0 2024-09-13T02:50:27.640 INFO:tasks.workunit.client.0.smithi100.stdout:1/70: truncate fd 4605637 0 2024-09-13T02:50:27.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/30: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T02:50:27.641 INFO:tasks.workunit.client.0.smithi100.stdout:0/46: dwrite d2/f11 [0,4194304] 0 2024-09-13T02:50:27.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/31: mkdir d3/d6/d9 0 2024-09-13T02:50:27.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/32: mknod d3/d6/d9/ca 0 2024-09-13T02:50:27.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/33: readlink d3/l5 0 2024-09-13T02:50:27.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/34: creat d3/fb x:0 0 0 2024-09-13T02:50:27.647 INFO:tasks.workunit.client.0.smithi100.stdout:6/63: write f7 [5680265,54990] 0 2024-09-13T02:50:27.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/64: rename lf to l10 0 2024-09-13T02:50:27.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/65: fsync fc 0 2024-09-13T02:50:27.650 INFO:tasks.workunit.client.0.smithi100.stdout:6/66: symlink l11 0 2024-09-13T02:50:27.650 INFO:tasks.workunit.client.0.smithi100.stdout:6/67: write fc [4667639,79463] 0 2024-09-13T02:50:27.651 INFO:tasks.workunit.client.0.smithi100.stdout:6/68: chown ld 253293351 1 2024-09-13T02:50:27.651 INFO:tasks.workunit.client.0.smithi100.stdout:6/69: write fc [5300577,4057] 0 2024-09-13T02:50:27.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/47: dread d2/dd/fe [0,4194304] 0 2024-09-13T02:50:27.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/73: dwrite d3/d5/fe [0,4194304] 0 2024-09-13T02:50:27.652 INFO:tasks.workunit.client.0.smithi100.stdout:1/71: dread de/d12/f17 [0,4194304] 0 2024-09-13T02:50:27.653 INFO:tasks.workunit.client.0.smithi100.stdout:2/92: dwrite d0/f15 [0,4194304] 0 2024-09-13T02:50:27.655 INFO:tasks.workunit.client.0.smithi100.stdout:3/58: dwrite fb [0,4194304] 0 2024-09-13T02:50:27.655 INFO:tasks.workunit.client.0.smithi100.stdout:3/59: truncate f4 4569767 0 2024-09-13T02:50:27.657 INFO:tasks.workunit.client.0.smithi100.stdout:8/71: rename df/d13/d17 to df/d13/d20 0 2024-09-13T02:50:27.661 INFO:tasks.workunit.client.0.smithi100.stdout:2/93: link d0/f6 d0/f19 0 2024-09-13T02:50:27.661 INFO:tasks.workunit.client.0.smithi100.stdout:2/94: fdatasync d0/db/f12 0 2024-09-13T02:50:27.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/60: link d10/f12 d10/f16 0 2024-09-13T02:50:27.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/61: chown fc 2972 1 2024-09-13T02:50:27.667 INFO:tasks.workunit.client.0.smithi100.stdout:4/35: truncate d3/f4 2132910 0 2024-09-13T02:50:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:3/62: mkdir d10/d17 0 2024-09-13T02:50:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:3/63: chown fe 75 1 2024-09-13T02:50:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:3/64: chown f9 307492269 1 2024-09-13T02:50:27.673 INFO:tasks.workunit.client.0.smithi100.stdout:3/65: chown l6 16 1 2024-09-13T02:50:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/36: mkdir d3/dc 0 2024-09-13T02:50:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:2/95: write d0/f1 [1104660,17324] 0 2024-09-13T02:50:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:2/96: fdatasync d0/f11 0 2024-09-13T02:50:27.675 INFO:tasks.workunit.client.0.smithi100.stdout:8/72: mkdir df/d13/d21 0 2024-09-13T02:50:27.676 INFO:tasks.workunit.client.0.smithi100.stdout:3/66: truncate f3 421553 0 2024-09-13T02:50:27.677 INFO:tasks.workunit.client.0.smithi100.stdout:2/97: unlink d0/c14 0 2024-09-13T02:50:27.678 INFO:tasks.workunit.client.0.smithi100.stdout:8/73: creat df/d13/d21/f22 x:0 0 0 2024-09-13T02:50:27.678 INFO:tasks.workunit.client.0.smithi100.stdout:8/74: chown df/d13/d20/d18 1774 1 2024-09-13T02:50:27.678 INFO:tasks.workunit.client.0.smithi100.stdout:8/75: fdatasync fb 0 2024-09-13T02:50:27.678 INFO:tasks.workunit.client.0.smithi100.stdout:8/76: readlink df/d13/d20/l1f 0 2024-09-13T02:50:27.680 INFO:tasks.workunit.client.0.smithi100.stdout:8/77: creat df/d13/d20/f23 x:0 0 0 2024-09-13T02:50:27.680 INFO:tasks.workunit.client.0.smithi100.stdout:8/78: read - df/d13/d21/f22 zero size 2024-09-13T02:50:27.680 INFO:tasks.workunit.client.0.smithi100.stdout:8/79: creat df/d13/d20/d18/f24 x:0 0 0 2024-09-13T02:50:27.681 INFO:tasks.workunit.client.0.smithi100.stdout:8/80: mknod df/d13/d20/c25 0 2024-09-13T02:50:27.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/81: mknod df/d13/d21/c26 0 2024-09-13T02:50:27.682 INFO:tasks.workunit.client.0.smithi100.stdout:8/82: write f3 [237329,115581] 0 2024-09-13T02:50:27.684 INFO:tasks.workunit.client.0.smithi100.stdout:8/83: creat df/d13/d20/f27 x:0 0 0 2024-09-13T02:50:27.684 INFO:tasks.workunit.client.0.smithi100.stdout:8/84: chown df/l10 1756 1 2024-09-13T02:50:27.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/72: dwrite de/d12/f17 [0,4194304] 0 2024-09-13T02:50:27.684 INFO:tasks.workunit.client.0.smithi100.stdout:3/67: write f2 [1148838,118144] 0 2024-09-13T02:50:27.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/73: symlink de/l18 0 2024-09-13T02:50:27.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/85: mknod df/d13/c28 0 2024-09-13T02:50:27.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/86: dread - df/d13/f19 zero size 2024-09-13T02:50:27.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/87: creat df/d13/d21/f29 x:0 0 0 2024-09-13T02:50:27.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/88: read fb [207503,92353] 0 2024-09-13T02:50:27.688 INFO:tasks.workunit.client.0.smithi100.stdout:3/68: rmdir d10/d17 0 2024-09-13T02:50:27.690 INFO:tasks.workunit.client.0.smithi100.stdout:0/48: dwrite d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:27.690 INFO:tasks.workunit.client.0.smithi100.stdout:8/89: mknod df/d13/c2a 0 2024-09-13T02:50:27.691 INFO:tasks.workunit.client.0.smithi100.stdout:8/90: creat df/f2b x:0 0 0 2024-09-13T02:50:27.691 INFO:tasks.workunit.client.0.smithi100.stdout:6/70: dwrite fc [0,4194304] 0 2024-09-13T02:50:27.691 INFO:tasks.workunit.client.0.smithi100.stdout:7/74: dwrite d3/fc [0,4194304] 0 2024-09-13T02:50:27.694 INFO:tasks.workunit.client.0.smithi100.stdout:0/49: mkdir d2/dd/d12 0 2024-09-13T02:50:27.696 INFO:tasks.workunit.client.0.smithi100.stdout:8/91: mkdir df/d13/d20/d18/d2c 0 2024-09-13T02:50:27.696 INFO:tasks.workunit.client.0.smithi100.stdout:8/92: rename df/d13/d20 to df/d13/d20/d2d 22 2024-09-13T02:50:27.696 INFO:tasks.workunit.client.0.smithi100.stdout:8/93: readlink df/d13/d20/l1f 0 2024-09-13T02:50:27.697 INFO:tasks.workunit.client.0.smithi100.stdout:6/71: mkdir d12 0 2024-09-13T02:50:27.697 INFO:tasks.workunit.client.0.smithi100.stdout:0/50: write d2/dd/fe [2753904,4149] 0 2024-09-13T02:50:27.700 INFO:tasks.workunit.client.0.smithi100.stdout:3/69: fsync d10/f12 0 2024-09-13T02:50:27.700 INFO:tasks.workunit.client.0.smithi100.stdout:7/75: read d3/fc [2652234,6534] 0 2024-09-13T02:50:27.703 INFO:tasks.workunit.client.0.smithi100.stdout:1/74: dwrite fd [0,4194304] 0 2024-09-13T02:50:27.704 INFO:tasks.workunit.client.0.smithi100.stdout:8/94: mkdir df/d13/d20/d18/d2c/d2e 0 2024-09-13T02:50:27.704 INFO:tasks.workunit.client.0.smithi100.stdout:8/95: read df/d13/f16 [741862,61638] 0 2024-09-13T02:50:27.704 INFO:tasks.workunit.client.0.smithi100.stdout:8/96: write df/f1a [243467,108791] 0 2024-09-13T02:50:27.704 INFO:tasks.workunit.client.0.smithi100.stdout:6/72: symlink d12/l13 0 2024-09-13T02:50:27.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/51: mknod d2/dd/c13 0 2024-09-13T02:50:27.707 INFO:tasks.workunit.client.0.smithi100.stdout:3/70: symlink d10/l18 0 2024-09-13T02:50:27.708 INFO:tasks.workunit.client.0.smithi100.stdout:7/76: creat d3/f15 x:0 0 0 2024-09-13T02:50:27.708 INFO:tasks.workunit.client.0.smithi100.stdout:7/77: truncate d3/f11 1586683 0 2024-09-13T02:50:27.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/97: truncate f2 3697763 0 2024-09-13T02:50:27.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/98: write df/d13/d21/f22 [147915,54165] 0 2024-09-13T02:50:27.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/99: readlink df/d13/d20/d18/l1b 0 2024-09-13T02:50:27.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/100: chown df/d13/d20 184 1 2024-09-13T02:50:27.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/101: write df/d13/f16 [1197973,59544] 0 2024-09-13T02:50:27.710 INFO:tasks.workunit.client.0.smithi100.stdout:2/98: getdents d0 0 2024-09-13T02:50:27.710 INFO:tasks.workunit.client.0.smithi100.stdout:4/37: write f2 [2019488,43631] 0 2024-09-13T02:50:27.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/73: mkdir d12/d14 0 2024-09-13T02:50:27.712 INFO:tasks.workunit.client.0.smithi100.stdout:1/75: dread f8 [0,4194304] 0 2024-09-13T02:50:27.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/99: read d0/f1 [1409488,111508] 0 2024-09-13T02:50:27.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/100: dread - d0/db/f16 zero size 2024-09-13T02:50:27.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/101: chown d0 2430 1 2024-09-13T02:50:27.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/102: creat d0/db/f1a x:0 0 0 2024-09-13T02:50:27.714 INFO:tasks.workunit.client.0.smithi100.stdout:3/71: symlink d10/l19 0 2024-09-13T02:50:27.716 INFO:tasks.workunit.client.0.smithi100.stdout:4/38: creat d3/d6/d9/fd x:0 0 0 2024-09-13T02:50:27.716 INFO:tasks.workunit.client.0.smithi100.stdout:7/78: dread d3/d5/fe [0,4194304] 0 2024-09-13T02:50:27.718 INFO:tasks.workunit.client.0.smithi100.stdout:6/74: truncate f7 7949733 0 2024-09-13T02:50:27.721 INFO:tasks.workunit.client.0.smithi100.stdout:2/103: mknod d0/db/c1b 0 2024-09-13T02:50:27.721 INFO:tasks.workunit.client.0.smithi100.stdout:2/104: write d0/f1 [1337630,47651] 0 2024-09-13T02:50:27.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/72: mknod d10/c1a 0 2024-09-13T02:50:27.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/73: dread - d10/f12 zero size 2024-09-13T02:50:27.723 INFO:tasks.workunit.client.0.smithi100.stdout:0/52: write d2/d9/fb [978634,104328] 0 2024-09-13T02:50:27.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/39: mknod d3/d6/d9/ce 0 2024-09-13T02:50:27.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/40: rename d3 to d3/dc/df 22 2024-09-13T02:50:27.725 INFO:tasks.workunit.client.0.smithi100.stdout:4/41: write d3/f4 [3128828,73407] 0 2024-09-13T02:50:27.726 INFO:tasks.workunit.client.0.smithi100.stdout:4/42: readlink d3/l5 0 2024-09-13T02:50:27.726 INFO:tasks.workunit.client.0.smithi100.stdout:4/43: chown f0 70695908 1 2024-09-13T02:50:27.726 INFO:tasks.workunit.client.0.smithi100.stdout:4/44: read d3/f4 [597867,69776] 0 2024-09-13T02:50:27.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/79: unlink d3/l9 0 2024-09-13T02:50:27.727 INFO:tasks.workunit.client.0.smithi100.stdout:6/75: mknod d12/c15 0 2024-09-13T02:50:27.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/74: dread f4 [0,4194304] 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/75: read f9 [60455,21631] 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/76: truncate d10/f16 513476 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/77: write d10/f11 [138242,3230] 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/78: chown f2 64478 1 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/79: fsync f3 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/80: creat d10/f1b x:0 0 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/81: write d10/f16 [1027215,85840] 0 2024-09-13T02:50:27.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/82: truncate fe 342072 0 2024-09-13T02:50:27.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/105: symlink d0/l1c 0 2024-09-13T02:50:27.731 INFO:tasks.workunit.client.0.smithi100.stdout:2/106: chown d0/db/f1a 3 1 2024-09-13T02:50:27.732 INFO:tasks.workunit.client.0.smithi100.stdout:4/45: creat d3/d6/f10 x:0 0 0 2024-09-13T02:50:27.733 INFO:tasks.workunit.client.0.smithi100.stdout:9/100: sync 2024-09-13T02:50:27.733 INFO:tasks.workunit.client.0.smithi100.stdout:5/39: sync 2024-09-13T02:50:27.733 INFO:tasks.workunit.client.0.smithi100.stdout:7/80: mkdir d3/d16 0 2024-09-13T02:50:27.735 INFO:tasks.workunit.client.0.smithi100.stdout:3/83: symlink d10/l1c 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/81: write d3/fa [3889872,63863] 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/82: creat d3/d5/f17 x:0 0 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/83: readlink d3/d5/l13 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/84: creat d3/f18 x:0 0 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:7/85: truncate d3/f11 2047030 0 2024-09-13T02:50:27.738 INFO:tasks.workunit.client.0.smithi100.stdout:2/107: write d0/f15 [3917304,126477] 0 2024-09-13T02:50:27.739 INFO:tasks.workunit.client.0.smithi100.stdout:9/101: dread f9 [0,4194304] 0 2024-09-13T02:50:27.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/86: mknod d3/d16/c19 0 2024-09-13T02:50:27.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/87: readlink d3/d5/l10 0 2024-09-13T02:50:27.742 INFO:tasks.workunit.client.0.smithi100.stdout:7/88: readlink d3/d5/l13 0 2024-09-13T02:50:27.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/102: truncate f9 816758 0 2024-09-13T02:50:27.743 INFO:tasks.workunit.client.0.smithi100.stdout:9/103: write dd/ff [1038665,14316] 0 2024-09-13T02:50:27.744 INFO:tasks.workunit.client.0.smithi100.stdout:3/84: write f8 [4433787,96416] 0 2024-09-13T02:50:27.747 INFO:tasks.workunit.client.0.smithi100.stdout:2/108: dread d0/db/f12 [0,4194304] 0 2024-09-13T02:50:27.747 INFO:tasks.workunit.client.0.smithi100.stdout:3/85: unlink ca 0 2024-09-13T02:50:27.748 INFO:tasks.workunit.client.0.smithi100.stdout:9/104: getdents dd 0 2024-09-13T02:50:27.749 INFO:tasks.workunit.client.0.smithi100.stdout:5/40: dwrite f8 [0,4194304] 0 2024-09-13T02:50:27.750 INFO:tasks.workunit.client.0.smithi100.stdout:3/86: mknod d10/c1d 0 2024-09-13T02:50:27.750 INFO:tasks.workunit.client.0.smithi100.stdout:3/87: readlink d10/l13 0 2024-09-13T02:50:27.750 INFO:tasks.workunit.client.0.smithi100.stdout:3/88: dread - d10/f1b zero size 2024-09-13T02:50:27.750 INFO:tasks.workunit.client.0.smithi100.stdout:9/105: mkdir dd/d1b 0 2024-09-13T02:50:27.751 INFO:tasks.workunit.client.0.smithi100.stdout:2/109: dread d0/db/ff [0,4194304] 0 2024-09-13T02:50:27.751 INFO:tasks.workunit.client.0.smithi100.stdout:5/41: truncate f9 446668 0 2024-09-13T02:50:27.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/46: rmdir d3/d6/d9 39 2024-09-13T02:50:27.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/47: chown d3 0 1 2024-09-13T02:50:27.753 INFO:tasks.workunit.client.0.smithi100.stdout:6/76: dread f7 [4194304,4194304] 0 2024-09-13T02:50:27.753 INFO:tasks.workunit.client.0.smithi100.stdout:3/89: mknod d10/c1e 0 2024-09-13T02:50:27.755 INFO:tasks.workunit.client.0.smithi100.stdout:2/110: truncate d0/db/f12 1867694 0 2024-09-13T02:50:27.755 INFO:tasks.workunit.client.0.smithi100.stdout:3/90: fsync d10/f12 0 2024-09-13T02:50:27.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/76: truncate fd 3517995 0 2024-09-13T02:50:27.757 INFO:tasks.workunit.client.0.smithi100.stdout:6/77: creat d12/f16 x:0 0 0 2024-09-13T02:50:27.758 INFO:tasks.workunit.client.0.smithi100.stdout:9/106: mknod dd/c1c 0 2024-09-13T02:50:27.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/91: truncate f2 563292 0 2024-09-13T02:50:27.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/92: dread - d10/f15 zero size 2024-09-13T02:50:27.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/77: link de/c10 de/d14/c19 0 2024-09-13T02:50:27.763 INFO:tasks.workunit.client.0.smithi100.stdout:1/78: fdatasync de/f11 0 2024-09-13T02:50:27.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/79: write de/d12/f17 [1518283,88203] 0 2024-09-13T02:50:27.765 INFO:tasks.workunit.client.0.smithi100.stdout:9/107: mkdir dd/d1b/d1d 0 2024-09-13T02:50:27.768 INFO:tasks.workunit.client.0.smithi100.stdout:1/80: creat de/d14/f1a x:0 0 0 2024-09-13T02:50:27.769 INFO:tasks.workunit.client.0.smithi100.stdout:7/89: getdents d3/d5 0 2024-09-13T02:50:27.770 INFO:tasks.workunit.client.0.smithi100.stdout:1/81: creat de/d12/f1b x:0 0 0 2024-09-13T02:50:27.770 INFO:tasks.workunit.client.0.smithi100.stdout:9/108: mkdir dd/d1e 0 2024-09-13T02:50:27.772 INFO:tasks.workunit.client.0.smithi100.stdout:7/90: creat d3/d5/f1a x:0 0 0 2024-09-13T02:50:27.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/109: stat dd/f19 0 2024-09-13T02:50:27.774 INFO:tasks.workunit.client.0.smithi100.stdout:4/48: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.774 INFO:tasks.workunit.client.0.smithi100.stdout:4/49: fdatasync d3/d6/d9/fd 0 2024-09-13T02:50:27.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/91: truncate d3/fc 1881901 0 2024-09-13T02:50:27.776 INFO:tasks.workunit.client.0.smithi100.stdout:9/110: stat dd/c18 0 2024-09-13T02:50:27.777 INFO:tasks.workunit.client.0.smithi100.stdout:4/50: rmdir d3/d6/d9 39 2024-09-13T02:50:27.779 INFO:tasks.workunit.client.0.smithi100.stdout:9/111: creat dd/d1b/d1d/f1f x:0 0 0 2024-09-13T02:50:27.780 INFO:tasks.workunit.client.0.smithi100.stdout:2/111: fsync d0/db/f12 0 2024-09-13T02:50:27.782 INFO:tasks.workunit.client.0.smithi100.stdout:6/78: fsync d12/f16 0 2024-09-13T02:50:27.783 INFO:tasks.workunit.client.0.smithi100.stdout:2/112: symlink d0/db/l1d 0 2024-09-13T02:50:27.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/51: rmdir d3/d6 39 2024-09-13T02:50:27.784 INFO:tasks.workunit.client.0.smithi100.stdout:4/52: readlink d3/l5 0 2024-09-13T02:50:27.786 INFO:tasks.workunit.client.0.smithi100.stdout:1/82: unlink fd 0 2024-09-13T02:50:27.792 INFO:tasks.workunit.client.0.smithi100.stdout:5/42: truncate f8 395379 0 2024-09-13T02:50:27.792 INFO:tasks.workunit.client.0.smithi100.stdout:5/43: write f9 [1366318,22519] 0 2024-09-13T02:50:27.794 INFO:tasks.workunit.client.0.smithi100.stdout:2/113: dread d0/f11 [0,4194304] 0 2024-09-13T02:50:27.795 INFO:tasks.workunit.client.0.smithi100.stdout:2/114: write d0/db/f1a [174300,104419] 0 2024-09-13T02:50:27.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/44: rename f9 to db/ff 0 2024-09-13T02:50:27.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/45: chown db/cc 51698603 1 2024-09-13T02:50:27.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/46: rename c7 to db/de/c10 0 2024-09-13T02:50:27.797 INFO:tasks.workunit.client.0.smithi100.stdout:1/83: fsync de/d12/f1b 0 2024-09-13T02:50:27.797 INFO:tasks.workunit.client.0.smithi100.stdout:2/115: dread d0/db/ff [0,4194304] 0 2024-09-13T02:50:27.797 INFO:tasks.workunit.client.0.smithi100.stdout:2/116: chown d0/db/f12 9 1 2024-09-13T02:50:27.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/47: creat db/f11 x:0 0 0 2024-09-13T02:50:27.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/48: fdatasync f4 0 2024-09-13T02:50:27.802 INFO:tasks.workunit.client.0.smithi100.stdout:9/112: dread dd/ff [0,4194304] 0 2024-09-13T02:50:27.803 INFO:tasks.workunit.client.0.smithi100.stdout:5/49: creat db/de/f12 x:0 0 0 2024-09-13T02:50:27.803 INFO:tasks.workunit.client.0.smithi100.stdout:5/50: fdatasync db/de/f12 0 2024-09-13T02:50:27.805 INFO:tasks.workunit.client.0.smithi100.stdout:9/113: mknod dd/d1b/d1d/c20 0 2024-09-13T02:50:27.807 INFO:tasks.workunit.client.0.smithi100.stdout:9/114: dread dd/ff [0,4194304] 0 2024-09-13T02:50:27.807 INFO:tasks.workunit.client.0.smithi100.stdout:1/84: dread de/f11 [0,4194304] 0 2024-09-13T02:50:27.809 INFO:tasks.workunit.client.0.smithi100.stdout:9/115: rename dd/d1e to dd/d1b/d21 0 2024-09-13T02:50:27.810 INFO:tasks.workunit.client.0.smithi100.stdout:1/85: link ca de/d14/c1c 0 2024-09-13T02:50:27.819 INFO:tasks.workunit.client.0.smithi100.stdout:7/92: dwrite f0 [0,4194304] 0 2024-09-13T02:50:27.819 INFO:tasks.workunit.client.0.smithi100.stdout:2/117: fsync d0/f15 0 2024-09-13T02:50:27.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/118: mknod d0/c1e 0 2024-09-13T02:50:27.824 INFO:tasks.workunit.client.0.smithi100.stdout:7/93: mkdir d3/d5/d1b 0 2024-09-13T02:50:27.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/51: getdents db 0 2024-09-13T02:50:27.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/52: write f8 [1023058,125372] 0 2024-09-13T02:50:27.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/53: fdatasync db/de/f12 0 2024-09-13T02:50:27.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/53: dwrite d3/fb [0,4194304] 0 2024-09-13T02:50:27.826 INFO:tasks.workunit.client.0.smithi100.stdout:5/54: mknod db/c13 0 2024-09-13T02:50:27.829 INFO:tasks.workunit.client.0.smithi100.stdout:3/93: dwrite f8 [4194304,4194304] 0 2024-09-13T02:50:27.829 INFO:tasks.workunit.client.0.smithi100.stdout:4/54: creat d3/d6/d9/f11 x:0 0 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/55: symlink db/de/l14 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/56: stat db/de/l14 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/57: write db/f11 [1042875,85656] 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/58: write db/f11 [1239876,131044] 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:5/59: creat db/de/f15 x:0 0 0 2024-09-13T02:50:27.830 INFO:tasks.workunit.client.0.smithi100.stdout:3/94: mkdir d10/d1f 0 2024-09-13T02:50:27.831 INFO:tasks.workunit.client.0.smithi100.stdout:4/55: creat d3/dc/f12 x:0 0 0 2024-09-13T02:50:27.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/86: dwrite de/d12/f1b [0,4194304] 0 2024-09-13T02:50:27.832 INFO:tasks.workunit.client.0.smithi100.stdout:1/87: write de/f11 [4311162,12752] 0 2024-09-13T02:50:27.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/79: dwrite d12/f16 [0,4194304] 0 2024-09-13T02:50:27.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/56: mkdir d3/d6/d13 0 2024-09-13T02:50:27.833 INFO:tasks.workunit.client.0.smithi100.stdout:1/88: dread f7 [0,4194304] 0 2024-09-13T02:50:27.835 INFO:tasks.workunit.client.0.smithi100.stdout:6/80: write fc [5193741,129790] 0 2024-09-13T02:50:27.835 INFO:tasks.workunit.client.0.smithi100.stdout:6/81: fsync d12/f16 0 2024-09-13T02:50:27.835 INFO:tasks.workunit.client.0.smithi100.stdout:6/82: read f7 [2505109,2440] 0 2024-09-13T02:50:27.837 INFO:tasks.workunit.client.0.smithi100.stdout:7/94: write d3/fa [1723984,37855] 0 2024-09-13T02:50:27.837 INFO:tasks.workunit.client.0.smithi100.stdout:7/95: write d3/f18 [310039,103008] 0 2024-09-13T02:50:27.837 INFO:tasks.workunit.client.0.smithi100.stdout:5/60: read f8 [408986,93833] 0 2024-09-13T02:50:27.838 INFO:tasks.workunit.client.0.smithi100.stdout:2/119: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:27.840 INFO:tasks.workunit.client.0.smithi100.stdout:1/89: truncate de/d12/f17 4192497 0 2024-09-13T02:50:27.843 INFO:tasks.workunit.client.0.smithi100.stdout:7/96: chown d3/d5/l13 12468 1 2024-09-13T02:50:27.843 INFO:tasks.workunit.client.0.smithi100.stdout:7/97: write f0 [4080680,104141] 0 2024-09-13T02:50:27.844 INFO:tasks.workunit.client.0.smithi100.stdout:5/61: mknod db/de/c16 0 2024-09-13T02:50:27.844 INFO:tasks.workunit.client.0.smithi100.stdout:5/62: dread - db/de/f15 zero size 2024-09-13T02:50:27.846 INFO:tasks.workunit.client.0.smithi100.stdout:1/90: fdatasync de/f11 0 2024-09-13T02:50:27.848 INFO:tasks.workunit.client.0.smithi100.stdout:7/98: mkdir d3/d5/d1b/d1c 0 2024-09-13T02:50:27.848 INFO:tasks.workunit.client.0.smithi100.stdout:7/99: read d3/fc [232605,58189] 0 2024-09-13T02:50:27.849 INFO:tasks.workunit.client.0.smithi100.stdout:5/63: unlink db/de/l14 0 2024-09-13T02:50:27.849 INFO:tasks.workunit.client.0.smithi100.stdout:6/83: dread f2 [0,4194304] 0 2024-09-13T02:50:27.851 INFO:tasks.workunit.client.0.smithi100.stdout:1/91: symlink de/d12/l1d 0 2024-09-13T02:50:27.851 INFO:tasks.workunit.client.0.smithi100.stdout:1/92: creat de/d14/f1e x:0 0 0 2024-09-13T02:50:27.851 INFO:tasks.workunit.client.0.smithi100.stdout:7/100: rmdir d3/d5/d1b 39 2024-09-13T02:50:27.853 INFO:tasks.workunit.client.0.smithi100.stdout:1/93: mknod de/d12/c1f 0 2024-09-13T02:50:27.855 INFO:tasks.workunit.client.0.smithi100.stdout:6/84: dread f2 [0,4194304] 0 2024-09-13T02:50:27.855 INFO:tasks.workunit.client.0.smithi100.stdout:3/95: dwrite f9 [0,4194304] 0 2024-09-13T02:50:27.858 INFO:tasks.workunit.client.0.smithi100.stdout:4/57: dwrite f0 [0,4194304] 0 2024-09-13T02:50:27.859 INFO:tasks.workunit.client.0.smithi100.stdout:1/94: dread f7 [0,4194304] 0 2024-09-13T02:50:27.859 INFO:tasks.workunit.client.0.smithi100.stdout:1/95: chown f8 16592 1 2024-09-13T02:50:27.859 INFO:tasks.workunit.client.0.smithi100.stdout:4/58: symlink d3/d6/d9/l14 0 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:3/96: dread f4 [0,4194304] 0 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:8/102: sync 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:8/103: write f6 [1233530,91544] 0 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:8/104: dread - df/d13/f19 zero size 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/96: unlink l6 0 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/97: chown de/l18 63362807 1 2024-09-13T02:50:27.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/98: creat de/f20 x:0 0 0 2024-09-13T02:50:27.864 INFO:tasks.workunit.client.0.smithi100.stdout:4/59: unlink d3/l5 0 2024-09-13T02:50:27.864 INFO:tasks.workunit.client.0.smithi100.stdout:4/60: chown f2 5359 1 2024-09-13T02:50:27.867 INFO:tasks.workunit.client.0.smithi100.stdout:3/97: dread f4 [0,4194304] 0 2024-09-13T02:50:27.867 INFO:tasks.workunit.client.0.smithi100.stdout:3/98: getdents d10/d1f 0 2024-09-13T02:50:27.869 INFO:tasks.workunit.client.0.smithi100.stdout:3/99: mknod d10/c20 0 2024-09-13T02:50:27.872 INFO:tasks.workunit.client.0.smithi100.stdout:3/100: rmdir d10/d1f 0 2024-09-13T02:50:27.874 INFO:tasks.workunit.client.0.smithi100.stdout:3/101: mkdir d10/d21 0 2024-09-13T02:50:27.874 INFO:tasks.workunit.client.0.smithi100.stdout:3/102: stat d10/c14 0 2024-09-13T02:50:27.874 INFO:tasks.workunit.client.0.smithi100.stdout:3/103: fdatasync fc 0 2024-09-13T02:50:27.874 INFO:tasks.workunit.client.0.smithi100.stdout:3/104: chown d10/c20 427 1 2024-09-13T02:50:27.876 INFO:tasks.workunit.client.0.smithi100.stdout:3/105: mknod d10/c22 0 2024-09-13T02:50:27.878 INFO:tasks.workunit.client.0.smithi100.stdout:2/120: dwrite d0/f1 [0,4194304] 0 2024-09-13T02:50:27.878 INFO:tasks.workunit.client.0.smithi100.stdout:7/101: dwrite d3/d5/f1a [0,4194304] 0 2024-09-13T02:50:27.878 INFO:tasks.workunit.client.0.smithi100.stdout:3/106: dread fe [0,4194304] 0 2024-09-13T02:50:27.882 INFO:tasks.workunit.client.0.smithi100.stdout:2/121: unlink d0/f6 0 2024-09-13T02:50:27.884 INFO:tasks.workunit.client.0.smithi100.stdout:7/102: symlink d3/d5/d1b/l1d 0 2024-09-13T02:50:27.886 INFO:tasks.workunit.client.0.smithi100.stdout:2/122: creat d0/f1f x:0 0 0 2024-09-13T02:50:27.886 INFO:tasks.workunit.client.0.smithi100.stdout:2/123: creat d0/f20 x:0 0 0 2024-09-13T02:50:27.886 INFO:tasks.workunit.client.0.smithi100.stdout:2/124: fdatasync d0/f20 0 2024-09-13T02:50:27.889 INFO:tasks.workunit.client.0.smithi100.stdout:7/103: link d3/d5/fe d3/d5/f1e 0 2024-09-13T02:50:27.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/104: read d3/f18 [227190,20668] 0 2024-09-13T02:50:27.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/105: write d3/fa [5370485,27837] 0 2024-09-13T02:50:27.890 INFO:tasks.workunit.client.0.smithi100.stdout:7/106: write d3/fc [75389,3945] 0 2024-09-13T02:50:27.897 INFO:tasks.workunit.client.0.smithi100.stdout:5/64: dwrite db/ff [0,4194304] 0 2024-09-13T02:50:27.899 INFO:tasks.workunit.client.0.smithi100.stdout:7/107: write d3/d5/f1a [1438014,32802] 0 2024-09-13T02:50:27.900 INFO:tasks.workunit.client.0.smithi100.stdout:5/65: symlink db/de/l17 0 2024-09-13T02:50:27.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/66: rename db/de/l17 to db/de/l18 0 2024-09-13T02:50:27.903 INFO:tasks.workunit.client.0.smithi100.stdout:5/67: mknod db/c19 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/68: mknod db/de/c1a 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/69: fdatasync db/de/f15 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/70: readlink l3 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/71: truncate db/de/f15 298922 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/72: fsync f4 0 2024-09-13T02:50:27.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/85: dread fc [0,4194304] 0 2024-09-13T02:50:27.907 INFO:tasks.workunit.client.0.smithi100.stdout:6/86: mknod d12/d14/c17 0 2024-09-13T02:50:27.909 INFO:tasks.workunit.client.0.smithi100.stdout:6/87: mknod d12/d14/c18 0 2024-09-13T02:50:27.909 INFO:tasks.workunit.client.0.smithi100.stdout:1/99: dwrite de/d12/f1b [0,4194304] 0 2024-09-13T02:50:27.909 INFO:tasks.workunit.client.0.smithi100.stdout:6/88: fsync f7 0 2024-09-13T02:50:27.909 INFO:tasks.workunit.client.0.smithi100.stdout:4/61: dwrite f2 [0,4194304] 0 2024-09-13T02:50:27.909 INFO:tasks.workunit.client.0.smithi100.stdout:3/107: dwrite fb [0,4194304] 0 2024-09-13T02:50:27.913 INFO:tasks.workunit.client.0.smithi100.stdout:4/62: creat d3/d6/d13/f15 x:0 0 0 2024-09-13T02:50:27.913 INFO:tasks.workunit.client.0.smithi100.stdout:4/63: dread - d3/d6/d9/fd zero size 2024-09-13T02:50:27.913 INFO:tasks.workunit.client.0.smithi100.stdout:4/64: chown d3/f4 3904 1 2024-09-13T02:50:27.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/65: truncate d3/f4 4270148 0 2024-09-13T02:50:27.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/66: chown d3/d6/d13 16 1 2024-09-13T02:50:27.914 INFO:tasks.workunit.client.0.smithi100.stdout:3/108: symlink d10/d21/l23 0 2024-09-13T02:50:27.915 INFO:tasks.workunit.client.0.smithi100.stdout:4/67: symlink d3/d6/d9/l16 0 2024-09-13T02:50:27.916 INFO:tasks.workunit.client.0.smithi100.stdout:4/68: chown d3/fb 489258 1 2024-09-13T02:50:27.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/125: write d0/f1 [1587732,31430] 0 2024-09-13T02:50:27.917 INFO:tasks.workunit.client.0.smithi100.stdout:4/69: symlink d3/l17 0 2024-09-13T02:50:27.917 INFO:tasks.workunit.client.0.smithi100.stdout:1/100: getdents de 0 2024-09-13T02:50:27.919 INFO:tasks.workunit.client.0.smithi100.stdout:2/126: mkdir d0/db/d21 0 2024-09-13T02:50:27.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/101: symlink de/d14/l21 0 2024-09-13T02:50:27.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/102: truncate f7 1084526 0 2024-09-13T02:50:27.922 INFO:tasks.workunit.client.0.smithi100.stdout:7/108: dwrite d3/d5/fe [4194304,4194304] 0 2024-09-13T02:50:27.924 INFO:tasks.workunit.client.0.smithi100.stdout:1/103: mkdir de/d14/d22 0 2024-09-13T02:50:27.924 INFO:tasks.workunit.client.0.smithi100.stdout:1/104: truncate de/d14/f1e 592348 0 2024-09-13T02:50:27.924 INFO:tasks.workunit.client.0.smithi100.stdout:3/109: dread f4 [0,4194304] 0 2024-09-13T02:50:27.924 INFO:tasks.workunit.client.0.smithi100.stdout:3/110: chown f4 255 1 2024-09-13T02:50:27.927 INFO:tasks.workunit.client.0.smithi100.stdout:1/105: creat de/f23 x:0 0 0 2024-09-13T02:50:27.927 INFO:tasks.workunit.client.0.smithi100.stdout:1/106: write de/f23 [656566,122690] 0 2024-09-13T02:50:27.929 INFO:tasks.workunit.client.0.smithi100.stdout:1/107: mkdir de/d12/d24 0 2024-09-13T02:50:27.929 INFO:tasks.workunit.client.0.smithi100.stdout:1/108: dread - de/d14/f1a zero size 2024-09-13T02:50:27.929 INFO:tasks.workunit.client.0.smithi100.stdout:1/109: truncate f8 1513219 0 2024-09-13T02:50:27.929 INFO:tasks.workunit.client.0.smithi100.stdout:1/110: write de/f23 [1299808,129035] 0 2024-09-13T02:50:27.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/53: sync 2024-09-13T02:50:27.931 INFO:tasks.workunit.client.0.smithi100.stdout:9/116: sync 2024-09-13T02:50:27.931 INFO:tasks.workunit.client.0.smithi100.stdout:9/117: chown dd/fe 0 1 2024-09-13T02:50:27.932 INFO:tasks.workunit.client.0.smithi100.stdout:0/54: creat d2/dd/d12/f14 x:0 0 0 2024-09-13T02:50:27.933 INFO:tasks.workunit.client.0.smithi100.stdout:3/111: dread f8 [0,4194304] 0 2024-09-13T02:50:27.933 INFO:tasks.workunit.client.0.smithi100.stdout:3/112: stat d10/f12 0 2024-09-13T02:50:27.933 INFO:tasks.workunit.client.0.smithi100.stdout:9/118: stat dd/l13 0 2024-09-13T02:50:27.933 INFO:tasks.workunit.client.0.smithi100.stdout:3/113: write d10/f16 [1460769,109342] 0 2024-09-13T02:50:27.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/73: rmdir db/de 39 2024-09-13T02:50:27.936 INFO:tasks.workunit.client.0.smithi100.stdout:0/55: truncate d2/fa 3903014 0 2024-09-13T02:50:27.937 INFO:tasks.workunit.client.0.smithi100.stdout:9/119: rename dd/c17 to dd/d1b/d1d/c22 0 2024-09-13T02:50:27.938 INFO:tasks.workunit.client.0.smithi100.stdout:9/120: rename dd/d1b to dd/d1b/d21/d23 22 2024-09-13T02:50:27.938 INFO:tasks.workunit.client.0.smithi100.stdout:9/121: getdents dd/d1b/d21 0 2024-09-13T02:50:27.938 INFO:tasks.workunit.client.0.smithi100.stdout:5/74: symlink db/de/l1b 0 2024-09-13T02:50:27.940 INFO:tasks.workunit.client.0.smithi100.stdout:9/122: mkdir dd/d1b/d24 0 2024-09-13T02:50:27.941 INFO:tasks.workunit.client.0.smithi100.stdout:7/109: write d3/d5/fe [5416280,101102] 0 2024-09-13T02:50:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/75: creat db/de/f1c x:0 0 0 2024-09-13T02:50:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/76: readlink db/de/l1b 0 2024-09-13T02:50:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/77: truncate db/de/f1c 289564 0 2024-09-13T02:50:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/78: truncate f4 3757239 0 2024-09-13T02:50:27.942 INFO:tasks.workunit.client.0.smithi100.stdout:5/79: rename db/de to db/de/d1d 22 2024-09-13T02:50:27.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/127: rmdir d0/db 39 2024-09-13T02:50:27.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/123: creat dd/f25 x:0 0 0 2024-09-13T02:50:27.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/114: dread fb [0,4194304] 0 2024-09-13T02:50:27.945 INFO:tasks.workunit.client.0.smithi100.stdout:7/110: mknod d3/c1f 0 2024-09-13T02:50:27.945 INFO:tasks.workunit.client.0.smithi100.stdout:7/111: chown d3/fa 23068 1 2024-09-13T02:50:27.945 INFO:tasks.workunit.client.0.smithi100.stdout:3/115: dread f3 [0,4194304] 0 2024-09-13T02:50:27.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/80: mknod db/de/c1e 0 2024-09-13T02:50:27.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/81: fdatasync db/de/f15 0 2024-09-13T02:50:27.946 INFO:tasks.workunit.client.0.smithi100.stdout:3/116: write f3 [21962,98880] 0 2024-09-13T02:50:27.949 INFO:tasks.workunit.client.0.smithi100.stdout:6/89: dwrite d12/f16 [0,4194304] 0 2024-09-13T02:50:27.952 INFO:tasks.workunit.client.0.smithi100.stdout:0/56: write d2/f11 [534148,81390] 0 2024-09-13T02:50:27.952 INFO:tasks.workunit.client.0.smithi100.stdout:1/111: read f8 [885363,97239] 0 2024-09-13T02:50:27.952 INFO:tasks.workunit.client.0.smithi100.stdout:1/112: write f8 [1966622,123075] 0 2024-09-13T02:50:27.953 INFO:tasks.workunit.client.0.smithi100.stdout:7/112: dread d3/fc [0,4194304] 0 2024-09-13T02:50:27.953 INFO:tasks.workunit.client.0.smithi100.stdout:7/113: fdatasync d3/fa 0 2024-09-13T02:50:27.953 INFO:tasks.workunit.client.0.smithi100.stdout:2/128: dread d0/db/ff [0,4194304] 0 2024-09-13T02:50:27.955 INFO:tasks.workunit.client.0.smithi100.stdout:6/90: unlink d12/l13 0 2024-09-13T02:50:27.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/114: dread d3/fa [4194304,4194304] 0 2024-09-13T02:50:27.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/115: chown d3/c6 43 1 2024-09-13T02:50:27.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/116: chown d3/c4 31427737 1 2024-09-13T02:50:27.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/117: rename d3/d5 to d3/d5/d1b/d1c/d20 22 2024-09-13T02:50:27.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/129: write d0/f11 [2040621,44947] 0 2024-09-13T02:50:27.964 INFO:tasks.workunit.client.0.smithi100.stdout:6/91: dread f2 [0,4194304] 0 2024-09-13T02:50:27.968 INFO:tasks.workunit.client.0.smithi100.stdout:3/117: dread fc [0,4194304] 0 2024-09-13T02:50:27.968 INFO:tasks.workunit.client.0.smithi100.stdout:6/92: symlink d12/d14/l19 0 2024-09-13T02:50:27.968 INFO:tasks.workunit.client.0.smithi100.stdout:6/93: stat d12/d14/l19 0 2024-09-13T02:50:27.971 INFO:tasks.workunit.client.0.smithi100.stdout:9/124: dwrite f5 [0,4194304] 0 2024-09-13T02:50:27.973 INFO:tasks.workunit.client.0.smithi100.stdout:6/94: dread f7 [4194304,4194304] 0 2024-09-13T02:50:27.973 INFO:tasks.workunit.client.0.smithi100.stdout:6/95: read f2 [3349918,106703] 0 2024-09-13T02:50:27.974 INFO:tasks.workunit.client.0.smithi100.stdout:6/96: creat d12/d14/f1a x:0 0 0 2024-09-13T02:50:27.977 INFO:tasks.workunit.client.0.smithi100.stdout:1/113: dread f8 [0,4194304] 0 2024-09-13T02:50:27.987 INFO:tasks.workunit.client.0.smithi100.stdout:2/130: dwrite d0/f1f [0,4194304] 0 2024-09-13T02:50:27.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/82: dwrite db/de/f1c [0,4194304] 0 2024-09-13T02:50:27.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/83: write db/de/f15 [603883,18113] 0 2024-09-13T02:50:27.993 INFO:tasks.workunit.client.0.smithi100.stdout:3/118: dwrite d10/f16 [0,4194304] 0 2024-09-13T02:50:27.993 INFO:tasks.workunit.client.0.smithi100.stdout:3/119: fsync d10/f12 0 2024-09-13T02:50:27.993 INFO:tasks.workunit.client.0.smithi100.stdout:3/120: readlink ld 0 2024-09-13T02:50:27.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/121: read f3 [260030,9680] 0 2024-09-13T02:50:27.994 INFO:tasks.workunit.client.0.smithi100.stdout:2/131: creat d0/db/d21/f22 x:0 0 0 2024-09-13T02:50:27.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/114: dread de/d12/f1b [0,4194304] 0 2024-09-13T02:50:27.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/115: dread f7 [0,4194304] 0 2024-09-13T02:50:27.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/122: unlink d10/f11 0 2024-09-13T02:50:27.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/97: dwrite f7 [0,4194304] 0 2024-09-13T02:50:27.997 INFO:tasks.workunit.client.0.smithi100.stdout:2/132: write d0/f20 [51488,28671] 0 2024-09-13T02:50:27.998 INFO:tasks.workunit.client.0.smithi100.stdout:1/116: link de/c10 de/d12/c25 0 2024-09-13T02:50:28.000 INFO:tasks.workunit.client.0.smithi100.stdout:6/98: mknod d12/c1b 0 2024-09-13T02:50:28.002 INFO:tasks.workunit.client.0.smithi100.stdout:1/117: write de/f11 [1561583,19852] 0 2024-09-13T02:50:28.003 INFO:tasks.workunit.client.0.smithi100.stdout:1/118: write de/d12/f17 [2080625,109842] 0 2024-09-13T02:50:28.004 INFO:tasks.workunit.client.0.smithi100.stdout:6/99: mkdir d12/d14/d1c 0 2024-09-13T02:50:28.007 INFO:tasks.workunit.client.0.smithi100.stdout:1/119: fdatasync de/d12/f17 0 2024-09-13T02:50:28.009 INFO:tasks.workunit.client.0.smithi100.stdout:1/120: mkdir de/d14/d22/d26 0 2024-09-13T02:50:28.011 INFO:tasks.workunit.client.0.smithi100.stdout:1/121: rmdir de/d14/d22/d26 0 2024-09-13T02:50:28.012 INFO:tasks.workunit.client.0.smithi100.stdout:3/123: rmdir d10 39 2024-09-13T02:50:28.012 INFO:tasks.workunit.client.0.smithi100.stdout:3/124: readlink d10/l19 0 2024-09-13T02:50:28.012 INFO:tasks.workunit.client.0.smithi100.stdout:8/105: sync 2024-09-13T02:50:28.012 INFO:tasks.workunit.client.0.smithi100.stdout:0/57: dwrite d2/f11 [0,4194304] 0 2024-09-13T02:50:28.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/100: truncate f7 4551596 0 2024-09-13T02:50:28.015 INFO:tasks.workunit.client.0.smithi100.stdout:8/106: rmdir df/d13/d20 39 2024-09-13T02:50:28.016 INFO:tasks.workunit.client.0.smithi100.stdout:8/107: symlink df/l2f 0 2024-09-13T02:50:28.019 INFO:tasks.workunit.client.0.smithi100.stdout:3/125: read f4 [1786659,35716] 0 2024-09-13T02:50:28.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/126: link d10/l18 d10/l24 0 2024-09-13T02:50:28.021 INFO:tasks.workunit.client.0.smithi100.stdout:6/101: read fc [3095256,85239] 0 2024-09-13T02:50:28.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/102: chown ce 27783 1 2024-09-13T02:50:28.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/103: read f2 [1066181,120326] 0 2024-09-13T02:50:28.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/104: truncate f2 5046676 0 2024-09-13T02:50:28.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/127: rename d10/l19 to d10/d21/l25 0 2024-09-13T02:50:28.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/128: write d10/f15 [491375,72564] 0 2024-09-13T02:50:28.024 INFO:tasks.workunit.client.0.smithi100.stdout:8/108: dread f2 [0,4194304] 0 2024-09-13T02:50:28.024 INFO:tasks.workunit.client.0.smithi100.stdout:8/109: write df/f1a [643793,19528] 0 2024-09-13T02:50:28.025 INFO:tasks.workunit.client.0.smithi100.stdout:6/105: rename l8 to d12/d14/d1c/l1d 0 2024-09-13T02:50:28.025 INFO:tasks.workunit.client.0.smithi100.stdout:0/58: dread d2/d9/fb [0,4194304] 0 2024-09-13T02:50:28.025 INFO:tasks.workunit.client.0.smithi100.stdout:6/106: mknod d12/d14/d1c/c1e 0 2024-09-13T02:50:28.027 INFO:tasks.workunit.client.0.smithi100.stdout:0/59: link d2/dd/fe d2/dd/d12/f15 0 2024-09-13T02:50:28.027 INFO:tasks.workunit.client.0.smithi100.stdout:0/60: creat d2/dd/d12/f16 x:0 0 0 2024-09-13T02:50:28.028 INFO:tasks.workunit.client.0.smithi100.stdout:6/107: mkdir d12/d14/d1f 0 2024-09-13T02:50:28.028 INFO:tasks.workunit.client.0.smithi100.stdout:6/108: fsync fc 0 2024-09-13T02:50:28.029 INFO:tasks.workunit.client.0.smithi100.stdout:8/110: dread f8 [0,4194304] 0 2024-09-13T02:50:28.029 INFO:tasks.workunit.client.0.smithi100.stdout:8/111: write df/d13/d20/f23 [125960,68454] 0 2024-09-13T02:50:28.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/109: symlink d12/d14/l20 0 2024-09-13T02:50:28.030 INFO:tasks.workunit.client.0.smithi100.stdout:5/84: dwrite db/de/f15 [0,4194304] 0 2024-09-13T02:50:28.030 INFO:tasks.workunit.client.0.smithi100.stdout:6/110: mkdir d12/d14/d21 0 2024-09-13T02:50:28.030 INFO:tasks.workunit.client.0.smithi100.stdout:6/111: read fc [2887068,106826] 0 2024-09-13T02:50:28.030 INFO:tasks.workunit.client.0.smithi100.stdout:6/112: write fc [2596405,120219] 0 2024-09-13T02:50:28.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/112: symlink df/d13/l30 0 2024-09-13T02:50:28.031 INFO:tasks.workunit.client.0.smithi100.stdout:1/122: dread de/f11 [0,4194304] 0 2024-09-13T02:50:28.033 INFO:tasks.workunit.client.0.smithi100.stdout:6/113: creat d12/d14/d1c/f22 x:0 0 0 2024-09-13T02:50:28.033 INFO:tasks.workunit.client.0.smithi100.stdout:6/114: rename d12/d14 to d12/d14/d21/d23 22 2024-09-13T02:50:28.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/113: unlink df/d13/d20/f27 0 2024-09-13T02:50:28.035 INFO:tasks.workunit.client.0.smithi100.stdout:5/85: rmdir db/de 39 2024-09-13T02:50:28.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/114: dread df/d13/d21/f22 [0,4194304] 0 2024-09-13T02:50:28.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/123: dread f8 [0,4194304] 0 2024-09-13T02:50:28.037 INFO:tasks.workunit.client.0.smithi100.stdout:1/124: readlink de/d14/l21 0 2024-09-13T02:50:28.037 INFO:tasks.workunit.client.0.smithi100.stdout:2/133: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T02:50:28.037 INFO:tasks.workunit.client.0.smithi100.stdout:0/61: dread d2/fa [0,4194304] 0 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/134: chown d0/db/f1a 41 1 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/135: chown d0/db/c1b 10 1 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:6/115: mknod d12/d14/c24 0 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:6/116: fsync f2 0 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:8/115: symlink df/d13/d20/l31 0 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:8/116: chown fb 489 1 2024-09-13T02:50:28.038 INFO:tasks.workunit.client.0.smithi100.stdout:3/129: getdents d10/d21 0 2024-09-13T02:50:28.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/62: creat d2/f17 x:0 0 0 2024-09-13T02:50:28.048 INFO:tasks.workunit.client.0.smithi100.stdout:2/136: mkdir d0/db/d23 0 2024-09-13T02:50:28.049 INFO:tasks.workunit.client.0.smithi100.stdout:2/137: chown d0/f11 28097 1 2024-09-13T02:50:28.049 INFO:tasks.workunit.client.0.smithi100.stdout:1/125: creat de/d12/d24/f27 x:0 0 0 2024-09-13T02:50:28.050 INFO:tasks.workunit.client.0.smithi100.stdout:1/126: write de/d14/f1e [212658,63959] 0 2024-09-13T02:50:28.052 INFO:tasks.workunit.client.0.smithi100.stdout:3/130: rename d10/l24 to d10/l26 0 2024-09-13T02:50:28.055 INFO:tasks.workunit.client.0.smithi100.stdout:1/127: mknod de/d14/d22/c28 0 2024-09-13T02:50:28.055 INFO:tasks.workunit.client.0.smithi100.stdout:1/128: write de/d12/f1b [4291099,120112] 0 2024-09-13T02:50:28.057 INFO:tasks.workunit.client.0.smithi100.stdout:2/138: dread d0/f15 [0,4194304] 0 2024-09-13T02:50:28.057 INFO:tasks.workunit.client.0.smithi100.stdout:1/129: dread f7 [0,4194304] 0 2024-09-13T02:50:28.057 INFO:tasks.workunit.client.0.smithi100.stdout:8/117: link df/d13/d20/c25 df/d13/c32 0 2024-09-13T02:50:28.058 INFO:tasks.workunit.client.0.smithi100.stdout:3/131: rmdir d10/d21 39 2024-09-13T02:50:28.058 INFO:tasks.workunit.client.0.smithi100.stdout:2/139: readlink d0/la 0 2024-09-13T02:50:28.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/118: mknod df/d13/d20/d18/c33 0 2024-09-13T02:50:28.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/119: truncate df/d13/d21/f29 391980 0 2024-09-13T02:50:28.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/120: fdatasync f2 0 2024-09-13T02:50:28.060 INFO:tasks.workunit.client.0.smithi100.stdout:8/121: write f8 [4365003,128582] 0 2024-09-13T02:50:28.060 INFO:tasks.workunit.client.0.smithi100.stdout:3/132: mknod d10/d21/c27 0 2024-09-13T02:50:28.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/122: rmdir df/d13/d20/d18/d2c/d2e 0 2024-09-13T02:50:28.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/123: write f2 [4647785,1349] 0 2024-09-13T02:50:28.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/124: chown df/d13/l30 0 1 2024-09-13T02:50:28.064 INFO:tasks.workunit.client.0.smithi100.stdout:3/133: creat d10/d21/f28 x:0 0 0 2024-09-13T02:50:28.065 INFO:tasks.workunit.client.0.smithi100.stdout:8/125: symlink df/d13/d20/d18/l34 0 2024-09-13T02:50:28.065 INFO:tasks.workunit.client.0.smithi100.stdout:9/125: sync 2024-09-13T02:50:28.065 INFO:tasks.workunit.client.0.smithi100.stdout:7/118: sync 2024-09-13T02:50:28.065 INFO:tasks.workunit.client.0.smithi100.stdout:4/70: sync 2024-09-13T02:50:28.067 INFO:tasks.workunit.client.0.smithi100.stdout:7/119: mknod d3/c21 0 2024-09-13T02:50:28.068 INFO:tasks.workunit.client.0.smithi100.stdout:5/86: dwrite db/f11 [0,4194304] 0 2024-09-13T02:50:28.070 INFO:tasks.workunit.client.0.smithi100.stdout:5/87: mkdir db/de/d1f 0 2024-09-13T02:50:28.071 INFO:tasks.workunit.client.0.smithi100.stdout:7/120: dread d3/f18 [0,4194304] 0 2024-09-13T02:50:28.072 INFO:tasks.workunit.client.0.smithi100.stdout:7/121: mknod d3/d5/c22 0 2024-09-13T02:50:28.072 INFO:tasks.workunit.client.0.smithi100.stdout:7/122: chown d3/c4 1268 1 2024-09-13T02:50:28.072 INFO:tasks.workunit.client.0.smithi100.stdout:7/123: chown d3/f11 3839181 1 2024-09-13T02:50:28.072 INFO:tasks.workunit.client.0.smithi100.stdout:7/124: fdatasync d3/d5/fe 0 2024-09-13T02:50:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/125: chown d3/d5/c8 1320 1 2024-09-13T02:50:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:9/126: dread dd/f10 [0,4194304] 0 2024-09-13T02:50:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/126: dread d3/f18 [0,4194304] 0 2024-09-13T02:50:28.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/127: symlink d3/l23 0 2024-09-13T02:50:28.078 INFO:tasks.workunit.client.0.smithi100.stdout:3/134: write f8 [8336288,129304] 0 2024-09-13T02:50:28.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/71: write d3/fb [3042407,121421] 0 2024-09-13T02:50:28.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/72: write d3/d6/f10 [236805,92859] 0 2024-09-13T02:50:28.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/73: dread - d3/dc/f12 zero size 2024-09-13T02:50:28.081 INFO:tasks.workunit.client.0.smithi100.stdout:4/74: write d3/d6/d13/f15 [215924,100460] 0 2024-09-13T02:50:28.083 INFO:tasks.workunit.client.0.smithi100.stdout:6/117: dwrite f7 [0,4194304] 0 2024-09-13T02:50:28.083 INFO:tasks.workunit.client.0.smithi100.stdout:6/118: write f2 [5057318,80527] 0 2024-09-13T02:50:28.083 INFO:tasks.workunit.client.0.smithi100.stdout:0/63: dwrite d2/f11 [0,4194304] 0 2024-09-13T02:50:28.085 INFO:tasks.workunit.client.0.smithi100.stdout:4/75: link d3/fb d3/d6/f18 0 2024-09-13T02:50:28.085 INFO:tasks.workunit.client.0.smithi100.stdout:2/140: dwrite d0/db/f17 [0,4194304] 0 2024-09-13T02:50:28.085 INFO:tasks.workunit.client.0.smithi100.stdout:2/141: chown d0/db/f1a 21 1 2024-09-13T02:50:28.085 INFO:tasks.workunit.client.0.smithi100.stdout:1/130: dwrite de/d14/f1a [0,4194304] 0 2024-09-13T02:50:28.086 INFO:tasks.workunit.client.0.smithi100.stdout:6/119: mknod d12/d14/d21/c25 0 2024-09-13T02:50:28.089 INFO:tasks.workunit.client.0.smithi100.stdout:0/64: rename d2/dd/fe to d2/dd/d12/f18 0 2024-09-13T02:50:28.091 INFO:tasks.workunit.client.0.smithi100.stdout:5/88: write db/ff [3825067,70515] 0 2024-09-13T02:50:28.095 INFO:tasks.workunit.client.0.smithi100.stdout:1/131: mkdir de/d14/d22/d29 0 2024-09-13T02:50:28.096 INFO:tasks.workunit.client.0.smithi100.stdout:1/132: creat de/d12/f2a x:0 0 0 2024-09-13T02:50:28.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/142: dread d0/f1f [0,4194304] 0 2024-09-13T02:50:28.099 INFO:tasks.workunit.client.0.smithi100.stdout:4/76: rename f2 to d3/d6/f19 0 2024-09-13T02:50:28.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/89: write f4 [2550843,75180] 0 2024-09-13T02:50:28.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/126: getdents df/d13/d20/d18 0 2024-09-13T02:50:28.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/127: fsync df/d13/f14 0 2024-09-13T02:50:28.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/128: truncate df/d13/d21/f22 315037 0 2024-09-13T02:50:28.100 INFO:tasks.workunit.client.0.smithi100.stdout:0/65: chown d2/l8 1097972 1 2024-09-13T02:50:28.100 INFO:tasks.workunit.client.0.smithi100.stdout:0/66: fdatasync d2/f17 0 2024-09-13T02:50:28.108 INFO:tasks.workunit.client.0.smithi100.stdout:1/133: mknod de/d14/d22/c2b 0 2024-09-13T02:50:28.109 INFO:tasks.workunit.client.0.smithi100.stdout:1/134: write de/f23 [1125647,87709] 0 2024-09-13T02:50:28.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/77: symlink d3/l1a 0 2024-09-13T02:50:28.111 INFO:tasks.workunit.client.0.smithi100.stdout:7/128: dwrite d3/f15 [0,4194304] 0 2024-09-13T02:50:28.111 INFO:tasks.workunit.client.0.smithi100.stdout:7/129: fdatasync d3/f15 0 2024-09-13T02:50:28.111 INFO:tasks.workunit.client.0.smithi100.stdout:8/129: rename df/d13/c1d to df/d13/d20/d18/d2c/c35 0 2024-09-13T02:50:28.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/67: mknod d2/d9/c19 0 2024-09-13T02:50:28.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/68: dread - d2/dd/d12/f14 zero size 2024-09-13T02:50:28.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/69: read d2/dd/d12/f15 [1504601,119375] 0 2024-09-13T02:50:28.113 INFO:tasks.workunit.client.0.smithi100.stdout:4/78: mkdir d3/d1b 0 2024-09-13T02:50:28.117 INFO:tasks.workunit.client.0.smithi100.stdout:7/130: unlink d3/f11 0 2024-09-13T02:50:28.120 INFO:tasks.workunit.client.0.smithi100.stdout:1/135: rename de/d14/f1e to de/f2c 0 2024-09-13T02:50:28.120 INFO:tasks.workunit.client.0.smithi100.stdout:1/136: write f1 [8904084,120583] 0 2024-09-13T02:50:28.121 INFO:tasks.workunit.client.0.smithi100.stdout:1/137: write de/f11 [1667128,75404] 0 2024-09-13T02:50:28.121 INFO:tasks.workunit.client.0.smithi100.stdout:8/130: creat df/d13/d20/d18/f36 x:0 0 0 2024-09-13T02:50:28.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/131: dread f0 [0,4194304] 0 2024-09-13T02:50:28.122 INFO:tasks.workunit.client.0.smithi100.stdout:1/138: mknod de/d12/d24/c2d 0 2024-09-13T02:50:28.123 INFO:tasks.workunit.client.0.smithi100.stdout:8/131: creat df/d13/f37 x:0 0 0 2024-09-13T02:50:28.123 INFO:tasks.workunit.client.0.smithi100.stdout:8/132: truncate df/d13/d20/d18/f36 313713 0 2024-09-13T02:50:28.124 INFO:tasks.workunit.client.0.smithi100.stdout:0/70: truncate d2/f11 196911 0 2024-09-13T02:50:28.124 INFO:tasks.workunit.client.0.smithi100.stdout:6/120: dwrite d12/d14/d1c/f22 [0,4194304] 0 2024-09-13T02:50:28.129 INFO:tasks.workunit.client.0.smithi100.stdout:0/71: dread d2/dd/d12/f15 [0,4194304] 0 2024-09-13T02:50:28.129 INFO:tasks.workunit.client.0.smithi100.stdout:0/72: truncate d2/f17 653493 0 2024-09-13T02:50:28.131 INFO:tasks.workunit.client.0.smithi100.stdout:3/135: dwrite d10/f16 [0,4194304] 0 2024-09-13T02:50:28.131 INFO:tasks.workunit.client.0.smithi100.stdout:0/73: getdents d2 0 2024-09-13T02:50:28.132 INFO:tasks.workunit.client.0.smithi100.stdout:0/74: chown d2 66699 1 2024-09-13T02:50:28.132 INFO:tasks.workunit.client.0.smithi100.stdout:3/136: write d10/d21/f28 [118459,6120] 0 2024-09-13T02:50:28.132 INFO:tasks.workunit.client.0.smithi100.stdout:3/137: creat d10/d21/f29 x:0 0 0 2024-09-13T02:50:28.132 INFO:tasks.workunit.client.0.smithi100.stdout:3/138: chown d10/f1b 0 1 2024-09-13T02:50:28.132 INFO:tasks.workunit.client.0.smithi100.stdout:3/139: write f3 [1216487,68734] 0 2024-09-13T02:50:28.133 INFO:tasks.workunit.client.0.smithi100.stdout:3/140: creat d10/f2a x:0 0 0 2024-09-13T02:50:28.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/79: fsync d3/fb 0 2024-09-13T02:50:28.133 INFO:tasks.workunit.client.0.smithi100.stdout:8/133: dread fb [0,4194304] 0 2024-09-13T02:50:28.134 INFO:tasks.workunit.client.0.smithi100.stdout:0/75: mkdir d2/d1a 0 2024-09-13T02:50:28.134 INFO:tasks.workunit.client.0.smithi100.stdout:0/76: fdatasync d2/d9/fb 0 2024-09-13T02:50:28.134 INFO:tasks.workunit.client.0.smithi100.stdout:0/77: dread - d2/dd/d12/f16 zero size 2024-09-13T02:50:28.134 INFO:tasks.workunit.client.0.smithi100.stdout:4/80: creat d3/d6/f1c x:0 0 0 2024-09-13T02:50:28.135 INFO:tasks.workunit.client.0.smithi100.stdout:8/134: mkdir df/d13/d20/d18/d2c/d38 0 2024-09-13T02:50:28.136 INFO:tasks.workunit.client.0.smithi100.stdout:0/78: creat d2/d9/f1b x:0 0 0 2024-09-13T02:50:28.141 INFO:tasks.workunit.client.0.smithi100.stdout:5/90: dwrite db/de/f1c [0,4194304] 0 2024-09-13T02:50:28.142 INFO:tasks.workunit.client.0.smithi100.stdout:8/135: write f8 [3893576,102139] 0 2024-09-13T02:50:28.142 INFO:tasks.workunit.client.0.smithi100.stdout:2/143: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:28.142 INFO:tasks.workunit.client.0.smithi100.stdout:2/144: fsync d0/f11 0 2024-09-13T02:50:28.143 INFO:tasks.workunit.client.0.smithi100.stdout:5/91: mknod db/de/d1f/c20 0 2024-09-13T02:50:28.143 INFO:tasks.workunit.client.0.smithi100.stdout:6/121: dread d12/d14/d1c/f22 [0,4194304] 0 2024-09-13T02:50:28.144 INFO:tasks.workunit.client.0.smithi100.stdout:6/122: dread - d12/d14/f1a zero size 2024-09-13T02:50:28.144 INFO:tasks.workunit.client.0.smithi100.stdout:6/123: write f2 [149172,124767] 0 2024-09-13T02:50:28.144 INFO:tasks.workunit.client.0.smithi100.stdout:7/132: dwrite d3/d5/f1a [4194304,4194304] 0 2024-09-13T02:50:28.144 INFO:tasks.workunit.client.0.smithi100.stdout:6/124: chown d12/d14/c17 10 1 2024-09-13T02:50:28.147 INFO:tasks.workunit.client.0.smithi100.stdout:4/81: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:28.148 INFO:tasks.workunit.client.0.smithi100.stdout:3/141: dread f8 [4194304,4194304] 0 2024-09-13T02:50:28.148 INFO:tasks.workunit.client.0.smithi100.stdout:5/92: mknod db/de/d1f/c21 0 2024-09-13T02:50:28.155 INFO:tasks.workunit.client.0.smithi100.stdout:7/133: write d3/d5/f1e [492845,77247] 0 2024-09-13T02:50:28.157 INFO:tasks.workunit.client.0.smithi100.stdout:3/142: link f4 d10/f2b 0 2024-09-13T02:50:28.159 INFO:tasks.workunit.client.0.smithi100.stdout:5/93: unlink db/de/c16 0 2024-09-13T02:50:28.159 INFO:tasks.workunit.client.0.smithi100.stdout:5/94: write fa [893108,45725] 0 2024-09-13T02:50:28.159 INFO:tasks.workunit.client.0.smithi100.stdout:2/145: write d0/fe [2298160,85036] 0 2024-09-13T02:50:28.160 INFO:tasks.workunit.client.0.smithi100.stdout:1/139: rename de/d12/d24 to de/d14/d2e 0 2024-09-13T02:50:28.160 INFO:tasks.workunit.client.0.smithi100.stdout:7/134: unlink d3/c21 0 2024-09-13T02:50:28.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/143: mknod d10/d21/c2c 0 2024-09-13T02:50:28.164 INFO:tasks.workunit.client.0.smithi100.stdout:3/144: creat d10/d21/f2d x:0 0 0 2024-09-13T02:50:28.165 INFO:tasks.workunit.client.0.smithi100.stdout:3/145: truncate f2 4447358 0 2024-09-13T02:50:28.165 INFO:tasks.workunit.client.0.smithi100.stdout:1/140: dread de/d12/f1b [0,4194304] 0 2024-09-13T02:50:28.165 INFO:tasks.workunit.client.0.smithi100.stdout:5/95: creat db/de/f22 x:0 0 0 2024-09-13T02:50:28.166 INFO:tasks.workunit.client.0.smithi100.stdout:5/96: chown db/de/l1b 31318 1 2024-09-13T02:50:28.166 INFO:tasks.workunit.client.0.smithi100.stdout:5/97: write db/de/f12 [750468,72463] 0 2024-09-13T02:50:28.167 INFO:tasks.workunit.client.0.smithi100.stdout:0/79: rename d2/dd/d12/f15 to d2/d1a/f1c 0 2024-09-13T02:50:28.167 INFO:tasks.workunit.client.0.smithi100.stdout:0/80: fsync d2/fa 0 2024-09-13T02:50:28.167 INFO:tasks.workunit.client.0.smithi100.stdout:0/81: truncate d2/dd/d12/f14 221915 0 2024-09-13T02:50:28.168 INFO:tasks.workunit.client.0.smithi100.stdout:4/82: rename d3/d6/d13 to d3/d6/d1d 0 2024-09-13T02:50:28.168 INFO:tasks.workunit.client.0.smithi100.stdout:4/83: write d3/d6/f10 [872461,78685] 0 2024-09-13T02:50:28.171 INFO:tasks.workunit.client.0.smithi100.stdout:5/98: symlink db/de/l23 0 2024-09-13T02:50:28.171 INFO:tasks.workunit.client.0.smithi100.stdout:3/146: write f2 [53714,78606] 0 2024-09-13T02:50:28.172 INFO:tasks.workunit.client.0.smithi100.stdout:2/146: symlink d0/l24 0 2024-09-13T02:50:28.172 INFO:tasks.workunit.client.0.smithi100.stdout:2/147: creat d0/db/d21/f25 x:0 0 0 2024-09-13T02:50:28.174 INFO:tasks.workunit.client.0.smithi100.stdout:8/136: rename f6 to df/d13/d20/d18/f39 0 2024-09-13T02:50:28.176 INFO:tasks.workunit.client.0.smithi100.stdout:0/82: symlink d2/d1a/l1d 0 2024-09-13T02:50:28.179 INFO:tasks.workunit.client.0.smithi100.stdout:5/99: creat db/f24 x:0 0 0 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/147: rename d10/d21/c27 to d10/d21/c2e 0 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/148: readlink ld 0 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/149: chown d10/f2a 5002 1 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/150: creat d10/d21/f2f x:0 0 0 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/151: write d10/f12 [5182460,98590] 0 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/152: dread - d10/f2a zero size 2024-09-13T02:50:28.182 INFO:tasks.workunit.client.0.smithi100.stdout:3/153: fsync d10/d21/f29 0 2024-09-13T02:50:28.183 INFO:tasks.workunit.client.0.smithi100.stdout:3/154: write f9 [5475183,65953] 0 2024-09-13T02:50:28.183 INFO:tasks.workunit.client.0.smithi100.stdout:8/137: mknod df/d13/d20/d18/d2c/d38/c3a 0 2024-09-13T02:50:28.183 INFO:tasks.workunit.client.0.smithi100.stdout:8/138: truncate df/f2b 428664 0 2024-09-13T02:50:28.184 INFO:tasks.workunit.client.0.smithi100.stdout:2/148: write d0/f4 [3062175,47441] 0 2024-09-13T02:50:28.185 INFO:tasks.workunit.client.0.smithi100.stdout:9/127: sync 2024-09-13T02:50:28.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/141: rmdir de 39 2024-09-13T02:50:28.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/142: chown de/d14/f1a 130595 1 2024-09-13T02:50:28.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/143: chown l3 114854 1 2024-09-13T02:50:28.185 INFO:tasks.workunit.client.0.smithi100.stdout:0/83: link d2/fa d2/d1a/f1e 0 2024-09-13T02:50:28.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/100: link db/de/c10 db/c25 0 2024-09-13T02:50:28.189 INFO:tasks.workunit.client.0.smithi100.stdout:3/155: mknod d10/c30 0 2024-09-13T02:50:28.189 INFO:tasks.workunit.client.0.smithi100.stdout:3/156: creat d10/f31 x:0 0 0 2024-09-13T02:50:28.191 INFO:tasks.workunit.client.0.smithi100.stdout:7/135: rename d3/l23 to d3/d5/l24 0 2024-09-13T02:50:28.191 INFO:tasks.workunit.client.0.smithi100.stdout:8/139: rename df/d13/d20/d18/d2c to df/d13/d20/d18/d2c/d38/d3b 22 2024-09-13T02:50:28.191 INFO:tasks.workunit.client.0.smithi100.stdout:8/140: chown df/d13/d21/f29 3340428 1 2024-09-13T02:50:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:0/84: write d2/dd/f10 [762075,94526] 0 2024-09-13T02:50:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:2/149: rename d0/db/f17 to d0/db/f26 0 2024-09-13T02:50:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:2/150: fdatasync d0/f15 0 2024-09-13T02:50:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:4/84: dwrite d3/d6/f1c [0,4194304] 0 2024-09-13T02:50:28.197 INFO:tasks.workunit.client.0.smithi100.stdout:9/128: creat dd/d1b/d21/f26 x:0 0 0 2024-09-13T02:50:28.199 INFO:tasks.workunit.client.0.smithi100.stdout:1/144: rename ca to de/d14/c2f 0 2024-09-13T02:50:28.200 INFO:tasks.workunit.client.0.smithi100.stdout:0/85: dread d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:28.200 INFO:tasks.workunit.client.0.smithi100.stdout:0/86: readlink d2/l4 0 2024-09-13T02:50:28.200 INFO:tasks.workunit.client.0.smithi100.stdout:8/141: link df/d13/d20/l31 df/d13/d20/d18/d2c/l3c 0 2024-09-13T02:50:28.204 INFO:tasks.workunit.client.0.smithi100.stdout:2/151: symlink d0/db/d21/l27 0 2024-09-13T02:50:28.206 INFO:tasks.workunit.client.0.smithi100.stdout:4/85: symlink d3/d6/l1e 0 2024-09-13T02:50:28.210 INFO:tasks.workunit.client.0.smithi100.stdout:9/129: dwrite f9 [0,4194304] 0 2024-09-13T02:50:28.213 INFO:tasks.workunit.client.0.smithi100.stdout:5/101: rmdir db 39 2024-09-13T02:50:28.215 INFO:tasks.workunit.client.0.smithi100.stdout:1/145: getdents de 0 2024-09-13T02:50:28.216 INFO:tasks.workunit.client.0.smithi100.stdout:0/87: creat d2/f1f x:0 0 0 2024-09-13T02:50:28.217 INFO:tasks.workunit.client.0.smithi100.stdout:3/157: getdents d10 0 2024-09-13T02:50:28.219 INFO:tasks.workunit.client.0.smithi100.stdout:4/86: dread d3/f4 [0,4194304] 0 2024-09-13T02:50:28.219 INFO:tasks.workunit.client.0.smithi100.stdout:4/87: chown d3/d6/d9/l16 5552 1 2024-09-13T02:50:28.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/142: symlink df/d13/d21/l3d 0 2024-09-13T02:50:28.219 INFO:tasks.workunit.client.0.smithi100.stdout:8/143: chown df/d13/f14 200 1 2024-09-13T02:50:28.223 INFO:tasks.workunit.client.0.smithi100.stdout:1/146: rmdir de/d14/d2e 39 2024-09-13T02:50:28.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/158: creat d10/f32 x:0 0 0 2024-09-13T02:50:28.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/152: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T02:50:28.226 INFO:tasks.workunit.client.0.smithi100.stdout:4/88: write d3/f4 [3785590,76279] 0 2024-09-13T02:50:28.226 INFO:tasks.workunit.client.0.smithi100.stdout:8/144: rmdir df/d13/d20/d18/d2c/d38 39 2024-09-13T02:50:28.227 INFO:tasks.workunit.client.0.smithi100.stdout:5/102: truncate db/de/f12 196225 0 2024-09-13T02:50:28.228 INFO:tasks.workunit.client.0.smithi100.stdout:1/147: rename de/d12/f17 to de/d12/f30 0 2024-09-13T02:50:28.229 INFO:tasks.workunit.client.0.smithi100.stdout:1/148: dread f7 [0,4194304] 0 2024-09-13T02:50:28.230 INFO:tasks.workunit.client.0.smithi100.stdout:2/153: mknod d0/db/d23/c28 0 2024-09-13T02:50:28.231 INFO:tasks.workunit.client.0.smithi100.stdout:2/154: chown d0/db/c1b 2 1 2024-09-13T02:50:28.231 INFO:tasks.workunit.client.0.smithi100.stdout:2/155: chown d0/f11 4659 1 2024-09-13T02:50:28.231 INFO:tasks.workunit.client.0.smithi100.stdout:8/145: rmdir df/d13/d20/d18/d2c/d38 39 2024-09-13T02:50:28.231 INFO:tasks.workunit.client.0.smithi100.stdout:8/146: write df/d13/f37 [64707,99816] 0 2024-09-13T02:50:28.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/103: mknod db/c26 0 2024-09-13T02:50:28.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/104: chown l6 255 1 2024-09-13T02:50:28.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/105: fdatasync db/de/f12 0 2024-09-13T02:50:28.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/159: getdents d10/d21 0 2024-09-13T02:50:28.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/160: creat d10/f33 x:0 0 0 2024-09-13T02:50:28.233 INFO:tasks.workunit.client.0.smithi100.stdout:4/89: rmdir d3/d6/d9 39 2024-09-13T02:50:28.234 INFO:tasks.workunit.client.0.smithi100.stdout:5/106: link fa db/de/f27 0 2024-09-13T02:50:28.234 INFO:tasks.workunit.client.0.smithi100.stdout:5/107: write f8 [898700,110614] 0 2024-09-13T02:50:28.237 INFO:tasks.workunit.client.0.smithi100.stdout:3/161: unlink d10/c20 0 2024-09-13T02:50:28.237 INFO:tasks.workunit.client.0.smithi100.stdout:3/162: fdatasync d10/f33 0 2024-09-13T02:50:28.237 INFO:tasks.workunit.client.0.smithi100.stdout:9/130: truncate f9 655786 0 2024-09-13T02:50:28.238 INFO:tasks.workunit.client.0.smithi100.stdout:5/108: write db/de/f27 [427136,96377] 0 2024-09-13T02:50:28.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/90: rmdir d3/d6/d9 39 2024-09-13T02:50:28.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/91: chown d3/d6/d9/ca 6041 1 2024-09-13T02:50:28.241 INFO:tasks.workunit.client.0.smithi100.stdout:3/163: mkdir d10/d34 0 2024-09-13T02:50:28.241 INFO:tasks.workunit.client.0.smithi100.stdout:3/164: fdatasync d10/f2b 0 2024-09-13T02:50:28.243 INFO:tasks.workunit.client.0.smithi100.stdout:4/92: link d3/d6/l1e d3/d6/d9/l1f 0 2024-09-13T02:50:28.243 INFO:tasks.workunit.client.0.smithi100.stdout:3/165: link d10/d21/c2e d10/c35 0 2024-09-13T02:50:28.244 INFO:tasks.workunit.client.0.smithi100.stdout:3/166: dread - d10/d21/f29 zero size 2024-09-13T02:50:28.244 INFO:tasks.workunit.client.0.smithi100.stdout:5/109: truncate db/de/f12 541834 0 2024-09-13T02:50:28.245 INFO:tasks.workunit.client.0.smithi100.stdout:4/93: mknod d3/dc/c20 0 2024-09-13T02:50:28.245 INFO:tasks.workunit.client.0.smithi100.stdout:4/94: chown d3/d6/d9/ca 408158049 1 2024-09-13T02:50:28.249 INFO:tasks.workunit.client.0.smithi100.stdout:3/167: read fb [2647385,107919] 0 2024-09-13T02:50:28.249 INFO:tasks.workunit.client.0.smithi100.stdout:3/168: dread - d10/f1b zero size 2024-09-13T02:50:28.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/169: symlink d10/l36 0 2024-09-13T02:50:28.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/170: write f3 [1216128,5493] 0 2024-09-13T02:50:28.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/171: stat d10/c1a 0 2024-09-13T02:50:28.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/172: chown d10/f16 3 1 2024-09-13T02:50:28.260 INFO:tasks.workunit.client.0.smithi100.stdout:4/95: dread d3/d6/f1c [0,4194304] 0 2024-09-13T02:50:28.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/96: getdents d3/d6 0 2024-09-13T02:50:28.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/97: stat d3 0 2024-09-13T02:50:28.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/88: dwrite d2/f17 [0,4194304] 0 2024-09-13T02:50:28.263 INFO:tasks.workunit.client.0.smithi100.stdout:4/98: rmdir d3/d1b 0 2024-09-13T02:50:28.264 INFO:tasks.workunit.client.0.smithi100.stdout:4/99: fdatasync d3/d6/d9/f11 0 2024-09-13T02:50:28.264 INFO:tasks.workunit.client.0.smithi100.stdout:8/147: dwrite df/d13/f19 [0,4194304] 0 2024-09-13T02:50:28.264 INFO:tasks.workunit.client.0.smithi100.stdout:3/173: write d10/f12 [46624,86023] 0 2024-09-13T02:50:28.264 INFO:tasks.workunit.client.0.smithi100.stdout:3/174: write fb [1154955,99825] 0 2024-09-13T02:50:28.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/149: dwrite de/f20 [0,4194304] 0 2024-09-13T02:50:28.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/150: readlink de/d14/l21 0 2024-09-13T02:50:28.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/151: fsync de/f23 0 2024-09-13T02:50:28.266 INFO:tasks.workunit.client.0.smithi100.stdout:9/131: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:50:28.279 INFO:tasks.workunit.client.0.smithi100.stdout:1/152: creat de/d14/d22/f31 x:0 0 0 2024-09-13T02:50:28.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/89: getdents d2/d9 0 2024-09-13T02:50:28.282 INFO:tasks.workunit.client.0.smithi100.stdout:0/90: write d2/dd/d12/f14 [406070,91559] 0 2024-09-13T02:50:28.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/132: mkdir dd/d1b/d27 0 2024-09-13T02:50:28.285 INFO:tasks.workunit.client.0.smithi100.stdout:1/153: creat de/d12/f32 x:0 0 0 2024-09-13T02:50:28.296 INFO:tasks.workunit.client.0.smithi100.stdout:5/110: dwrite fa [0,4194304] 0 2024-09-13T02:50:28.296 INFO:tasks.workunit.client.0.smithi100.stdout:5/111: chown db/c25 2613892 1 2024-09-13T02:50:28.297 INFO:tasks.workunit.client.0.smithi100.stdout:4/100: dwrite d3/d6/f19 [0,4194304] 0 2024-09-13T02:50:28.299 INFO:tasks.workunit.client.0.smithi100.stdout:0/91: mknod d2/dd/d12/c20 0 2024-09-13T02:50:28.300 INFO:tasks.workunit.client.0.smithi100.stdout:9/133: mkdir dd/d1b/d1d/d28 0 2024-09-13T02:50:28.305 INFO:tasks.workunit.client.0.smithi100.stdout:8/148: dwrite df/d13/d20/f23 [0,4194304] 0 2024-09-13T02:50:28.307 INFO:tasks.workunit.client.0.smithi100.stdout:6/125: sync 2024-09-13T02:50:28.332 INFO:tasks.workunit.client.0.smithi100.stdout:5/112: creat db/f28 x:0 0 0 2024-09-13T02:50:28.333 INFO:tasks.workunit.client.0.smithi100.stdout:5/113: dread - db/f24 zero size 2024-09-13T02:50:28.333 INFO:tasks.workunit.client.0.smithi100.stdout:4/101: mkdir d3/d6/d21 0 2024-09-13T02:50:28.333 INFO:tasks.workunit.client.0.smithi100.stdout:4/102: readlink d3/d6/l1e 0 2024-09-13T02:50:28.342 INFO:tasks.workunit.client.0.smithi100.stdout:4/103: dread d3/d6/f19 [0,4194304] 0 2024-09-13T02:50:28.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/126: mknod d12/d14/c26 0 2024-09-13T02:50:28.351 INFO:tasks.workunit.client.0.smithi100.stdout:5/114: creat db/de/f29 x:0 0 0 2024-09-13T02:50:28.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/104: truncate f0 925776 0 2024-09-13T02:50:28.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/105: stat d3/dc/f12 0 2024-09-13T02:50:28.352 INFO:tasks.workunit.client.0.smithi100.stdout:4/106: read d3/d6/f10 [60905,32928] 0 2024-09-13T02:50:28.353 INFO:tasks.workunit.client.0.smithi100.stdout:9/134: link l7 dd/l29 0 2024-09-13T02:50:28.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/149: getdents df/d13 0 2024-09-13T02:50:28.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/150: truncate df/d13/d21/f29 780900 0 2024-09-13T02:50:28.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/151: write df/f2b [1058407,31826] 0 2024-09-13T02:50:28.355 INFO:tasks.workunit.client.0.smithi100.stdout:4/107: unlink d3/d6/d9/ca 0 2024-09-13T02:50:28.358 INFO:tasks.workunit.client.0.smithi100.stdout:4/108: unlink d3/d6/d9/l14 0 2024-09-13T02:50:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:9/135: symlink dd/l2a 0 2024-09-13T02:50:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:9/136: truncate dd/ff 1250097 0 2024-09-13T02:50:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:4/109: link d3/dc/c20 d3/dc/c22 0 2024-09-13T02:50:28.359 INFO:tasks.workunit.client.0.smithi100.stdout:9/137: readlink dd/l11 0 2024-09-13T02:50:28.361 INFO:tasks.workunit.client.0.smithi100.stdout:9/138: write dd/f1a [993440,58731] 0 2024-09-13T02:50:28.362 INFO:tasks.workunit.client.0.smithi100.stdout:9/139: fdatasync dd/f12 0 2024-09-13T02:50:28.364 INFO:tasks.workunit.client.0.smithi100.stdout:5/115: write db/f11 [3979148,123717] 0 2024-09-13T02:50:28.366 INFO:tasks.workunit.client.0.smithi100.stdout:9/140: mknod dd/d1b/c2b 0 2024-09-13T02:50:28.366 INFO:tasks.workunit.client.0.smithi100.stdout:4/110: dread d3/fb [0,4194304] 0 2024-09-13T02:50:28.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/116: mknod db/de/c2a 0 2024-09-13T02:50:28.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/117: write db/f24 [144595,86049] 0 2024-09-13T02:50:28.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/118: fdatasync db/de/f22 0 2024-09-13T02:50:28.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/119: read - db/de/f22 zero size 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/127: dwrite f2 [0,4194304] 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/128: creat d12/f27 x:0 0 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/129: stat f2 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/130: readlink d12/d14/l19 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:6/131: write d12/f16 [4928898,5839] 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:9/141: link dd/d1b/d21/f26 dd/d1b/d1d/f2c 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:9/142: truncate f9 1212462 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:9/143: write dd/f25 [201018,75196] 0 2024-09-13T02:50:28.370 INFO:tasks.workunit.client.0.smithi100.stdout:5/120: mkdir db/de/d1f/d2b 0 2024-09-13T02:50:28.374 INFO:tasks.workunit.client.0.smithi100.stdout:6/132: rmdir d12/d14/d1f 0 2024-09-13T02:50:28.375 INFO:tasks.workunit.client.0.smithi100.stdout:6/133: write fc [1425311,1783] 0 2024-09-13T02:50:28.377 INFO:tasks.workunit.client.0.smithi100.stdout:9/144: rename dd/c1c to dd/d1b/d1d/c2d 0 2024-09-13T02:50:28.378 INFO:tasks.workunit.client.0.smithi100.stdout:6/134: getdents d12/d14/d1c 0 2024-09-13T02:50:28.380 INFO:tasks.workunit.client.0.smithi100.stdout:5/121: dread db/f11 [0,4194304] 0 2024-09-13T02:50:28.381 INFO:tasks.workunit.client.0.smithi100.stdout:5/122: mknod db/de/c2c 0 2024-09-13T02:50:28.384 INFO:tasks.workunit.client.0.smithi100.stdout:9/145: dread f5 [0,4194304] 0 2024-09-13T02:50:28.386 INFO:tasks.workunit.client.0.smithi100.stdout:9/146: rename dd/f10 to dd/d1b/d24/f2e 0 2024-09-13T02:50:28.386 INFO:tasks.workunit.client.0.smithi100.stdout:9/147: chown dd/d1b/d21/f26 2053304544 1 2024-09-13T02:50:28.387 INFO:tasks.workunit.client.0.smithi100.stdout:5/123: fdatasync db/f24 0 2024-09-13T02:50:28.388 INFO:tasks.workunit.client.0.smithi100.stdout:5/124: fsync db/de/f22 0 2024-09-13T02:50:28.388 INFO:tasks.workunit.client.0.smithi100.stdout:4/111: dwrite d3/d6/f18 [0,4194304] 0 2024-09-13T02:50:28.388 INFO:tasks.workunit.client.0.smithi100.stdout:9/148: creat dd/d1b/d21/f2f x:0 0 0 2024-09-13T02:50:28.391 INFO:tasks.workunit.client.0.smithi100.stdout:4/112: rename d3/dc/f12 to d3/dc/f23 0 2024-09-13T02:50:28.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/135: dread f2 [0,4194304] 0 2024-09-13T02:50:28.413 INFO:tasks.workunit.client.0.smithi100.stdout:7/136: sync 2024-09-13T02:50:28.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/136: dwrite f2 [0,4194304] 0 2024-09-13T02:50:28.420 INFO:tasks.workunit.client.0.smithi100.stdout:5/125: dwrite db/de/f15 [0,4194304] 0 2024-09-13T02:50:28.420 INFO:tasks.workunit.client.0.smithi100.stdout:5/126: write db/de/f12 [697176,74600] 0 2024-09-13T02:50:28.420 INFO:tasks.workunit.client.0.smithi100.stdout:5/127: chown db/ff 3364923 1 2024-09-13T02:50:28.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/137: unlink fc 0 2024-09-13T02:50:28.421 INFO:tasks.workunit.client.0.smithi100.stdout:2/156: sync 2024-09-13T02:50:28.422 INFO:tasks.workunit.client.0.smithi100.stdout:4/113: dread f0 [0,4194304] 0 2024-09-13T02:50:28.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/128: dread f8 [0,4194304] 0 2024-09-13T02:50:28.423 INFO:tasks.workunit.client.0.smithi100.stdout:5/129: chown db/c25 300772 1 2024-09-13T02:50:28.426 INFO:tasks.workunit.client.0.smithi100.stdout:5/130: link db/de/f1c db/de/d1f/d2b/f2d 0 2024-09-13T02:50:28.426 INFO:tasks.workunit.client.0.smithi100.stdout:5/131: write db/f24 [178853,76070] 0 2024-09-13T02:50:28.430 INFO:tasks.workunit.client.0.smithi100.stdout:7/137: dwrite d3/fa [0,4194304] 0 2024-09-13T02:50:28.436 INFO:tasks.workunit.client.0.smithi100.stdout:7/138: mkdir d3/d16/d25 0 2024-09-13T02:50:28.436 INFO:tasks.workunit.client.0.smithi100.stdout:7/139: fdatasync d3/f15 0 2024-09-13T02:50:28.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/140: mknod d3/d5/c26 0 2024-09-13T02:50:28.440 INFO:tasks.workunit.client.0.smithi100.stdout:7/141: creat d3/d5/f27 x:0 0 0 2024-09-13T02:50:28.440 INFO:tasks.workunit.client.0.smithi100.stdout:7/142: write d3/d5/f27 [673970,68395] 0 2024-09-13T02:50:28.442 INFO:tasks.workunit.client.0.smithi100.stdout:7/143: rename d3/f18 to d3/d5/d1b/f28 0 2024-09-13T02:50:28.442 INFO:tasks.workunit.client.0.smithi100.stdout:7/144: read d3/d5/d1b/f28 [163115,40312] 0 2024-09-13T02:50:28.460 INFO:tasks.workunit.client.0.smithi100.stdout:4/114: dwrite d3/d6/f18 [0,4194304] 0 2024-09-13T02:50:28.461 INFO:tasks.workunit.client.0.smithi100.stdout:6/138: dwrite f2 [0,4194304] 0 2024-09-13T02:50:28.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/132: dwrite db/de/f22 [0,4194304] 0 2024-09-13T02:50:28.461 INFO:tasks.workunit.client.0.smithi100.stdout:7/145: dwrite f0 [0,4194304] 0 2024-09-13T02:50:28.464 INFO:tasks.workunit.client.0.smithi100.stdout:5/133: mknod db/c2e 0 2024-09-13T02:50:28.464 INFO:tasks.workunit.client.0.smithi100.stdout:5/134: read db/f11 [2867365,34846] 0 2024-09-13T02:50:28.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/146: mknod d3/d5/d1b/c29 0 2024-09-13T02:50:28.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/147: readlink d3/d5/l24 0 2024-09-13T02:50:28.467 INFO:tasks.workunit.client.0.smithi100.stdout:5/135: rename db/de/f12 to db/f2f 0 2024-09-13T02:50:28.467 INFO:tasks.workunit.client.0.smithi100.stdout:5/136: fdatasync db/f2f 0 2024-09-13T02:50:28.469 INFO:tasks.workunit.client.0.smithi100.stdout:5/137: rename db/de/f1c to db/de/d1f/d2b/f30 0 2024-09-13T02:50:28.471 INFO:tasks.workunit.client.0.smithi100.stdout:5/138: creat db/de/d1f/f31 x:0 0 0 2024-09-13T02:50:28.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/139: write f2 [1388172,128001] 0 2024-09-13T02:50:28.472 INFO:tasks.workunit.client.0.smithi100.stdout:5/139: rename c1 to db/de/c32 0 2024-09-13T02:50:28.473 INFO:tasks.workunit.client.0.smithi100.stdout:6/140: mkdir d12/d14/d1c/d28 0 2024-09-13T02:50:28.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/140: truncate db/de/d1f/d2b/f30 4188046 0 2024-09-13T02:50:28.474 INFO:tasks.workunit.client.0.smithi100.stdout:5/141: readlink db/de/l1b 0 2024-09-13T02:50:28.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/142: dread - db/de/d1f/f31 zero size 2024-09-13T02:50:28.475 INFO:tasks.workunit.client.0.smithi100.stdout:4/115: dwrite d3/d6/d9/fd [0,4194304] 0 2024-09-13T02:50:28.475 INFO:tasks.workunit.client.0.smithi100.stdout:4/116: write d3/d6/d9/f11 [536162,112099] 0 2024-09-13T02:50:28.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/141: mknod d12/d14/c29 0 2024-09-13T02:50:28.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/142: write d12/d14/f1a [209745,26253] 0 2024-09-13T02:50:28.477 INFO:tasks.workunit.client.0.smithi100.stdout:5/143: creat db/de/d1f/d2b/f33 x:0 0 0 2024-09-13T02:50:28.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/117: link d3/dc/f23 d3/d6/d21/f24 0 2024-09-13T02:50:28.481 INFO:tasks.workunit.client.0.smithi100.stdout:7/148: dwrite f0 [0,4194304] 0 2024-09-13T02:50:28.481 INFO:tasks.workunit.client.0.smithi100.stdout:5/144: rename db/ff to db/de/d1f/d2b/f34 0 2024-09-13T02:50:28.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/118: mkdir d3/d6/d9/d25 0 2024-09-13T02:50:28.487 INFO:tasks.workunit.client.0.smithi100.stdout:7/149: creat d3/d5/f2a x:0 0 0 2024-09-13T02:50:28.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/119: creat d3/d6/f26 x:0 0 0 2024-09-13T02:50:28.489 INFO:tasks.workunit.client.0.smithi100.stdout:7/150: truncate d3/d5/f27 659921 0 2024-09-13T02:50:28.489 INFO:tasks.workunit.client.0.smithi100.stdout:7/151: readlink d3/l12 0 2024-09-13T02:50:28.489 INFO:tasks.workunit.client.0.smithi100.stdout:7/152: write d3/fc [156927,3993] 0 2024-09-13T02:50:28.491 INFO:tasks.workunit.client.0.smithi100.stdout:7/153: symlink d3/d5/d1b/l2b 0 2024-09-13T02:50:28.494 INFO:tasks.workunit.client.0.smithi100.stdout:6/143: truncate f2 587907 0 2024-09-13T02:50:28.494 INFO:tasks.workunit.client.0.smithi100.stdout:6/144: stat d12/d14/l19 0 2024-09-13T02:50:28.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/120: write d3/d6/d9/fd [2901048,104685] 0 2024-09-13T02:50:28.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/154: write d3/d5/f27 [1178869,53815] 0 2024-09-13T02:50:28.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/155: chown d3/d5/f27 35 1 2024-09-13T02:50:28.496 INFO:tasks.workunit.client.0.smithi100.stdout:7/156: chown f0 107 1 2024-09-13T02:50:28.498 INFO:tasks.workunit.client.0.smithi100.stdout:3/175: sync 2024-09-13T02:50:28.498 INFO:tasks.workunit.client.0.smithi100.stdout:7/157: mknod d3/d5/d1b/c2c 0 2024-09-13T02:50:28.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/145: write d12/d14/d1c/f22 [2639636,80543] 0 2024-09-13T02:50:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:3/176: rmdir d10/d34 0 2024-09-13T02:50:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:3/177: write d10/d21/f29 [329030,121977] 0 2024-09-13T02:50:28.502 INFO:tasks.workunit.client.0.smithi100.stdout:5/145: write db/de/d1f/d2b/f30 [2746939,72363] 0 2024-09-13T02:50:28.503 INFO:tasks.workunit.client.0.smithi100.stdout:7/158: mkdir d3/d2d 0 2024-09-13T02:50:28.503 INFO:tasks.workunit.client.0.smithi100.stdout:7/159: write d3/d5/f27 [1299878,38096] 0 2024-09-13T02:50:28.504 INFO:tasks.workunit.client.0.smithi100.stdout:6/146: fsync d12/d14/d1c/f22 0 2024-09-13T02:50:28.504 INFO:tasks.workunit.client.0.smithi100.stdout:6/147: stat d12/f27 0 2024-09-13T02:50:28.505 INFO:tasks.workunit.client.0.smithi100.stdout:3/178: symlink d10/l37 0 2024-09-13T02:50:28.505 INFO:tasks.workunit.client.0.smithi100.stdout:3/179: stat d10/d21/f29 0 2024-09-13T02:50:28.505 INFO:tasks.workunit.client.0.smithi100.stdout:3/180: creat d10/f38 x:0 0 0 2024-09-13T02:50:28.506 INFO:tasks.workunit.client.0.smithi100.stdout:4/121: write d3/d6/f19 [1968454,108446] 0 2024-09-13T02:50:28.506 INFO:tasks.workunit.client.0.smithi100.stdout:5/146: link db/de/f29 db/de/d1f/d2b/f35 0 2024-09-13T02:50:28.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/160: getdents d3/d5/d1b 0 2024-09-13T02:50:28.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/161: readlink d3/l12 0 2024-09-13T02:50:28.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/162: chown d3/d5/d1b/d1c 0 1 2024-09-13T02:50:28.509 INFO:tasks.workunit.client.0.smithi100.stdout:3/181: symlink d10/l39 0 2024-09-13T02:50:28.509 INFO:tasks.workunit.client.0.smithi100.stdout:3/182: fsync d10/f33 0 2024-09-13T02:50:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:4/122: rename d3/d6/d1d to d3/d6/d9/d27 0 2024-09-13T02:50:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:1/154: sync 2024-09-13T02:50:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/147: mknod db/de/d1f/c36 0 2024-09-13T02:50:28.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/148: creat db/de/d1f/d2b/f37 x:0 0 0 2024-09-13T02:50:28.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/163: symlink d3/d2d/l2e 0 2024-09-13T02:50:28.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/164: write d3/d5/f1e [4562694,6063] 0 2024-09-13T02:50:28.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/183: link d10/f16 d10/f3a 0 2024-09-13T02:50:28.515 INFO:tasks.workunit.client.0.smithi100.stdout:3/184: dread - d10/d21/f2d zero size 2024-09-13T02:50:28.517 INFO:tasks.workunit.client.0.smithi100.stdout:4/123: creat d3/d6/d9/d27/f28 x:0 0 0 2024-09-13T02:50:28.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/149: unlink db/f24 0 2024-09-13T02:50:28.520 INFO:tasks.workunit.client.0.smithi100.stdout:7/165: write d3/d5/f17 [226167,40888] 0 2024-09-13T02:50:28.521 INFO:tasks.workunit.client.0.smithi100.stdout:3/185: creat d10/d21/f3b x:0 0 0 2024-09-13T02:50:28.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/124: rename d3/d6/l1e to d3/d6/d9/l29 0 2024-09-13T02:50:28.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/125: chown d3/l17 131230550 1 2024-09-13T02:50:28.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/126: chown d3/fb 387 1 2024-09-13T02:50:28.523 INFO:tasks.workunit.client.0.smithi100.stdout:4/127: stat d3/d6/d9/d27/f15 0 2024-09-13T02:50:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:7/166: mknod d3/d16/c2f 0 2024-09-13T02:50:28.524 INFO:tasks.workunit.client.0.smithi100.stdout:7/167: chown d3/d2d 5207725 1 2024-09-13T02:50:28.525 INFO:tasks.workunit.client.0.smithi100.stdout:4/128: mknod d3/d6/d9/d27/c2a 0 2024-09-13T02:50:28.525 INFO:tasks.workunit.client.0.smithi100.stdout:4/129: chown d3/fb 4607398 1 2024-09-13T02:50:28.526 INFO:tasks.workunit.client.0.smithi100.stdout:5/150: getdents db/de 0 2024-09-13T02:50:28.527 INFO:tasks.workunit.client.0.smithi100.stdout:1/155: dwrite de/f11 [0,4194304] 0 2024-09-13T02:50:28.527 INFO:tasks.workunit.client.0.smithi100.stdout:6/148: dwrite d12/d14/d1c/f22 [4194304,4194304] 0 2024-09-13T02:50:28.528 INFO:tasks.workunit.client.0.smithi100.stdout:7/168: creat d3/d5/d1b/d1c/f30 x:0 0 0 2024-09-13T02:50:28.528 INFO:tasks.workunit.client.0.smithi100.stdout:7/169: chown d3 7402 1 2024-09-13T02:50:28.528 INFO:tasks.workunit.client.0.smithi100.stdout:7/170: readlink d3/d2d/l2e 0 2024-09-13T02:50:28.528 INFO:tasks.workunit.client.0.smithi100.stdout:4/130: creat d3/d6/d9/f2b x:0 0 0 2024-09-13T02:50:28.529 INFO:tasks.workunit.client.0.smithi100.stdout:5/151: mknod db/de/d1f/c38 0 2024-09-13T02:50:28.529 INFO:tasks.workunit.client.0.smithi100.stdout:5/152: creat db/f39 x:0 0 0 2024-09-13T02:50:28.530 INFO:tasks.workunit.client.0.smithi100.stdout:5/153: stat db/de/d1f/c38 0 2024-09-13T02:50:28.530 INFO:tasks.workunit.client.0.smithi100.stdout:5/154: dread - db/de/d1f/f31 zero size 2024-09-13T02:50:28.533 INFO:tasks.workunit.client.0.smithi100.stdout:4/131: symlink d3/d6/l2c 0 2024-09-13T02:50:28.533 INFO:tasks.workunit.client.0.smithi100.stdout:4/132: stat d3/l17 0 2024-09-13T02:50:28.535 INFO:tasks.workunit.client.0.smithi100.stdout:5/155: unlink db/de/c2c 0 2024-09-13T02:50:28.536 INFO:tasks.workunit.client.0.smithi100.stdout:7/171: symlink d3/d5/l31 0 2024-09-13T02:50:28.540 INFO:tasks.workunit.client.0.smithi100.stdout:7/172: rename d3/d5/fe to d3/d16/f32 0 2024-09-13T02:50:28.540 INFO:tasks.workunit.client.0.smithi100.stdout:7/173: write d3/d16/f32 [8323674,120914] 0 2024-09-13T02:50:28.543 INFO:tasks.workunit.client.0.smithi100.stdout:3/186: dwrite d10/f2b [0,4194304] 0 2024-09-13T02:50:28.543 INFO:tasks.workunit.client.0.smithi100.stdout:3/187: write f2 [2250010,75255] 0 2024-09-13T02:50:28.546 INFO:tasks.workunit.client.0.smithi100.stdout:7/174: symlink d3/d5/d1b/l33 0 2024-09-13T02:50:28.548 INFO:tasks.workunit.client.0.smithi100.stdout:3/188: unlink fe 0 2024-09-13T02:50:28.548 INFO:tasks.workunit.client.0.smithi100.stdout:3/189: truncate d10/d21/f2f 316601 0 2024-09-13T02:50:28.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/175: rmdir d3/d5/d1b/d1c 39 2024-09-13T02:50:28.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/176: write d3/fc [569353,90288] 0 2024-09-13T02:50:28.554 INFO:tasks.workunit.client.0.smithi100.stdout:4/133: rmdir d3 39 2024-09-13T02:50:28.554 INFO:tasks.workunit.client.0.smithi100.stdout:7/177: readlink d3/d5/l10 0 2024-09-13T02:50:28.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/156: dwrite f1 [4194304,4194304] 0 2024-09-13T02:50:28.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/157: fsync de/d14/f1a 0 2024-09-13T02:50:28.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/158: creat de/d12/f33 x:0 0 0 2024-09-13T02:50:28.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/159: truncate de/f11 5143692 0 2024-09-13T02:50:28.557 INFO:tasks.workunit.client.0.smithi100.stdout:1/160: fdatasync de/d14/f1a 0 2024-09-13T02:50:28.557 INFO:tasks.workunit.client.0.smithi100.stdout:4/134: unlink d3/c8 0 2024-09-13T02:50:28.557 INFO:tasks.workunit.client.0.smithi100.stdout:4/135: write d3/f4 [4101252,16126] 0 2024-09-13T02:50:28.557 INFO:tasks.workunit.client.0.smithi100.stdout:4/136: chown d3/d6/d9 6137 1 2024-09-13T02:50:28.557 INFO:tasks.workunit.client.0.smithi100.stdout:7/178: unlink d3/d5/d1b/c2c 0 2024-09-13T02:50:28.559 INFO:tasks.workunit.client.0.smithi100.stdout:1/161: rename c9 to de/c34 0 2024-09-13T02:50:28.559 INFO:tasks.workunit.client.0.smithi100.stdout:1/162: creat de/d14/d22/f35 x:0 0 0 2024-09-13T02:50:28.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/137: mkdir d3/d6/d9/d27/d2d 0 2024-09-13T02:50:28.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/138: readlink d3/l1a 0 2024-09-13T02:50:28.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/139: chown f0 0 1 2024-09-13T02:50:28.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/179: link d3/d5/d1b/l2b d3/l34 0 2024-09-13T02:50:28.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/180: write d3/d5/f27 [1203066,21443] 0 2024-09-13T02:50:28.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/181: write d3/d16/f32 [6997453,51419] 0 2024-09-13T02:50:28.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/163: creat de/d14/f36 x:0 0 0 2024-09-13T02:50:28.563 INFO:tasks.workunit.client.0.smithi100.stdout:4/140: creat d3/d6/d9/f2e x:0 0 0 2024-09-13T02:50:28.564 INFO:tasks.workunit.client.0.smithi100.stdout:7/182: symlink d3/d5/d1b/l35 0 2024-09-13T02:50:28.565 INFO:tasks.workunit.client.0.smithi100.stdout:4/141: mkdir d3/d6/d2f 0 2024-09-13T02:50:28.565 INFO:tasks.workunit.client.0.smithi100.stdout:4/142: chown d3/d6/d9/d27/c2a 0 1 2024-09-13T02:50:28.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/183: mkdir d3/d5/d1b/d1c/d36 0 2024-09-13T02:50:28.566 INFO:tasks.workunit.client.0.smithi100.stdout:7/184: write d3/d5/f2a [619021,22188] 0 2024-09-13T02:50:28.566 INFO:tasks.workunit.client.0.smithi100.stdout:4/143: rmdir d3/d6/d21 39 2024-09-13T02:50:28.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/144: stat d3/d6/d9 0 2024-09-13T02:50:28.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/145: dread - d3/d6/d9/f2e zero size 2024-09-13T02:50:28.567 INFO:tasks.workunit.client.0.smithi100.stdout:4/146: symlink d3/d6/d21/l30 0 2024-09-13T02:50:28.567 INFO:tasks.workunit.client.0.smithi100.stdout:6/149: dwrite d12/f16 [0,4194304] 0 2024-09-13T02:50:28.568 INFO:tasks.workunit.client.0.smithi100.stdout:5/156: dwrite db/f39 [0,4194304] 0 2024-09-13T02:50:28.572 INFO:tasks.workunit.client.0.smithi100.stdout:3/190: truncate f2 5180339 0 2024-09-13T02:50:28.572 INFO:tasks.workunit.client.0.smithi100.stdout:3/191: dread - d10/f38 zero size 2024-09-13T02:50:28.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/157: symlink db/de/d1f/d2b/l3a 0 2024-09-13T02:50:28.581 INFO:tasks.workunit.client.0.smithi100.stdout:7/185: dread d3/d5/f1e [4194304,4194304] 0 2024-09-13T02:50:28.582 INFO:tasks.workunit.client.0.smithi100.stdout:3/192: link d10/l36 d10/d21/l3c 0 2024-09-13T02:50:28.584 INFO:tasks.workunit.client.0.smithi100.stdout:3/193: symlink d10/l3d 0 2024-09-13T02:50:28.585 INFO:tasks.workunit.client.0.smithi100.stdout:3/194: readlink d10/l26 0 2024-09-13T02:50:28.585 INFO:tasks.workunit.client.0.smithi100.stdout:7/186: link d3/d5/c22 d3/d5/c37 0 2024-09-13T02:50:28.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/150: dwrite f7 [0,4194304] 0 2024-09-13T02:50:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:2/157: sync 2024-09-13T02:50:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:8/152: sync 2024-09-13T02:50:28.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/149: sync 2024-09-13T02:50:28.595 INFO:tasks.workunit.client.0.smithi100.stdout:6/151: creat d12/d14/d1c/d28/f2a x:0 0 0 2024-09-13T02:50:28.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/150: write dd/d1b/d21/f2f [111117,97927] 0 2024-09-13T02:50:28.595 INFO:tasks.workunit.client.0.smithi100.stdout:0/92: sync 2024-09-13T02:50:28.595 INFO:tasks.workunit.client.0.smithi100.stdout:3/195: getdents d10/d21 0 2024-09-13T02:50:28.596 INFO:tasks.workunit.client.0.smithi100.stdout:4/147: dwrite d3/d6/f1c [0,4194304] 0 2024-09-13T02:50:28.596 INFO:tasks.workunit.client.0.smithi100.stdout:4/148: write d3/d6/f10 [1394113,57543] 0 2024-09-13T02:50:28.596 INFO:tasks.workunit.client.0.smithi100.stdout:4/149: chown d3/d6/f10 213180186 1 2024-09-13T02:50:28.596 INFO:tasks.workunit.client.0.smithi100.stdout:8/153: write df/d13/d20/d18/f39 [1119265,37695] 0 2024-09-13T02:50:28.598 INFO:tasks.workunit.client.0.smithi100.stdout:0/93: mkdir d2/d9/d21 0 2024-09-13T02:50:28.599 INFO:tasks.workunit.client.0.smithi100.stdout:3/196: unlink f3 0 2024-09-13T02:50:28.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/187: write d3/f15 [711367,114553] 0 2024-09-13T02:50:28.601 INFO:tasks.workunit.client.0.smithi100.stdout:6/152: rmdir d12 39 2024-09-13T02:50:28.601 INFO:tasks.workunit.client.0.smithi100.stdout:6/153: write d12/d14/f1a [995512,32725] 0 2024-09-13T02:50:28.602 INFO:tasks.workunit.client.0.smithi100.stdout:3/197: mknod d10/d21/c3e 0 2024-09-13T02:50:28.602 INFO:tasks.workunit.client.0.smithi100.stdout:3/198: fdatasync fb 0 2024-09-13T02:50:28.603 INFO:tasks.workunit.client.0.smithi100.stdout:8/154: getdents df/d13/d20/d18 0 2024-09-13T02:50:28.604 INFO:tasks.workunit.client.0.smithi100.stdout:3/199: truncate d10/f16 5002240 0 2024-09-13T02:50:28.605 INFO:tasks.workunit.client.0.smithi100.stdout:7/188: symlink d3/d5/l38 0 2024-09-13T02:50:28.609 INFO:tasks.workunit.client.0.smithi100.stdout:3/200: mknod d10/d21/c3f 0 2024-09-13T02:50:28.609 INFO:tasks.workunit.client.0.smithi100.stdout:8/155: dread df/d13/d20/d18/f36 [0,4194304] 0 2024-09-13T02:50:28.609 INFO:tasks.workunit.client.0.smithi100.stdout:3/201: creat d10/f40 x:0 0 0 2024-09-13T02:50:28.609 INFO:tasks.workunit.client.0.smithi100.stdout:0/94: dread d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:3/202: mknod d10/d21/c41 0 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:3/203: chown d10/d21/f29 55026 1 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:0/95: rename c0 to d2/d9/d21/c22 0 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:8/156: write df/f2b [793637,68959] 0 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:3/204: creat d10/d21/f42 x:0 0 0 2024-09-13T02:50:28.610 INFO:tasks.workunit.client.0.smithi100.stdout:3/205: write d10/f33 [171737,60404] 0 2024-09-13T02:50:28.611 INFO:tasks.workunit.client.0.smithi100.stdout:8/157: symlink df/d13/d20/d18/d2c/l3e 0 2024-09-13T02:50:28.611 INFO:tasks.workunit.client.0.smithi100.stdout:8/158: readlink df/l11 0 2024-09-13T02:50:28.611 INFO:tasks.workunit.client.0.smithi100.stdout:3/206: mknod d10/d21/c43 0 2024-09-13T02:50:28.611 INFO:tasks.workunit.client.0.smithi100.stdout:3/207: creat d10/f44 x:0 0 0 2024-09-13T02:50:28.612 INFO:tasks.workunit.client.0.smithi100.stdout:8/159: mknod df/d13/d20/d18/d2c/c3f 0 2024-09-13T02:50:28.613 INFO:tasks.workunit.client.0.smithi100.stdout:3/208: symlink d10/l45 0 2024-09-13T02:50:28.614 INFO:tasks.workunit.client.0.smithi100.stdout:3/209: creat d10/d21/f46 x:0 0 0 2024-09-13T02:50:28.616 INFO:tasks.workunit.client.0.smithi100.stdout:3/210: rename d10/l1c to d10/l47 0 2024-09-13T02:50:28.616 INFO:tasks.workunit.client.0.smithi100.stdout:3/211: creat d10/d21/f48 x:0 0 0 2024-09-13T02:50:28.616 INFO:tasks.workunit.client.0.smithi100.stdout:3/212: dread - d10/d21/f2d zero size 2024-09-13T02:50:28.617 INFO:tasks.workunit.client.0.smithi100.stdout:3/213: write fb [41450,11414] 0 2024-09-13T02:50:28.617 INFO:tasks.workunit.client.0.smithi100.stdout:6/154: dread d12/f16 [0,4194304] 0 2024-09-13T02:50:28.631 INFO:tasks.workunit.client.0.smithi100.stdout:4/150: dwrite d3/d6/d9/fd [0,4194304] 0 2024-09-13T02:50:28.631 INFO:tasks.workunit.client.0.smithi100.stdout:2/158: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:28.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/189: dwrite d3/fa [4194304,4194304] 0 2024-09-13T02:50:28.632 INFO:tasks.workunit.client.0.smithi100.stdout:4/151: dread f0 [0,4194304] 0 2024-09-13T02:50:28.633 INFO:tasks.workunit.client.0.smithi100.stdout:0/96: dwrite d2/fa [0,4194304] 0 2024-09-13T02:50:28.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/190: creat d3/d5/d1b/d1c/f39 x:0 0 0 2024-09-13T02:50:28.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/191: write d3/fc [2618091,129230] 0 2024-09-13T02:50:28.640 INFO:tasks.workunit.client.0.smithi100.stdout:4/152: symlink d3/l31 0 2024-09-13T02:50:28.640 INFO:tasks.workunit.client.0.smithi100.stdout:0/97: mkdir d2/d1a/d23 0 2024-09-13T02:50:28.641 INFO:tasks.workunit.client.0.smithi100.stdout:0/98: chown d2/dd/d12/f18 220 1 2024-09-13T02:50:28.641 INFO:tasks.workunit.client.0.smithi100.stdout:2/159: getdents d0/db/d21 0 2024-09-13T02:50:28.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/192: rmdir d3/d16/d25 0 2024-09-13T02:50:28.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/153: symlink d3/d6/d2f/l32 0 2024-09-13T02:50:28.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/99: mknod d2/d9/c24 0 2024-09-13T02:50:28.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/100: chown d2/l8 265 1 2024-09-13T02:50:28.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/160: dread d0/f1f [0,4194304] 0 2024-09-13T02:50:28.645 INFO:tasks.workunit.client.0.smithi100.stdout:7/193: symlink d3/d16/l3a 0 2024-09-13T02:50:28.646 INFO:tasks.workunit.client.0.smithi100.stdout:7/194: mkdir d3/d16/d3b 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/101: dread d2/d1a/f1c [0,4194304] 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/102: readlink d2/l4 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/103: read d2/d9/fb [178015,5545] 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/214: truncate d10/f3a 3770324 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/215: creat d10/f49 x:0 0 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/216: truncate d10/d21/f2d 364683 0 2024-09-13T02:50:28.648 INFO:tasks.workunit.client.0.smithi100.stdout:3/217: write d10/d21/f28 [446837,76917] 0 2024-09-13T02:50:28.649 INFO:tasks.workunit.client.0.smithi100.stdout:0/104: symlink d2/d1a/l25 0 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:3/218: mknod d10/c4a 0 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:3/219: chown d10/d21/l25 0 1 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:3/220: write d10/f1b [676654,10116] 0 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/161: write d0/f1f [757380,71280] 0 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:7/195: dread d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:28.651 INFO:tasks.workunit.client.0.smithi100.stdout:7/196: creat d3/f3c x:0 0 0 2024-09-13T02:50:28.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/197: dread d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:28.654 INFO:tasks.workunit.client.0.smithi100.stdout:4/154: rmdir d3 39 2024-09-13T02:50:28.655 INFO:tasks.workunit.client.0.smithi100.stdout:0/105: mknod d2/c26 0 2024-09-13T02:50:28.655 INFO:tasks.workunit.client.0.smithi100.stdout:7/198: mknod d3/d5/d1b/c3d 0 2024-09-13T02:50:28.655 INFO:tasks.workunit.client.0.smithi100.stdout:7/199: truncate d3/d5/f17 1220693 0 2024-09-13T02:50:28.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/155: creat d3/d6/d2f/f33 x:0 0 0 2024-09-13T02:50:28.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/156: fsync d3/d6/f18 0 2024-09-13T02:50:28.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/157: read - d3/d6/f26 zero size 2024-09-13T02:50:28.657 INFO:tasks.workunit.client.0.smithi100.stdout:3/221: dread fb [0,4194304] 0 2024-09-13T02:50:28.657 INFO:tasks.workunit.client.0.smithi100.stdout:3/222: chown d10/l47 35881 1 2024-09-13T02:50:28.658 INFO:tasks.workunit.client.0.smithi100.stdout:0/106: rename d2/f17 to d2/d1a/d23/f27 0 2024-09-13T02:50:28.660 INFO:tasks.workunit.client.0.smithi100.stdout:7/200: truncate d3/d5/f27 684820 0 2024-09-13T02:50:28.661 INFO:tasks.workunit.client.0.smithi100.stdout:7/201: write d3/fc [1995087,49831] 0 2024-09-13T02:50:28.662 INFO:tasks.workunit.client.0.smithi100.stdout:7/202: creat d3/d5/d1b/d1c/f3e x:0 0 0 2024-09-13T02:50:28.662 INFO:tasks.workunit.client.0.smithi100.stdout:3/223: rename d10/l18 to d10/d21/l4b 0 2024-09-13T02:50:28.662 INFO:tasks.workunit.client.0.smithi100.stdout:3/224: chown d10/f1b 1317620 1 2024-09-13T02:50:28.665 INFO:tasks.workunit.client.0.smithi100.stdout:7/203: symlink d3/l3f 0 2024-09-13T02:50:28.668 INFO:tasks.workunit.client.0.smithi100.stdout:7/204: getdents d3/d5 0 2024-09-13T02:50:28.669 INFO:tasks.workunit.client.0.smithi100.stdout:7/205: read d3/d5/f2a [548314,82819] 0 2024-09-13T02:50:28.672 INFO:tasks.workunit.client.0.smithi100.stdout:4/158: rmdir d3/d6/d2f 39 2024-09-13T02:50:28.673 INFO:tasks.workunit.client.0.smithi100.stdout:4/159: mkdir d3/d6/d9/d27/d34 0 2024-09-13T02:50:28.674 INFO:tasks.workunit.client.0.smithi100.stdout:4/160: getdents d3/d6/d9/d25 0 2024-09-13T02:50:28.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/161: creat d3/d6/f35 x:0 0 0 2024-09-13T02:50:28.676 INFO:tasks.workunit.client.0.smithi100.stdout:4/162: creat d3/d6/d9/d27/d2d/f36 x:0 0 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/163: symlink d3/d6/d2f/l37 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/164: creat d3/d6/f38 x:0 0 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/165: readlink d3/d6/d9/l29 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/166: fsync d3/d6/f1c 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/167: fdatasync d3/d6/d21/f24 0 2024-09-13T02:50:28.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/168: fsync d3/d6/d9/d27/f28 0 2024-09-13T02:50:28.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/169: write d3/d6/d9/f11 [249074,69906] 0 2024-09-13T02:50:28.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/170: chown d3/d6/d9/d27/d2d/f36 5 1 2024-09-13T02:50:28.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/171: chown d3/d6/f35 2 1 2024-09-13T02:50:28.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/172: write d3/d6/f26 [716603,107028] 0 2024-09-13T02:50:28.679 INFO:tasks.workunit.client.0.smithi100.stdout:4/173: dread - d3/d6/d21/f24 zero size 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:0/107: dwrite d2/d9/fb [4194304,4194304] 0 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/225: dwrite d10/f32 [0,4194304] 0 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/226: readlink d10/l26 0 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/227: read - d10/f44 zero size 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/228: write d10/f31 [949347,100309] 0 2024-09-13T02:50:28.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/229: chown d10/d21/f3b 642 1 2024-09-13T02:50:28.692 INFO:tasks.workunit.client.0.smithi100.stdout:2/162: dwrite d0/db/f26 [0,4194304] 0 2024-09-13T02:50:28.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/108: mkdir d2/d9/d21/d28 0 2024-09-13T02:50:28.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/109: chown d2/dd/d12/f16 60410 1 2024-09-13T02:50:28.698 INFO:tasks.workunit.client.0.smithi100.stdout:0/110: link d2/fa d2/d1a/f29 0 2024-09-13T02:50:28.698 INFO:tasks.workunit.client.0.smithi100.stdout:0/111: chown d2/fa 81313047 1 2024-09-13T02:50:28.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/174: dwrite d3/d6/f18 [0,4194304] 0 2024-09-13T02:50:28.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/175: write d3/d6/f1c [4748860,11649] 0 2024-09-13T02:50:28.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/176: chown d3/d6/d21 13410 1 2024-09-13T02:50:28.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/177: chown d3/d6/f10 4329692 1 2024-09-13T02:50:28.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/163: dread d0/f11 [0,4194304] 0 2024-09-13T02:50:28.704 INFO:tasks.workunit.client.0.smithi100.stdout:2/164: write d0/f19 [2091553,65060] 0 2024-09-13T02:50:28.704 INFO:tasks.workunit.client.0.smithi100.stdout:2/165: chown d0/f20 9800891 1 2024-09-13T02:50:28.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/112: truncate d2/d1a/f29 3809840 0 2024-09-13T02:50:28.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/113: stat d2/d9/f1b 0 2024-09-13T02:50:28.709 INFO:tasks.workunit.client.0.smithi100.stdout:7/206: dwrite d3/d5/f17 [0,4194304] 0 2024-09-13T02:50:28.709 INFO:tasks.workunit.client.0.smithi100.stdout:3/230: dwrite d10/f2a [0,4194304] 0 2024-09-13T02:50:28.711 INFO:tasks.workunit.client.0.smithi100.stdout:7/207: creat d3/d5/d1b/d1c/d36/f40 x:0 0 0 2024-09-13T02:50:28.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/208: creat d3/d2d/f41 x:0 0 0 2024-09-13T02:50:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:3/231: rmdir d10/d21 39 2024-09-13T02:50:28.715 INFO:tasks.workunit.client.0.smithi100.stdout:3/232: rmdir d10/d21 39 2024-09-13T02:50:28.716 INFO:tasks.workunit.client.0.smithi100.stdout:7/209: write d3/fc [2503641,79465] 0 2024-09-13T02:50:28.717 INFO:tasks.workunit.client.0.smithi100.stdout:7/210: dread d3/d5/f27 [0,4194304] 0 2024-09-13T02:50:28.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/114: dread d2/d1a/f29 [0,4194304] 0 2024-09-13T02:50:28.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/115: write d2/dd/d12/f14 [1270430,14292] 0 2024-09-13T02:50:28.731 INFO:tasks.workunit.client.0.smithi100.stdout:0/116: dread d2/d1a/f1c [0,4194304] 0 2024-09-13T02:50:28.731 INFO:tasks.workunit.client.0.smithi100.stdout:0/117: write d2/dd/d12/f16 [438765,1705] 0 2024-09-13T02:50:28.747 INFO:tasks.workunit.client.0.smithi100.stdout:3/233: dwrite f2 [0,4194304] 0 2024-09-13T02:50:28.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/211: dwrite d3/d5/d1b/d1c/f30 [0,4194304] 0 2024-09-13T02:50:28.747 INFO:tasks.workunit.client.0.smithi100.stdout:0/118: dwrite d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:28.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/212: mknod d3/d5/c42 0 2024-09-13T02:50:28.752 INFO:tasks.workunit.client.0.smithi100.stdout:7/213: fdatasync d3/d5/f1a 0 2024-09-13T02:50:28.752 INFO:tasks.workunit.client.0.smithi100.stdout:7/214: creat d3/d2d/f43 x:0 0 0 2024-09-13T02:50:28.752 INFO:tasks.workunit.client.0.smithi100.stdout:0/119: mkdir d2/d9/d21/d2a 0 2024-09-13T02:50:28.753 INFO:tasks.workunit.client.0.smithi100.stdout:7/215: symlink d3/d5/l44 0 2024-09-13T02:50:28.753 INFO:tasks.workunit.client.0.smithi100.stdout:7/216: fsync f0 0 2024-09-13T02:50:28.754 INFO:tasks.workunit.client.0.smithi100.stdout:0/120: rename d2/d1a/d23/f27 to d2/d9/d21/d2a/f2b 0 2024-09-13T02:50:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/121: rmdir d2/d9/d21 39 2024-09-13T02:50:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/122: write d2/dd/d12/f16 [1413299,83436] 0 2024-09-13T02:50:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:0/123: write d2/d9/fb [1608267,37148] 0 2024-09-13T02:50:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/164: sync 2024-09-13T02:50:28.755 INFO:tasks.workunit.client.0.smithi100.stdout:5/158: sync 2024-09-13T02:50:28.758 INFO:tasks.workunit.client.0.smithi100.stdout:1/165: creat de/d14/d2e/f37 x:0 0 0 2024-09-13T02:50:28.758 INFO:tasks.workunit.client.0.smithi100.stdout:1/166: creat de/d14/d2e/f38 x:0 0 0 2024-09-13T02:50:28.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/159: rmdir db/de/d1f 39 2024-09-13T02:50:28.759 INFO:tasks.workunit.client.0.smithi100.stdout:5/160: creat db/f3b x:0 0 0 2024-09-13T02:50:28.760 INFO:tasks.workunit.client.0.smithi100.stdout:1/167: mkdir de/d14/d39 0 2024-09-13T02:50:28.761 INFO:tasks.workunit.client.0.smithi100.stdout:5/161: truncate fa 1426206 0 2024-09-13T02:50:28.761 INFO:tasks.workunit.client.0.smithi100.stdout:5/162: creat db/f3c x:0 0 0 2024-09-13T02:50:28.763 INFO:tasks.workunit.client.0.smithi100.stdout:1/168: rmdir de/d12 39 2024-09-13T02:50:28.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/169: link de/f11 de/f3a 0 2024-09-13T02:50:28.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/170: mknod de/c3b 0 2024-09-13T02:50:28.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/171: fsync de/d14/d22/f31 0 2024-09-13T02:50:28.765 INFO:tasks.workunit.client.0.smithi100.stdout:1/172: read f7 [806874,8784] 0 2024-09-13T02:50:28.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/124: write d2/f5 [272246,46101] 0 2024-09-13T02:50:28.767 INFO:tasks.workunit.client.0.smithi100.stdout:0/125: dread - d2/d9/f1b zero size 2024-09-13T02:50:28.768 INFO:tasks.workunit.client.0.smithi100.stdout:3/234: dwrite d10/f44 [0,4194304] 0 2024-09-13T02:50:28.768 INFO:tasks.workunit.client.0.smithi100.stdout:3/235: fsync d10/d21/f29 0 2024-09-13T02:50:28.768 INFO:tasks.workunit.client.0.smithi100.stdout:7/217: dwrite d3/d5/f1a [0,4194304] 0 2024-09-13T02:50:28.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/126: unlink d2/d1a/f1c 0 2024-09-13T02:50:28.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/127: dread d2/f11 [0,4194304] 0 2024-09-13T02:50:28.774 INFO:tasks.workunit.client.0.smithi100.stdout:3/236: rmdir d10 39 2024-09-13T02:50:28.775 INFO:tasks.workunit.client.0.smithi100.stdout:0/128: link d2/l4 d2/d1a/l2c 0 2024-09-13T02:50:28.776 INFO:tasks.workunit.client.0.smithi100.stdout:3/237: mknod d10/c4c 0 2024-09-13T02:50:28.778 INFO:tasks.workunit.client.0.smithi100.stdout:5/163: getdents db 0 2024-09-13T02:50:28.779 INFO:tasks.workunit.client.0.smithi100.stdout:5/164: symlink db/l3d 0 2024-09-13T02:50:28.779 INFO:tasks.workunit.client.0.smithi100.stdout:5/165: dread - db/f28 zero size 2024-09-13T02:50:28.780 INFO:tasks.workunit.client.0.smithi100.stdout:5/166: mkdir db/de/d3e 0 2024-09-13T02:50:28.780 INFO:tasks.workunit.client.0.smithi100.stdout:5/167: truncate db/de/d1f/d2b/f33 245394 0 2024-09-13T02:50:28.781 INFO:tasks.workunit.client.0.smithi100.stdout:5/168: rename db/de/d1f/c38 to db/de/d1f/c3f 0 2024-09-13T02:50:28.783 INFO:tasks.workunit.client.0.smithi100.stdout:5/169: creat db/f40 x:0 0 0 2024-09-13T02:50:28.784 INFO:tasks.workunit.client.0.smithi100.stdout:7/218: dwrite d3/d5/d1b/f28 [0,4194304] 0 2024-09-13T02:50:28.785 INFO:tasks.workunit.client.0.smithi100.stdout:5/170: unlink db/f40 0 2024-09-13T02:50:28.789 INFO:tasks.workunit.client.0.smithi100.stdout:0/129: dread d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:28.791 INFO:tasks.workunit.client.0.smithi100.stdout:5/171: getdents db/de 0 2024-09-13T02:50:28.792 INFO:tasks.workunit.client.0.smithi100.stdout:7/219: write d3/d5/f1a [2671624,28297] 0 2024-09-13T02:50:28.793 INFO:tasks.workunit.client.0.smithi100.stdout:5/172: creat db/de/f41 x:0 0 0 2024-09-13T02:50:28.794 INFO:tasks.workunit.client.0.smithi100.stdout:0/130: write d2/fa [873673,117912] 0 2024-09-13T02:50:28.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/238: dwrite d10/f32 [0,4194304] 0 2024-09-13T02:50:28.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/173: truncate db/de/f22 1399909 0 2024-09-13T02:50:28.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/174: truncate db/de/f41 817325 0 2024-09-13T02:50:28.797 INFO:tasks.workunit.client.0.smithi100.stdout:0/131: link d2/dd/d12/f16 d2/d1a/d23/f2d 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/239: getdents d10 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/240: truncate d10/d21/f42 331326 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/241: read d10/d21/f2f [147943,67376] 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/175: truncate f8 117868 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/242: write d10/f2b [4245958,60105] 0 2024-09-13T02:50:28.799 INFO:tasks.workunit.client.0.smithi100.stdout:5/176: write db/de/f41 [750062,7741] 0 2024-09-13T02:50:28.800 INFO:tasks.workunit.client.0.smithi100.stdout:0/132: rmdir d2/d9/d21/d2a 39 2024-09-13T02:50:28.800 INFO:tasks.workunit.client.0.smithi100.stdout:5/177: dread db/de/d1f/d2b/f33 [0,4194304] 0 2024-09-13T02:50:28.801 INFO:tasks.workunit.client.0.smithi100.stdout:3/243: unlink d10/d21/f28 0 2024-09-13T02:50:28.802 INFO:tasks.workunit.client.0.smithi100.stdout:0/133: symlink d2/d9/d21/l2e 0 2024-09-13T02:50:28.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/178: rename db/de/d1f/d2b/f37 to db/de/d3e/f42 0 2024-09-13T02:50:28.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/179: dread - db/de/d3e/f42 zero size 2024-09-13T02:50:28.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/180: fdatasync f8 0 2024-09-13T02:50:28.805 INFO:tasks.workunit.client.0.smithi100.stdout:7/220: dread d3/d5/f1a [4194304,4194304] 0 2024-09-13T02:50:28.805 INFO:tasks.workunit.client.0.smithi100.stdout:3/244: mknod d10/d21/c4d 0 2024-09-13T02:50:28.807 INFO:tasks.workunit.client.0.smithi100.stdout:0/134: link d2/dd/c13 d2/d9/d21/c2f 0 2024-09-13T02:50:28.807 INFO:tasks.workunit.client.0.smithi100.stdout:0/135: chown d2/d1a/l1d 1267877 1 2024-09-13T02:50:28.809 INFO:tasks.workunit.client.0.smithi100.stdout:3/245: creat d10/f4e x:0 0 0 2024-09-13T02:50:28.813 INFO:tasks.workunit.client.0.smithi100.stdout:7/221: getdents d3/d5/d1b/d1c 0 2024-09-13T02:50:28.813 INFO:tasks.workunit.client.0.smithi100.stdout:7/222: readlink d3/l3f 0 2024-09-13T02:50:28.813 INFO:tasks.workunit.client.0.smithi100.stdout:0/136: dread d2/dd/d12/f14 [0,4194304] 0 2024-09-13T02:50:28.813 INFO:tasks.workunit.client.0.smithi100.stdout:3/246: symlink d10/l4f 0 2024-09-13T02:50:28.814 INFO:tasks.workunit.client.0.smithi100.stdout:3/247: fsync d10/f44 0 2024-09-13T02:50:28.814 INFO:tasks.workunit.client.0.smithi100.stdout:7/223: rename f0 to d3/d16/d3b/f45 0 2024-09-13T02:50:28.814 INFO:tasks.workunit.client.0.smithi100.stdout:0/137: truncate d2/dd/d12/f14 1050948 0 2024-09-13T02:50:28.815 INFO:tasks.workunit.client.0.smithi100.stdout:5/181: write db/f39 [457426,110648] 0 2024-09-13T02:50:28.815 INFO:tasks.workunit.client.0.smithi100.stdout:8/160: sync 2024-09-13T02:50:28.815 INFO:tasks.workunit.client.0.smithi100.stdout:9/151: sync 2024-09-13T02:50:28.815 INFO:tasks.workunit.client.0.smithi100.stdout:7/224: symlink d3/d16/l46 0 2024-09-13T02:50:28.816 INFO:tasks.workunit.client.0.smithi100.stdout:0/138: symlink d2/dd/l30 0 2024-09-13T02:50:28.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/182: mknod db/de/d1f/c43 0 2024-09-13T02:50:28.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/183: write f4 [4298340,97366] 0 2024-09-13T02:50:28.819 INFO:tasks.workunit.client.0.smithi100.stdout:7/225: truncate d3/fa 6008987 0 2024-09-13T02:50:28.819 INFO:tasks.workunit.client.0.smithi100.stdout:0/139: mknod d2/dd/c31 0 2024-09-13T02:50:28.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/248: dread f8 [0,4194304] 0 2024-09-13T02:50:28.821 INFO:tasks.workunit.client.0.smithi100.stdout:5/184: creat db/de/d1f/f44 x:0 0 0 2024-09-13T02:50:28.822 INFO:tasks.workunit.client.0.smithi100.stdout:0/140: symlink d2/d1a/d23/l32 0 2024-09-13T02:50:28.823 INFO:tasks.workunit.client.0.smithi100.stdout:7/226: dread d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:28.823 INFO:tasks.workunit.client.0.smithi100.stdout:3/249: link d10/f32 d10/f50 0 2024-09-13T02:50:28.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/227: symlink d3/d5/d1b/d1c/d36/l47 0 2024-09-13T02:50:28.826 INFO:tasks.workunit.client.0.smithi100.stdout:7/228: dread - d3/d2d/f43 zero size 2024-09-13T02:50:28.826 INFO:tasks.workunit.client.0.smithi100.stdout:3/250: mkdir d10/d21/d51 0 2024-09-13T02:50:28.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/185: dread db/de/d1f/d2b/f30 [0,4194304] 0 2024-09-13T02:50:28.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/186: write db/de/f41 [1786257,95931] 0 2024-09-13T02:50:28.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/187: creat db/de/f45 x:0 0 0 2024-09-13T02:50:28.828 INFO:tasks.workunit.client.0.smithi100.stdout:7/229: link d3/l34 d3/d5/d1b/l48 0 2024-09-13T02:50:28.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/230: write d3/d5/f1e [2151551,127589] 0 2024-09-13T02:50:28.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/231: chown d3/d2d/f41 58272 1 2024-09-13T02:50:28.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/141: rename d2/dd/d12 to d2/dd/d33 0 2024-09-13T02:50:28.832 INFO:tasks.workunit.client.0.smithi100.stdout:7/232: mkdir d3/d16/d3b/d49 0 2024-09-13T02:50:28.833 INFO:tasks.workunit.client.0.smithi100.stdout:0/142: unlink d2/d1a/f29 0 2024-09-13T02:50:28.834 INFO:tasks.workunit.client.0.smithi100.stdout:7/233: creat d3/d16/d3b/d49/f4a x:0 0 0 2024-09-13T02:50:28.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/234: rename d3/d5/l44 to d3/d5/l4b 0 2024-09-13T02:50:28.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/235: creat d3/f4c x:0 0 0 2024-09-13T02:50:28.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/236: read d3/fc [348504,129395] 0 2024-09-13T02:50:28.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/237: write d3/d16/f32 [7956299,107208] 0 2024-09-13T02:50:28.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/238: dread - d3/d5/d1b/d1c/f39 zero size 2024-09-13T02:50:28.838 INFO:tasks.workunit.client.0.smithi100.stdout:7/239: getdents d3/d2d 0 2024-09-13T02:50:28.839 INFO:tasks.workunit.client.0.smithi100.stdout:9/152: dwrite f9 [0,4194304] 0 2024-09-13T02:50:28.841 INFO:tasks.workunit.client.0.smithi100.stdout:9/153: dread dd/f1a [0,4194304] 0 2024-09-13T02:50:28.842 INFO:tasks.workunit.client.0.smithi100.stdout:8/161: dwrite df/d13/f37 [0,4194304] 0 2024-09-13T02:50:28.842 INFO:tasks.workunit.client.0.smithi100.stdout:5/188: getdents db/de/d1f 0 2024-09-13T02:50:28.843 INFO:tasks.workunit.client.0.smithi100.stdout:5/189: write db/de/d1f/f31 [125665,27553] 0 2024-09-13T02:50:28.844 INFO:tasks.workunit.client.0.smithi100.stdout:9/154: creat dd/d1b/d1d/d28/f30 x:0 0 0 2024-09-13T02:50:28.847 INFO:tasks.workunit.client.0.smithi100.stdout:0/143: getdents d2/dd 0 2024-09-13T02:50:28.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/190: mknod db/de/c46 0 2024-09-13T02:50:28.850 INFO:tasks.workunit.client.0.smithi100.stdout:5/191: truncate db/de/f41 2452357 0 2024-09-13T02:50:28.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/162: dread df/d13/f19 [0,4194304] 0 2024-09-13T02:50:28.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/163: readlink df/d13/d21/l3d 0 2024-09-13T02:50:28.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/164: read f3 [191370,23716] 0 2024-09-13T02:50:28.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/155: mkdir dd/d1b/d31 0 2024-09-13T02:50:28.854 INFO:tasks.workunit.client.0.smithi100.stdout:9/156: dread dd/f19 [0,4194304] 0 2024-09-13T02:50:28.854 INFO:tasks.workunit.client.0.smithi100.stdout:9/157: chown dd/d1b/d1d/f1f 12 1 2024-09-13T02:50:28.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/192: rename db/c13 to db/de/d1f/c47 0 2024-09-13T02:50:28.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/193: write fa [1781398,12619] 0 2024-09-13T02:50:28.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/194: stat f8 0 2024-09-13T02:50:28.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/165: unlink df/d13/c2a 0 2024-09-13T02:50:28.857 INFO:tasks.workunit.client.0.smithi100.stdout:0/144: write d2/d9/fb [4663045,8958] 0 2024-09-13T02:50:28.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/158: symlink dd/d1b/d27/l32 0 2024-09-13T02:50:28.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/159: readlink dd/l29 0 2024-09-13T02:50:28.860 INFO:tasks.workunit.client.0.smithi100.stdout:5/195: dread db/f11 [0,4194304] 0 2024-09-13T02:50:28.860 INFO:tasks.workunit.client.0.smithi100.stdout:0/145: rename d2/d9/d21/d2a to d2/d1a/d23/d34 0 2024-09-13T02:50:28.861 INFO:tasks.workunit.client.0.smithi100.stdout:8/166: getdents df/d13/d20 0 2024-09-13T02:50:28.861 INFO:tasks.workunit.client.0.smithi100.stdout:8/167: fsync df/d13/d20/f23 0 2024-09-13T02:50:28.862 INFO:tasks.workunit.client.0.smithi100.stdout:0/146: creat d2/d9/d21/d28/f35 x:0 0 0 2024-09-13T02:50:28.862 INFO:tasks.workunit.client.0.smithi100.stdout:6/155: sync 2024-09-13T02:50:28.863 INFO:tasks.workunit.client.0.smithi100.stdout:2/166: sync 2024-09-13T02:50:28.863 INFO:tasks.workunit.client.0.smithi100.stdout:4/178: sync 2024-09-13T02:50:28.864 INFO:tasks.workunit.client.0.smithi100.stdout:6/156: getdents d12 0 2024-09-13T02:50:28.865 INFO:tasks.workunit.client.0.smithi100.stdout:6/157: chown ca 946677 1 2024-09-13T02:50:28.866 INFO:tasks.workunit.client.0.smithi100.stdout:2/167: truncate d0/f18 1947598 0 2024-09-13T02:50:28.867 INFO:tasks.workunit.client.0.smithi100.stdout:0/147: mknod d2/c36 0 2024-09-13T02:50:28.870 INFO:tasks.workunit.client.0.smithi100.stdout:5/196: dread fa [0,4194304] 0 2024-09-13T02:50:28.871 INFO:tasks.workunit.client.0.smithi100.stdout:6/158: mknod d12/d14/d1c/c2b 0 2024-09-13T02:50:28.871 INFO:tasks.workunit.client.0.smithi100.stdout:0/148: symlink d2/l37 0 2024-09-13T02:50:28.872 INFO:tasks.workunit.client.0.smithi100.stdout:0/149: write d2/d9/fb [6652261,35567] 0 2024-09-13T02:50:28.873 INFO:tasks.workunit.client.0.smithi100.stdout:6/159: unlink d12/d14/d1c/f22 0 2024-09-13T02:50:28.873 INFO:tasks.workunit.client.0.smithi100.stdout:6/160: fsync d12/f16 0 2024-09-13T02:50:28.874 INFO:tasks.workunit.client.0.smithi100.stdout:0/150: write d2/dd/d33/f18 [261084,22504] 0 2024-09-13T02:50:28.876 INFO:tasks.workunit.client.0.smithi100.stdout:0/151: mknod d2/dd/c38 0 2024-09-13T02:50:28.876 INFO:tasks.workunit.client.0.smithi100.stdout:4/179: write d3/fb [1754734,128491] 0 2024-09-13T02:50:28.877 INFO:tasks.workunit.client.0.smithi100.stdout:4/180: creat d3/d6/d9/d27/f39 x:0 0 0 2024-09-13T02:50:28.878 INFO:tasks.workunit.client.0.smithi100.stdout:0/152: dread d2/dd/d33/f14 [0,4194304] 0 2024-09-13T02:50:28.879 INFO:tasks.workunit.client.0.smithi100.stdout:4/181: mkdir d3/d3a 0 2024-09-13T02:50:28.880 INFO:tasks.workunit.client.0.smithi100.stdout:0/153: creat d2/d1a/d23/d34/f39 x:0 0 0 2024-09-13T02:50:28.881 INFO:tasks.workunit.client.0.smithi100.stdout:4/182: mkdir d3/d6/d9/d27/d34/d3b 0 2024-09-13T02:50:28.882 INFO:tasks.workunit.client.0.smithi100.stdout:0/154: symlink d2/d1a/d23/l3a 0 2024-09-13T02:50:28.882 INFO:tasks.workunit.client.0.smithi100.stdout:0/155: chown d2/d9/fb 24 1 2024-09-13T02:50:28.883 INFO:tasks.workunit.client.0.smithi100.stdout:0/156: fdatasync d2/d1a/d23/d34/f2b 0 2024-09-13T02:50:28.883 INFO:tasks.workunit.client.0.smithi100.stdout:0/157: chown d2/c26 80616 1 2024-09-13T02:50:28.884 INFO:tasks.workunit.client.0.smithi100.stdout:4/183: creat d3/d6/d9/f3c x:0 0 0 2024-09-13T02:50:28.884 INFO:tasks.workunit.client.0.smithi100.stdout:0/158: write d2/d1a/f1e [181489,19330] 0 2024-09-13T02:50:28.885 INFO:tasks.workunit.client.0.smithi100.stdout:4/184: rename d3/d6/d2f/l37 to d3/d6/d9/d27/d2d/l3d 0 2024-09-13T02:50:28.885 INFO:tasks.workunit.client.0.smithi100.stdout:0/159: truncate d2/d1a/d23/d34/f2b 541611 0 2024-09-13T02:50:28.885 INFO:tasks.workunit.client.0.smithi100.stdout:0/160: readlink d2/dd/l30 0 2024-09-13T02:50:28.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/161: mkdir d2/dd/d33/d3b 0 2024-09-13T02:50:28.888 INFO:tasks.workunit.client.0.smithi100.stdout:0/162: mkdir d2/d1a/d23/d34/d3c 0 2024-09-13T02:50:28.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/168: dwrite fc [0,4194304] 0 2024-09-13T02:50:28.899 INFO:tasks.workunit.client.0.smithi100.stdout:9/160: dwrite f5 [0,4194304] 0 2024-09-13T02:50:28.899 INFO:tasks.workunit.client.0.smithi100.stdout:9/161: chown dd/d1b/d1d 0 1 2024-09-13T02:50:28.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/169: dread df/d13/d21/f29 [0,4194304] 0 2024-09-13T02:50:28.900 INFO:tasks.workunit.client.0.smithi100.stdout:8/170: write df/d13/d20/d18/f36 [1359165,119884] 0 2024-09-13T02:50:28.912 INFO:tasks.workunit.client.0.smithi100.stdout:5/197: dwrite db/de/f15 [4194304,4194304] 0 2024-09-13T02:50:28.912 INFO:tasks.workunit.client.0.smithi100.stdout:2/168: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:28.912 INFO:tasks.workunit.client.0.smithi100.stdout:2/169: read d0/db/ff [161049,53719] 0 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:2/170: chown d0/f19 285 1 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:2/171: write d0/db/ff [1915692,99662] 0 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/161: dwrite f7 [0,4194304] 0 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/162: dread - d12/f27 zero size 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:4/185: dwrite d3/d6/f19 [0,4194304] 0 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:4/186: write d3/d6/f38 [683351,35207] 0 2024-09-13T02:50:28.913 INFO:tasks.workunit.client.0.smithi100.stdout:6/163: write d12/d14/f1a [759241,105616] 0 2024-09-13T02:50:28.915 INFO:tasks.workunit.client.0.smithi100.stdout:5/198: mknod db/c48 0 2024-09-13T02:50:28.917 INFO:tasks.workunit.client.0.smithi100.stdout:2/172: symlink d0/db/d23/l29 0 2024-09-13T02:50:28.920 INFO:tasks.workunit.client.0.smithi100.stdout:4/187: mkdir d3/d6/d9/d27/d2d/d3e 0 2024-09-13T02:50:28.920 INFO:tasks.workunit.client.0.smithi100.stdout:4/188: stat d3/d6/d9/d27/f28 0 2024-09-13T02:50:28.922 INFO:tasks.workunit.client.0.smithi100.stdout:6/164: mknod d12/d14/d1c/c2c 0 2024-09-13T02:50:28.923 INFO:tasks.workunit.client.0.smithi100.stdout:5/199: rename db/de/l23 to db/de/d1f/l49 0 2024-09-13T02:50:28.924 INFO:tasks.workunit.client.0.smithi100.stdout:2/173: creat d0/db/d23/f2a x:0 0 0 2024-09-13T02:50:28.925 INFO:tasks.workunit.client.0.smithi100.stdout:4/189: rmdir d3/dc 39 2024-09-13T02:50:28.925 INFO:tasks.workunit.client.0.smithi100.stdout:4/190: write d3/d6/d9/f2b [461856,37223] 0 2024-09-13T02:50:28.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:28 smithi100 ceph-mon[27894]: pgmap v245: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 9.8 MiB/s rd, 23 MiB/s wr, 926 op/s 2024-09-13T02:50:28.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/165: creat d12/d14/f2d x:0 0 0 2024-09-13T02:50:28.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/166: readlink l10 0 2024-09-13T02:50:28.927 INFO:tasks.workunit.client.0.smithi100.stdout:4/191: rename d3/d6/d9/d27/d2d/d3e to d3/d6/d9/d27/d2d/d3f 0 2024-09-13T02:50:28.927 INFO:tasks.workunit.client.0.smithi100.stdout:0/163: getdents d2/d1a/d23/d34 0 2024-09-13T02:50:28.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/167: mkdir d12/d2e 0 2024-09-13T02:50:28.930 INFO:tasks.workunit.client.0.smithi100.stdout:5/200: dread db/f39 [0,4194304] 0 2024-09-13T02:50:28.930 INFO:tasks.workunit.client.0.smithi100.stdout:4/192: unlink d3/d6/d9/f2b 0 2024-09-13T02:50:28.930 INFO:tasks.workunit.client.0.smithi100.stdout:4/193: chown d3/dc/c20 356 1 2024-09-13T02:50:28.931 INFO:tasks.workunit.client.0.smithi100.stdout:0/164: mknod d2/d9/c3d 0 2024-09-13T02:50:28.932 INFO:tasks.workunit.client.0.smithi100.stdout:5/201: unlink db/f39 0 2024-09-13T02:50:28.933 INFO:tasks.workunit.client.0.smithi100.stdout:6/168: dread f2 [0,4194304] 0 2024-09-13T02:50:28.933 INFO:tasks.workunit.client.0.smithi100.stdout:4/194: symlink d3/d6/d9/d27/d34/l40 0 2024-09-13T02:50:28.934 INFO:tasks.workunit.client.0.smithi100.stdout:0/165: mkdir d2/d9/d21/d3e 0 2024-09-13T02:50:28.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:28 smithi122 ceph-mon[34559]: pgmap v245: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 9.8 MiB/s rd, 23 MiB/s wr, 926 op/s 2024-09-13T02:50:28.936 INFO:tasks.workunit.client.0.smithi100.stdout:5/202: creat db/de/d1f/d2b/f4a x:0 0 0 2024-09-13T02:50:28.937 INFO:tasks.workunit.client.0.smithi100.stdout:6/169: mkdir d12/d14/d2f 0 2024-09-13T02:50:28.939 INFO:tasks.workunit.client.0.smithi100.stdout:4/195: rename d3/d6/d9/d27/f28 to d3/d6/d9/d27/f41 0 2024-09-13T02:50:28.940 INFO:tasks.workunit.client.0.smithi100.stdout:5/203: rmdir db/de/d1f 39 2024-09-13T02:50:28.941 INFO:tasks.workunit.client.0.smithi100.stdout:6/170: creat d12/d14/d1c/f30 x:0 0 0 2024-09-13T02:50:28.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/173: sync 2024-09-13T02:50:28.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/174: chown de/f11 15 1 2024-09-13T02:50:28.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/251: sync 2024-09-13T02:50:28.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/252: creat d10/f52 x:0 0 0 2024-09-13T02:50:28.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/253: fdatasync d10/d21/f48 0 2024-09-13T02:50:28.944 INFO:tasks.workunit.client.0.smithi100.stdout:3/254: getdents d10/d21/d51 0 2024-09-13T02:50:28.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/175: dread de/d12/f30 [0,4194304] 0 2024-09-13T02:50:28.956 INFO:tasks.workunit.client.0.smithi100.stdout:0/166: dread d2/d1a/d23/d34/f2b [0,4194304] 0 2024-09-13T02:50:28.957 INFO:tasks.workunit.client.0.smithi100.stdout:0/167: write d2/dd/f10 [3333177,121048] 0 2024-09-13T02:50:28.958 INFO:tasks.workunit.client.0.smithi100.stdout:5/204: getdents db/de 0 2024-09-13T02:50:28.962 INFO:tasks.workunit.client.0.smithi100.stdout:5/205: creat db/de/d1f/f4b x:0 0 0 2024-09-13T02:50:28.962 INFO:tasks.workunit.client.0.smithi100.stdout:5/206: truncate db/de/d1f/d2b/f33 848520 0 2024-09-13T02:50:28.975 INFO:tasks.workunit.client.0.smithi100.stdout:4/196: dwrite d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:28.976 INFO:tasks.workunit.client.0.smithi100.stdout:4/197: write d3/d6/f26 [681226,10550] 0 2024-09-13T02:50:28.986 INFO:tasks.workunit.client.0.smithi100.stdout:4/198: dread d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:28.986 INFO:tasks.workunit.client.0.smithi100.stdout:4/199: chown d3/d6/d9/f11 4172232 1 2024-09-13T02:50:28.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/200: mkdir d3/d6/d9/d27/d2d/d42 0 2024-09-13T02:50:28.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/201: chown d3/d6 126475 1 2024-09-13T02:50:28.987 INFO:tasks.workunit.client.0.smithi100.stdout:4/202: creat d3/d6/d21/f43 x:0 0 0 2024-09-13T02:50:28.989 INFO:tasks.workunit.client.0.smithi100.stdout:2/174: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:50:28.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/175: symlink d0/db/d23/l2b 0 2024-09-13T02:50:28.990 INFO:tasks.workunit.client.0.smithi100.stdout:2/176: getdents d0/db 0 2024-09-13T02:50:28.991 INFO:tasks.workunit.client.0.smithi100.stdout:2/177: write d0/f20 [148253,37209] 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:2/178: chown d0/f1 74 1 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:6/171: dwrite d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:6/172: write d12/f27 [11369,112976] 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:6/173: readlink d12/d14/d1c/l1d 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:6/174: readlink l3 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:6/175: chown d12/d14/f2d 4025 1 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:1/176: dwrite de/d14/f1a [4194304,4194304] 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:1/177: truncate de/d12/f2a 214133 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:0/168: dwrite d2/dd/d33/f18 [0,4194304] 0 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:0/169: chown d2/d1a/d23/f2d 35765572 1 2024-09-13T02:50:28.992 INFO:tasks.workunit.client.0.smithi100.stdout:5/207: dwrite db/de/f22 [0,4194304] 0 2024-09-13T02:50:28.993 INFO:tasks.workunit.client.0.smithi100.stdout:2/179: creat d0/f2c x:0 0 0 2024-09-13T02:50:28.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/178: dread f8 [0,4194304] 0 2024-09-13T02:50:28.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/179: chown de/c34 6 1 2024-09-13T02:50:28.994 INFO:tasks.workunit.client.0.smithi100.stdout:1/180: truncate de/d14/d2e/f37 318165 0 2024-09-13T02:50:28.995 INFO:tasks.workunit.client.0.smithi100.stdout:1/181: write de/d14/f36 [340586,40062] 0 2024-09-13T02:50:28.995 INFO:tasks.workunit.client.0.smithi100.stdout:1/182: fdatasync de/d14/d2e/f27 0 2024-09-13T02:50:28.995 INFO:tasks.workunit.client.0.smithi100.stdout:0/170: mknod d2/d1a/c3f 0 2024-09-13T02:50:28.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/203: dread d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:28.998 INFO:tasks.workunit.client.0.smithi100.stdout:3/255: dwrite d10/d21/f3b [0,4194304] 0 2024-09-13T02:50:28.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/204: chown d3/d6/f38 14 1 2024-09-13T02:50:28.998 INFO:tasks.workunit.client.0.smithi100.stdout:0/171: dread d2/d1a/d23/f2d [0,4194304] 0 2024-09-13T02:50:28.999 INFO:tasks.workunit.client.0.smithi100.stdout:5/208: unlink db/de/d1f/d2b/f30 0 2024-09-13T02:50:28.999 INFO:tasks.workunit.client.0.smithi100.stdout:5/209: fsync db/f3b 0 2024-09-13T02:50:28.999 INFO:tasks.workunit.client.0.smithi100.stdout:5/210: dread - db/f3c zero size 2024-09-13T02:50:28.999 INFO:tasks.workunit.client.0.smithi100.stdout:5/211: write db/f3b [45446,110540] 0 2024-09-13T02:50:29.001 INFO:tasks.workunit.client.0.smithi100.stdout:2/180: dread d0/f1 [0,4194304] 0 2024-09-13T02:50:29.004 INFO:tasks.workunit.client.0.smithi100.stdout:4/205: creat d3/d6/d9/d27/d2d/d3f/f44 x:0 0 0 2024-09-13T02:50:29.005 INFO:tasks.workunit.client.0.smithi100.stdout:0/172: creat d2/dd/d33/d3b/f40 x:0 0 0 2024-09-13T02:50:29.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/181: creat d0/db/f2d x:0 0 0 2024-09-13T02:50:29.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/182: chown d0/db/d23/f2a 0 1 2024-09-13T02:50:29.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/183: write d0/db/d23/f2a [253081,28913] 0 2024-09-13T02:50:29.006 INFO:tasks.workunit.client.0.smithi100.stdout:2/184: fdatasync d0/db/d21/f25 0 2024-09-13T02:50:29.007 INFO:tasks.workunit.client.0.smithi100.stdout:2/185: stat d0/db/f12 0 2024-09-13T02:50:29.007 INFO:tasks.workunit.client.0.smithi100.stdout:0/173: mknod d2/d9/c41 0 2024-09-13T02:50:29.007 INFO:tasks.workunit.client.0.smithi100.stdout:0/174: stat d2/dd/d33/c20 0 2024-09-13T02:50:29.008 INFO:tasks.workunit.client.0.smithi100.stdout:0/175: fdatasync d2/d1a/d23/d34/f39 0 2024-09-13T02:50:29.008 INFO:tasks.workunit.client.0.smithi100.stdout:0/176: symlink d2/d9/d21/l42 0 2024-09-13T02:50:29.009 INFO:tasks.workunit.client.0.smithi100.stdout:0/177: stat d2/d9/d21/d28/f35 0 2024-09-13T02:50:29.009 INFO:tasks.workunit.client.0.smithi100.stdout:0/178: chown d2/d1a/f1e 5924 1 2024-09-13T02:50:29.009 INFO:tasks.workunit.client.0.smithi100.stdout:2/186: getdents d0 0 2024-09-13T02:50:29.009 INFO:tasks.workunit.client.0.smithi100.stdout:0/179: write d2/dd/d33/f16 [1041359,81454] 0 2024-09-13T02:50:29.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/180: mkdir d2/dd/d33/d43 0 2024-09-13T02:50:29.012 INFO:tasks.workunit.client.0.smithi100.stdout:0/181: mknod d2/dd/d33/c44 0 2024-09-13T02:50:29.012 INFO:tasks.workunit.client.0.smithi100.stdout:0/182: write d2/dd/f10 [2624474,107665] 0 2024-09-13T02:50:29.012 INFO:tasks.workunit.client.0.smithi100.stdout:0/183: chown d2/d9/d21/l2e 82604792 1 2024-09-13T02:50:29.012 INFO:tasks.workunit.client.0.smithi100.stdout:0/184: read - d2/d9/f1b zero size 2024-09-13T02:50:29.012 INFO:tasks.workunit.client.0.smithi100.stdout:3/256: dwrite d10/f4e [0,4194304] 0 2024-09-13T02:50:29.017 INFO:tasks.workunit.client.0.smithi100.stdout:0/185: symlink d2/l45 0 2024-09-13T02:50:29.020 INFO:tasks.workunit.client.0.smithi100.stdout:7/240: sync 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:8/171: sync 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:9/162: sync 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:8/172: stat df/d13/d21 0 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/241: dread - d3/d5/d1b/d1c/d36/f40 zero size 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:9/163: dread - dd/d1b/d1d/f2c zero size 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:7/242: readlink d3/d5/d1b/l33 0 2024-09-13T02:50:29.021 INFO:tasks.workunit.client.0.smithi100.stdout:9/164: truncate dd/f1a 700600 0 2024-09-13T02:50:29.022 INFO:tasks.workunit.client.0.smithi100.stdout:4/206: rmdir d3/d6/d9/d27/d2d 39 2024-09-13T02:50:29.022 INFO:tasks.workunit.client.0.smithi100.stdout:4/207: write d3/d6/d9/d27/f15 [571266,60458] 0 2024-09-13T02:50:29.027 INFO:tasks.workunit.client.0.smithi100.stdout:9/165: dread dd/d1b/d21/f2f [0,4194304] 0 2024-09-13T02:50:29.028 INFO:tasks.workunit.client.0.smithi100.stdout:9/166: mknod dd/d1b/d1d/c33 0 2024-09-13T02:50:29.029 INFO:tasks.workunit.client.0.smithi100.stdout:9/167: fsync fc 0 2024-09-13T02:50:29.029 INFO:tasks.workunit.client.0.smithi100.stdout:9/168: truncate dd/d1b/d21/f2f 725401 0 2024-09-13T02:50:29.030 INFO:tasks.workunit.client.0.smithi100.stdout:9/169: rename ca to dd/d1b/c34 0 2024-09-13T02:50:29.031 INFO:tasks.workunit.client.0.smithi100.stdout:9/170: creat dd/d1b/d24/f35 x:0 0 0 2024-09-13T02:50:29.032 INFO:tasks.workunit.client.0.smithi100.stdout:9/171: rmdir dd/d1b/d21 39 2024-09-13T02:50:29.032 INFO:tasks.workunit.client.0.smithi100.stdout:9/172: write fb [982530,105445] 0 2024-09-13T02:50:29.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/173: dread df/d13/d20/f23 [0,4194304] 0 2024-09-13T02:50:29.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/174: write df/d13/d21/f29 [841784,19885] 0 2024-09-13T02:50:29.033 INFO:tasks.workunit.client.0.smithi100.stdout:8/175: creat df/d13/d21/f40 x:0 0 0 2024-09-13T02:50:29.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/173: mkdir dd/d1b/d1d/d36 0 2024-09-13T02:50:29.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/176: mkdir df/d13/d20/d18/d41 0 2024-09-13T02:50:29.041 INFO:tasks.workunit.client.0.smithi100.stdout:3/257: dwrite d10/d21/f29 [0,4194304] 0 2024-09-13T02:50:29.043 INFO:tasks.workunit.client.0.smithi100.stdout:2/187: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T02:50:29.043 INFO:tasks.workunit.client.0.smithi100.stdout:2/188: readlink d0/db/d23/l2b 0 2024-09-13T02:50:29.043 INFO:tasks.workunit.client.0.smithi100.stdout:2/189: readlink d0/db/l1d 0 2024-09-13T02:50:29.048 INFO:tasks.workunit.client.0.smithi100.stdout:3/258: rmdir d10 39 2024-09-13T02:50:29.048 INFO:tasks.workunit.client.0.smithi100.stdout:7/243: dwrite d3/d5/d1b/d1c/f39 [0,4194304] 0 2024-09-13T02:50:29.049 INFO:tasks.workunit.client.0.smithi100.stdout:0/186: dwrite d2/f1f [0,4194304] 0 2024-09-13T02:50:29.050 INFO:tasks.workunit.client.0.smithi100.stdout:3/259: creat d10/f53 x:0 0 0 2024-09-13T02:50:29.051 INFO:tasks.workunit.client.0.smithi100.stdout:7/244: creat d3/d2d/f4d x:0 0 0 2024-09-13T02:50:29.052 INFO:tasks.workunit.client.0.smithi100.stdout:0/187: link d2/d1a/l25 d2/d1a/d23/d34/d3c/l46 0 2024-09-13T02:50:29.055 INFO:tasks.workunit.client.0.smithi100.stdout:0/188: getdents d2/d1a 0 2024-09-13T02:50:29.058 INFO:tasks.workunit.client.0.smithi100.stdout:9/174: dwrite dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:29.058 INFO:tasks.workunit.client.0.smithi100.stdout:8/177: dwrite f5 [0,4194304] 0 2024-09-13T02:50:29.060 INFO:tasks.workunit.client.0.smithi100.stdout:9/175: creat dd/d1b/d1d/d36/f37 x:0 0 0 2024-09-13T02:50:29.060 INFO:tasks.workunit.client.0.smithi100.stdout:9/176: write dd/d1b/d1d/f2c [857907,85393] 0 2024-09-13T02:50:29.061 INFO:tasks.workunit.client.0.smithi100.stdout:9/177: dread dd/d1b/d21/f2f [0,4194304] 0 2024-09-13T02:50:29.062 INFO:tasks.workunit.client.0.smithi100.stdout:9/178: write dd/f19 [456356,57487] 0 2024-09-13T02:50:29.063 INFO:tasks.workunit.client.0.smithi100.stdout:7/245: getdents d3/d2d 0 2024-09-13T02:50:29.066 INFO:tasks.workunit.client.0.smithi100.stdout:0/189: rename d2/d1a/d23 to d2/d9/d21/d47 0 2024-09-13T02:50:29.066 INFO:tasks.workunit.client.0.smithi100.stdout:0/190: write d2/f11 [1139657,78609] 0 2024-09-13T02:50:29.069 INFO:tasks.workunit.client.0.smithi100.stdout:8/178: rename df/d13/f19 to df/d13/d20/f42 0 2024-09-13T02:50:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:9/179: rmdir dd 39 2024-09-13T02:50:29.071 INFO:tasks.workunit.client.0.smithi100.stdout:0/191: dread d2/d9/fb [0,4194304] 0 2024-09-13T02:50:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:9/180: creat dd/d1b/d1d/d36/f38 x:0 0 0 2024-09-13T02:50:29.072 INFO:tasks.workunit.client.0.smithi100.stdout:9/181: dread - dd/d1b/d1d/f1f zero size 2024-09-13T02:50:29.085 INFO:tasks.workunit.client.0.smithi100.stdout:8/179: dwrite f3 [0,4194304] 0 2024-09-13T02:50:29.086 INFO:tasks.workunit.client.0.smithi100.stdout:8/180: symlink df/d13/d20/d18/d41/l43 0 2024-09-13T02:50:29.091 INFO:tasks.workunit.client.0.smithi100.stdout:8/181: dread f2 [0,4194304] 0 2024-09-13T02:50:29.092 INFO:tasks.workunit.client.0.smithi100.stdout:8/182: unlink df/d13/d20/d18/f24 0 2024-09-13T02:50:29.093 INFO:tasks.workunit.client.0.smithi100.stdout:8/183: creat df/d13/f44 x:0 0 0 2024-09-13T02:50:29.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/176: sync 2024-09-13T02:50:29.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/183: sync 2024-09-13T02:50:29.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/184: creat de/d14/d22/f3c x:0 0 0 2024-09-13T02:50:29.104 INFO:tasks.workunit.client.0.smithi100.stdout:6/177: write f7 [4628730,102043] 0 2024-09-13T02:50:29.105 INFO:tasks.workunit.client.0.smithi100.stdout:1/185: link de/d14/d22/f3c de/d14/d22/f3d 0 2024-09-13T02:50:29.106 INFO:tasks.workunit.client.0.smithi100.stdout:1/186: chown l2 15886818 1 2024-09-13T02:50:29.106 INFO:tasks.workunit.client.0.smithi100.stdout:1/187: fsync de/d14/f1a 0 2024-09-13T02:50:29.106 INFO:tasks.workunit.client.0.smithi100.stdout:1/188: stat de/c10 0 2024-09-13T02:50:29.113 INFO:tasks.workunit.client.0.smithi100.stdout:1/189: dread de/f20 [0,4194304] 0 2024-09-13T02:50:29.129 INFO:tasks.workunit.client.0.smithi100.stdout:1/190: dwrite de/d14/f1a [0,4194304] 0 2024-09-13T02:50:29.131 INFO:tasks.workunit.client.0.smithi100.stdout:1/191: rename de/d14/d22/f3d to de/d12/f3e 0 2024-09-13T02:50:29.131 INFO:tasks.workunit.client.0.smithi100.stdout:1/192: fdatasync de/f3a 0 2024-09-13T02:50:29.131 INFO:tasks.workunit.client.0.smithi100.stdout:1/193: write de/d12/f33 [933151,118153] 0 2024-09-13T02:50:29.132 INFO:tasks.workunit.client.0.smithi100.stdout:1/194: getdents de 0 2024-09-13T02:50:29.132 INFO:tasks.workunit.client.0.smithi100.stdout:1/195: symlink de/d14/d39/l3f 0 2024-09-13T02:50:29.132 INFO:tasks.workunit.client.0.smithi100.stdout:1/196: readlink l2 0 2024-09-13T02:50:29.134 INFO:tasks.workunit.client.0.smithi100.stdout:1/197: rename de/c3b to de/d12/c40 0 2024-09-13T02:50:29.134 INFO:tasks.workunit.client.0.smithi100.stdout:1/198: chown de/d14/d2e/f38 458580888 1 2024-09-13T02:50:29.134 INFO:tasks.workunit.client.0.smithi100.stdout:1/199: write de/d12/f1b [4837798,33145] 0 2024-09-13T02:50:29.134 INFO:tasks.workunit.client.0.smithi100.stdout:1/200: creat de/d14/f41 x:0 0 0 2024-09-13T02:50:29.135 INFO:tasks.workunit.client.0.smithi100.stdout:1/201: write f8 [2309131,44753] 0 2024-09-13T02:50:29.135 INFO:tasks.workunit.client.0.smithi100.stdout:1/202: readlink de/d14/l21 0 2024-09-13T02:50:29.150 INFO:tasks.workunit.client.0.smithi100.stdout:5/212: sync 2024-09-13T02:50:29.150 INFO:tasks.workunit.client.0.smithi100.stdout:5/213: rename db/de to db/de/d1f/d4c 22 2024-09-13T02:50:29.151 INFO:tasks.workunit.client.0.smithi100.stdout:5/214: creat db/de/d3e/f4d x:0 0 0 2024-09-13T02:50:29.151 INFO:tasks.workunit.client.0.smithi100.stdout:5/215: creat db/de/d3e/f4e x:0 0 0 2024-09-13T02:50:29.152 INFO:tasks.workunit.client.0.smithi100.stdout:5/216: read db/f3b [147980,128262] 0 2024-09-13T02:50:29.153 INFO:tasks.workunit.client.0.smithi100.stdout:5/217: symlink db/de/d1f/d2b/l4f 0 2024-09-13T02:50:29.153 INFO:tasks.workunit.client.0.smithi100.stdout:5/218: fsync db/de/f45 0 2024-09-13T02:50:29.154 INFO:tasks.workunit.client.0.smithi100.stdout:5/219: dread - db/de/d3e/f42 zero size 2024-09-13T02:50:29.154 INFO:tasks.workunit.client.0.smithi100.stdout:5/220: dread - db/de/d1f/d2b/f35 zero size 2024-09-13T02:50:29.154 INFO:tasks.workunit.client.0.smithi100.stdout:5/221: symlink db/l50 0 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/222: getdents db 0 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/223: chown db/de/c1e 49 1 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/224: stat db/de/c2a 0 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/225: write f4 [3654077,31209] 0 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/226: chown f4 21133 1 2024-09-13T02:50:29.156 INFO:tasks.workunit.client.0.smithi100.stdout:5/227: readlink db/de/l1b 0 2024-09-13T02:50:29.157 INFO:tasks.workunit.client.0.smithi100.stdout:5/228: write db/de/f41 [2981767,48351] 0 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:2/190: sync 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:4/208: sync 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/260: sync 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:7/246: sync 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/261: fdatasync d10/f4e 0 2024-09-13T02:50:29.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/262: creat d10/f54 x:0 0 0 2024-09-13T02:50:29.201 INFO:tasks.workunit.client.0.smithi100.stdout:2/191: rmdir d0/db/d21 39 2024-09-13T02:50:29.201 INFO:tasks.workunit.client.0.smithi100.stdout:2/192: creat d0/db/f2e x:0 0 0 2024-09-13T02:50:29.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/263: creat d10/d21/d51/f55 x:0 0 0 2024-09-13T02:50:29.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/264: read - d10/f49 zero size 2024-09-13T02:50:29.204 INFO:tasks.workunit.client.0.smithi100.stdout:4/209: dread d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:29.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/210: write d3/dc/f23 [192025,18445] 0 2024-09-13T02:50:29.212 INFO:tasks.workunit.client.0.smithi100.stdout:4/211: creat d3/d6/d21/f45 x:0 0 0 2024-09-13T02:50:29.213 INFO:tasks.workunit.client.0.smithi100.stdout:7/247: dwrite d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:29.213 INFO:tasks.workunit.client.0.smithi100.stdout:3/265: write fc [1679551,24257] 0 2024-09-13T02:50:29.217 INFO:tasks.workunit.client.0.smithi100.stdout:4/212: rename d3/d6/d9/d27 to d3/d6/d21/d46 0 2024-09-13T02:50:29.220 INFO:tasks.workunit.client.0.smithi100.stdout:3/266: rename f2 to d10/d21/f56 0 2024-09-13T02:50:29.220 INFO:tasks.workunit.client.0.smithi100.stdout:4/213: link d3/d6/d9/f2e d3/d6/d21/d46/f47 0 2024-09-13T02:50:29.221 INFO:tasks.workunit.client.0.smithi100.stdout:4/214: rename d3/f4 to d3/dc/f48 0 2024-09-13T02:50:29.221 INFO:tasks.workunit.client.0.smithi100.stdout:4/215: truncate d3/d6/d21/f45 362710 0 2024-09-13T02:50:29.223 INFO:tasks.workunit.client.0.smithi100.stdout:7/248: write d3/d5/f17 [1415492,26400] 0 2024-09-13T02:50:29.225 INFO:tasks.workunit.client.0.smithi100.stdout:3/267: dread d10/f2b [0,4194304] 0 2024-09-13T02:50:29.227 INFO:tasks.workunit.client.0.smithi100.stdout:3/268: mkdir d10/d21/d57 0 2024-09-13T02:50:29.228 INFO:tasks.workunit.client.0.smithi100.stdout:3/269: rename d10/d21/c43 to d10/d21/d57/c58 0 2024-09-13T02:50:29.237 INFO:tasks.workunit.client.0.smithi100.stdout:4/216: dwrite d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:29.237 INFO:tasks.workunit.client.0.smithi100.stdout:4/217: fdatasync d3/d6/d9/f11 0 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/218: chown d3/d6/d21 4060205 1 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/219: chown d3/l17 0 1 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/220: chown d3/d6/d2f/f33 0 1 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/221: fsync d3/d6/f18 0 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/222: write d3/d6/d21/d46/f47 [246198,5334] 0 2024-09-13T02:50:29.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/223: truncate f0 1938206 0 2024-09-13T02:50:29.245 INFO:tasks.workunit.client.0.smithi100.stdout:3/270: dwrite d10/f15 [0,4194304] 0 2024-09-13T02:50:29.252 INFO:tasks.workunit.client.0.smithi100.stdout:4/224: dwrite d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:29.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/271: rename d10/f4e to d10/d21/d51/f59 0 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/229: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:9/182: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:8/184: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/192: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:1/203: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:6/178: sync 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:0/193: stat d2/d9/c19 0 2024-09-13T02:50:29.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/230: truncate f8 715140 0 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:1/204: chown de/c34 55 1 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:6/179: chown d12/d14/f2d 380726750 1 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:5/231: creat db/de/d3e/f51 x:0 0 0 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/225: unlink d3/d6/d21/d46/d2d/d3f/f44 0 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:5/232: dread db/f3b [0,4194304] 0 2024-09-13T02:50:29.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/272: unlink d10/d21/l23 0 2024-09-13T02:50:29.261 INFO:tasks.workunit.client.0.smithi100.stdout:9/183: unlink f9 0 2024-09-13T02:50:29.263 INFO:tasks.workunit.client.0.smithi100.stdout:0/194: symlink d2/dd/d33/d3b/l48 0 2024-09-13T02:50:29.263 INFO:tasks.workunit.client.0.smithi100.stdout:0/195: chown d2/dd/d33/c44 450673 1 2024-09-13T02:50:29.264 INFO:tasks.workunit.client.0.smithi100.stdout:1/205: creat de/f42 x:0 0 0 2024-09-13T02:50:29.264 INFO:tasks.workunit.client.0.smithi100.stdout:1/206: creat de/d14/d22/f43 x:0 0 0 2024-09-13T02:50:29.265 INFO:tasks.workunit.client.0.smithi100.stdout:5/233: rmdir db/de/d1f/d2b 39 2024-09-13T02:50:29.265 INFO:tasks.workunit.client.0.smithi100.stdout:4/226: read d3/d6/f19 [1401082,90289] 0 2024-09-13T02:50:29.265 INFO:tasks.workunit.client.0.smithi100.stdout:9/184: chown dd/c16 1279121575 1 2024-09-13T02:50:29.267 INFO:tasks.workunit.client.0.smithi100.stdout:3/273: write d10/f44 [1850083,71137] 0 2024-09-13T02:50:29.267 INFO:tasks.workunit.client.0.smithi100.stdout:3/274: read - d10/f49 zero size 2024-09-13T02:50:29.267 INFO:tasks.workunit.client.0.smithi100.stdout:3/275: dread - d10/f52 zero size 2024-09-13T02:50:29.268 INFO:tasks.workunit.client.0.smithi100.stdout:6/180: rmdir d12/d14 39 2024-09-13T02:50:29.268 INFO:tasks.workunit.client.0.smithi100.stdout:6/181: fsync d12/d14/f1a 0 2024-09-13T02:50:29.271 INFO:tasks.workunit.client.0.smithi100.stdout:1/207: unlink de/d12/c40 0 2024-09-13T02:50:29.271 INFO:tasks.workunit.client.0.smithi100.stdout:8/185: dwrite df/d13/d20/d18/f39 [0,4194304] 0 2024-09-13T02:50:29.273 INFO:tasks.workunit.client.0.smithi100.stdout:4/227: rename d3/d6/d9/l29 to d3/d6/d21/d46/d34/l49 0 2024-09-13T02:50:29.273 INFO:tasks.workunit.client.0.smithi100.stdout:4/228: fdatasync d3/d6/d21/d46/f15 0 2024-09-13T02:50:29.273 INFO:tasks.workunit.client.0.smithi100.stdout:9/185: truncate fc 1878127 0 2024-09-13T02:50:29.274 INFO:tasks.workunit.client.0.smithi100.stdout:9/186: chown dd/d1b/d27/l32 1536 1 2024-09-13T02:50:29.274 INFO:tasks.workunit.client.0.smithi100.stdout:3/276: mkdir d10/d21/d51/d5a 0 2024-09-13T02:50:29.275 INFO:tasks.workunit.client.0.smithi100.stdout:3/277: dread - d10/d21/d51/f55 zero size 2024-09-13T02:50:29.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/182: rmdir d12/d14/d21 39 2024-09-13T02:50:29.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/183: truncate d12/d14/d1c/d28/f2a 1028957 0 2024-09-13T02:50:29.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/184: truncate d12/f27 272692 0 2024-09-13T02:50:29.276 INFO:tasks.workunit.client.0.smithi100.stdout:0/196: mknod d2/c49 0 2024-09-13T02:50:29.276 INFO:tasks.workunit.client.0.smithi100.stdout:0/197: creat d2/d9/d21/d28/f4a x:0 0 0 2024-09-13T02:50:29.276 INFO:tasks.workunit.client.0.smithi100.stdout:0/198: chown d2/l45 2703 1 2024-09-13T02:50:29.276 INFO:tasks.workunit.client.0.smithi100.stdout:1/208: mkdir de/d14/d44 0 2024-09-13T02:50:29.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/186: mknod df/d13/d20/d18/d2c/c45 0 2024-09-13T02:50:29.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/187: truncate df/d13/d21/f22 704263 0 2024-09-13T02:50:29.279 INFO:tasks.workunit.client.0.smithi100.stdout:6/185: rename ce to d12/d2e/c31 0 2024-09-13T02:50:29.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/199: mkdir d2/dd/d33/d43/d4b 0 2024-09-13T02:50:29.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/200: chown d2/d9/fb 73400 1 2024-09-13T02:50:29.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/201: truncate d2/f11 1384366 0 2024-09-13T02:50:29.281 INFO:tasks.workunit.client.0.smithi100.stdout:0/202: chown d2/d9/d21/l2e 1110 1 2024-09-13T02:50:29.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/188: creat df/d13/d20/d18/d2c/f46 x:0 0 0 2024-09-13T02:50:29.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/189: dread - df/d13/d21/f40 zero size 2024-09-13T02:50:29.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/190: chown df/d13/d21 2083755 1 2024-09-13T02:50:29.282 INFO:tasks.workunit.client.0.smithi100.stdout:8/191: readlink df/d13/l30 0 2024-09-13T02:50:29.283 INFO:tasks.workunit.client.0.smithi100.stdout:8/192: mknod df/d13/d20/d18/d41/c47 0 2024-09-13T02:50:29.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/203: mkdir d2/d1a/d4c 0 2024-09-13T02:50:29.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/204: truncate d2/d9/f1b 607905 0 2024-09-13T02:50:29.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/205: chown d2/d9/d21/l2e 5973 1 2024-09-13T02:50:29.286 INFO:tasks.workunit.client.0.smithi100.stdout:0/206: write d2/dd/d33/d3b/f40 [160131,6871] 0 2024-09-13T02:50:29.289 INFO:tasks.workunit.client.0.smithi100.stdout:0/207: creat d2/dd/d33/d43/d4b/f4d x:0 0 0 2024-09-13T02:50:29.316 INFO:tasks.workunit.client.0.smithi100.stdout:0/208: dread d2/dd/d33/f16 [0,4194304] 0 2024-09-13T02:50:29.316 INFO:tasks.workunit.client.0.smithi100.stdout:3/278: dwrite f9 [4194304,4194304] 0 2024-09-13T02:50:29.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/209: creat d2/d9/d21/d47/f4e x:0 0 0 2024-09-13T02:50:29.317 INFO:tasks.workunit.client.0.smithi100.stdout:3/279: rename d10/f12 to d10/d21/d57/f5b 0 2024-09-13T02:50:29.318 INFO:tasks.workunit.client.0.smithi100.stdout:0/210: creat d2/d1a/f4f x:0 0 0 2024-09-13T02:50:29.319 INFO:tasks.workunit.client.0.smithi100.stdout:3/280: rename ld to d10/d21/d51/d5a/l5c 0 2024-09-13T02:50:29.320 INFO:tasks.workunit.client.0.smithi100.stdout:0/211: truncate d2/fa 2215162 0 2024-09-13T02:50:29.320 INFO:tasks.workunit.client.0.smithi100.stdout:1/209: write de/f11 [73770,11615] 0 2024-09-13T02:50:29.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/234: dwrite db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:29.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/235: truncate db/de/d3e/f42 363994 0 2024-09-13T02:50:29.320 INFO:tasks.workunit.client.0.smithi100.stdout:1/210: write de/d14/d2e/f37 [1312263,97698] 0 2024-09-13T02:50:29.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/212: dread d2/d9/d21/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:29.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/213: write d2/f11 [1911974,107067] 0 2024-09-13T02:50:29.321 INFO:tasks.workunit.client.0.smithi100.stdout:0/214: truncate d2/dd/d33/d43/d4b/f4d 905251 0 2024-09-13T02:50:29.323 INFO:tasks.workunit.client.0.smithi100.stdout:8/193: dwrite df/d13/d20/f23 [0,4194304] 0 2024-09-13T02:50:29.323 INFO:tasks.workunit.client.0.smithi100.stdout:8/194: truncate df/d13/f44 987814 0 2024-09-13T02:50:29.326 INFO:tasks.workunit.client.0.smithi100.stdout:6/186: dwrite d12/d14/d1c/d28/f2a [0,4194304] 0 2024-09-13T02:50:29.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/236: creat db/de/f52 x:0 0 0 2024-09-13T02:50:29.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/237: write f4 [2217131,92268] 0 2024-09-13T02:50:29.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/238: creat db/de/d1f/f53 x:0 0 0 2024-09-13T02:50:29.327 INFO:tasks.workunit.client.0.smithi100.stdout:0/215: symlink d2/dd/d33/d3b/l50 0 2024-09-13T02:50:29.328 INFO:tasks.workunit.client.0.smithi100.stdout:6/187: dread f2 [0,4194304] 0 2024-09-13T02:50:29.329 INFO:tasks.workunit.client.0.smithi100.stdout:3/281: dread d10/f50 [0,4194304] 0 2024-09-13T02:50:29.329 INFO:tasks.workunit.client.0.smithi100.stdout:6/188: chown d12/d14/l20 3 1 2024-09-13T02:50:29.329 INFO:tasks.workunit.client.0.smithi100.stdout:8/195: symlink df/d13/d20/d18/d41/l48 0 2024-09-13T02:50:29.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/211: dwrite de/f2c [0,4194304] 0 2024-09-13T02:50:29.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/212: fsync de/d12/f1b 0 2024-09-13T02:50:29.337 INFO:tasks.workunit.client.0.smithi100.stdout:5/239: rename db/de/f22 to db/de/f54 0 2024-09-13T02:50:29.339 INFO:tasks.workunit.client.0.smithi100.stdout:3/282: creat d10/d21/f5d x:0 0 0 2024-09-13T02:50:29.339 INFO:tasks.workunit.client.0.smithi100.stdout:3/283: truncate d10/d21/f48 634017 0 2024-09-13T02:50:29.342 INFO:tasks.workunit.client.0.smithi100.stdout:1/213: rename de/d12/f32 to de/f45 0 2024-09-13T02:50:29.342 INFO:tasks.workunit.client.0.smithi100.stdout:1/214: readlink l2 0 2024-09-13T02:50:29.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/284: mkdir d10/d21/d51/d5a/d5e 0 2024-09-13T02:50:29.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/285: creat d10/f5f x:0 0 0 2024-09-13T02:50:29.346 INFO:tasks.workunit.client.0.smithi100.stdout:3/286: dread d10/d21/f48 [0,4194304] 0 2024-09-13T02:50:29.346 INFO:tasks.workunit.client.0.smithi100.stdout:1/215: link de/d12/f1b de/f46 0 2024-09-13T02:50:29.349 INFO:tasks.workunit.client.0.smithi100.stdout:1/216: rename de/d12/f1b to de/d14/d44/f47 0 2024-09-13T02:50:29.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/193: sync 2024-09-13T02:50:29.352 INFO:tasks.workunit.client.0.smithi100.stdout:2/194: truncate d0/db/f12 2944576 0 2024-09-13T02:50:29.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/195: mknod d0/db/d23/c2f 0 2024-09-13T02:50:29.355 INFO:tasks.workunit.client.0.smithi100.stdout:8/196: dwrite df/d13/d21/f22 [0,4194304] 0 2024-09-13T02:50:29.356 INFO:tasks.workunit.client.0.smithi100.stdout:8/197: stat df/d13/d21/f29 0 2024-09-13T02:50:29.356 INFO:tasks.workunit.client.0.smithi100.stdout:7/249: sync 2024-09-13T02:50:29.356 INFO:tasks.workunit.client.0.smithi100.stdout:6/189: truncate d12/d14/d1c/d28/f2a 3422562 0 2024-09-13T02:50:29.356 INFO:tasks.workunit.client.0.smithi100.stdout:3/287: write f8 [1005235,108158] 0 2024-09-13T02:50:29.356 INFO:tasks.workunit.client.0.smithi100.stdout:3/288: creat d10/d21/f60 x:0 0 0 2024-09-13T02:50:29.357 INFO:tasks.workunit.client.0.smithi100.stdout:5/240: dwrite db/de/f52 [0,4194304] 0 2024-09-13T02:50:29.357 INFO:tasks.workunit.client.0.smithi100.stdout:5/241: truncate db/de/d1f/f4b 501709 0 2024-09-13T02:50:29.357 INFO:tasks.workunit.client.0.smithi100.stdout:5/242: dread - db/de/d3e/f4d zero size 2024-09-13T02:50:29.357 INFO:tasks.workunit.client.0.smithi100.stdout:5/243: chown db/l3d 219513359 1 2024-09-13T02:50:29.359 INFO:tasks.workunit.client.0.smithi100.stdout:8/198: rename df/d13/d20/d18/l1b to df/d13/d20/d18/d2c/l49 0 2024-09-13T02:50:29.360 INFO:tasks.workunit.client.0.smithi100.stdout:7/250: truncate d3/d5/f1a 5205865 0 2024-09-13T02:50:29.362 INFO:tasks.workunit.client.0.smithi100.stdout:6/190: unlink f2 0 2024-09-13T02:50:29.362 INFO:tasks.workunit.client.0.smithi100.stdout:1/217: write de/d14/f1a [3177726,82160] 0 2024-09-13T02:50:29.363 INFO:tasks.workunit.client.0.smithi100.stdout:1/218: write de/f45 [55078,11889] 0 2024-09-13T02:50:29.363 INFO:tasks.workunit.client.0.smithi100.stdout:1/219: chown de/f11 954575889 1 2024-09-13T02:50:29.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/289: mknod d10/c61 0 2024-09-13T02:50:29.364 INFO:tasks.workunit.client.0.smithi100.stdout:3/290: write d10/f53 [702730,114622] 0 2024-09-13T02:50:29.368 INFO:tasks.workunit.client.0.smithi100.stdout:5/244: creat db/de/d1f/d2b/f55 x:0 0 0 2024-09-13T02:50:29.374 INFO:tasks.workunit.client.0.smithi100.stdout:8/199: link df/d13/d20/d18/d2c/c35 df/d13/c4a 0 2024-09-13T02:50:29.375 INFO:tasks.workunit.client.0.smithi100.stdout:7/251: creat d3/d5/d1b/f4e x:0 0 0 2024-09-13T02:50:29.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/196: dread d0/fe [0,4194304] 0 2024-09-13T02:50:29.376 INFO:tasks.workunit.client.0.smithi100.stdout:3/291: symlink d10/d21/d51/d5a/d5e/l62 0 2024-09-13T02:50:29.379 INFO:tasks.workunit.client.0.smithi100.stdout:8/200: symlink df/d13/d20/d18/d2c/l4b 0 2024-09-13T02:50:29.380 INFO:tasks.workunit.client.0.smithi100.stdout:7/252: mkdir d3/d5/d4f 0 2024-09-13T02:50:29.381 INFO:tasks.workunit.client.0.smithi100.stdout:6/191: truncate d12/d14/d1c/d28/f2a 111781 0 2024-09-13T02:50:29.381 INFO:tasks.workunit.client.0.smithi100.stdout:1/220: dwrite de/d14/d44/f47 [0,4194304] 0 2024-09-13T02:50:29.382 INFO:tasks.workunit.client.0.smithi100.stdout:2/197: rename d0/f4 to d0/db/d21/f30 0 2024-09-13T02:50:29.382 INFO:tasks.workunit.client.0.smithi100.stdout:2/198: write d0/db/ff [1223000,111779] 0 2024-09-13T02:50:29.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/199: read d0/db/f1a [246229,81145] 0 2024-09-13T02:50:29.383 INFO:tasks.workunit.client.0.smithi100.stdout:3/292: symlink d10/d21/d57/l63 0 2024-09-13T02:50:29.383 INFO:tasks.workunit.client.0.smithi100.stdout:8/201: dread df/f2b [0,4194304] 0 2024-09-13T02:50:29.384 INFO:tasks.workunit.client.0.smithi100.stdout:5/245: mknod db/de/d1f/d2b/c56 0 2024-09-13T02:50:29.385 INFO:tasks.workunit.client.0.smithi100.stdout:7/253: unlink d3/d2d/f43 0 2024-09-13T02:50:29.385 INFO:tasks.workunit.client.0.smithi100.stdout:7/254: chown d3/l12 838 1 2024-09-13T02:50:29.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/221: mkdir de/d14/d2e/d48 0 2024-09-13T02:50:29.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/192: rename ca to d12/d14/d1c/c32 0 2024-09-13T02:50:29.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/193: readlink d12/d14/d1c/l1d 0 2024-09-13T02:50:29.388 INFO:tasks.workunit.client.0.smithi100.stdout:2/200: symlink d0/db/d21/l31 0 2024-09-13T02:50:29.388 INFO:tasks.workunit.client.0.smithi100.stdout:2/201: readlink d0/la 0 2024-09-13T02:50:29.391 INFO:tasks.workunit.client.0.smithi100.stdout:8/202: mknod df/d13/d20/c4c 0 2024-09-13T02:50:29.391 INFO:tasks.workunit.client.0.smithi100.stdout:8/203: creat df/d13/d21/f4d x:0 0 0 2024-09-13T02:50:29.393 INFO:tasks.workunit.client.0.smithi100.stdout:3/293: getdents d10 0 2024-09-13T02:50:29.393 INFO:tasks.workunit.client.0.smithi100.stdout:2/202: dread d0/fe [0,4194304] 0 2024-09-13T02:50:29.393 INFO:tasks.workunit.client.0.smithi100.stdout:8/204: write df/d13/d20/d18/f36 [852276,18205] 0 2024-09-13T02:50:29.395 INFO:tasks.workunit.client.0.smithi100.stdout:7/255: dread d3/d5/d1b/f28 [0,4194304] 0 2024-09-13T02:50:29.395 INFO:tasks.workunit.client.0.smithi100.stdout:7/256: chown d3/d5/l13 418899077 1 2024-09-13T02:50:29.395 INFO:tasks.workunit.client.0.smithi100.stdout:3/294: rmdir d10/d21/d57 39 2024-09-13T02:50:29.395 INFO:tasks.workunit.client.0.smithi100.stdout:3/295: write d10/f40 [727257,82705] 0 2024-09-13T02:50:29.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/203: mkdir d0/d32 0 2024-09-13T02:50:29.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/204: dread - d0/db/d21/f22 zero size 2024-09-13T02:50:29.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/205: readlink d0/db/d23/l29 0 2024-09-13T02:50:29.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/205: creat df/d13/d20/f4e x:0 0 0 2024-09-13T02:50:29.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/206: dread - df/d13/d21/f4d zero size 2024-09-13T02:50:29.401 INFO:tasks.workunit.client.0.smithi100.stdout:7/257: getdents d3/d16 0 2024-09-13T02:50:29.402 INFO:tasks.workunit.client.0.smithi100.stdout:3/296: truncate d10/f44 184973 0 2024-09-13T02:50:29.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/206: creat d0/db/d21/f33 x:0 0 0 2024-09-13T02:50:29.404 INFO:tasks.workunit.client.0.smithi100.stdout:8/207: mknod df/d13/d20/c4f 0 2024-09-13T02:50:29.405 INFO:tasks.workunit.client.0.smithi100.stdout:3/297: mknod d10/d21/d51/c64 0 2024-09-13T02:50:29.406 INFO:tasks.workunit.client.0.smithi100.stdout:5/246: dwrite db/f3c [0,4194304] 0 2024-09-13T02:50:29.406 INFO:tasks.workunit.client.0.smithi100.stdout:2/207: rmdir d0 39 2024-09-13T02:50:29.408 INFO:tasks.workunit.client.0.smithi100.stdout:1/222: dwrite de/f46 [0,4194304] 0 2024-09-13T02:50:29.408 INFO:tasks.workunit.client.0.smithi100.stdout:3/298: getdents d10/d21/d57 0 2024-09-13T02:50:29.408 INFO:tasks.workunit.client.0.smithi100.stdout:3/299: getdents d10/d21/d57 0 2024-09-13T02:50:29.412 INFO:tasks.workunit.client.0.smithi100.stdout:5/247: creat db/f57 x:0 0 0 2024-09-13T02:50:29.413 INFO:tasks.workunit.client.0.smithi100.stdout:2/208: symlink d0/l34 0 2024-09-13T02:50:29.417 INFO:tasks.workunit.client.0.smithi100.stdout:8/208: rmdir df 39 2024-09-13T02:50:29.417 INFO:tasks.workunit.client.0.smithi100.stdout:3/300: dread d10/f44 [0,4194304] 0 2024-09-13T02:50:29.417 INFO:tasks.workunit.client.0.smithi100.stdout:7/258: dwrite d3/d5/f1a [0,4194304] 0 2024-09-13T02:50:29.418 INFO:tasks.workunit.client.0.smithi100.stdout:1/223: rename de/d14/d22/f31 to de/d14/d22/d29/f49 0 2024-09-13T02:50:29.420 INFO:tasks.workunit.client.0.smithi100.stdout:9/187: sync 2024-09-13T02:50:29.420 INFO:tasks.workunit.client.0.smithi100.stdout:4/229: sync 2024-09-13T02:50:29.424 INFO:tasks.workunit.client.0.smithi100.stdout:3/301: link d10/c4c d10/d21/d51/d5a/c65 0 2024-09-13T02:50:29.425 INFO:tasks.workunit.client.0.smithi100.stdout:8/209: dread df/f1a [0,4194304] 0 2024-09-13T02:50:29.425 INFO:tasks.workunit.client.0.smithi100.stdout:5/248: symlink db/de/d1f/d2b/l58 0 2024-09-13T02:50:29.425 INFO:tasks.workunit.client.0.smithi100.stdout:2/209: rmdir d0/db/d23 39 2024-09-13T02:50:29.426 INFO:tasks.workunit.client.0.smithi100.stdout:4/230: rename d3/l17 to d3/d6/d2f/l4a 0 2024-09-13T02:50:29.426 INFO:tasks.workunit.client.0.smithi100.stdout:3/302: rename d10/d21/d51/d5a/d5e to d10/d21/d51/d5a/d5e/d66 22 2024-09-13T02:50:29.426 INFO:tasks.workunit.client.0.smithi100.stdout:3/303: creat d10/d21/f67 x:0 0 0 2024-09-13T02:50:29.427 INFO:tasks.workunit.client.0.smithi100.stdout:9/188: mkdir dd/d1b/d21/d39 0 2024-09-13T02:50:29.429 INFO:tasks.workunit.client.0.smithi100.stdout:5/249: symlink db/l59 0 2024-09-13T02:50:29.431 INFO:tasks.workunit.client.0.smithi100.stdout:2/210: unlink d0/l24 0 2024-09-13T02:50:29.433 INFO:tasks.workunit.client.0.smithi100.stdout:8/210: rename df/d13/d20/d18/d2c/c45 to df/d13/d21/c50 0 2024-09-13T02:50:29.435 INFO:tasks.workunit.client.0.smithi100.stdout:3/304: truncate d10/d21/f2f 186147 0 2024-09-13T02:50:29.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/211: dread d0/f15 [0,4194304] 0 2024-09-13T02:50:29.436 INFO:tasks.workunit.client.0.smithi100.stdout:5/250: mknod db/de/d1f/c5a 0 2024-09-13T02:50:29.437 INFO:tasks.workunit.client.0.smithi100.stdout:3/305: symlink d10/d21/d51/d5a/l68 0 2024-09-13T02:50:29.437 INFO:tasks.workunit.client.0.smithi100.stdout:9/189: mknod dd/c3a 0 2024-09-13T02:50:29.439 INFO:tasks.workunit.client.0.smithi100.stdout:5/251: rename db/de/f54 to db/f5b 0 2024-09-13T02:50:29.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/252: write db/de/d3e/f4e [27459,68058] 0 2024-09-13T02:50:29.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/190: unlink dd/d1b/d21/f2f 0 2024-09-13T02:50:29.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/191: chown dd/d1b/d27 1 1 2024-09-13T02:50:29.442 INFO:tasks.workunit.client.0.smithi100.stdout:5/253: truncate db/f11 2977180 0 2024-09-13T02:50:29.442 INFO:tasks.workunit.client.0.smithi100.stdout:5/254: stat db/c19 0 2024-09-13T02:50:29.442 INFO:tasks.workunit.client.0.smithi100.stdout:5/255: creat db/f5c x:0 0 0 2024-09-13T02:50:29.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/306: dread d10/f50 [0,4194304] 0 2024-09-13T02:50:29.444 INFO:tasks.workunit.client.0.smithi100.stdout:5/256: rename db/cc to db/de/d1f/c5d 0 2024-09-13T02:50:29.445 INFO:tasks.workunit.client.0.smithi100.stdout:5/257: truncate db/f28 640052 0 2024-09-13T02:50:29.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/307: dread fb [0,4194304] 0 2024-09-13T02:50:29.450 INFO:tasks.workunit.client.0.smithi100.stdout:3/308: rename d10/d21/f48 to d10/d21/d51/d5a/f69 0 2024-09-13T02:50:29.452 INFO:tasks.workunit.client.0.smithi100.stdout:3/309: mkdir d10/d21/d51/d5a/d5e/d6a 0 2024-09-13T02:50:29.452 INFO:tasks.workunit.client.0.smithi100.stdout:3/310: chown d10/f54 55 1 2024-09-13T02:50:29.453 INFO:tasks.workunit.client.0.smithi100.stdout:7/259: dwrite d3/fc [0,4194304] 0 2024-09-13T02:50:29.457 INFO:tasks.workunit.client.0.smithi100.stdout:8/211: dread f3 [0,4194304] 0 2024-09-13T02:50:29.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/212: rename df/d13/d20/d18/d41/l43 to df/d13/d21/l51 0 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/213: symlink df/d13/d20/d18/d2c/d38/l52 0 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/214: chown df/d13/d20/d18/d2c/c3f 33362760 1 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/215: readlink df/d13/d20/l1f 0 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/216: write df/d13/d20/f4e [592616,59533] 0 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/217: chown df/d13/d20/c25 390689266 1 2024-09-13T02:50:29.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/218: symlink df/d13/l53 0 2024-09-13T02:50:29.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/219: rename c0 to df/d13/c54 0 2024-09-13T02:50:29.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/220: mknod df/d13/d20/d18/d41/c55 0 2024-09-13T02:50:29.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/221: creat df/d13/d20/d18/d41/f56 x:0 0 0 2024-09-13T02:50:29.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/222: write f2 [5410826,91231] 0 2024-09-13T02:50:29.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/223: chown df/c1e 7270 1 2024-09-13T02:50:29.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/224: truncate f8 2821067 0 2024-09-13T02:50:29.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/225: chown df/d13/d20/d18/f36 92 1 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/224: dwrite f1 [4194304,4194304] 0 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/225: readlink l2 0 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/226: creat de/d14/d22/f4a x:0 0 0 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/227: dread - de/d14/d2e/f27 zero size 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/228: fdatasync de/d14/d2e/f38 0 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/229: write de/d14/d22/f3c [309704,85718] 0 2024-09-13T02:50:29.470 INFO:tasks.workunit.client.0.smithi100.stdout:1/230: write de/d12/f30 [3332078,71400] 0 2024-09-13T02:50:29.474 INFO:tasks.workunit.client.0.smithi100.stdout:1/231: rmdir de/d14/d2e 39 2024-09-13T02:50:29.476 INFO:tasks.workunit.client.0.smithi100.stdout:1/232: link de/d12/f30 de/d14/d22/d29/f4b 0 2024-09-13T02:50:29.477 INFO:tasks.workunit.client.0.smithi100.stdout:1/233: creat de/d14/d2e/d48/f4c x:0 0 0 2024-09-13T02:50:29.478 INFO:tasks.workunit.client.0.smithi100.stdout:1/234: symlink de/d14/d44/l4d 0 2024-09-13T02:50:29.487 INFO:tasks.workunit.client.0.smithi100.stdout:2/212: dwrite d0/f1f [0,4194304] 0 2024-09-13T02:50:29.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/231: dwrite d3/d6/d21/f43 [0,4194304] 0 2024-09-13T02:50:29.489 INFO:tasks.workunit.client.0.smithi100.stdout:9/192: dwrite dd/d1b/d1d/d36/f38 [0,4194304] 0 2024-09-13T02:50:29.489 INFO:tasks.workunit.client.0.smithi100.stdout:9/193: write dd/d1b/d1d/d36/f37 [969245,22833] 0 2024-09-13T02:50:29.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/258: dwrite db/de/d1f/f53 [0,4194304] 0 2024-09-13T02:50:29.489 INFO:tasks.workunit.client.0.smithi100.stdout:5/259: chown db/l3d 1321 1 2024-09-13T02:50:29.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/213: link d0/db/f16 d0/db/d23/f35 0 2024-09-13T02:50:29.490 INFO:tasks.workunit.client.0.smithi100.stdout:3/311: dwrite d10/d21/f67 [0,4194304] 0 2024-09-13T02:50:29.490 INFO:tasks.workunit.client.0.smithi100.stdout:7/260: dwrite d3/f15 [0,4194304] 0 2024-09-13T02:50:29.490 INFO:tasks.workunit.client.0.smithi100.stdout:8/226: dwrite df/d13/d20/d18/d2c/f46 [0,4194304] 0 2024-09-13T02:50:29.490 INFO:tasks.workunit.client.0.smithi100.stdout:8/227: chown df 49 1 2024-09-13T02:50:29.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/228: write f2 [3268293,31655] 0 2024-09-13T02:50:29.502 INFO:tasks.workunit.client.0.smithi100.stdout:8/229: dread f2 [0,4194304] 0 2024-09-13T02:50:29.502 INFO:tasks.workunit.client.0.smithi100.stdout:8/230: dread - df/d13/d21/f40 zero size 2024-09-13T02:50:29.505 INFO:tasks.workunit.client.0.smithi100.stdout:8/231: dread df/d13/f16 [0,4194304] 0 2024-09-13T02:50:29.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/260: unlink fa 0 2024-09-13T02:50:29.508 INFO:tasks.workunit.client.0.smithi100.stdout:5/261: chown db/f2f 115 1 2024-09-13T02:50:29.510 INFO:tasks.workunit.client.0.smithi100.stdout:2/214: rmdir d0/d32 0 2024-09-13T02:50:29.510 INFO:tasks.workunit.client.0.smithi100.stdout:2/215: read - d0/db/d21/f25 zero size 2024-09-13T02:50:29.511 INFO:tasks.workunit.client.0.smithi100.stdout:1/235: rmdir de 39 2024-09-13T02:50:29.513 INFO:tasks.workunit.client.0.smithi100.stdout:3/312: creat d10/d21/d51/d5a/d5e/f6b x:0 0 0 2024-09-13T02:50:29.513 INFO:tasks.workunit.client.0.smithi100.stdout:3/313: chown d10/d21/d57/f5b 141904 1 2024-09-13T02:50:29.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/261: unlink d3/d5/d1b/f28 0 2024-09-13T02:50:29.517 INFO:tasks.workunit.client.0.smithi100.stdout:4/232: rmdir d3/d6 39 2024-09-13T02:50:29.519 INFO:tasks.workunit.client.0.smithi100.stdout:9/194: rmdir dd/d1b/d1d/d36 39 2024-09-13T02:50:29.520 INFO:tasks.workunit.client.0.smithi100.stdout:8/232: truncate fb 2196779 0 2024-09-13T02:50:29.523 INFO:tasks.workunit.client.0.smithi100.stdout:7/262: write d3/fa [2287618,111270] 0 2024-09-13T02:50:29.523 INFO:tasks.workunit.client.0.smithi100.stdout:2/216: mkdir d0/d36 0 2024-09-13T02:50:29.524 INFO:tasks.workunit.client.0.smithi100.stdout:1/236: rename de/d14/d22/d29/f49 to de/d14/d2e/f4e 0 2024-09-13T02:50:29.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/314: mkdir d10/d21/d51/d6c 0 2024-09-13T02:50:29.525 INFO:tasks.workunit.client.0.smithi100.stdout:3/315: write d10/f16 [1441596,104385] 0 2024-09-13T02:50:29.526 INFO:tasks.workunit.client.0.smithi100.stdout:9/195: getdents dd/d1b 0 2024-09-13T02:50:29.526 INFO:tasks.workunit.client.0.smithi100.stdout:0/216: sync 2024-09-13T02:50:29.526 INFO:tasks.workunit.client.0.smithi100.stdout:5/262: rmdir db/de/d3e 39 2024-09-13T02:50:29.527 INFO:tasks.workunit.client.0.smithi100.stdout:2/217: rename d0/l9 to d0/l37 0 2024-09-13T02:50:29.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/237: link de/d14/d22/f4a de/f4f 0 2024-09-13T02:50:29.532 INFO:tasks.workunit.client.0.smithi100.stdout:3/316: creat d10/d21/d51/d6c/f6d x:0 0 0 2024-09-13T02:50:29.535 INFO:tasks.workunit.client.0.smithi100.stdout:9/196: rename dd/d1b/d1d/d28/f30 to dd/d1b/d1d/f3b 0 2024-09-13T02:50:29.537 INFO:tasks.workunit.client.0.smithi100.stdout:5/263: symlink db/de/d1f/l5e 0 2024-09-13T02:50:29.538 INFO:tasks.workunit.client.0.smithi100.stdout:1/238: creat de/d14/d2e/d48/f50 x:0 0 0 2024-09-13T02:50:29.539 INFO:tasks.workunit.client.0.smithi100.stdout:1/239: chown de/d12/c16 58 1 2024-09-13T02:50:29.539 INFO:tasks.workunit.client.0.smithi100.stdout:3/317: mknod d10/d21/c6e 0 2024-09-13T02:50:29.541 INFO:tasks.workunit.client.0.smithi100.stdout:9/197: rmdir dd/d1b 39 2024-09-13T02:50:29.543 INFO:tasks.workunit.client.0.smithi100.stdout:0/217: mkdir d2/d1a/d51 0 2024-09-13T02:50:29.545 INFO:tasks.workunit.client.0.smithi100.stdout:9/198: mkdir dd/d1b/d1d/d36/d3c 0 2024-09-13T02:50:29.545 INFO:tasks.workunit.client.0.smithi100.stdout:9/199: read dd/f19 [32656,64205] 0 2024-09-13T02:50:29.547 INFO:tasks.workunit.client.0.smithi100.stdout:8/233: link fb df/d13/d21/f57 0 2024-09-13T02:50:29.548 INFO:tasks.workunit.client.0.smithi100.stdout:1/240: write de/f20 [1619339,37924] 0 2024-09-13T02:50:29.548 INFO:tasks.workunit.client.0.smithi100.stdout:0/218: mknod d2/d9/d21/d47/c52 0 2024-09-13T02:50:29.548 INFO:tasks.workunit.client.0.smithi100.stdout:0/219: stat d2/f5 0 2024-09-13T02:50:29.548 INFO:tasks.workunit.client.0.smithi100.stdout:6/194: sync 2024-09-13T02:50:29.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/264: link db/l50 db/de/d3e/l5f 0 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/265: chown db/f3b 49504096 1 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/266: fsync db/f11 0 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/218: dwrite d0/db/ff [0,4194304] 0 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/219: chown d0/f20 408172937 1 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/220: fdatasync d0/f15 0 2024-09-13T02:50:29.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/221: write d0/db/d21/f25 [831826,95842] 0 2024-09-13T02:50:29.551 INFO:tasks.workunit.client.0.smithi100.stdout:7/263: dwrite d3/f15 [0,4194304] 0 2024-09-13T02:50:29.551 INFO:tasks.workunit.client.0.smithi100.stdout:7/264: fdatasync d3/d5/d1b/d1c/f30 0 2024-09-13T02:50:29.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/200: rename dd/c16 to dd/d1b/d1d/d36/c3d 0 2024-09-13T02:50:29.553 INFO:tasks.workunit.client.0.smithi100.stdout:1/241: mknod de/d14/d22/d29/c51 0 2024-09-13T02:50:29.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/201: stat dd/d1b/d24 0 2024-09-13T02:50:29.553 INFO:tasks.workunit.client.0.smithi100.stdout:0/220: mknod d2/dd/d33/d43/c53 0 2024-09-13T02:50:29.554 INFO:tasks.workunit.client.0.smithi100.stdout:1/242: mkdir de/d14/d22/d52 0 2024-09-13T02:50:29.554 INFO:tasks.workunit.client.0.smithi100.stdout:6/195: dread d12/f27 [0,4194304] 0 2024-09-13T02:50:29.554 INFO:tasks.workunit.client.0.smithi100.stdout:0/221: getdents d2/dd/d33 0 2024-09-13T02:50:29.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/222: getdents d0/db 0 2024-09-13T02:50:29.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/223: getdents d0/db 0 2024-09-13T02:50:29.555 INFO:tasks.workunit.client.0.smithi100.stdout:6/196: read d12/f27 [190883,94845] 0 2024-09-13T02:50:29.556 INFO:tasks.workunit.client.0.smithi100.stdout:3/318: write f9 [1410018,104454] 0 2024-09-13T02:50:29.556 INFO:tasks.workunit.client.0.smithi100.stdout:2/224: link d0/f20 d0/f38 0 2024-09-13T02:50:29.557 INFO:tasks.workunit.client.0.smithi100.stdout:6/197: creat d12/d14/d2f/f33 x:0 0 0 2024-09-13T02:50:29.557 INFO:tasks.workunit.client.0.smithi100.stdout:6/198: stat d12/d14/d21/c25 0 2024-09-13T02:50:29.557 INFO:tasks.workunit.client.0.smithi100.stdout:6/199: fdatasync d12/d14/d1c/d28/f2a 0 2024-09-13T02:50:29.558 INFO:tasks.workunit.client.0.smithi100.stdout:3/319: rmdir d10/d21/d51/d5a/d5e/d6a 0 2024-09-13T02:50:29.559 INFO:tasks.workunit.client.0.smithi100.stdout:3/320: truncate d10/f44 1054061 0 2024-09-13T02:50:29.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/321: unlink d10/f50 0 2024-09-13T02:50:29.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/322: fsync fc 0 2024-09-13T02:50:29.562 INFO:tasks.workunit.client.0.smithi100.stdout:3/323: truncate d10/f40 60883 0 2024-09-13T02:50:29.563 INFO:tasks.workunit.client.0.smithi100.stdout:6/200: dread d12/f16 [0,4194304] 0 2024-09-13T02:50:29.571 INFO:tasks.workunit.client.0.smithi100.stdout:9/202: rename dd/d1b/d1d/d36/c3d to dd/d1b/d21/c3e 0 2024-09-13T02:50:29.572 INFO:tasks.workunit.client.0.smithi100.stdout:5/267: rename db/f3b to db/de/d3e/f60 0 2024-09-13T02:50:29.576 INFO:tasks.workunit.client.0.smithi100.stdout:6/201: write f7 [2759526,91528] 0 2024-09-13T02:50:29.576 INFO:tasks.workunit.client.0.smithi100.stdout:6/202: chown d12/d14/d1c/l1d 20 1 2024-09-13T02:50:29.577 INFO:tasks.workunit.client.0.smithi100.stdout:6/203: mkdir d12/d2e/d34 0 2024-09-13T02:50:29.577 INFO:tasks.workunit.client.0.smithi100.stdout:6/204: read - d12/d14/d2f/f33 zero size 2024-09-13T02:50:29.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/205: dread - d12/d14/d1c/f30 zero size 2024-09-13T02:50:29.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/206: rmdir d12 39 2024-09-13T02:50:29.578 INFO:tasks.workunit.client.0.smithi100.stdout:6/207: chown d12/d14/c18 125708 1 2024-09-13T02:50:29.586 INFO:tasks.workunit.client.0.smithi100.stdout:9/203: dread fc [0,4194304] 0 2024-09-13T02:50:29.586 INFO:tasks.workunit.client.0.smithi100.stdout:9/204: fsync dd/ff 0 2024-09-13T02:50:29.598 INFO:tasks.workunit.client.0.smithi100.stdout:7/265: dwrite d3/d16/f32 [8388608,4194304] 0 2024-09-13T02:50:29.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/266: mkdir d3/d2d/d50 0 2024-09-13T02:50:29.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/267: truncate d3/d2d/f41 228917 0 2024-09-13T02:50:29.600 INFO:tasks.workunit.client.0.smithi100.stdout:8/234: dwrite fc [0,4194304] 0 2024-09-13T02:50:29.601 INFO:tasks.workunit.client.0.smithi100.stdout:7/268: stat d3/d5/d1b/l2b 0 2024-09-13T02:50:29.603 INFO:tasks.workunit.client.0.smithi100.stdout:8/235: symlink df/d13/d20/d18/d2c/l58 0 2024-09-13T02:50:29.605 INFO:tasks.workunit.client.0.smithi100.stdout:8/236: link df/d13/f44 df/d13/f59 0 2024-09-13T02:50:29.606 INFO:tasks.workunit.client.0.smithi100.stdout:0/222: dwrite d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:29.606 INFO:tasks.workunit.client.0.smithi100.stdout:0/223: fdatasync d2/d9/fb 0 2024-09-13T02:50:29.606 INFO:tasks.workunit.client.0.smithi100.stdout:0/224: read - d2/d9/d21/d47/d34/f39 zero size 2024-09-13T02:50:29.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/269: rmdir d3/d5/d1b 39 2024-09-13T02:50:29.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/270: chown d3/d5/f27 279903634 1 2024-09-13T02:50:29.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/271: chown d3/d2d/f4d 486561126 1 2024-09-13T02:50:29.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/272: truncate d3/d2d/f41 479755 0 2024-09-13T02:50:29.608 INFO:tasks.workunit.client.0.smithi100.stdout:7/273: symlink d3/d5/d1b/d1c/l51 0 2024-09-13T02:50:29.608 INFO:tasks.workunit.client.0.smithi100.stdout:7/274: dread - d3/f4c zero size 2024-09-13T02:50:29.610 INFO:tasks.workunit.client.0.smithi100.stdout:7/275: rename d3/d5/d1b/d1c/d36/f40 to d3/d2d/f52 0 2024-09-13T02:50:29.611 INFO:tasks.workunit.client.0.smithi100.stdout:2/225: dwrite d0/f1f [0,4194304] 0 2024-09-13T02:50:29.611 INFO:tasks.workunit.client.0.smithi100.stdout:2/226: readlink d0/db/d23/l29 0 2024-09-13T02:50:29.612 INFO:tasks.workunit.client.0.smithi100.stdout:7/276: creat d3/d5/f53 x:0 0 0 2024-09-13T02:50:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:5/268: dwrite db/de/d3e/f4e [0,4194304] 0 2024-09-13T02:50:29.614 INFO:tasks.workunit.client.0.smithi100.stdout:9/205: dwrite dd/d1b/d1d/f1f [0,4194304] 0 2024-09-13T02:50:29.619 INFO:tasks.workunit.client.0.smithi100.stdout:3/324: dwrite d10/d21/d51/f59 [0,4194304] 0 2024-09-13T02:50:29.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/208: dwrite d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:29.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/209: write d12/d14/f2d [521514,2147] 0 2024-09-13T02:50:29.619 INFO:tasks.workunit.client.0.smithi100.stdout:3/325: read d10/f40 [20171,122030] 0 2024-09-13T02:50:29.624 INFO:tasks.workunit.client.0.smithi100.stdout:9/206: mknod dd/d1b/d1d/d36/c3f 0 2024-09-13T02:50:29.628 INFO:tasks.workunit.client.0.smithi100.stdout:6/210: rename d12/d14/d21/c25 to d12/d14/d21/c35 0 2024-09-13T02:50:29.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/277: getdents d3/d16/d3b/d49 0 2024-09-13T02:50:29.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/269: link db/de/d1f/c21 db/c61 0 2024-09-13T02:50:29.629 INFO:tasks.workunit.client.0.smithi100.stdout:5/270: chown db/de 45041 1 2024-09-13T02:50:29.629 INFO:tasks.workunit.client.0.smithi100.stdout:6/211: dread d12/f16 [4194304,4194304] 0 2024-09-13T02:50:29.630 INFO:tasks.workunit.client.0.smithi100.stdout:9/207: rename dd/d1b/d21/c3e to dd/d1b/d21/c40 0 2024-09-13T02:50:29.630 INFO:tasks.workunit.client.0.smithi100.stdout:7/278: symlink d3/d16/d3b/d49/l54 0 2024-09-13T02:50:29.632 INFO:tasks.workunit.client.0.smithi100.stdout:3/326: write d10/f32 [1110458,122258] 0 2024-09-13T02:50:29.632 INFO:tasks.workunit.client.0.smithi100.stdout:3/327: chown d10 404167174 1 2024-09-13T02:50:29.633 INFO:tasks.workunit.client.0.smithi100.stdout:9/208: rename dd/ff to dd/d1b/d1d/d36/f41 0 2024-09-13T02:50:29.633 INFO:tasks.workunit.client.0.smithi100.stdout:9/209: write dd/f19 [1547451,33958] 0 2024-09-13T02:50:29.634 INFO:tasks.workunit.client.0.smithi100.stdout:7/279: mkdir d3/d16/d55 0 2024-09-13T02:50:29.634 INFO:tasks.workunit.client.0.smithi100.stdout:5/271: symlink db/de/d1f/d2b/l62 0 2024-09-13T02:50:29.635 INFO:tasks.workunit.client.0.smithi100.stdout:9/210: getdents dd/d1b/d24 0 2024-09-13T02:50:29.635 INFO:tasks.workunit.client.0.smithi100.stdout:8/237: dwrite df/d13/d20/d18/f39 [0,4194304] 0 2024-09-13T02:50:29.636 INFO:tasks.workunit.client.0.smithi100.stdout:7/280: mkdir d3/d16/d55/d56 0 2024-09-13T02:50:29.637 INFO:tasks.workunit.client.0.smithi100.stdout:2/227: dwrite d0/db/d21/f33 [0,4194304] 0 2024-09-13T02:50:29.637 INFO:tasks.workunit.client.0.smithi100.stdout:0/225: dwrite d2/d9/d21/d28/f4a [0,4194304] 0 2024-09-13T02:50:29.638 INFO:tasks.workunit.client.0.smithi100.stdout:8/238: mknod df/c5a 0 2024-09-13T02:50:29.639 INFO:tasks.workunit.client.0.smithi100.stdout:5/272: mkdir db/de/d63 0 2024-09-13T02:50:29.640 INFO:tasks.workunit.client.0.smithi100.stdout:9/211: mknod dd/c42 0 2024-09-13T02:50:29.641 INFO:tasks.workunit.client.0.smithi100.stdout:7/281: dread d3/d5/f17 [0,4194304] 0 2024-09-13T02:50:29.641 INFO:tasks.workunit.client.0.smithi100.stdout:7/282: chown d3/d5/c26 8172366 1 2024-09-13T02:50:29.647 INFO:tasks.workunit.client.0.smithi100.stdout:2/228: write d0/f1f [136313,108917] 0 2024-09-13T02:50:29.648 INFO:tasks.workunit.client.0.smithi100.stdout:2/229: write d0/db/f12 [3091618,94726] 0 2024-09-13T02:50:29.648 INFO:tasks.workunit.client.0.smithi100.stdout:2/230: chown d0/d36 1732 1 2024-09-13T02:50:29.648 INFO:tasks.workunit.client.0.smithi100.stdout:8/239: creat df/d13/d20/d18/d2c/d38/f5b x:0 0 0 2024-09-13T02:50:29.649 INFO:tasks.workunit.client.0.smithi100.stdout:5/273: mknod db/c64 0 2024-09-13T02:50:29.650 INFO:tasks.workunit.client.0.smithi100.stdout:9/212: truncate fb 1201570 0 2024-09-13T02:50:29.650 INFO:tasks.workunit.client.0.smithi100.stdout:7/283: link d3/l34 d3/d16/l57 0 2024-09-13T02:50:29.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/231: mkdir d0/db/d23/d39 0 2024-09-13T02:50:29.653 INFO:tasks.workunit.client.0.smithi100.stdout:0/226: rename d2/d9/d21 to d2/dd/d54 0 2024-09-13T02:50:29.653 INFO:tasks.workunit.client.0.smithi100.stdout:8/240: mkdir df/d13/d5c 0 2024-09-13T02:50:29.654 INFO:tasks.workunit.client.0.smithi100.stdout:8/241: write df/d13/d20/d18/f36 [787347,109875] 0 2024-09-13T02:50:29.654 INFO:tasks.workunit.client.0.smithi100.stdout:2/232: creat d0/db/d23/f3a x:0 0 0 2024-09-13T02:50:29.655 INFO:tasks.workunit.client.0.smithi100.stdout:8/242: mkdir df/d5d 0 2024-09-13T02:50:29.655 INFO:tasks.workunit.client.0.smithi100.stdout:8/243: rename df/d13/d20/d18/d2c/d38 to df/d13/d20/d18/d2c/d38/d5e 22 2024-09-13T02:50:29.656 INFO:tasks.workunit.client.0.smithi100.stdout:6/212: dwrite d12/d14/d1c/d28/f2a [0,4194304] 0 2024-09-13T02:50:29.656 INFO:tasks.workunit.client.0.smithi100.stdout:6/213: stat ld 0 2024-09-13T02:50:29.657 INFO:tasks.workunit.client.0.smithi100.stdout:3/328: dwrite d10/d21/d51/f55 [0,4194304] 0 2024-09-13T02:50:29.662 INFO:tasks.workunit.client.0.smithi100.stdout:5/274: dread db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:29.663 INFO:tasks.workunit.client.0.smithi100.stdout:9/213: dread dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:29.663 INFO:tasks.workunit.client.0.smithi100.stdout:9/214: fdatasync dd/d1b/d1d/d36/f37 0 2024-09-13T02:50:29.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/329: truncate f8 14140 0 2024-09-13T02:50:29.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/330: creat d10/d21/d51/d6c/f6f x:0 0 0 2024-09-13T02:50:29.668 INFO:tasks.workunit.client.0.smithi100.stdout:3/331: symlink d10/d21/d51/d6c/l70 0 2024-09-13T02:50:29.668 INFO:tasks.workunit.client.0.smithi100.stdout:3/332: write fc [670705,28479] 0 2024-09-13T02:50:29.668 INFO:tasks.workunit.client.0.smithi100.stdout:3/333: chown d10/d21/c2e 3052 1 2024-09-13T02:50:29.668 INFO:tasks.workunit.client.0.smithi100.stdout:3/334: write d10/f40 [8157,116088] 0 2024-09-13T02:50:29.668 INFO:tasks.workunit.client.0.smithi100.stdout:3/335: fsync d10/d21/f56 0 2024-09-13T02:50:29.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/275: rename db/de/f27 to db/de/d63/f65 0 2024-09-13T02:50:29.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/276: stat db/de/d1f/c43 0 2024-09-13T02:50:29.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/277: fsync db/f5c 0 2024-09-13T02:50:29.670 INFO:tasks.workunit.client.0.smithi100.stdout:2/233: read d0/db/d21/f33 [1685339,21837] 0 2024-09-13T02:50:29.670 INFO:tasks.workunit.client.0.smithi100.stdout:2/234: dread - d0/db/f2d zero size 2024-09-13T02:50:29.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/336: mkdir d10/d21/d51/d5a/d5e/d71 0 2024-09-13T02:50:29.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/337: chown d10/l26 61 1 2024-09-13T02:50:29.670 INFO:tasks.workunit.client.0.smithi100.stdout:3/338: creat d10/d21/d51/d5a/d5e/f72 x:0 0 0 2024-09-13T02:50:29.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/278: dread db/de/d1f/f31 [0,4194304] 0 2024-09-13T02:50:29.672 INFO:tasks.workunit.client.0.smithi100.stdout:7/284: dread d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:29.672 INFO:tasks.workunit.client.0.smithi100.stdout:4/233: sync 2024-09-13T02:50:29.673 INFO:tasks.workunit.client.0.smithi100.stdout:4/234: mkdir d3/dc/d4b 0 2024-09-13T02:50:29.673 INFO:tasks.workunit.client.0.smithi100.stdout:4/235: write d3/d6/d2f/f33 [411948,40023] 0 2024-09-13T02:50:29.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/339: dread d10/f31 [0,4194304] 0 2024-09-13T02:50:29.680 INFO:tasks.workunit.client.0.smithi100.stdout:3/340: fsync d10/f31 0 2024-09-13T02:50:29.680 INFO:tasks.workunit.client.0.smithi100.stdout:1/243: sync 2024-09-13T02:50:29.681 INFO:tasks.workunit.client.0.smithi100.stdout:2/235: dread d0/f1f [0,4194304] 0 2024-09-13T02:50:29.685 INFO:tasks.workunit.client.0.smithi100.stdout:2/236: dread d0/f11 [4194304,4194304] 0 2024-09-13T02:50:29.686 INFO:tasks.workunit.client.0.smithi100.stdout:4/236: write d3/d6/d21/f43 [624631,85878] 0 2024-09-13T02:50:29.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/237: stat d3/d6/d2f 0 2024-09-13T02:50:29.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/238: write d3/d6/f26 [1063352,22309] 0 2024-09-13T02:50:29.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/239: dread - d3/d6/d21/d46/f39 zero size 2024-09-13T02:50:29.687 INFO:tasks.workunit.client.0.smithi100.stdout:4/240: chown d3/d3a 89674 1 2024-09-13T02:50:29.688 INFO:tasks.workunit.client.0.smithi100.stdout:4/241: symlink d3/d6/d21/d46/d34/l4c 0 2024-09-13T02:50:29.688 INFO:tasks.workunit.client.0.smithi100.stdout:4/242: write d3/d6/f35 [870491,2920] 0 2024-09-13T02:50:29.691 INFO:tasks.workunit.client.0.smithi100.stdout:4/243: unlink d3/d6/f26 0 2024-09-13T02:50:29.692 INFO:tasks.workunit.client.0.smithi100.stdout:4/244: creat d3/d6/d2f/f4d x:0 0 0 2024-09-13T02:50:29.693 INFO:tasks.workunit.client.0.smithi100.stdout:4/245: mknod d3/d6/d21/d46/c4e 0 2024-09-13T02:50:29.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/246: mkdir d3/d3a/d4f 0 2024-09-13T02:50:29.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/247: mknod d3/d6/d21/d46/c50 0 2024-09-13T02:50:29.695 INFO:tasks.workunit.client.0.smithi100.stdout:4/248: symlink d3/d6/d21/d46/d2d/d3f/l51 0 2024-09-13T02:50:29.695 INFO:tasks.workunit.client.0.smithi100.stdout:4/249: readlink d3/d6/d9/l16 0 2024-09-13T02:50:29.696 INFO:tasks.workunit.client.0.smithi100.stdout:4/250: mkdir d3/dc/d4b/d52 0 2024-09-13T02:50:29.697 INFO:tasks.workunit.client.0.smithi100.stdout:4/251: dread d3/d6/d21/f45 [0,4194304] 0 2024-09-13T02:50:29.697 INFO:tasks.workunit.client.0.smithi100.stdout:4/252: write d3/d6/d21/d46/f41 [788496,6823] 0 2024-09-13T02:50:29.697 INFO:tasks.workunit.client.0.smithi100.stdout:9/215: dwrite dd/d1b/d1d/f2c [0,4194304] 0 2024-09-13T02:50:29.698 INFO:tasks.workunit.client.0.smithi100.stdout:4/253: rename d3/d6/d2f/f4d to d3/d6/d9/f53 0 2024-09-13T02:50:29.698 INFO:tasks.workunit.client.0.smithi100.stdout:4/254: creat d3/d6/d2f/f54 x:0 0 0 2024-09-13T02:50:29.698 INFO:tasks.workunit.client.0.smithi100.stdout:4/255: stat d3/d6/f1c 0 2024-09-13T02:50:29.700 INFO:tasks.workunit.client.0.smithi100.stdout:4/256: rename d3/d6/f1c to d3/d6/d21/d46/d2d/d42/f55 0 2024-09-13T02:50:29.702 INFO:tasks.workunit.client.0.smithi100.stdout:4/257: truncate d3/d6/f19 683822 0 2024-09-13T02:50:29.716 INFO:tasks.workunit.client.0.smithi100.stdout:7/285: dwrite d3/d5/f27 [0,4194304] 0 2024-09-13T02:50:29.718 INFO:tasks.workunit.client.0.smithi100.stdout:7/286: getdents d3/d5/d1b/d1c 0 2024-09-13T02:50:29.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/287: dread d3/d5/f1a [4194304,4194304] 0 2024-09-13T02:50:29.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/288: write d3/d5/f1a [5936353,79627] 0 2024-09-13T02:50:29.720 INFO:tasks.workunit.client.0.smithi100.stdout:7/289: write d3/d5/f53 [79348,121269] 0 2024-09-13T02:50:29.720 INFO:tasks.workunit.client.0.smithi100.stdout:5/279: dwrite db/de/d3e/f4e [0,4194304] 0 2024-09-13T02:50:29.721 INFO:tasks.workunit.client.0.smithi100.stdout:3/341: dwrite d10/d21/f29 [0,4194304] 0 2024-09-13T02:50:29.721 INFO:tasks.workunit.client.0.smithi100.stdout:7/290: mknod d3/d16/d3b/c58 0 2024-09-13T02:50:29.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/342: mkdir d10/d21/d51/d5a/d73 0 2024-09-13T02:50:29.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/343: truncate d10/d21/f2d 596020 0 2024-09-13T02:50:29.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/344: creat d10/d21/d51/d6c/f74 x:0 0 0 2024-09-13T02:50:29.722 INFO:tasks.workunit.client.0.smithi100.stdout:1/244: dwrite de/d14/d2e/d48/f50 [0,4194304] 0 2024-09-13T02:50:29.723 INFO:tasks.workunit.client.0.smithi100.stdout:9/216: dwrite dd/f1a [0,4194304] 0 2024-09-13T02:50:29.725 INFO:tasks.workunit.client.0.smithi100.stdout:7/291: rmdir d3/d2d/d50 0 2024-09-13T02:50:29.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/292: getdents d3/d5/d4f 0 2024-09-13T02:50:29.726 INFO:tasks.workunit.client.0.smithi100.stdout:7/293: dread - d3/f4c zero size 2024-09-13T02:50:29.727 INFO:tasks.workunit.client.0.smithi100.stdout:3/345: symlink d10/l75 0 2024-09-13T02:50:29.728 INFO:tasks.workunit.client.0.smithi100.stdout:3/346: write d10/f53 [1277023,88898] 0 2024-09-13T02:50:29.729 INFO:tasks.workunit.client.0.smithi100.stdout:5/280: dread db/de/d3e/f4e [0,4194304] 0 2024-09-13T02:50:29.735 INFO:tasks.workunit.client.0.smithi100.stdout:5/281: rename db/de/d1f/f44 to db/de/d3e/f66 0 2024-09-13T02:50:29.736 INFO:tasks.workunit.client.0.smithi100.stdout:7/294: getdents d3 0 2024-09-13T02:50:29.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/245: write de/f2c [549159,69894] 0 2024-09-13T02:50:29.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/246: read - de/d14/d22/f43 zero size 2024-09-13T02:50:29.740 INFO:tasks.workunit.client.0.smithi100.stdout:4/258: truncate d3/d6/d21/f43 601757 0 2024-09-13T02:50:29.740 INFO:tasks.workunit.client.0.smithi100.stdout:1/247: mknod de/d12/c53 0 2024-09-13T02:50:29.741 INFO:tasks.workunit.client.0.smithi100.stdout:1/248: write de/d14/d2e/f38 [190669,128107] 0 2024-09-13T02:50:29.742 INFO:tasks.workunit.client.0.smithi100.stdout:5/282: getdents db/de/d1f/d2b 0 2024-09-13T02:50:29.743 INFO:tasks.workunit.client.0.smithi100.stdout:7/295: mknod d3/d16/d3b/d49/c59 0 2024-09-13T02:50:29.744 INFO:tasks.workunit.client.0.smithi100.stdout:4/259: mkdir d3/d3a/d56 0 2024-09-13T02:50:29.745 INFO:tasks.workunit.client.0.smithi100.stdout:5/283: mknod db/de/d3e/c67 0 2024-09-13T02:50:29.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/260: rename d3/d6/d9/d25 to d3/dc/d4b/d52/d57 0 2024-09-13T02:50:29.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/261: write d3/fb [915480,28416] 0 2024-09-13T02:50:29.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/262: chown d3/d3a/d56 4491685 1 2024-09-13T02:50:29.748 INFO:tasks.workunit.client.0.smithi100.stdout:4/263: dread - d3/d6/d21/d46/f39 zero size 2024-09-13T02:50:29.750 INFO:tasks.workunit.client.0.smithi100.stdout:5/284: read db/de/d3e/f4e [2073978,84400] 0 2024-09-13T02:50:29.751 INFO:tasks.workunit.client.0.smithi100.stdout:4/264: mkdir d3/d6/d21/d46/d2d/d58 0 2024-09-13T02:50:29.752 INFO:tasks.workunit.client.0.smithi100.stdout:5/285: creat db/de/d3e/f68 x:0 0 0 2024-09-13T02:50:29.758 INFO:tasks.workunit.client.0.smithi100.stdout:5/286: write db/de/d1f/d2b/f35 [3589621,110913] 0 2024-09-13T02:50:29.758 INFO:tasks.workunit.client.0.smithi100.stdout:5/287: creat db/de/d1f/f69 x:0 0 0 2024-09-13T02:50:29.759 INFO:tasks.workunit.client.0.smithi100.stdout:7/296: dwrite d3/f15 [0,4194304] 0 2024-09-13T02:50:29.766 INFO:tasks.workunit.client.0.smithi100.stdout:7/297: rename d3/d5/l4b to d3/d16/d55/d56/l5a 0 2024-09-13T02:50:29.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/298: read d3/d16/f32 [920820,39104] 0 2024-09-13T02:50:29.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/299: chown d3/d5/c26 2 1 2024-09-13T02:50:29.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/300: creat d3/d16/d55/d56/f5b x:0 0 0 2024-09-13T02:50:29.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/301: dread - d3/d5/d1b/f4e zero size 2024-09-13T02:50:29.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/302: chown d3/c6 1034134624 1 2024-09-13T02:50:29.771 INFO:tasks.workunit.client.0.smithi100.stdout:7/303: symlink d3/d16/d55/l5c 0 2024-09-13T02:50:29.771 INFO:tasks.workunit.client.0.smithi100.stdout:7/304: chown d3/d5/d1b/l48 563889 1 2024-09-13T02:50:29.771 INFO:tasks.workunit.client.0.smithi100.stdout:5/288: getdents db 0 2024-09-13T02:50:29.772 INFO:tasks.workunit.client.0.smithi100.stdout:7/305: dread d3/d2d/f41 [0,4194304] 0 2024-09-13T02:50:29.772 INFO:tasks.workunit.client.0.smithi100.stdout:5/289: read db/de/d3e/f42 [339202,34745] 0 2024-09-13T02:50:29.773 INFO:tasks.workunit.client.0.smithi100.stdout:7/306: creat d3/d16/d3b/f5d x:0 0 0 2024-09-13T02:50:29.773 INFO:tasks.workunit.client.0.smithi100.stdout:7/307: creat d3/d16/d55/f5e x:0 0 0 2024-09-13T02:50:29.774 INFO:tasks.workunit.client.0.smithi100.stdout:5/290: symlink db/de/l6a 0 2024-09-13T02:50:29.774 INFO:tasks.workunit.client.0.smithi100.stdout:5/291: getdents db 0 2024-09-13T02:50:29.774 INFO:tasks.workunit.client.0.smithi100.stdout:5/292: truncate db/de/d1f/d2b/f33 1722012 0 2024-09-13T02:50:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:7/308: creat d3/d2d/f5f x:0 0 0 2024-09-13T02:50:29.775 INFO:tasks.workunit.client.0.smithi100.stdout:5/293: mknod db/de/d3e/c6b 0 2024-09-13T02:50:29.776 INFO:tasks.workunit.client.0.smithi100.stdout:5/294: symlink db/l6c 0 2024-09-13T02:50:29.778 INFO:tasks.workunit.client.0.smithi100.stdout:4/265: dwrite d3/fb [0,4194304] 0 2024-09-13T02:50:29.785 INFO:tasks.workunit.client.0.smithi100.stdout:8/244: sync 2024-09-13T02:50:29.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/227: sync 2024-09-13T02:50:29.785 INFO:tasks.workunit.client.0.smithi100.stdout:6/214: sync 2024-09-13T02:50:29.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/245: truncate df/d13/f59 1275208 0 2024-09-13T02:50:29.786 INFO:tasks.workunit.client.0.smithi100.stdout:8/246: fsync df/d13/f37 0 2024-09-13T02:50:29.786 INFO:tasks.workunit.client.0.smithi100.stdout:0/228: write d2/dd/d54/d47/d34/f39 [10821,22899] 0 2024-09-13T02:50:29.787 INFO:tasks.workunit.client.0.smithi100.stdout:8/247: write df/d13/f44 [738163,122216] 0 2024-09-13T02:50:29.787 INFO:tasks.workunit.client.0.smithi100.stdout:8/248: dread - df/d13/d20/d18/d2c/d38/f5b zero size 2024-09-13T02:50:29.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/215: mkdir d12/d2e/d34/d36 0 2024-09-13T02:50:29.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/216: dread - d12/d14/d2f/f33 zero size 2024-09-13T02:50:29.787 INFO:tasks.workunit.client.0.smithi100.stdout:6/217: read d12/d14/f2d [438521,91160] 0 2024-09-13T02:50:29.789 INFO:tasks.workunit.client.0.smithi100.stdout:8/249: unlink df/d13/d21/f22 0 2024-09-13T02:50:29.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/229: symlink d2/d1a/l55 0 2024-09-13T02:50:29.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/230: chown d2/d1a/d51 3240 1 2024-09-13T02:50:29.790 INFO:tasks.workunit.client.0.smithi100.stdout:0/231: write d2/dd/d33/d3b/f40 [1000273,41097] 0 2024-09-13T02:50:29.791 INFO:tasks.workunit.client.0.smithi100.stdout:6/218: truncate f7 1624130 0 2024-09-13T02:50:29.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/250: link df/l2f df/d13/d20/d18/d2c/l5f 0 2024-09-13T02:50:29.792 INFO:tasks.workunit.client.0.smithi100.stdout:8/251: stat df/d13/c28 0 2024-09-13T02:50:29.793 INFO:tasks.workunit.client.0.smithi100.stdout:6/219: unlink d12/d14/c26 0 2024-09-13T02:50:29.794 INFO:tasks.workunit.client.0.smithi100.stdout:6/220: mknod d12/d14/d2f/c37 0 2024-09-13T02:50:29.802 INFO:tasks.workunit.client.0.smithi100.stdout:5/295: dwrite db/f28 [0,4194304] 0 2024-09-13T02:50:29.803 INFO:tasks.workunit.client.0.smithi100.stdout:0/232: dread d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:29.804 INFO:tasks.workunit.client.0.smithi100.stdout:4/266: dwrite d3/dc/f48 [0,4194304] 0 2024-09-13T02:50:29.804 INFO:tasks.workunit.client.0.smithi100.stdout:4/267: readlink d3/l31 0 2024-09-13T02:50:29.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/296: mknod db/de/d1f/d2b/c6d 0 2024-09-13T02:50:29.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/297: write db/de/d3e/f66 [266399,28502] 0 2024-09-13T02:50:29.805 INFO:tasks.workunit.client.0.smithi100.stdout:0/233: chown d2/d1a/l25 8379794 1 2024-09-13T02:50:29.805 INFO:tasks.workunit.client.0.smithi100.stdout:0/234: dread - d2/dd/d54/d28/f35 zero size 2024-09-13T02:50:29.805 INFO:tasks.workunit.client.0.smithi100.stdout:7/309: dwrite d3/d16/d3b/f5d [0,4194304] 0 2024-09-13T02:50:29.806 INFO:tasks.workunit.client.0.smithi100.stdout:4/268: creat d3/dc/d4b/d52/f59 x:0 0 0 2024-09-13T02:50:29.806 INFO:tasks.workunit.client.0.smithi100.stdout:4/269: chown d3/d6 1199 1 2024-09-13T02:50:29.806 INFO:tasks.workunit.client.0.smithi100.stdout:4/270: creat d3/d6/d2f/f5a x:0 0 0 2024-09-13T02:50:29.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/252: read fc [1035046,61043] 0 2024-09-13T02:50:29.809 INFO:tasks.workunit.client.0.smithi100.stdout:6/221: write d12/d14/f1a [1917484,119277] 0 2024-09-13T02:50:29.809 INFO:tasks.workunit.client.0.smithi100.stdout:0/235: creat d2/f56 x:0 0 0 2024-09-13T02:50:29.810 INFO:tasks.workunit.client.0.smithi100.stdout:7/310: symlink d3/d16/d55/l60 0 2024-09-13T02:50:29.810 INFO:tasks.workunit.client.0.smithi100.stdout:7/311: chown d3/d5/f1a 649 1 2024-09-13T02:50:29.811 INFO:tasks.workunit.client.0.smithi100.stdout:5/298: dread db/f3c [0,4194304] 0 2024-09-13T02:50:29.813 INFO:tasks.workunit.client.0.smithi100.stdout:8/253: mknod df/d13/d20/d18/d2c/c60 0 2024-09-13T02:50:29.815 INFO:tasks.workunit.client.0.smithi100.stdout:6/222: link d12/d14/f2d d12/d2e/d34/d36/f38 0 2024-09-13T02:50:29.817 INFO:tasks.workunit.client.0.smithi100.stdout:5/299: symlink db/de/d1f/l6e 0 2024-09-13T02:50:29.817 INFO:tasks.workunit.client.0.smithi100.stdout:5/300: write db/de/d1f/d2b/f55 [975664,5945] 0 2024-09-13T02:50:29.817 INFO:tasks.workunit.client.0.smithi100.stdout:5/301: readlink db/de/l6a 0 2024-09-13T02:50:29.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/254: rename df/d13/d20/d18/d2c/f46 to df/d13/d20/f61 0 2024-09-13T02:50:29.821 INFO:tasks.workunit.client.0.smithi100.stdout:6/223: creat d12/d2e/f39 x:0 0 0 2024-09-13T02:50:29.822 INFO:tasks.workunit.client.0.smithi100.stdout:0/236: dread d2/f1f [0,4194304] 0 2024-09-13T02:50:29.823 INFO:tasks.workunit.client.0.smithi100.stdout:8/255: mknod df/c62 0 2024-09-13T02:50:29.825 INFO:tasks.workunit.client.0.smithi100.stdout:0/237: truncate d2/fa 3173331 0 2024-09-13T02:50:29.827 INFO:tasks.workunit.client.0.smithi100.stdout:0/238: mknod d2/dd/d33/d43/c57 0 2024-09-13T02:50:29.828 INFO:tasks.workunit.client.0.smithi100.stdout:0/239: creat d2/f58 x:0 0 0 2024-09-13T02:50:29.828 INFO:tasks.workunit.client.0.smithi100.stdout:0/240: chown d2/dd/d54/d47/c52 585925 1 2024-09-13T02:50:29.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/241: symlink d2/dd/d54/d47/d34/l59 0 2024-09-13T02:50:29.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/242: chown d2/d9/f1b 62369120 1 2024-09-13T02:50:29.830 INFO:tasks.workunit.client.0.smithi100.stdout:7/312: truncate d3/d16/d3b/f5d 3739823 0 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/224: getdents d12/d2e/d34/d36 0 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/225: dread - d12/d14/d2f/f33 zero size 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/226: truncate d12/d14/f1a 4705945 0 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/227: fsync d12/d14/f2d 0 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:5/302: dread db/de/f15 [0,4194304] 0 2024-09-13T02:50:29.833 INFO:tasks.workunit.client.0.smithi100.stdout:4/271: dwrite d3/d6/d21/d46/d2d/d42/f55 [0,4194304] 0 2024-09-13T02:50:29.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/256: getdents df/d13/d20/d18/d2c 0 2024-09-13T02:50:29.834 INFO:tasks.workunit.client.0.smithi100.stdout:8/257: stat df/d13/d21/f40 0 2024-09-13T02:50:29.837 INFO:tasks.workunit.client.0.smithi100.stdout:6/228: creat d12/d14/d1c/f3a x:0 0 0 2024-09-13T02:50:29.838 INFO:tasks.workunit.client.0.smithi100.stdout:7/313: dread d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:29.844 INFO:tasks.workunit.client.0.smithi100.stdout:5/303: symlink db/de/d3e/l6f 0 2024-09-13T02:50:29.845 INFO:tasks.workunit.client.0.smithi100.stdout:8/258: rename df/d13/d20/f23 to df/d13/d20/d18/f63 0 2024-09-13T02:50:29.846 INFO:tasks.workunit.client.0.smithi100.stdout:4/272: dread d3/d6/f19 [0,4194304] 0 2024-09-13T02:50:29.846 INFO:tasks.workunit.client.0.smithi100.stdout:6/229: unlink d12/d14/d1c/d28/f2a 0 2024-09-13T02:50:29.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/304: fdatasync db/de/d3e/f66 0 2024-09-13T02:50:29.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/305: chown db/de/d3e/l5f 890 1 2024-09-13T02:50:29.847 INFO:tasks.workunit.client.0.smithi100.stdout:8/259: creat df/f64 x:0 0 0 2024-09-13T02:50:29.848 INFO:tasks.workunit.client.0.smithi100.stdout:4/273: creat d3/d6/d21/d46/d2d/d3f/f5b x:0 0 0 2024-09-13T02:50:29.848 INFO:tasks.workunit.client.0.smithi100.stdout:4/274: stat d3/d6/d2f/l32 0 2024-09-13T02:50:29.849 INFO:tasks.workunit.client.0.smithi100.stdout:7/314: getdents d3/d16/d3b 0 2024-09-13T02:50:29.849 INFO:tasks.workunit.client.0.smithi100.stdout:7/315: truncate d3/f3c 67070 0 2024-09-13T02:50:29.850 INFO:tasks.workunit.client.0.smithi100.stdout:7/316: creat d3/d16/d55/d56/f61 x:0 0 0 2024-09-13T02:50:29.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/260: rmdir df/d13/d20 39 2024-09-13T02:50:29.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/261: fsync df/d13/d20/d18/d41/f56 0 2024-09-13T02:50:29.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/317: mknod d3/d16/c62 0 2024-09-13T02:50:29.854 INFO:tasks.workunit.client.0.smithi100.stdout:7/318: chown d3/d16/d55/d56/f61 413730284 1 2024-09-13T02:50:29.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/262: rename df/d13/d21/c26 to df/d13/d20/d18/d2c/d38/c65 0 2024-09-13T02:50:29.856 INFO:tasks.workunit.client.0.smithi100.stdout:7/319: mknod d3/d5/c63 0 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/263: mkdir df/d13/d20/d18/d2c/d66 0 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:8/264: chown df/l11 0 1 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:5/306: dread db/de/d1f/d2b/f34 [0,4194304] 0 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:0/243: dwrite d2/dd/d54/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:0/244: chown d2/c26 106162222 1 2024-09-13T02:50:29.858 INFO:tasks.workunit.client.0.smithi100.stdout:0/245: truncate d2/f56 377318 0 2024-09-13T02:50:29.860 INFO:tasks.workunit.client.0.smithi100.stdout:1/249: sync 2024-09-13T02:50:29.860 INFO:tasks.workunit.client.0.smithi100.stdout:9/217: sync 2024-09-13T02:50:29.860 INFO:tasks.workunit.client.0.smithi100.stdout:3/347: sync 2024-09-13T02:50:29.861 INFO:tasks.workunit.client.0.smithi100.stdout:4/275: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:29.862 INFO:tasks.workunit.client.0.smithi100.stdout:8/265: link df/d13/d20/d18/f36 df/f67 0 2024-09-13T02:50:29.863 INFO:tasks.workunit.client.0.smithi100.stdout:5/307: mkdir db/de/d63/d70 0 2024-09-13T02:50:29.865 INFO:tasks.workunit.client.0.smithi100.stdout:6/230: dwrite d12/d14/d1c/f3a [0,4194304] 0 2024-09-13T02:50:29.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/250: creat de/d12/f54 x:0 0 0 2024-09-13T02:50:29.865 INFO:tasks.workunit.client.0.smithi100.stdout:6/231: truncate d12/d2e/f39 674951 0 2024-09-13T02:50:29.865 INFO:tasks.workunit.client.0.smithi100.stdout:9/218: mkdir dd/d1b/d1d/d43 0 2024-09-13T02:50:29.866 INFO:tasks.workunit.client.0.smithi100.stdout:9/219: stat dd/f12 0 2024-09-13T02:50:29.867 INFO:tasks.workunit.client.0.smithi100.stdout:4/276: mkdir d3/d3a/d5c 0 2024-09-13T02:50:29.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/266: mkdir df/d13/d68 0 2024-09-13T02:50:29.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/267: dread - df/f64 zero size 2024-09-13T02:50:29.869 INFO:tasks.workunit.client.0.smithi100.stdout:8/268: truncate df/d13/d21/f4d 1367 0 2024-09-13T02:50:29.872 INFO:tasks.workunit.client.0.smithi100.stdout:1/251: creat de/d14/d22/d52/f55 x:0 0 0 2024-09-13T02:50:29.872 INFO:tasks.workunit.client.0.smithi100.stdout:1/252: stat de/d14/d2e/f4e 0 2024-09-13T02:50:29.873 INFO:tasks.workunit.client.0.smithi100.stdout:9/220: truncate dd/d1b/d1d/d36/f37 512925 0 2024-09-13T02:50:29.873 INFO:tasks.workunit.client.0.smithi100.stdout:9/221: readlink l6 0 2024-09-13T02:50:29.874 INFO:tasks.workunit.client.0.smithi100.stdout:4/277: truncate d3/dc/f23 3382617 0 2024-09-13T02:50:29.875 INFO:tasks.workunit.client.0.smithi100.stdout:8/269: creat df/d5d/f69 x:0 0 0 2024-09-13T02:50:29.876 INFO:tasks.workunit.client.0.smithi100.stdout:5/308: write db/de/f15 [4950534,5987] 0 2024-09-13T02:50:29.877 INFO:tasks.workunit.client.0.smithi100.stdout:1/253: creat de/d14/d2e/f56 x:0 0 0 2024-09-13T02:50:29.877 INFO:tasks.workunit.client.0.smithi100.stdout:1/254: chown de/d12/f2a 10459045 1 2024-09-13T02:50:29.877 INFO:tasks.workunit.client.0.smithi100.stdout:1/255: chown de/d14/d2e/d48 8203269 1 2024-09-13T02:50:29.877 INFO:tasks.workunit.client.0.smithi100.stdout:9/222: getdents dd/d1b/d27 0 2024-09-13T02:50:29.878 INFO:tasks.workunit.client.0.smithi100.stdout:4/278: symlink d3/dc/d4b/d52/d57/l5d 0 2024-09-13T02:50:29.878 INFO:tasks.workunit.client.0.smithi100.stdout:4/279: chown d3/d3a/d4f 121761 1 2024-09-13T02:50:29.878 INFO:tasks.workunit.client.0.smithi100.stdout:4/280: write d3/d6/d21/d46/d2d/f36 [729562,13945] 0 2024-09-13T02:50:29.879 INFO:tasks.workunit.client.0.smithi100.stdout:8/270: rmdir df/d13/d20/d18/d2c/d66 0 2024-09-13T02:50:29.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/309: mkdir db/de/d3e/d71 0 2024-09-13T02:50:29.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/223: rmdir dd/d1b/d1d/d36 39 2024-09-13T02:50:29.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/224: write dd/d1b/d24/f35 [301254,24082] 0 2024-09-13T02:50:29.881 INFO:tasks.workunit.client.0.smithi100.stdout:9/225: readlink dd/d1b/d27/l32 0 2024-09-13T02:50:29.882 INFO:tasks.workunit.client.0.smithi100.stdout:7/320: dwrite d3/fa [4194304,4194304] 0 2024-09-13T02:50:29.883 INFO:tasks.workunit.client.0.smithi100.stdout:4/281: link d3/d6/f19 d3/d6/d21/d46/f5e 0 2024-09-13T02:50:29.884 INFO:tasks.workunit.client.0.smithi100.stdout:2/237: sync 2024-09-13T02:50:29.884 INFO:tasks.workunit.client.0.smithi100.stdout:8/271: unlink df/d13/d20/d18/d41/c47 0 2024-09-13T02:50:29.885 INFO:tasks.workunit.client.0.smithi100.stdout:8/272: fdatasync df/d13/f44 0 2024-09-13T02:50:29.886 INFO:tasks.workunit.client.0.smithi100.stdout:9/226: creat dd/d1b/d1d/d43/f44 x:0 0 0 2024-09-13T02:50:29.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/348: dwrite d10/f31 [0,4194304] 0 2024-09-13T02:50:29.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/349: chown f9 19994 1 2024-09-13T02:50:29.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/350: chown d10/d21/d51/d5a/l5c 10783 1 2024-09-13T02:50:29.886 INFO:tasks.workunit.client.0.smithi100.stdout:3/351: write d10/d21/d51/d5a/d5e/f72 [808308,86638] 0 2024-09-13T02:50:29.887 INFO:tasks.workunit.client.0.smithi100.stdout:3/352: truncate d10/f38 783834 0 2024-09-13T02:50:29.887 INFO:tasks.workunit.client.0.smithi100.stdout:3/353: truncate d10/f49 304143 0 2024-09-13T02:50:29.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/321: unlink d3/d5/c22 0 2024-09-13T02:50:29.887 INFO:tasks.workunit.client.0.smithi100.stdout:0/246: dwrite d2/dd/d54/d28/f35 [0,4194304] 0 2024-09-13T02:50:29.887 INFO:tasks.workunit.client.0.smithi100.stdout:0/247: readlink d2/dd/lf 0 2024-09-13T02:50:29.888 INFO:tasks.workunit.client.0.smithi100.stdout:4/282: link d3/d6/d21/d46/d2d/d3f/l51 d3/d6/d21/d46/d2d/d3f/l5f 0 2024-09-13T02:50:29.888 INFO:tasks.workunit.client.0.smithi100.stdout:4/283: write d3/d6/f10 [4686612,106651] 0 2024-09-13T02:50:29.889 INFO:tasks.workunit.client.0.smithi100.stdout:2/238: link d0/l37 d0/db/d23/d39/l3b 0 2024-09-13T02:50:29.891 INFO:tasks.workunit.client.0.smithi100.stdout:5/310: symlink db/de/l72 0 2024-09-13T02:50:29.891 INFO:tasks.workunit.client.0.smithi100.stdout:5/311: chown db/f5b 571 1 2024-09-13T02:50:29.891 INFO:tasks.workunit.client.0.smithi100.stdout:8/273: mknod df/d13/d20/d18/c6a 0 2024-09-13T02:50:29.895 INFO:tasks.workunit.client.0.smithi100.stdout:1/256: dwrite de/d14/f1a [0,4194304] 0 2024-09-13T02:50:29.895 INFO:tasks.workunit.client.0.smithi100.stdout:1/257: truncate de/d14/d22/d52/f55 805089 0 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:1/258: write de/f23 [641764,114936] 0 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:1/259: dread - de/d14/d22/f35 zero size 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:1/260: read - de/d14/d2e/d48/f4c zero size 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:1/261: fsync f8 0 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:1/262: dread - de/d14/d22/f4a zero size 2024-09-13T02:50:29.896 INFO:tasks.workunit.client.0.smithi100.stdout:7/322: dread d3/d5/f27 [0,4194304] 0 2024-09-13T02:50:29.898 INFO:tasks.workunit.client.0.smithi100.stdout:9/227: creat dd/d1b/d1d/f45 x:0 0 0 2024-09-13T02:50:29.900 INFO:tasks.workunit.client.0.smithi100.stdout:3/354: unlink d10/f5f 0 2024-09-13T02:50:29.900 INFO:tasks.workunit.client.0.smithi100.stdout:3/355: creat d10/d21/d51/d6c/f76 x:0 0 0 2024-09-13T02:50:29.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/248: rename d2/l37 to d2/dd/d33/d3b/l5a 0 2024-09-13T02:50:29.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/249: dread d2/dd/d33/d43/d4b/f4d [0,4194304] 0 2024-09-13T02:50:29.904 INFO:tasks.workunit.client.0.smithi100.stdout:0/250: write d2/d9/f1b [664875,97274] 0 2024-09-13T02:50:29.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/312: unlink l6 0 2024-09-13T02:50:29.906 INFO:tasks.workunit.client.0.smithi100.stdout:8/274: creat df/d13/d5c/f6b x:0 0 0 2024-09-13T02:50:29.906 INFO:tasks.workunit.client.0.smithi100.stdout:8/275: creat df/f6c x:0 0 0 2024-09-13T02:50:29.908 INFO:tasks.workunit.client.0.smithi100.stdout:7/323: symlink d3/d16/d3b/l64 0 2024-09-13T02:50:29.908 INFO:tasks.workunit.client.0.smithi100.stdout:7/324: write d3/fc [4261838,12722] 0 2024-09-13T02:50:29.908 INFO:tasks.workunit.client.0.smithi100.stdout:7/325: write d3/fa [3871066,56142] 0 2024-09-13T02:50:29.908 INFO:tasks.workunit.client.0.smithi100.stdout:3/356: write d10/f2a [504329,125370] 0 2024-09-13T02:50:29.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/228: unlink dd/l2a 0 2024-09-13T02:50:29.909 INFO:tasks.workunit.client.0.smithi100.stdout:1/263: write de/d14/f1a [78739,116719] 0 2024-09-13T02:50:29.909 INFO:tasks.workunit.client.0.smithi100.stdout:5/313: dread db/f3c [0,4194304] 0 2024-09-13T02:50:29.912 INFO:tasks.workunit.client.0.smithi100.stdout:4/284: rename d3/dc/d4b/d52/d57 to d3/d6/d2f/d60 0 2024-09-13T02:50:29.912 INFO:tasks.workunit.client.0.smithi100.stdout:4/285: write d3/d6/d21/d46/f15 [1363681,66137] 0 2024-09-13T02:50:29.913 INFO:tasks.workunit.client.0.smithi100.stdout:0/251: symlink d2/d1a/d51/l5b 0 2024-09-13T02:50:29.915 INFO:tasks.workunit.client.0.smithi100.stdout:8/276: link fc df/d13/d68/f6d 0 2024-09-13T02:50:29.919 INFO:tasks.workunit.client.0.smithi100.stdout:3/357: mknod d10/d21/d57/c77 0 2024-09-13T02:50:29.920 INFO:tasks.workunit.client.0.smithi100.stdout:1/264: unlink de/d14/c19 0 2024-09-13T02:50:29.921 INFO:tasks.workunit.client.0.smithi100.stdout:2/239: rename d0/c8 to d0/db/c3c 0 2024-09-13T02:50:29.922 INFO:tasks.workunit.client.0.smithi100.stdout:4/286: getdents d3/d6/d21/d46/d2d/d42 0 2024-09-13T02:50:29.923 INFO:tasks.workunit.client.0.smithi100.stdout:0/252: symlink d2/dd/d33/d43/d4b/l5c 0 2024-09-13T02:50:29.925 INFO:tasks.workunit.client.0.smithi100.stdout:8/277: mknod df/d13/c6e 0 2024-09-13T02:50:29.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/314: dwrite db/de/d1f/f4b [0,4194304] 0 2024-09-13T02:50:29.927 INFO:tasks.workunit.client.0.smithi100.stdout:8/278: read df/d13/d20/f4e [282142,106666] 0 2024-09-13T02:50:29.929 INFO:tasks.workunit.client.0.smithi100.stdout:1/265: unlink de/d14/d2e/c2d 0 2024-09-13T02:50:29.933 INFO:tasks.workunit.client.0.smithi100.stdout:7/326: rename d3/d16/d3b/d49 to d3/d5/d1b/d1c/d36/d65 0 2024-09-13T02:50:29.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/287: unlink d3/d6/f35 0 2024-09-13T02:50:29.936 INFO:tasks.workunit.client.0.smithi100.stdout:0/253: mkdir d2/dd/d54/d3e/d5d 0 2024-09-13T02:50:29.938 INFO:tasks.workunit.client.0.smithi100.stdout:5/315: symlink db/de/d63/d70/l73 0 2024-09-13T02:50:29.938 INFO:tasks.workunit.client.0.smithi100.stdout:3/358: dwrite f8 [0,4194304] 0 2024-09-13T02:50:29.939 INFO:tasks.workunit.client.0.smithi100.stdout:8/279: mkdir df/d6f 0 2024-09-13T02:50:29.939 INFO:tasks.workunit.client.0.smithi100.stdout:8/280: chown df/f64 23 1 2024-09-13T02:50:29.942 INFO:tasks.workunit.client.0.smithi100.stdout:9/229: rename dd/d1b/d1d/f45 to dd/d1b/d1d/d36/d3c/f46 0 2024-09-13T02:50:29.942 INFO:tasks.workunit.client.0.smithi100.stdout:9/230: chown dd/d1b/c34 377277 1 2024-09-13T02:50:29.943 INFO:tasks.workunit.client.0.smithi100.stdout:7/327: chown d3/d5/l13 71 1 2024-09-13T02:50:29.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/240: dwrite d0/db/f26 [0,4194304] 0 2024-09-13T02:50:29.943 INFO:tasks.workunit.client.0.smithi100.stdout:0/254: symlink d2/dd/d54/d3e/d5d/l5e 0 2024-09-13T02:50:29.948 INFO:tasks.workunit.client.0.smithi100.stdout:3/359: dread d10/f32 [0,4194304] 0 2024-09-13T02:50:29.954 INFO:tasks.workunit.client.0.smithi100.stdout:9/231: write dd/d1b/d1d/f2c [3177555,22902] 0 2024-09-13T02:50:29.954 INFO:tasks.workunit.client.0.smithi100.stdout:9/232: write dd/f19 [2147790,70810] 0 2024-09-13T02:50:29.954 INFO:tasks.workunit.client.0.smithi100.stdout:9/233: write f5 [4953125,129851] 0 2024-09-13T02:50:29.954 INFO:tasks.workunit.client.0.smithi100.stdout:9/234: fsync dd/f1a 0 2024-09-13T02:50:29.957 INFO:tasks.workunit.client.0.smithi100.stdout:9/235: write fc [235068,103130] 0 2024-09-13T02:50:29.958 INFO:tasks.workunit.client.0.smithi100.stdout:9/236: readlink dd/l29 0 2024-09-13T02:50:29.963 INFO:tasks.workunit.client.0.smithi100.stdout:2/241: creat d0/f3d x:0 0 0 2024-09-13T02:50:29.963 INFO:tasks.workunit.client.0.smithi100.stdout:2/242: readlink d0/la 0 2024-09-13T02:50:29.964 INFO:tasks.workunit.client.0.smithi100.stdout:0/255: symlink d2/dd/d54/d47/d34/d3c/l5f 0 2024-09-13T02:50:29.964 INFO:tasks.workunit.client.0.smithi100.stdout:0/256: chown d2/dd/d54 1 1 2024-09-13T02:50:29.964 INFO:tasks.workunit.client.0.smithi100.stdout:3/360: truncate d10/f44 354050 0 2024-09-13T02:50:29.964 INFO:tasks.workunit.client.0.smithi100.stdout:3/361: creat d10/d21/d51/d5a/d5e/f78 x:0 0 0 2024-09-13T02:50:29.967 INFO:tasks.workunit.client.0.smithi100.stdout:8/281: rename df/d13/d20/d18 to df/d5d/d70 0 2024-09-13T02:50:29.971 INFO:tasks.workunit.client.0.smithi100.stdout:9/237: creat dd/d1b/d1d/d36/f47 x:0 0 0 2024-09-13T02:50:29.972 INFO:tasks.workunit.client.0.smithi100.stdout:5/316: dwrite db/f28 [4194304,4194304] 0 2024-09-13T02:50:29.972 INFO:tasks.workunit.client.0.smithi100.stdout:0/257: mknod d2/dd/d54/c60 0 2024-09-13T02:50:29.973 INFO:tasks.workunit.client.0.smithi100.stdout:2/243: rmdir d0/db/d23 39 2024-09-13T02:50:29.973 INFO:tasks.workunit.client.0.smithi100.stdout:5/317: dread db/de/d1f/d2b/f33 [0,4194304] 0 2024-09-13T02:50:29.974 INFO:tasks.workunit.client.0.smithi100.stdout:0/258: truncate d2/dd/f10 3132028 0 2024-09-13T02:50:29.974 INFO:tasks.workunit.client.0.smithi100.stdout:7/328: dwrite d3/d5/d1b/d1c/f3e [0,4194304] 0 2024-09-13T02:50:29.975 INFO:tasks.workunit.client.0.smithi100.stdout:4/288: dwrite d3/d6/d21/d46/d2d/f36 [0,4194304] 0 2024-09-13T02:50:29.976 INFO:tasks.workunit.client.0.smithi100.stdout:5/318: rename db/f2f to db/de/d63/d70/f74 0 2024-09-13T02:50:29.979 INFO:tasks.workunit.client.0.smithi100.stdout:3/362: dread d10/d21/f29 [0,4194304] 0 2024-09-13T02:50:29.980 INFO:tasks.workunit.client.0.smithi100.stdout:5/319: unlink db/de/d1f/d2b/f33 0 2024-09-13T02:50:29.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/363: unlink d10/l75 0 2024-09-13T02:50:29.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/320: mknod db/c75 0 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:5/321: fsync db/de/d3e/f51 0 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:5/322: chown db/c48 157266 1 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:5/323: write db/de/d1f/d2b/f34 [3904325,6461] 0 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:3/364: creat d10/f79 x:0 0 0 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:3/365: stat d10/d21/d51/c64 0 2024-09-13T02:50:29.984 INFO:tasks.workunit.client.0.smithi100.stdout:3/366: chown d10/d21/c6e 516786696 1 2024-09-13T02:50:29.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/324: symlink db/de/d1f/d2b/l76 0 2024-09-13T02:50:29.985 INFO:tasks.workunit.client.0.smithi100.stdout:2/244: write d0/db/d21/f30 [5281706,5920] 0 2024-09-13T02:50:29.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/367: dread d10/d21/f42 [0,4194304] 0 2024-09-13T02:50:29.985 INFO:tasks.workunit.client.0.smithi100.stdout:3/368: fdatasync d10/f38 0 2024-09-13T02:50:29.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/325: symlink db/de/d63/d70/l77 0 2024-09-13T02:50:29.986 INFO:tasks.workunit.client.0.smithi100.stdout:3/369: symlink d10/d21/d51/l7a 0 2024-09-13T02:50:29.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/326: rmdir db/de/d3e 39 2024-09-13T02:50:29.988 INFO:tasks.workunit.client.0.smithi100.stdout:4/289: dread d3/d6/d9/fd [0,4194304] 0 2024-09-13T02:50:29.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/327: mkdir db/de/d1f/d78 0 2024-09-13T02:50:29.993 INFO:tasks.workunit.client.0.smithi100.stdout:2/245: dread d0/db/d21/f33 [0,4194304] 0 2024-09-13T02:50:29.994 INFO:tasks.workunit.client.0.smithi100.stdout:2/246: symlink d0/db/d23/l3e 0 2024-09-13T02:50:29.997 INFO:tasks.workunit.client.0.smithi100.stdout:2/247: dread d0/f20 [0,4194304] 0 2024-09-13T02:50:29.998 INFO:tasks.workunit.client.0.smithi100.stdout:4/290: dread d3/d6/f18 [0,4194304] 0 2024-09-13T02:50:29.999 INFO:tasks.workunit.client.0.smithi100.stdout:4/291: mknod d3/d3a/d4f/c61 0 2024-09-13T02:50:30.001 INFO:tasks.workunit.client.0.smithi100.stdout:8/282: dwrite fc [0,4194304] 0 2024-09-13T02:50:30.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/292: link d3/d6/d21/l30 d3/d6/d21/d46/d2d/d42/l62 0 2024-09-13T02:50:30.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/293: dread - d3/d6/d21/d46/d2d/d3f/f5b zero size 2024-09-13T02:50:30.001 INFO:tasks.workunit.client.0.smithi100.stdout:4/294: readlink d3/d6/d21/d46/d2d/d3f/l51 0 2024-09-13T02:50:30.001 INFO:tasks.workunit.client.0.smithi100.stdout:9/238: dwrite fb [0,4194304] 0 2024-09-13T02:50:30.002 INFO:tasks.workunit.client.0.smithi100.stdout:3/370: dwrite d10/d21/d51/f55 [4194304,4194304] 0 2024-09-13T02:50:30.002 INFO:tasks.workunit.client.0.smithi100.stdout:5/328: dread db/de/d1f/f53 [0,4194304] 0 2024-09-13T02:50:30.002 INFO:tasks.workunit.client.0.smithi100.stdout:2/248: read d0/f20 [11806,10836] 0 2024-09-13T02:50:30.002 INFO:tasks.workunit.client.0.smithi100.stdout:8/283: creat df/d5d/d70/d2c/d38/f71 x:0 0 0 2024-09-13T02:50:30.003 INFO:tasks.workunit.client.0.smithi100.stdout:4/295: mkdir d3/d63 0 2024-09-13T02:50:30.003 INFO:tasks.workunit.client.0.smithi100.stdout:4/296: fdatasync d3/d6/d21/d46/d2d/d42/f55 0 2024-09-13T02:50:30.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/239: mknod dd/d1b/d1d/d28/c48 0 2024-09-13T02:50:30.006 INFO:tasks.workunit.client.0.smithi100.stdout:6/232: sync 2024-09-13T02:50:30.008 INFO:tasks.workunit.client.0.smithi100.stdout:4/297: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:30.008 INFO:tasks.workunit.client.0.smithi100.stdout:4/298: readlink d3/d6/d21/d46/d34/l49 0 2024-09-13T02:50:30.008 INFO:tasks.workunit.client.0.smithi100.stdout:4/299: creat d3/dc/d4b/d52/f64 x:0 0 0 2024-09-13T02:50:30.013 INFO:tasks.workunit.client.0.smithi100.stdout:2/249: mkdir d0/db/d3f 0 2024-09-13T02:50:30.015 INFO:tasks.workunit.client.0.smithi100.stdout:8/284: getdents df/d5d/d70 0 2024-09-13T02:50:30.015 INFO:tasks.workunit.client.0.smithi100.stdout:8/285: creat df/d13/d5c/f72 x:0 0 0 2024-09-13T02:50:30.017 INFO:tasks.workunit.client.0.smithi100.stdout:6/233: truncate d12/d2e/d34/d36/f38 493094 0 2024-09-13T02:50:30.017 INFO:tasks.workunit.client.0.smithi100.stdout:6/234: chown d12/d14 10087 1 2024-09-13T02:50:30.017 INFO:tasks.workunit.client.0.smithi100.stdout:6/235: creat d12/d2e/f3b x:0 0 0 2024-09-13T02:50:30.017 INFO:tasks.workunit.client.0.smithi100.stdout:6/236: dread - d12/d14/d2f/f33 zero size 2024-09-13T02:50:30.018 INFO:tasks.workunit.client.0.smithi100.stdout:4/300: dread d3/fb [0,4194304] 0 2024-09-13T02:50:30.018 INFO:tasks.workunit.client.0.smithi100.stdout:4/301: chown d3/d6/d21/d46/d2d/d3f/f5b 1961475 1 2024-09-13T02:50:30.019 INFO:tasks.workunit.client.0.smithi100.stdout:4/302: readlink d3/d6/d21/l30 0 2024-09-13T02:50:30.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/371: rmdir d10/d21 39 2024-09-13T02:50:30.022 INFO:tasks.workunit.client.0.smithi100.stdout:3/372: dread d10/d21/d51/d5a/f69 [0,4194304] 0 2024-09-13T02:50:30.022 INFO:tasks.workunit.client.0.smithi100.stdout:2/250: creat d0/db/f40 x:0 0 0 2024-09-13T02:50:30.025 INFO:tasks.workunit.client.0.smithi100.stdout:9/240: dwrite dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:30.025 INFO:tasks.workunit.client.0.smithi100.stdout:9/241: write dd/f19 [2168383,20018] 0 2024-09-13T02:50:30.025 INFO:tasks.workunit.client.0.smithi100.stdout:6/237: creat d12/d14/f3c x:0 0 0 2024-09-13T02:50:30.027 INFO:tasks.workunit.client.0.smithi100.stdout:4/303: rmdir d3/d3a 39 2024-09-13T02:50:30.027 INFO:tasks.workunit.client.0.smithi100.stdout:4/304: fsync d3/d6/d21/d46/f15 0 2024-09-13T02:50:30.027 INFO:tasks.workunit.client.0.smithi100.stdout:4/305: fsync d3/d6/d21/d46/d2d/d3f/f5b 0 2024-09-13T02:50:30.028 INFO:tasks.workunit.client.0.smithi100.stdout:3/373: symlink d10/d21/l7b 0 2024-09-13T02:50:30.033 INFO:tasks.workunit.client.0.smithi100.stdout:1/266: sync 2024-09-13T02:50:30.033 INFO:tasks.workunit.client.0.smithi100.stdout:6/238: truncate d12/d14/f1a 1943578 0 2024-09-13T02:50:30.035 INFO:tasks.workunit.client.0.smithi100.stdout:1/267: rename de/d12/c1f to de/d14/d22/c57 0 2024-09-13T02:50:30.041 INFO:tasks.workunit.client.0.smithi100.stdout:1/268: link c0 de/d14/d44/c58 0 2024-09-13T02:50:30.041 INFO:tasks.workunit.client.0.smithi100.stdout:1/269: write de/d14/d2e/f4e [339653,119594] 0 2024-09-13T02:50:30.041 INFO:tasks.workunit.client.0.smithi100.stdout:1/270: creat de/d12/f59 x:0 0 0 2024-09-13T02:50:30.041 INFO:tasks.workunit.client.0.smithi100.stdout:1/271: read - de/d14/d2e/d48/f4c zero size 2024-09-13T02:50:30.044 INFO:tasks.workunit.client.0.smithi100.stdout:1/272: mkdir de/d14/d22/d52/d5a 0 2024-09-13T02:50:30.044 INFO:tasks.workunit.client.0.smithi100.stdout:3/374: dread d10/f32 [0,4194304] 0 2024-09-13T02:50:30.046 INFO:tasks.workunit.client.0.smithi100.stdout:2/251: dwrite d0/db/d21/f30 [4194304,4194304] 0 2024-09-13T02:50:30.046 INFO:tasks.workunit.client.0.smithi100.stdout:2/252: fsync d0/fe 0 2024-09-13T02:50:30.046 INFO:tasks.workunit.client.0.smithi100.stdout:2/253: write d0/f2c [784188,117436] 0 2024-09-13T02:50:30.049 INFO:tasks.workunit.client.0.smithi100.stdout:3/375: rmdir d10/d21/d51/d5a 39 2024-09-13T02:50:30.049 INFO:tasks.workunit.client.0.smithi100.stdout:2/254: rename d0/c1e to d0/db/c41 0 2024-09-13T02:50:30.050 INFO:tasks.workunit.client.0.smithi100.stdout:3/376: fsync d10/d21/d51/d6c/f6d 0 2024-09-13T02:50:30.052 INFO:tasks.workunit.client.0.smithi100.stdout:2/255: symlink d0/l42 0 2024-09-13T02:50:30.052 INFO:tasks.workunit.client.0.smithi100.stdout:2/256: chown d0/db/d23/f3a 42988228 1 2024-09-13T02:50:30.053 INFO:tasks.workunit.client.0.smithi100.stdout:2/257: link d0/db/d23/f2a d0/db/d23/d39/f43 0 2024-09-13T02:50:30.054 INFO:tasks.workunit.client.0.smithi100.stdout:2/258: write d0/db/d23/d39/f43 [1064120,89951] 0 2024-09-13T02:50:30.063 INFO:tasks.workunit.client.0.smithi100.stdout:9/242: dwrite dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:30.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/243: rmdir dd/d1b/d27 39 2024-09-13T02:50:30.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/244: fsync dd/f1a 0 2024-09-13T02:50:30.064 INFO:tasks.workunit.client.0.smithi100.stdout:4/306: dwrite d3/d6/d9/fd [0,4194304] 0 2024-09-13T02:50:30.064 INFO:tasks.workunit.client.0.smithi100.stdout:9/245: mknod dd/d1b/d21/d39/c49 0 2024-09-13T02:50:30.065 INFO:tasks.workunit.client.0.smithi100.stdout:9/246: truncate dd/d1b/d24/f2e 5193447 0 2024-09-13T02:50:30.065 INFO:tasks.workunit.client.0.smithi100.stdout:6/239: dwrite d12/d14/d1c/f3a [0,4194304] 0 2024-09-13T02:50:30.065 INFO:tasks.workunit.client.0.smithi100.stdout:6/240: readlink l3 0 2024-09-13T02:50:30.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/247: rename fb to dd/f4a 0 2024-09-13T02:50:30.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/248: fdatasync dd/d1b/d24/f2e 0 2024-09-13T02:50:30.066 INFO:tasks.workunit.client.0.smithi100.stdout:9/249: write dd/d1b/d21/f26 [2718238,88641] 0 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/273: fsync de/d12/f59 0 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/274: chown f8 6733834 1 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:6/241: dread d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:6/242: stat d12/d14/c17 0 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:6/243: chown d12/d14/d1c/c1e 2709661 1 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:6/244: chown d12/d14/d2f/f33 773 1 2024-09-13T02:50:30.069 INFO:tasks.workunit.client.0.smithi100.stdout:1/275: write de/d12/f59 [567512,97261] 0 2024-09-13T02:50:30.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/245: mknod d12/d14/d1c/d28/c3d 0 2024-09-13T02:50:30.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/276: symlink de/d14/d22/d52/d5a/l5b 0 2024-09-13T02:50:30.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/277: fsync f8 0 2024-09-13T02:50:30.074 INFO:tasks.workunit.client.0.smithi100.stdout:1/278: read de/d14/d22/d29/f4b [411895,106700] 0 2024-09-13T02:50:30.074 INFO:tasks.workunit.client.0.smithi100.stdout:6/246: mknod d12/d14/c3e 0 2024-09-13T02:50:30.075 INFO:tasks.workunit.client.0.smithi100.stdout:6/247: creat d12/d2e/d34/d36/f3f x:0 0 0 2024-09-13T02:50:30.077 INFO:tasks.workunit.client.0.smithi100.stdout:6/248: link d12/d14/c24 d12/d14/d1c/d28/c40 0 2024-09-13T02:50:30.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/249: symlink d12/d14/d2f/l41 0 2024-09-13T02:50:30.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/250: write d12/d14/f2d [1110527,88351] 0 2024-09-13T02:50:30.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/251: rename d12 to d12/d2e/d34/d36/d42 22 2024-09-13T02:50:30.078 INFO:tasks.workunit.client.0.smithi100.stdout:4/307: dwrite d3/d6/d21/d46/f15 [0,4194304] 0 2024-09-13T02:50:30.078 INFO:tasks.workunit.client.0.smithi100.stdout:4/308: chown d3/d6/d21/d46/f39 478936 1 2024-09-13T02:50:30.081 INFO:tasks.workunit.client.0.smithi100.stdout:7/329: sync 2024-09-13T02:50:30.081 INFO:tasks.workunit.client.0.smithi100.stdout:0/259: sync 2024-09-13T02:50:30.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/309: rename d3/d6/d21/d46/d34/d3b to d3/d3a/d5c/d65 0 2024-09-13T02:50:30.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/310: read - d3/d6/d2f/f54 zero size 2024-09-13T02:50:30.085 INFO:tasks.workunit.client.0.smithi100.stdout:4/311: symlink d3/d6/d21/d46/d2d/d3f/l66 0 2024-09-13T02:50:30.085 INFO:tasks.workunit.client.0.smithi100.stdout:4/312: chown d3/d63 579650 1 2024-09-13T02:50:30.085 INFO:tasks.workunit.client.0.smithi100.stdout:7/330: symlink d3/d5/d4f/l66 0 2024-09-13T02:50:30.086 INFO:tasks.workunit.client.0.smithi100.stdout:4/313: unlink d3/d6/d21/d46/d2d/f36 0 2024-09-13T02:50:30.087 INFO:tasks.workunit.client.0.smithi100.stdout:1/279: dwrite f7 [0,4194304] 0 2024-09-13T02:50:30.088 INFO:tasks.workunit.client.0.smithi100.stdout:1/280: stat de/d14/d44/l4d 0 2024-09-13T02:50:30.090 INFO:tasks.workunit.client.0.smithi100.stdout:0/260: dread d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:30.090 INFO:tasks.workunit.client.0.smithi100.stdout:0/261: truncate d2/dd/d54/d47/f4e 338671 0 2024-09-13T02:50:30.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/281: mkdir de/d14/d22/d52/d5c 0 2024-09-13T02:50:30.090 INFO:tasks.workunit.client.0.smithi100.stdout:1/282: write de/d12/f2a [605385,77998] 0 2024-09-13T02:50:30.094 INFO:tasks.workunit.client.0.smithi100.stdout:0/262: rename d2/dd/d54/c2f to d2/dd/d54/d47/d34/d3c/c61 0 2024-09-13T02:50:30.094 INFO:tasks.workunit.client.0.smithi100.stdout:6/252: getdents d12/d14/d2f 0 2024-09-13T02:50:30.094 INFO:tasks.workunit.client.0.smithi100.stdout:6/253: fsync d12/d14/f2d 0 2024-09-13T02:50:30.094 INFO:tasks.workunit.client.0.smithi100.stdout:6/254: truncate d12/d14/d2f/f33 681577 0 2024-09-13T02:50:30.094 INFO:tasks.workunit.client.0.smithi100.stdout:7/331: write d3/f15 [3328128,45186] 0 2024-09-13T02:50:30.095 INFO:tasks.workunit.client.0.smithi100.stdout:0/263: read d2/dd/d33/f16 [175732,115335] 0 2024-09-13T02:50:30.095 INFO:tasks.workunit.client.0.smithi100.stdout:0/264: readlink d2/dd/d54/d47/d34/l59 0 2024-09-13T02:50:30.095 INFO:tasks.workunit.client.0.smithi100.stdout:1/283: creat de/d14/d44/f5d x:0 0 0 2024-09-13T02:50:30.095 INFO:tasks.workunit.client.0.smithi100.stdout:1/284: write de/d14/d44/f5d [598343,17717] 0 2024-09-13T02:50:30.099 INFO:tasks.workunit.client.0.smithi100.stdout:0/265: creat d2/dd/d54/d3e/d5d/f62 x:0 0 0 2024-09-13T02:50:30.100 INFO:tasks.workunit.client.0.smithi100.stdout:0/266: chown d2/d1a/d51 13311726 1 2024-09-13T02:50:30.101 INFO:tasks.workunit.client.0.smithi100.stdout:1/285: creat de/d14/d22/d52/d5a/f5e x:0 0 0 2024-09-13T02:50:30.101 INFO:tasks.workunit.client.0.smithi100.stdout:0/267: creat d2/d1a/d4c/f63 x:0 0 0 2024-09-13T02:50:30.105 INFO:tasks.workunit.client.0.smithi100.stdout:1/286: rmdir de/d14/d2e 39 2024-09-13T02:50:30.105 INFO:tasks.workunit.client.0.smithi100.stdout:1/287: truncate de/d14/d2e/f27 590661 0 2024-09-13T02:50:30.106 INFO:tasks.workunit.client.0.smithi100.stdout:1/288: rmdir de/d14 39 2024-09-13T02:50:30.108 INFO:tasks.workunit.client.0.smithi100.stdout:1/289: mknod de/d14/d2e/c5f 0 2024-09-13T02:50:30.108 INFO:tasks.workunit.client.0.smithi100.stdout:1/290: chown de 41366441 1 2024-09-13T02:50:30.116 INFO:tasks.workunit.client.0.smithi100.stdout:1/291: truncate f7 793979 0 2024-09-13T02:50:30.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/314: dwrite d3/d6/d21/d46/f15 [4194304,4194304] 0 2024-09-13T02:50:30.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/315: truncate d3/dc/d4b/d52/f64 750909 0 2024-09-13T02:50:30.119 INFO:tasks.workunit.client.0.smithi100.stdout:4/316: mkdir d3/d6/d21/d67 0 2024-09-13T02:50:30.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/317: write d3/d6/d21/f45 [249682,53714] 0 2024-09-13T02:50:30.121 INFO:tasks.workunit.client.0.smithi100.stdout:4/318: symlink d3/d6/d9/l68 0 2024-09-13T02:50:30.127 INFO:tasks.workunit.client.0.smithi100.stdout:4/319: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:30.127 INFO:tasks.workunit.client.0.smithi100.stdout:4/320: truncate d3/d6/f18 329112 0 2024-09-13T02:50:30.128 INFO:tasks.workunit.client.0.smithi100.stdout:4/321: rmdir d3/d3a/d5c/d65 0 2024-09-13T02:50:30.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/322: write d3/d6/d21/d46/f5e [4100264,92284] 0 2024-09-13T02:50:30.144 INFO:tasks.workunit.client.0.smithi100.stdout:7/332: dwrite d3/d5/f1a [0,4194304] 0 2024-09-13T02:50:30.144 INFO:tasks.workunit.client.0.smithi100.stdout:7/333: chown d3/c4 0 1 2024-09-13T02:50:30.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/334: truncate d3/d2d/f4d 99848 0 2024-09-13T02:50:30.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/335: dread - d3/d16/d55/d56/f5b zero size 2024-09-13T02:50:30.145 INFO:tasks.workunit.client.0.smithi100.stdout:6/255: dwrite d12/d14/f3c [0,4194304] 0 2024-09-13T02:50:30.145 INFO:tasks.workunit.client.0.smithi100.stdout:0/268: dwrite d2/f56 [0,4194304] 0 2024-09-13T02:50:30.145 INFO:tasks.workunit.client.0.smithi100.stdout:1/292: dwrite de/f4f [0,4194304] 0 2024-09-13T02:50:30.156 INFO:tasks.workunit.client.0.smithi100.stdout:0/269: symlink d2/l64 0 2024-09-13T02:50:30.157 INFO:tasks.workunit.client.0.smithi100.stdout:7/336: write d3/d5/f1a [2309859,48553] 0 2024-09-13T02:50:30.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/270: link d2/dd/d54/d47/f2d d2/dd/d54/d28/f65 0 2024-09-13T02:50:30.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/271: write d2/dd/d33/f14 [446097,27887] 0 2024-09-13T02:50:30.157 INFO:tasks.workunit.client.0.smithi100.stdout:0/272: readlink d2/l64 0 2024-09-13T02:50:30.158 INFO:tasks.workunit.client.0.smithi100.stdout:7/337: truncate d3/d5/d1b/d1c/d36/d65/f4a 655597 0 2024-09-13T02:50:30.159 INFO:tasks.workunit.client.0.smithi100.stdout:7/338: truncate d3/d5/f27 1185799 0 2024-09-13T02:50:30.159 INFO:tasks.workunit.client.0.smithi100.stdout:7/339: dread - d3/d2d/f5f zero size 2024-09-13T02:50:30.170 INFO:tasks.workunit.client.0.smithi100.stdout:0/273: write d2/f56 [4503575,1839] 0 2024-09-13T02:50:30.170 INFO:tasks.workunit.client.0.smithi100.stdout:5/329: sync 2024-09-13T02:50:30.171 INFO:tasks.workunit.client.0.smithi100.stdout:8/286: sync 2024-09-13T02:50:30.171 INFO:tasks.workunit.client.0.smithi100.stdout:0/274: mknod d2/dd/d33/d43/c66 0 2024-09-13T02:50:30.171 INFO:tasks.workunit.client.0.smithi100.stdout:0/275: creat d2/dd/d33/d3b/f67 x:0 0 0 2024-09-13T02:50:30.171 INFO:tasks.workunit.client.0.smithi100.stdout:3/377: sync 2024-09-13T02:50:30.171 INFO:tasks.workunit.client.0.smithi100.stdout:2/259: sync 2024-09-13T02:50:30.172 INFO:tasks.workunit.client.0.smithi100.stdout:9/250: sync 2024-09-13T02:50:30.172 INFO:tasks.workunit.client.0.smithi100.stdout:3/378: chown d10/d21/d51/f59 19200 1 2024-09-13T02:50:30.174 INFO:tasks.workunit.client.0.smithi100.stdout:2/260: mkdir d0/d44 0 2024-09-13T02:50:30.174 INFO:tasks.workunit.client.0.smithi100.stdout:2/261: chown d0/db/f1a 49 1 2024-09-13T02:50:30.174 INFO:tasks.workunit.client.0.smithi100.stdout:3/379: getdents d10/d21/d51 0 2024-09-13T02:50:30.174 INFO:tasks.workunit.client.0.smithi100.stdout:3/380: chown d10/d21/c6e 255 1 2024-09-13T02:50:30.175 INFO:tasks.workunit.client.0.smithi100.stdout:4/323: dwrite d3/d6/d21/d46/f5e [0,4194304] 0 2024-09-13T02:50:30.175 INFO:tasks.workunit.client.0.smithi100.stdout:7/340: fdatasync d3/d5/f1a 0 2024-09-13T02:50:30.175 INFO:tasks.workunit.client.0.smithi100.stdout:6/256: dwrite d12/d2e/d34/d36/f38 [0,4194304] 0 2024-09-13T02:50:30.175 INFO:tasks.workunit.client.0.smithi100.stdout:1/293: dwrite de/d14/d22/f35 [0,4194304] 0 2024-09-13T02:50:30.175 INFO:tasks.workunit.client.0.smithi100.stdout:9/251: symlink dd/d1b/d1d/l4b 0 2024-09-13T02:50:30.178 INFO:tasks.workunit.client.0.smithi100.stdout:5/330: rename db/de/d3e/f68 to db/de/d1f/d2b/f79 0 2024-09-13T02:50:30.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/381: link d10/l36 d10/d21/l7c 0 2024-09-13T02:50:30.179 INFO:tasks.workunit.client.0.smithi100.stdout:3/382: dread - d10/d21/d51/d6c/f74 zero size 2024-09-13T02:50:30.180 INFO:tasks.workunit.client.0.smithi100.stdout:0/276: dread d2/f11 [0,4194304] 0 2024-09-13T02:50:30.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/262: dread d0/db/ff [0,4194304] 0 2024-09-13T02:50:30.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/263: readlink d0/db/d21/l27 0 2024-09-13T02:50:30.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/264: stat d0/db/f12 0 2024-09-13T02:50:30.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/265: write d0/db/f12 [4218881,120111] 0 2024-09-13T02:50:30.185 INFO:tasks.workunit.client.0.smithi100.stdout:2/266: chown d0/fe 13504574 1 2024-09-13T02:50:30.186 INFO:tasks.workunit.client.0.smithi100.stdout:2/267: write d0/f15 [2948783,120064] 0 2024-09-13T02:50:30.186 INFO:tasks.workunit.client.0.smithi100.stdout:2/268: creat d0/db/f45 x:0 0 0 2024-09-13T02:50:30.186 INFO:tasks.workunit.client.0.smithi100.stdout:7/341: unlink d3/d5/d1b/d1c/f3e 0 2024-09-13T02:50:30.190 INFO:tasks.workunit.client.0.smithi100.stdout:1/294: mkdir de/d14/d2e/d60 0 2024-09-13T02:50:30.194 INFO:tasks.workunit.client.0.smithi100.stdout:9/252: creat dd/d1b/d21/d39/f4c x:0 0 0 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/331: creat db/de/d3e/f7a x:0 0 0 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/332: dread - db/de/d3e/f7a zero size 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/333: dread - db/de/d3e/f7a zero size 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/334: chown db/de/d1f/d2b/l3a 6317 1 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/335: write db/de/d1f/d2b/f35 [1424878,90191] 0 2024-09-13T02:50:30.196 INFO:tasks.workunit.client.0.smithi100.stdout:5/336: chown db/de/d63/d70/l73 307757 1 2024-09-13T02:50:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:0/277: truncate d2/d9/fb 4431984 0 2024-09-13T02:50:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:2/269: mknod d0/d36/c46 0 2024-09-13T02:50:30.197 INFO:tasks.workunit.client.0.smithi100.stdout:7/342: creat d3/d5/d1b/f67 x:0 0 0 2024-09-13T02:50:30.198 INFO:tasks.workunit.client.0.smithi100.stdout:1/295: mkdir de/d14/d44/d61 0 2024-09-13T02:50:30.199 INFO:tasks.workunit.client.0.smithi100.stdout:5/337: creat db/de/f7b x:0 0 0 2024-09-13T02:50:30.200 INFO:tasks.workunit.client.0.smithi100.stdout:0/278: mkdir d2/dd/d54/d68 0 2024-09-13T02:50:30.202 INFO:tasks.workunit.client.0.smithi100.stdout:1/296: rename de/d14/c2f to de/d14/d44/d61/c62 0 2024-09-13T02:50:30.204 INFO:tasks.workunit.client.0.smithi100.stdout:1/297: creat de/d14/d22/f63 x:0 0 0 2024-09-13T02:50:30.204 INFO:tasks.workunit.client.0.smithi100.stdout:1/298: readlink de/d12/l13 0 2024-09-13T02:50:30.206 INFO:tasks.workunit.client.0.smithi100.stdout:0/279: dread d2/f1f [0,4194304] 0 2024-09-13T02:50:30.206 INFO:tasks.workunit.client.0.smithi100.stdout:1/299: truncate de/f4f 4112310 0 2024-09-13T02:50:30.206 INFO:tasks.workunit.client.0.smithi100.stdout:4/324: dwrite d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:30.207 INFO:tasks.workunit.client.0.smithi100.stdout:6/257: dwrite d12/d14/d1c/f3a [4194304,4194304] 0 2024-09-13T02:50:30.207 INFO:tasks.workunit.client.0.smithi100.stdout:5/338: write db/de/f41 [1689710,99763] 0 2024-09-13T02:50:30.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/383: dwrite d10/d21/d51/f59 [0,4194304] 0 2024-09-13T02:50:30.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/270: dread d0/db/ff [0,4194304] 0 2024-09-13T02:50:30.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/271: creat d0/db/d21/f47 x:0 0 0 2024-09-13T02:50:30.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/272: chown d0/f20 0 1 2024-09-13T02:50:30.209 INFO:tasks.workunit.client.0.smithi100.stdout:0/280: unlink d2/f1f 0 2024-09-13T02:50:30.209 INFO:tasks.workunit.client.0.smithi100.stdout:0/281: chown d2/d9/fb 25800 1 2024-09-13T02:50:30.209 INFO:tasks.workunit.client.0.smithi100.stdout:4/325: dread d3/d6/d21/d46/f47 [0,4194304] 0 2024-09-13T02:50:30.209 INFO:tasks.workunit.client.0.smithi100.stdout:1/300: dread de/d14/d2e/f37 [0,4194304] 0 2024-09-13T02:50:30.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/301: read de/f2c [3865213,130438] 0 2024-09-13T02:50:30.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/258: mkdir d12/d43 0 2024-09-13T02:50:30.211 INFO:tasks.workunit.client.0.smithi100.stdout:6/259: write f7 [2007202,96022] 0 2024-09-13T02:50:30.212 INFO:tasks.workunit.client.0.smithi100.stdout:3/384: creat d10/d21/d51/f7d x:0 0 0 2024-09-13T02:50:30.212 INFO:tasks.workunit.client.0.smithi100.stdout:3/385: fsync d10/d21/d51/d6c/f6f 0 2024-09-13T02:50:30.213 INFO:tasks.workunit.client.0.smithi100.stdout:5/339: symlink db/de/d3e/d71/l7c 0 2024-09-13T02:50:30.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/282: link d2/c49 d2/dd/d54/d68/c69 0 2024-09-13T02:50:30.215 INFO:tasks.workunit.client.0.smithi100.stdout:0/283: chown d2/c26 0 1 2024-09-13T02:50:30.216 INFO:tasks.workunit.client.0.smithi100.stdout:0/284: fdatasync d2/dd/d54/d28/f4a 0 2024-09-13T02:50:30.216 INFO:tasks.workunit.client.0.smithi100.stdout:4/326: truncate d3/d6/d21/f24 2501010 0 2024-09-13T02:50:30.216 INFO:tasks.workunit.client.0.smithi100.stdout:4/327: stat d3/d6/d9/f11 0 2024-09-13T02:50:30.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/260: getdents d12/d14/d21 0 2024-09-13T02:50:30.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/261: chown d12/d14/d1c/l1d 116 1 2024-09-13T02:50:30.218 INFO:tasks.workunit.client.0.smithi100.stdout:3/386: symlink d10/d21/l7e 0 2024-09-13T02:50:30.219 INFO:tasks.workunit.client.0.smithi100.stdout:5/340: creat db/de/d1f/d78/f7d x:0 0 0 2024-09-13T02:50:30.219 INFO:tasks.workunit.client.0.smithi100.stdout:5/341: chown db/l59 502 1 2024-09-13T02:50:30.220 INFO:tasks.workunit.client.0.smithi100.stdout:0/285: creat d2/dd/d54/d28/f6a x:0 0 0 2024-09-13T02:50:30.220 INFO:tasks.workunit.client.0.smithi100.stdout:7/343: dwrite d3/d16/d55/d56/f61 [0,4194304] 0 2024-09-13T02:50:30.221 INFO:tasks.workunit.client.0.smithi100.stdout:4/328: mkdir d3/d6/d2f/d60/d69 0 2024-09-13T02:50:30.222 INFO:tasks.workunit.client.0.smithi100.stdout:9/253: dwrite dd/f4a [0,4194304] 0 2024-09-13T02:50:30.222 INFO:tasks.workunit.client.0.smithi100.stdout:2/273: dread d0/db/f26 [0,4194304] 0 2024-09-13T02:50:30.222 INFO:tasks.workunit.client.0.smithi100.stdout:2/274: chown d0/l1c 35 1 2024-09-13T02:50:30.223 INFO:tasks.workunit.client.0.smithi100.stdout:9/254: truncate dd/d1b/d1d/d43/f44 455872 0 2024-09-13T02:50:30.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/275: write d0/db/d23/f2a [2052568,106345] 0 2024-09-13T02:50:30.224 INFO:tasks.workunit.client.0.smithi100.stdout:3/387: unlink d10/d21/c2c 0 2024-09-13T02:50:30.224 INFO:tasks.workunit.client.0.smithi100.stdout:3/388: getdents d10/d21/d51/d5a/d73 0 2024-09-13T02:50:30.224 INFO:tasks.workunit.client.0.smithi100.stdout:5/342: unlink db/f28 0 2024-09-13T02:50:30.227 INFO:tasks.workunit.client.0.smithi100.stdout:1/302: rename de/d14/d22/d52/d5a to de/d14/d22/d29/d64 0 2024-09-13T02:50:30.227 INFO:tasks.workunit.client.0.smithi100.stdout:4/329: getdents d3/dc/d4b 0 2024-09-13T02:50:30.230 INFO:tasks.workunit.client.0.smithi100.stdout:2/276: rmdir d0/d44 0 2024-09-13T02:50:30.232 INFO:tasks.workunit.client.0.smithi100.stdout:3/389: symlink d10/l7f 0 2024-09-13T02:50:30.233 INFO:tasks.workunit.client.0.smithi100.stdout:5/343: mkdir db/de/d3e/d7e 0 2024-09-13T02:50:30.233 INFO:tasks.workunit.client.0.smithi100.stdout:5/344: creat db/de/d1f/f7f x:0 0 0 2024-09-13T02:50:30.234 INFO:tasks.workunit.client.0.smithi100.stdout:9/255: write f5 [1637878,118808] 0 2024-09-13T02:50:30.235 INFO:tasks.workunit.client.0.smithi100.stdout:0/286: rename d2/f58 to d2/dd/d54/d3e/d5d/f6b 0 2024-09-13T02:50:30.237 INFO:tasks.workunit.client.0.smithi100.stdout:1/303: unlink de/d14/d2e/c5f 0 2024-09-13T02:50:30.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/287: dread d2/f11 [0,4194304] 0 2024-09-13T02:50:30.238 INFO:tasks.workunit.client.0.smithi100.stdout:4/330: link d3/d6/d21/f43 d3/d63/f6a 0 2024-09-13T02:50:30.239 INFO:tasks.workunit.client.0.smithi100.stdout:2/277: symlink d0/db/l48 0 2024-09-13T02:50:30.240 INFO:tasks.workunit.client.0.smithi100.stdout:3/390: mknod d10/c80 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/262: dwrite d12/f27 [0,4194304] 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/263: write d12/d2e/f3b [799194,20487] 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/264: creat d12/d14/d1c/f44 x:0 0 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/345: mknod db/de/d1f/c80 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/346: truncate db/de/d3e/f66 489788 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/347: fdatasync db/de/d1f/f4b 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/348: readlink db/de/d1f/l49 0 2024-09-13T02:50:30.242 INFO:tasks.workunit.client.0.smithi100.stdout:5/349: readlink db/de/l6a 0 2024-09-13T02:50:30.244 INFO:tasks.workunit.client.0.smithi100.stdout:1/304: mkdir de/d14/d22/d52/d65 0 2024-09-13T02:50:30.244 INFO:tasks.workunit.client.0.smithi100.stdout:1/305: truncate de/d14/d22/f3c 1080565 0 2024-09-13T02:50:30.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/278: dread d0/db/f26 [0,4194304] 0 2024-09-13T02:50:30.244 INFO:tasks.workunit.client.0.smithi100.stdout:7/344: dwrite d3/d5/d1b/d1c/d36/d65/f4a [0,4194304] 0 2024-09-13T02:50:30.245 INFO:tasks.workunit.client.0.smithi100.stdout:9/256: write dd/f1a [2355917,100056] 0 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/331: creat d3/d3a/d4f/f6b x:0 0 0 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/332: stat d3/d6/d21/f43 0 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/288: dread d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/289: readlink d2/d1a/l25 0 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/290: chown d2/d9/f1b 365520758 1 2024-09-13T02:50:30.246 INFO:tasks.workunit.client.0.smithi100.stdout:0/291: chown d2/dd/d54/c60 21868927 1 2024-09-13T02:50:30.249 INFO:tasks.workunit.client.0.smithi100.stdout:6/265: unlink d12/d14/d1c/c2b 0 2024-09-13T02:50:30.250 INFO:tasks.workunit.client.0.smithi100.stdout:5/350: mkdir db/de/d3e/d7e/d81 0 2024-09-13T02:50:30.252 INFO:tasks.workunit.client.0.smithi100.stdout:1/306: truncate de/d14/d2e/f27 184802 0 2024-09-13T02:50:30.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/391: dread f8 [0,4194304] 0 2024-09-13T02:50:30.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/392: write d10/d21/d51/d6c/f6f [821700,27241] 0 2024-09-13T02:50:30.253 INFO:tasks.workunit.client.0.smithi100.stdout:7/345: mknod d3/d2d/c68 0 2024-09-13T02:50:30.254 INFO:tasks.workunit.client.0.smithi100.stdout:2/279: dread d0/db/d23/f2a [0,4194304] 0 2024-09-13T02:50:30.254 INFO:tasks.workunit.client.0.smithi100.stdout:9/257: mknod dd/d1b/d1d/d36/d3c/c4d 0 2024-09-13T02:50:30.256 INFO:tasks.workunit.client.0.smithi100.stdout:4/333: rename d3/l31 to d3/d6/d9/l6c 0 2024-09-13T02:50:30.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/334: dread d3/d63/f6a [0,4194304] 0 2024-09-13T02:50:30.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/335: stat d3/d6/d9/ce 0 2024-09-13T02:50:30.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/336: readlink d3/d6/d9/l68 0 2024-09-13T02:50:30.271 INFO:tasks.workunit.client.0.smithi100.stdout:6/266: mkdir d12/d14/d2f/d45 0 2024-09-13T02:50:30.271 INFO:tasks.workunit.client.0.smithi100.stdout:6/267: chown d12/d14/d2f/c37 120954 1 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/351: mknod db/de/d1f/d78/c82 0 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/352: fdatasync db/de/d3e/f7a 0 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/307: mknod de/d12/c66 0 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/308: write de/f11 [5619562,89333] 0 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/309: write de/f23 [1822385,46313] 0 2024-09-13T02:50:30.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/310: readlink de/d14/l21 0 2024-09-13T02:50:30.273 INFO:tasks.workunit.client.0.smithi100.stdout:3/393: rmdir d10/d21/d51/d6c 39 2024-09-13T02:50:30.273 INFO:tasks.workunit.client.0.smithi100.stdout:3/394: chown d10/d21/d51/d5a 0 1 2024-09-13T02:50:30.273 INFO:tasks.workunit.client.0.smithi100.stdout:9/258: mkdir dd/d1b/d1d/d36/d4e 0 2024-09-13T02:50:30.276 INFO:tasks.workunit.client.0.smithi100.stdout:2/280: dwrite d0/db/d21/f47 [0,4194304] 0 2024-09-13T02:50:30.276 INFO:tasks.workunit.client.0.smithi100.stdout:7/346: dwrite d3/d5/f1a [0,4194304] 0 2024-09-13T02:50:30.276 INFO:tasks.workunit.client.0.smithi100.stdout:7/347: truncate d3/d16/d55/f5e 45157 0 2024-09-13T02:50:30.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/311: symlink de/d14/d2e/d60/l67 0 2024-09-13T02:50:30.277 INFO:tasks.workunit.client.0.smithi100.stdout:9/259: mkdir dd/d1b/d1d/d43/d4f 0 2024-09-13T02:50:30.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/292: rename d2/d1a/l1d to d2/dd/d33/d43/d4b/l6c 0 2024-09-13T02:50:30.283 INFO:tasks.workunit.client.0.smithi100.stdout:3/395: write d10/d21/f56 [7150534,83398] 0 2024-09-13T02:50:30.283 INFO:tasks.workunit.client.0.smithi100.stdout:2/281: creat d0/db/d23/d39/f49 x:0 0 0 2024-09-13T02:50:30.284 INFO:tasks.workunit.client.0.smithi100.stdout:2/282: creat d0/f4a x:0 0 0 2024-09-13T02:50:30.285 INFO:tasks.workunit.client.0.smithi100.stdout:1/312: mkdir de/d14/d22/d29/d68 0 2024-09-13T02:50:30.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/260: creat dd/d1b/d1d/d43/d4f/f50 x:0 0 0 2024-09-13T02:50:30.289 INFO:tasks.workunit.client.0.smithi100.stdout:4/337: rename d3/d6/d21/d46/d34/l4c to d3/l6d 0 2024-09-13T02:50:30.290 INFO:tasks.workunit.client.0.smithi100.stdout:0/293: mkdir d2/d9/d6d 0 2024-09-13T02:50:30.292 INFO:tasks.workunit.client.0.smithi100.stdout:3/396: creat d10/d21/d51/d5a/d5e/f81 x:0 0 0 2024-09-13T02:50:30.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/283: truncate d0/db/d21/f30 5413050 0 2024-09-13T02:50:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:3/397: fsync d10/d21/d51/d6c/f6f 0 2024-09-13T02:50:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:3/398: chown d10/d21/d51/d5a/d5e/f6b 1 1 2024-09-13T02:50:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:9/261: mkdir dd/d1b/d27/d51 0 2024-09-13T02:50:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:9/262: creat dd/d1b/d21/d39/f52 x:0 0 0 2024-09-13T02:50:30.296 INFO:tasks.workunit.client.0.smithi100.stdout:2/284: dread d0/f38 [0,4194304] 0 2024-09-13T02:50:30.297 INFO:tasks.workunit.client.0.smithi100.stdout:4/338: rename d3/d6/d21/d46/f15 to d3/dc/f6e 0 2024-09-13T02:50:30.297 INFO:tasks.workunit.client.0.smithi100.stdout:4/339: creat d3/dc/d4b/d52/f6f x:0 0 0 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/294: stat d2/d1a/c3f 0 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/295: readlink d2/l45 0 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/296: fdatasync d2/dd/d54/d28/f65 0 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/297: chown d2/dd/d54/d28 414325300 1 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/298: dread - d2/d1a/d4c/f63 zero size 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/299: write d2/dd/d33/f18 [4455288,64364] 0 2024-09-13T02:50:30.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/300: dread d2/dd/d54/d47/f4e [0,4194304] 0 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/263: rename dd/d1b/d1d/d36/f41 to dd/d1b/d27/f53 0 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/264: fsync dd/f4a 0 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/265: chown dd/d1b/d24/f35 15611 1 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/266: write fc [2311284,122436] 0 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/267: readlink dd/d1b/d27/l32 0 2024-09-13T02:50:30.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/268: stat dd/d1b/d1d/f2c 0 2024-09-13T02:50:30.302 INFO:tasks.workunit.client.0.smithi100.stdout:8/287: sync 2024-09-13T02:50:30.302 INFO:tasks.workunit.client.0.smithi100.stdout:5/353: dwrite f8 [0,4194304] 0 2024-09-13T02:50:30.302 INFO:tasks.workunit.client.0.smithi100.stdout:0/301: readlink d2/d1a/l2c 0 2024-09-13T02:50:30.303 INFO:tasks.workunit.client.0.smithi100.stdout:3/399: getdents d10/d21 0 2024-09-13T02:50:30.305 INFO:tasks.workunit.client.0.smithi100.stdout:2/285: rename d0/f18 to d0/db/d3f/f4b 0 2024-09-13T02:50:30.306 INFO:tasks.workunit.client.0.smithi100.stdout:9/269: creat dd/d1b/d1d/d28/f54 x:0 0 0 2024-09-13T02:50:30.307 INFO:tasks.workunit.client.0.smithi100.stdout:6/268: dwrite d12/d14/f2d [0,4194304] 0 2024-09-13T02:50:30.307 INFO:tasks.workunit.client.0.smithi100.stdout:7/348: dwrite d3/d2d/f5f [0,4194304] 0 2024-09-13T02:50:30.307 INFO:tasks.workunit.client.0.smithi100.stdout:1/313: dwrite de/d14/d22/f35 [4194304,4194304] 0 2024-09-13T02:50:30.308 INFO:tasks.workunit.client.0.smithi100.stdout:8/288: unlink df/d5d/d70/d2c/c35 0 2024-09-13T02:50:30.308 INFO:tasks.workunit.client.0.smithi100.stdout:8/289: chown df/d13/d5c 449007317 1 2024-09-13T02:50:30.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/314: dread de/d14/d2e/f37 [0,4194304] 0 2024-09-13T02:50:30.309 INFO:tasks.workunit.client.0.smithi100.stdout:0/302: truncate d2/dd/d54/d47/d34/f2b 1942136 0 2024-09-13T02:50:30.309 INFO:tasks.workunit.client.0.smithi100.stdout:5/354: dread f4 [4194304,4194304] 0 2024-09-13T02:50:30.311 INFO:tasks.workunit.client.0.smithi100.stdout:3/400: mkdir d10/d21/d51/d5a/d5e/d82 0 2024-09-13T02:50:30.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/340: rename d3/d6/d21/f45 to d3/d3a/d4f/f70 0 2024-09-13T02:50:30.313 INFO:tasks.workunit.client.0.smithi100.stdout:4/341: read d3/d6/d21/f43 [488506,123928] 0 2024-09-13T02:50:30.313 INFO:tasks.workunit.client.0.smithi100.stdout:2/286: mknod d0/db/c4c 0 2024-09-13T02:50:30.314 INFO:tasks.workunit.client.0.smithi100.stdout:9/270: symlink dd/d1b/d1d/d43/l55 0 2024-09-13T02:50:30.315 INFO:tasks.workunit.client.0.smithi100.stdout:6/269: truncate d12/d14/f1a 455595 0 2024-09-13T02:50:30.315 INFO:tasks.workunit.client.0.smithi100.stdout:6/270: creat d12/d2e/d34/d36/f46 x:0 0 0 2024-09-13T02:50:30.316 INFO:tasks.workunit.client.0.smithi100.stdout:9/271: dread dd/d1b/d1d/d36/f37 [0,4194304] 0 2024-09-13T02:50:30.318 INFO:tasks.workunit.client.0.smithi100.stdout:7/349: mknod d3/d5/d1b/d1c/d36/c69 0 2024-09-13T02:50:30.320 INFO:tasks.workunit.client.0.smithi100.stdout:1/315: mkdir de/d14/d2e/d69 0 2024-09-13T02:50:30.321 INFO:tasks.workunit.client.0.smithi100.stdout:5/355: creat db/f83 x:0 0 0 2024-09-13T02:50:30.321 INFO:tasks.workunit.client.0.smithi100.stdout:5/356: dread - db/de/d1f/f69 zero size 2024-09-13T02:50:30.321 INFO:tasks.workunit.client.0.smithi100.stdout:5/357: creat db/f84 x:0 0 0 2024-09-13T02:50:30.323 INFO:tasks.workunit.client.0.smithi100.stdout:3/401: creat d10/d21/d51/d6c/f83 x:0 0 0 2024-09-13T02:50:30.323 INFO:tasks.workunit.client.0.smithi100.stdout:3/402: write d10/d21/d57/f5b [752346,51225] 0 2024-09-13T02:50:30.323 INFO:tasks.workunit.client.0.smithi100.stdout:8/290: dwrite f2 [4194304,4194304] 0 2024-09-13T02:50:30.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/303: rename d2/c36 to d2/dd/d54/d47/d34/d3c/c6e 0 2024-09-13T02:50:30.326 INFO:tasks.workunit.client.0.smithi100.stdout:0/304: creat d2/dd/d33/d3b/f6f x:0 0 0 2024-09-13T02:50:30.327 INFO:tasks.workunit.client.0.smithi100.stdout:4/342: rename d3/d6/d2f/d60/l5d to d3/d6/d2f/d60/l71 0 2024-09-13T02:50:30.327 INFO:tasks.workunit.client.0.smithi100.stdout:4/343: chown d3/d6/d2f/l32 17024863 1 2024-09-13T02:50:30.330 INFO:tasks.workunit.client.0.smithi100.stdout:6/271: symlink d12/l47 0 2024-09-13T02:50:30.332 INFO:tasks.workunit.client.0.smithi100.stdout:1/316: creat de/d14/d22/d52/d5c/f6a x:0 0 0 2024-09-13T02:50:30.332 INFO:tasks.workunit.client.0.smithi100.stdout:1/317: truncate de/d14/d2e/f38 660819 0 2024-09-13T02:50:30.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/318: chown de/d12/f30 119 1 2024-09-13T02:50:30.334 INFO:tasks.workunit.client.0.smithi100.stdout:5/358: mkdir db/de/d3e/d7e/d81/d85 0 2024-09-13T02:50:30.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/359: stat db/de/d1f/d78/f7d 0 2024-09-13T02:50:30.335 INFO:tasks.workunit.client.0.smithi100.stdout:5/360: truncate db/de/f7b 1014806 0 2024-09-13T02:50:30.335 INFO:tasks.workunit.client.0.smithi100.stdout:3/403: link d10/d21/c4d d10/d21/d51/d5a/d5e/d71/c84 0 2024-09-13T02:50:30.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/305: truncate d2/d9/fb 2921867 0 2024-09-13T02:50:30.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/306: dread - d2/d1a/d4c/f63 zero size 2024-09-13T02:50:30.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/307: fsync d2/f11 0 2024-09-13T02:50:30.341 INFO:tasks.workunit.client.0.smithi100.stdout:4/344: mknod d3/d6/d2f/d60/c72 0 2024-09-13T02:50:30.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/272: creat d12/d14/d2f/d45/f48 x:0 0 0 2024-09-13T02:50:30.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/273: read - d12/d2e/d34/d36/f46 zero size 2024-09-13T02:50:30.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/274: creat d12/d14/d2f/d45/f49 x:0 0 0 2024-09-13T02:50:30.344 INFO:tasks.workunit.client.0.smithi100.stdout:1/319: write de/f4f [470274,43462] 0 2024-09-13T02:50:30.344 INFO:tasks.workunit.client.0.smithi100.stdout:3/404: link d10/c14 d10/d21/d51/d5a/d5e/c85 0 2024-09-13T02:50:30.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/345: creat d3/d6/d9/f73 x:0 0 0 2024-09-13T02:50:30.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/346: write d3/d6/d21/d46/d2d/d3f/f5b [81242,78485] 0 2024-09-13T02:50:30.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/347: write d3/d3a/d4f/f6b [64670,45978] 0 2024-09-13T02:50:30.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/348: write d3/d6/d2f/f33 [825657,108235] 0 2024-09-13T02:50:30.348 INFO:tasks.workunit.client.0.smithi100.stdout:9/272: dwrite dd/fe [0,4194304] 0 2024-09-13T02:50:30.348 INFO:tasks.workunit.client.0.smithi100.stdout:9/273: read dd/f1a [2564465,5275] 0 2024-09-13T02:50:30.351 INFO:tasks.workunit.client.0.smithi100.stdout:1/320: rename de/d14/d22/f43 to de/f6b 0 2024-09-13T02:50:30.354 INFO:tasks.workunit.client.0.smithi100.stdout:1/321: rmdir de/d14/d39 39 2024-09-13T02:50:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/287: dwrite d0/f15 [0,4194304] 0 2024-09-13T02:50:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/288: write d0/db/f40 [546441,110313] 0 2024-09-13T02:50:30.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/289: creat d0/f4d x:0 0 0 2024-09-13T02:50:30.356 INFO:tasks.workunit.client.0.smithi100.stdout:7/350: dwrite d3/fa [0,4194304] 0 2024-09-13T02:50:30.359 INFO:tasks.workunit.client.0.smithi100.stdout:1/322: rename de/f42 to de/d14/d39/f6c 0 2024-09-13T02:50:30.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/323: truncate de/d12/f2a 1271039 0 2024-09-13T02:50:30.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/324: write de/f2c [1557873,36505] 0 2024-09-13T02:50:30.361 INFO:tasks.workunit.client.0.smithi100.stdout:0/308: write d2/dd/d54/d28/f4a [3691010,54646] 0 2024-09-13T02:50:30.363 INFO:tasks.workunit.client.0.smithi100.stdout:2/290: creat d0/db/d3f/f4e x:0 0 0 2024-09-13T02:50:30.364 INFO:tasks.workunit.client.0.smithi100.stdout:2/291: write d0/db/d23/f3a [231940,163] 0 2024-09-13T02:50:30.364 INFO:tasks.workunit.client.0.smithi100.stdout:2/292: fsync d0/db/f12 0 2024-09-13T02:50:30.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/351: getdents d3/d5 0 2024-09-13T02:50:30.366 INFO:tasks.workunit.client.0.smithi100.stdout:7/352: write d3/d5/f1e [13119574,97096] 0 2024-09-13T02:50:30.368 INFO:tasks.workunit.client.0.smithi100.stdout:6/275: dwrite d12/f16 [0,4194304] 0 2024-09-13T02:50:30.368 INFO:tasks.workunit.client.0.smithi100.stdout:6/276: fsync f7 0 2024-09-13T02:50:30.368 INFO:tasks.workunit.client.0.smithi100.stdout:6/277: fsync d12/d2e/d34/d36/f3f 0 2024-09-13T02:50:30.374 INFO:tasks.workunit.client.0.smithi100.stdout:0/309: dread d2/f5 [0,4194304] 0 2024-09-13T02:50:30.375 INFO:tasks.workunit.client.0.smithi100.stdout:7/353: write d3/d5/f1e [9837153,103769] 0 2024-09-13T02:50:30.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/354: dread d3/d16/d55/f5e [0,4194304] 0 2024-09-13T02:50:30.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/355: chown d3/d16/d55/d56/f61 3 1 2024-09-13T02:50:30.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/356: dread - d3/d16/d55/d56/f5b zero size 2024-09-13T02:50:30.380 INFO:tasks.workunit.client.0.smithi100.stdout:2/293: creat d0/d36/f4f x:0 0 0 2024-09-13T02:50:30.380 INFO:tasks.workunit.client.0.smithi100.stdout:6/278: mknod d12/d14/d1c/c4a 0 2024-09-13T02:50:30.381 INFO:tasks.workunit.client.0.smithi100.stdout:0/310: link d2/dd/d54/d68/c69 d2/dd/d54/c70 0 2024-09-13T02:50:30.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/311: write d2/d9/fb [2285879,118780] 0 2024-09-13T02:50:30.382 INFO:tasks.workunit.client.0.smithi100.stdout:0/312: readlink d2/dd/d54/l2e 0 2024-09-13T02:50:30.383 INFO:tasks.workunit.client.0.smithi100.stdout:7/357: creat d3/d16/d3b/f6a x:0 0 0 2024-09-13T02:50:30.383 INFO:tasks.workunit.client.0.smithi100.stdout:0/313: read d2/d9/f1b [549070,93331] 0 2024-09-13T02:50:30.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/294: rename d0/db/d21/l27 to d0/db/d21/l50 0 2024-09-13T02:50:30.385 INFO:tasks.workunit.client.0.smithi100.stdout:3/405: dwrite d10/d21/d51/d5a/d5e/f78 [0,4194304] 0 2024-09-13T02:50:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:4/349: dwrite d3/d6/d21/f43 [0,4194304] 0 2024-09-13T02:50:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:4/350: write d3/d6/d2f/f33 [1980308,45099] 0 2024-09-13T02:50:30.386 INFO:tasks.workunit.client.0.smithi100.stdout:5/361: dwrite db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:30.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/279: read d12/d2e/f3b [147303,16461] 0 2024-09-13T02:50:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:7/358: symlink d3/d5/d1b/l6b 0 2024-09-13T02:50:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:7/359: truncate d3/d16/d3b/f6a 866060 0 2024-09-13T02:50:30.390 INFO:tasks.workunit.client.0.smithi100.stdout:7/360: fsync d3/fa 0 2024-09-13T02:50:30.391 INFO:tasks.workunit.client.0.smithi100.stdout:0/314: creat d2/dd/d54/d47/d34/d3c/f71 x:0 0 0 2024-09-13T02:50:30.397 INFO:tasks.workunit.client.0.smithi100.stdout:3/406: rename fb to d10/d21/f86 0 2024-09-13T02:50:30.399 INFO:tasks.workunit.client.0.smithi100.stdout:4/351: symlink d3/d6/d21/d67/l74 0 2024-09-13T02:50:30.400 INFO:tasks.workunit.client.0.smithi100.stdout:5/362: unlink db/de/d1f/f7f 0 2024-09-13T02:50:30.400 INFO:tasks.workunit.client.0.smithi100.stdout:5/363: fsync db/de/d1f/d2b/f35 0 2024-09-13T02:50:30.401 INFO:tasks.workunit.client.0.smithi100.stdout:6/280: mkdir d12/d43/d4b 0 2024-09-13T02:50:30.401 INFO:tasks.workunit.client.0.smithi100.stdout:6/281: fdatasync d12/f16 0 2024-09-13T02:50:30.402 INFO:tasks.workunit.client.0.smithi100.stdout:0/315: unlink d2/c49 0 2024-09-13T02:50:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/407: symlink d10/d21/d57/l87 0 2024-09-13T02:50:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/408: write d10/f38 [908280,127869] 0 2024-09-13T02:50:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/409: dread - d10/d21/d51/d6c/f6d zero size 2024-09-13T02:50:30.404 INFO:tasks.workunit.client.0.smithi100.stdout:3/410: fdatasync d10/f52 0 2024-09-13T02:50:30.405 INFO:tasks.workunit.client.0.smithi100.stdout:5/364: symlink db/de/d3e/d7e/d81/d85/l86 0 2024-09-13T02:50:30.405 INFO:tasks.workunit.client.0.smithi100.stdout:5/365: chown db/c48 7790 1 2024-09-13T02:50:30.406 INFO:tasks.workunit.client.0.smithi100.stdout:3/411: mknod d10/d21/d51/c88 0 2024-09-13T02:50:30.408 INFO:tasks.workunit.client.0.smithi100.stdout:1/325: dwrite de/f4f [0,4194304] 0 2024-09-13T02:50:30.411 INFO:tasks.workunit.client.0.smithi100.stdout:2/295: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T02:50:30.411 INFO:tasks.workunit.client.0.smithi100.stdout:2/296: chown d0 245504299 1 2024-09-13T02:50:30.411 INFO:tasks.workunit.client.0.smithi100.stdout:1/326: mkdir de/d14/d22/d29/d68/d6d 0 2024-09-13T02:50:30.420 INFO:tasks.workunit.client.0.smithi100.stdout:2/297: symlink d0/db/l51 0 2024-09-13T02:50:30.420 INFO:tasks.workunit.client.0.smithi100.stdout:2/298: write d0/db/d23/d39/f49 [485975,86302] 0 2024-09-13T02:50:30.420 INFO:tasks.workunit.client.0.smithi100.stdout:4/352: write d3/d6/f10 [986263,121954] 0 2024-09-13T02:50:30.420 INFO:tasks.workunit.client.0.smithi100.stdout:4/353: mknod d3/d6/d21/d46/d2d/d58/c75 0 2024-09-13T02:50:30.422 INFO:tasks.workunit.client.0.smithi100.stdout:4/354: creat d3/d6/d21/f76 x:0 0 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:4/355: creat d3/d6/d21/d46/d34/f77 x:0 0 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:4/356: write d3/d63/f6a [4861766,9054] 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/327: dread de/f20 [0,4194304] 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/328: truncate de/d14/d22/f63 799717 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/329: fdatasync de/d14/d2e/d48/f4c 0 2024-09-13T02:50:30.423 INFO:tasks.workunit.client.0.smithi100.stdout:1/330: readlink de/l18 0 2024-09-13T02:50:30.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/331: mknod de/d14/d22/d29/d68/c6e 0 2024-09-13T02:50:30.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/332: write de/f3a [208915,124409] 0 2024-09-13T02:50:30.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/333: read de/d14/d22/f63 [198272,2569] 0 2024-09-13T02:50:30.425 INFO:tasks.workunit.client.0.smithi100.stdout:1/334: creat de/d14/d22/d52/d65/f6f x:0 0 0 2024-09-13T02:50:30.427 INFO:tasks.workunit.client.0.smithi100.stdout:1/335: rename de/d12/f54 to de/d12/f70 0 2024-09-13T02:50:30.427 INFO:tasks.workunit.client.0.smithi100.stdout:1/336: chown de/d14/d2e/f4e 30 1 2024-09-13T02:50:30.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/337: chown de/d14/d2e/d60/l67 18 1 2024-09-13T02:50:30.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/338: write de/d14/d22/d52/d65/f6f [844716,93850] 0 2024-09-13T02:50:30.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/339: write de/d14/d22/d52/d5c/f6a [705461,13899] 0 2024-09-13T02:50:30.428 INFO:tasks.workunit.client.0.smithi100.stdout:1/340: creat de/d14/d22/d52/f71 x:0 0 0 2024-09-13T02:50:30.430 INFO:tasks.workunit.client.0.smithi100.stdout:0/316: dwrite d2/dd/d54/d28/f65 [0,4194304] 0 2024-09-13T02:50:30.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/341: dread de/f23 [0,4194304] 0 2024-09-13T02:50:30.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/342: chown de/d14/d22/d29/d64/f5e 65669664 1 2024-09-13T02:50:30.433 INFO:tasks.workunit.client.0.smithi100.stdout:5/366: dwrite db/de/d1f/f31 [0,4194304] 0 2024-09-13T02:50:30.435 INFO:tasks.workunit.client.0.smithi100.stdout:3/412: getdents d10/d21/d51 0 2024-09-13T02:50:30.436 INFO:tasks.workunit.client.0.smithi100.stdout:0/317: rename d2/dd/d33/f14 to d2/dd/d33/d43/d4b/f72 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:2/299: read d0/db/d21/f30 [2687983,98715] 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:2/300: truncate d0/f2c 1327606 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/282: dwrite d12/d14/d2f/d45/f48 [0,4194304] 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:4/357: dwrite d3/d3a/d4f/f6b [0,4194304] 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:1/343: mknod de/d14/d22/d52/c72 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:4/358: write d3/d6/d2f/f5a [74015,109411] 0 2024-09-13T02:50:30.438 INFO:tasks.workunit.client.0.smithi100.stdout:4/359: chown d3/d6/d21/d46/d2d/d3f/f5b 345544 1 2024-09-13T02:50:30.441 INFO:tasks.workunit.client.0.smithi100.stdout:5/367: readlink db/de/l1b 0 2024-09-13T02:50:30.443 INFO:tasks.workunit.client.0.smithi100.stdout:3/413: mkdir d10/d21/d51/d5a/d5e/d89 0 2024-09-13T02:50:30.448 INFO:tasks.workunit.client.0.smithi100.stdout:6/283: unlink d12/d2e/d34/d36/f3f 0 2024-09-13T02:50:30.449 INFO:tasks.workunit.client.0.smithi100.stdout:6/284: stat d12/d14/f3c 0 2024-09-13T02:50:30.460 INFO:tasks.workunit.client.0.smithi100.stdout:0/318: symlink d2/dd/d54/d3e/d5d/l73 0 2024-09-13T02:50:30.464 INFO:tasks.workunit.client.0.smithi100.stdout:0/319: symlink d2/dd/d54/d3e/l74 0 2024-09-13T02:50:30.466 INFO:tasks.workunit.client.0.smithi100.stdout:0/320: symlink d2/dd/d33/l75 0 2024-09-13T02:50:30.466 INFO:tasks.workunit.client.0.smithi100.stdout:0/321: stat d2/dd/d33/d3b/l48 0 2024-09-13T02:50:30.474 INFO:tasks.workunit.client.0.smithi100.stdout:2/301: dwrite d0/db/d3f/f4b [0,4194304] 0 2024-09-13T02:50:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/368: dwrite db/de/d3e/f60 [0,4194304] 0 2024-09-13T02:50:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:4/360: dwrite d3/d6/d21/f76 [0,4194304] 0 2024-09-13T02:50:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/369: dread - db/f83 zero size 2024-09-13T02:50:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/414: dwrite d10/f16 [0,4194304] 0 2024-09-13T02:50:30.475 INFO:tasks.workunit.client.0.smithi100.stdout:3/415: fsync d10/f3a 0 2024-09-13T02:50:30.476 INFO:tasks.workunit.client.0.smithi100.stdout:6/285: rename d12/d2e/d34 to d12/d43/d4b/d4c 0 2024-09-13T02:50:30.479 INFO:tasks.workunit.client.0.smithi100.stdout:0/322: dwrite d2/dd/d54/d28/f35 [4194304,4194304] 0 2024-09-13T02:50:30.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/370: dread db/de/d3e/f66 [0,4194304] 0 2024-09-13T02:50:30.480 INFO:tasks.workunit.client.0.smithi100.stdout:5/371: readlink db/de/d1f/l49 0 2024-09-13T02:50:30.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/361: link d3/d6/d21/f76 d3/d6/d21/d67/f78 0 2024-09-13T02:50:30.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/416: unlink f4 0 2024-09-13T02:50:30.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/286: unlink d12/d14/f3c 0 2024-09-13T02:50:30.493 INFO:tasks.workunit.client.0.smithi100.stdout:3/417: dread d10/d21/f56 [0,4194304] 0 2024-09-13T02:50:30.494 INFO:tasks.workunit.client.0.smithi100.stdout:3/418: mkdir d10/d8a 0 2024-09-13T02:50:30.496 INFO:tasks.workunit.client.0.smithi100.stdout:3/419: rmdir d10/d21/d57 39 2024-09-13T02:50:30.496 INFO:tasks.workunit.client.0.smithi100.stdout:3/420: chown d10/c61 127 1 2024-09-13T02:50:30.497 INFO:tasks.workunit.client.0.smithi100.stdout:9/274: sync 2024-09-13T02:50:30.497 INFO:tasks.workunit.client.0.smithi100.stdout:7/361: sync 2024-09-13T02:50:30.497 INFO:tasks.workunit.client.0.smithi100.stdout:8/291: sync 2024-09-13T02:50:30.497 INFO:tasks.workunit.client.0.smithi100.stdout:7/362: chown d3/d5/f53 5708631 1 2024-09-13T02:50:30.497 INFO:tasks.workunit.client.0.smithi100.stdout:9/275: truncate dd/d1b/d27/f53 1665713 0 2024-09-13T02:50:30.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/276: truncate dd/d1b/d1d/f3b 182149 0 2024-09-13T02:50:30.499 INFO:tasks.workunit.client.0.smithi100.stdout:4/362: dread d3/d6/d21/d46/d2d/d42/f55 [0,4194304] 0 2024-09-13T02:50:30.502 INFO:tasks.workunit.client.0.smithi100.stdout:4/363: mkdir d3/d6/d21/d46/d2d/d3f/d79 0 2024-09-13T02:50:30.503 INFO:tasks.workunit.client.0.smithi100.stdout:4/364: unlink d3/d6/d2f/f5a 0 2024-09-13T02:50:30.503 INFO:tasks.workunit.client.0.smithi100.stdout:4/365: stat d3/d6/d9/l6c 0 2024-09-13T02:50:30.504 INFO:tasks.workunit.client.0.smithi100.stdout:7/363: write d3/d5/f2a [3557933,126693] 0 2024-09-13T02:50:30.504 INFO:tasks.workunit.client.0.smithi100.stdout:4/366: mkdir d3/d6/d2f/d7a 0 2024-09-13T02:50:30.506 INFO:tasks.workunit.client.0.smithi100.stdout:7/364: rename d3/c6 to d3/d5/d1b/d1c/d36/c6c 0 2024-09-13T02:50:30.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/287: write d12/d14/d1c/f3a [786044,8312] 0 2024-09-13T02:50:30.508 INFO:tasks.workunit.client.0.smithi100.stdout:0/323: dwrite d2/dd/d33/d43/d4b/f72 [0,4194304] 0 2024-09-13T02:50:30.508 INFO:tasks.workunit.client.0.smithi100.stdout:7/365: getdents d3/d16/d55/d56 0 2024-09-13T02:50:30.510 INFO:tasks.workunit.client.0.smithi100.stdout:0/324: readlink d2/dd/d54/d47/d34/l59 0 2024-09-13T02:50:30.513 INFO:tasks.workunit.client.0.smithi100.stdout:7/366: truncate d3/fa 726267 0 2024-09-13T02:50:30.513 INFO:tasks.workunit.client.0.smithi100.stdout:2/302: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T02:50:30.514 INFO:tasks.workunit.client.0.smithi100.stdout:4/367: write d3/d6/d21/d46/d2d/d42/f55 [107459,47624] 0 2024-09-13T02:50:30.514 INFO:tasks.workunit.client.0.smithi100.stdout:4/368: stat d3/d6/d9/f73 0 2024-09-13T02:50:30.514 INFO:tasks.workunit.client.0.smithi100.stdout:7/367: rmdir d3/d5 39 2024-09-13T02:50:30.516 INFO:tasks.workunit.client.0.smithi100.stdout:2/303: rename d0/f20 to d0/db/f52 0 2024-09-13T02:50:30.516 INFO:tasks.workunit.client.0.smithi100.stdout:9/277: dread dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:30.517 INFO:tasks.workunit.client.0.smithi100.stdout:5/372: dwrite db/de/f52 [0,4194304] 0 2024-09-13T02:50:30.517 INFO:tasks.workunit.client.0.smithi100.stdout:5/373: chown db/de/d3e/d7e/d81/d85/l86 0 1 2024-09-13T02:50:30.517 INFO:tasks.workunit.client.0.smithi100.stdout:7/368: unlink d3/l34 0 2024-09-13T02:50:30.517 INFO:tasks.workunit.client.0.smithi100.stdout:8/292: dwrite df/f2b [0,4194304] 0 2024-09-13T02:50:30.518 INFO:tasks.workunit.client.0.smithi100.stdout:4/369: rename d3/d6/d9/f53 to d3/d3a/d56/f7b 0 2024-09-13T02:50:30.519 INFO:tasks.workunit.client.0.smithi100.stdout:4/370: write d3/dc/d4b/d52/f64 [203072,52897] 0 2024-09-13T02:50:30.520 INFO:tasks.workunit.client.0.smithi100.stdout:2/304: symlink d0/l53 0 2024-09-13T02:50:30.522 INFO:tasks.workunit.client.0.smithi100.stdout:9/278: mknod dd/d1b/d1d/c56 0 2024-09-13T02:50:30.523 INFO:tasks.workunit.client.0.smithi100.stdout:3/421: rmdir d10 39 2024-09-13T02:50:30.525 INFO:tasks.workunit.client.0.smithi100.stdout:5/374: rmdir db/de/d63 39 2024-09-13T02:50:30.529 INFO:tasks.workunit.client.0.smithi100.stdout:3/422: creat d10/d21/d51/d5a/d5e/d71/f8b x:0 0 0 2024-09-13T02:50:30.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/288: dwrite d12/d43/d4b/d4c/d36/f38 [0,4194304] 0 2024-09-13T02:50:30.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/289: stat d12/d14/d2f/d45 0 2024-09-13T02:50:30.532 INFO:tasks.workunit.client.0.smithi100.stdout:6/290: write d12/d14/d2f/d45/f49 [991187,83689] 0 2024-09-13T02:50:30.533 INFO:tasks.workunit.client.0.smithi100.stdout:4/371: rename d3/d3a/d4f to d3/dc/d4b/d7c 0 2024-09-13T02:50:30.533 INFO:tasks.workunit.client.0.smithi100.stdout:4/372: write d3/d6/d21/d46/d2d/d42/f55 [4059221,92013] 0 2024-09-13T02:50:30.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/291: mkdir d12/d14/d4d 0 2024-09-13T02:50:30.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/292: readlink l4 0 2024-09-13T02:50:30.535 INFO:tasks.workunit.client.0.smithi100.stdout:3/423: creat d10/d21/d51/d6c/f8c x:0 0 0 2024-09-13T02:50:30.535 INFO:tasks.workunit.client.0.smithi100.stdout:8/293: write f5 [3543443,70444] 0 2024-09-13T02:50:30.535 INFO:tasks.workunit.client.0.smithi100.stdout:3/424: truncate d10/d21/d51/d6c/f74 250003 0 2024-09-13T02:50:30.535 INFO:tasks.workunit.client.0.smithi100.stdout:8/294: write f5 [1564297,101559] 0 2024-09-13T02:50:30.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/373: symlink d3/d3a/d56/l7d 0 2024-09-13T02:50:30.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/293: getdents d12/d43/d4b/d4c/d36 0 2024-09-13T02:50:30.538 INFO:tasks.workunit.client.0.smithi100.stdout:8/295: read df/d13/f14 [317445,14645] 0 2024-09-13T02:50:30.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/374: mknod d3/dc/d4b/c7e 0 2024-09-13T02:50:30.539 INFO:tasks.workunit.client.0.smithi100.stdout:3/425: dread d10/d21/f29 [0,4194304] 0 2024-09-13T02:50:30.539 INFO:tasks.workunit.client.0.smithi100.stdout:3/426: fdatasync d10/d21/f2d 0 2024-09-13T02:50:30.540 INFO:tasks.workunit.client.0.smithi100.stdout:4/375: rename d3/d6/d2f/l4a to d3/d6/l7f 0 2024-09-13T02:50:30.541 INFO:tasks.workunit.client.0.smithi100.stdout:3/427: creat d10/d21/d51/d5a/d5e/d89/f8d x:0 0 0 2024-09-13T02:50:30.541 INFO:tasks.workunit.client.0.smithi100.stdout:8/296: symlink df/d13/d21/l73 0 2024-09-13T02:50:30.542 INFO:tasks.workunit.client.0.smithi100.stdout:8/297: chown df/d5d 52149181 1 2024-09-13T02:50:30.542 INFO:tasks.workunit.client.0.smithi100.stdout:4/376: rename d3/d6/d21/d46/f41 to d3/f80 0 2024-09-13T02:50:30.543 INFO:tasks.workunit.client.0.smithi100.stdout:3/428: stat d10/l26 0 2024-09-13T02:50:30.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/298: rename df/d5d/d70/d2c/l3e to df/d5d/d70/d2c/l74 0 2024-09-13T02:50:30.544 INFO:tasks.workunit.client.0.smithi100.stdout:4/377: rmdir d3/d63 39 2024-09-13T02:50:30.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/299: read df/d13/d21/f29 [218365,131060] 0 2024-09-13T02:50:30.546 INFO:tasks.workunit.client.0.smithi100.stdout:8/300: unlink df/d13/d21/f4d 0 2024-09-13T02:50:30.546 INFO:tasks.workunit.client.0.smithi100.stdout:8/301: write df/d13/f14 [478814,102638] 0 2024-09-13T02:50:30.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/378: read f0 [1011701,100825] 0 2024-09-13T02:50:30.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/379: stat d3/l1a 0 2024-09-13T02:50:30.547 INFO:tasks.workunit.client.0.smithi100.stdout:8/302: mknod df/d5d/d70/d2c/d38/c75 0 2024-09-13T02:50:30.548 INFO:tasks.workunit.client.0.smithi100.stdout:4/380: mknod d3/d3a/c81 0 2024-09-13T02:50:30.548 INFO:tasks.workunit.client.0.smithi100.stdout:4/381: write d3/d63/f6a [4967443,64840] 0 2024-09-13T02:50:30.548 INFO:tasks.workunit.client.0.smithi100.stdout:4/382: truncate d3/d6/f10 5144632 0 2024-09-13T02:50:30.549 INFO:tasks.workunit.client.0.smithi100.stdout:4/383: creat d3/d6/d21/d46/d2d/f82 x:0 0 0 2024-09-13T02:50:30.551 INFO:tasks.workunit.client.0.smithi100.stdout:4/384: rename d3/d6/f18 to d3/d6/d21/d46/f83 0 2024-09-13T02:50:30.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/305: dwrite d0/db/f16 [0,4194304] 0 2024-09-13T02:50:30.553 INFO:tasks.workunit.client.0.smithi100.stdout:0/325: dwrite d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:30.555 INFO:tasks.workunit.client.0.smithi100.stdout:2/306: write d0/db/d23/d39/f43 [1370001,125084] 0 2024-09-13T02:50:30.557 INFO:tasks.workunit.client.0.smithi100.stdout:7/369: write d3/fa [390030,75709] 0 2024-09-13T02:50:30.557 INFO:tasks.workunit.client.0.smithi100.stdout:5/375: dwrite db/de/d1f/d2b/f2d [4194304,4194304] 0 2024-09-13T02:50:30.557 INFO:tasks.workunit.client.0.smithi100.stdout:5/376: creat db/de/d1f/f87 x:0 0 0 2024-09-13T02:50:30.557 INFO:tasks.workunit.client.0.smithi100.stdout:9/279: dwrite dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:30.561 INFO:tasks.workunit.client.0.smithi100.stdout:8/303: write fc [2214426,87708] 0 2024-09-13T02:50:30.562 INFO:tasks.workunit.client.0.smithi100.stdout:8/304: fdatasync df/f2b 0 2024-09-13T02:50:30.562 INFO:tasks.workunit.client.0.smithi100.stdout:8/305: fsync df/f2b 0 2024-09-13T02:50:30.562 INFO:tasks.workunit.client.0.smithi100.stdout:8/306: chown df/f2b 1021191 1 2024-09-13T02:50:30.566 INFO:tasks.workunit.client.0.smithi100.stdout:3/429: dwrite d10/f49 [0,4194304] 0 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:0/326: rmdir d2/dd 39 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:8/307: write f2 [7584058,56773] 0 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/370: symlink d3/d2d/l6d 0 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/371: creat d3/d16/d55/f6e x:0 0 0 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/372: creat d3/d16/d3b/f6f x:0 0 0 2024-09-13T02:50:30.574 INFO:tasks.workunit.client.0.smithi100.stdout:5/377: rmdir db/de/d63/d70 39 2024-09-13T02:50:30.577 INFO:tasks.workunit.client.0.smithi100.stdout:0/327: dread d2/f5 [0,4194304] 0 2024-09-13T02:50:30.580 INFO:tasks.workunit.client.0.smithi100.stdout:7/373: unlink d3/d5/c42 0 2024-09-13T02:50:30.580 INFO:tasks.workunit.client.0.smithi100.stdout:5/378: rmdir db/de/d3e/d7e 39 2024-09-13T02:50:30.582 INFO:tasks.workunit.client.0.smithi100.stdout:7/374: link d3/d16/f32 d3/d16/d55/d56/f70 0 2024-09-13T02:50:30.582 INFO:tasks.workunit.client.0.smithi100.stdout:7/375: creat d3/d5/d1b/f71 x:0 0 0 2024-09-13T02:50:30.584 INFO:tasks.workunit.client.0.smithi100.stdout:7/376: mknod d3/d5/d1b/c72 0 2024-09-13T02:50:30.584 INFO:tasks.workunit.client.0.smithi100.stdout:7/377: write d3/d16/d55/f6e [1035642,103086] 0 2024-09-13T02:50:30.584 INFO:tasks.workunit.client.0.smithi100.stdout:7/378: fdatasync d3/d16/d55/f5e 0 2024-09-13T02:50:30.585 INFO:tasks.workunit.client.0.smithi100.stdout:7/379: symlink d3/d16/l73 0 2024-09-13T02:50:30.586 INFO:tasks.workunit.client.0.smithi100.stdout:7/380: rmdir d3/d5/d1b/d1c/d36/d65 39 2024-09-13T02:50:30.586 INFO:tasks.workunit.client.0.smithi100.stdout:7/381: creat d3/d2d/f74 x:0 0 0 2024-09-13T02:50:30.586 INFO:tasks.workunit.client.0.smithi100.stdout:7/382: dread - d3/d5/d1b/f4e zero size 2024-09-13T02:50:30.588 INFO:tasks.workunit.client.0.smithi100.stdout:7/383: unlink d3/d5/d1b/d1c/d36/c6c 0 2024-09-13T02:50:30.589 INFO:tasks.workunit.client.0.smithi100.stdout:7/384: symlink d3/d5/l75 0 2024-09-13T02:50:30.591 INFO:tasks.workunit.client.0.smithi100.stdout:7/385: unlink d3/d2d/f5f 0 2024-09-13T02:50:30.591 INFO:tasks.workunit.client.0.smithi100.stdout:7/386: write d3/d2d/f4d [1103319,44617] 0 2024-09-13T02:50:30.597 INFO:tasks.workunit.client.0.smithi100.stdout:8/308: rename df/d5d/d70/d2c/l74 to df/l76 0 2024-09-13T02:50:30.601 INFO:tasks.workunit.client.0.smithi100.stdout:2/307: dwrite d0/db/f40 [0,4194304] 0 2024-09-13T02:50:30.601 INFO:tasks.workunit.client.0.smithi100.stdout:5/379: dread db/de/d1f/f31 [0,4194304] 0 2024-09-13T02:50:30.601 INFO:tasks.workunit.client.0.smithi100.stdout:3/430: dwrite d10/d21/d51/d6c/f6f [0,4194304] 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:4/385: dwrite d3/d6/d21/d46/f83 [0,4194304] 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/280: dwrite dd/d1b/d1d/f2c [0,4194304] 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/328: dwrite d2/dd/d54/d28/f35 [0,4194304] 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/329: fsync d2/dd/d54/d28/f35 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/330: write d2/dd/d54/d47/f2d [4848235,108473] 0 2024-09-13T02:50:30.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/331: write d2/dd/d54/d47/d34/d3c/f71 [1017549,41020] 0 2024-09-13T02:50:30.603 INFO:tasks.workunit.client.0.smithi100.stdout:6/294: dwrite d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:30.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/380: mknod db/de/d3e/d7e/d81/c88 0 2024-09-13T02:50:30.608 INFO:tasks.workunit.client.0.smithi100.stdout:2/308: dread d0/db/d21/f30 [4194304,4194304] 0 2024-09-13T02:50:30.609 INFO:tasks.workunit.client.0.smithi100.stdout:4/386: link f0 d3/d6/d21/d46/d2d/d58/f84 0 2024-09-13T02:50:30.612 INFO:tasks.workunit.client.0.smithi100.stdout:1/344: sync 2024-09-13T02:50:30.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/332: write d2/dd/d54/d28/f35 [5864455,93437] 0 2024-09-13T02:50:30.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/333: symlink d2/d1a/d51/l76 0 2024-09-13T02:50:30.624 INFO:tasks.workunit.client.0.smithi100.stdout:3/431: rename d10/c35 to d10/d8a/c8e 0 2024-09-13T02:50:30.625 INFO:tasks.workunit.client.0.smithi100.stdout:0/334: creat d2/dd/d54/d47/f77 x:0 0 0 2024-09-13T02:50:30.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/381: dread db/de/d1f/f4b [0,4194304] 0 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/345: rename de/d14/d22/c57 to de/d14/d39/c73 0 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:3/432: rename d10 to d10/d21/d51/d5a/d5e/d82/d8f 22 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/346: readlink de/d14/d22/d29/d64/l5b 0 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/347: fdatasync de/d14/d22/d52/f55 0 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:1/348: creat de/d14/d22/d52/d65/f74 x:0 0 0 2024-09-13T02:50:30.626 INFO:tasks.workunit.client.0.smithi100.stdout:5/382: symlink db/de/d3e/d7e/d81/l89 0 2024-09-13T02:50:30.629 INFO:tasks.workunit.client.0.smithi100.stdout:0/335: rename d2/dd/d33/d43/c53 to d2/dd/d54/d47/c78 0 2024-09-13T02:50:30.630 INFO:tasks.workunit.client.0.smithi100.stdout:3/433: mkdir d10/d21/d51/d5a/d5e/d90 0 2024-09-13T02:50:30.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/349: mkdir de/d14/d2e/d75 0 2024-09-13T02:50:30.633 INFO:tasks.workunit.client.0.smithi100.stdout:1/350: fsync de/f23 0 2024-09-13T02:50:30.635 INFO:tasks.workunit.client.0.smithi100.stdout:3/434: creat d10/d21/d57/f91 x:0 0 0 2024-09-13T02:50:30.635 INFO:tasks.workunit.client.0.smithi100.stdout:3/435: truncate d10/d21/d51/d6c/f6f 5065277 0 2024-09-13T02:50:30.635 INFO:tasks.workunit.client.0.smithi100.stdout:6/295: dwrite d12/d2e/f3b [0,4194304] 0 2024-09-13T02:50:30.635 INFO:tasks.workunit.client.0.smithi100.stdout:6/296: readlink d12/d14/l19 0 2024-09-13T02:50:30.635 INFO:tasks.workunit.client.0.smithi100.stdout:6/297: chown d12/d14 21893 1 2024-09-13T02:50:30.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/351: mknod de/d14/d22/d52/c76 0 2024-09-13T02:50:30.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/352: creat de/d14/d22/f77 x:0 0 0 2024-09-13T02:50:30.639 INFO:tasks.workunit.client.0.smithi100.stdout:8/309: dwrite df/d5d/d70/d2c/d38/f71 [0,4194304] 0 2024-09-13T02:50:30.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/298: unlink d12/d2e/f39 0 2024-09-13T02:50:30.641 INFO:tasks.workunit.client.0.smithi100.stdout:6/299: truncate d12/d14/d1c/f30 1020096 0 2024-09-13T02:50:30.644 INFO:tasks.workunit.client.0.smithi100.stdout:3/436: unlink d10/c1d 0 2024-09-13T02:50:30.652 INFO:tasks.workunit.client.0.smithi100.stdout:3/437: creat d10/f92 x:0 0 0 2024-09-13T02:50:30.653 INFO:tasks.workunit.client.0.smithi100.stdout:8/310: rename df/d13/c15 to df/c77 0 2024-09-13T02:50:30.654 INFO:tasks.workunit.client.0.smithi100.stdout:6/300: rename d12/d14/d1c/d28/c40 to d12/d14/d1c/c4e 0 2024-09-13T02:50:30.655 INFO:tasks.workunit.client.0.smithi100.stdout:6/301: truncate d12/d14/d1c/f3a 7831345 0 2024-09-13T02:50:30.655 INFO:tasks.workunit.client.0.smithi100.stdout:2/309: dwrite d0/db/f12 [4194304,4194304] 0 2024-09-13T02:50:30.656 INFO:tasks.workunit.client.0.smithi100.stdout:9/281: dwrite dd/d1b/d1d/d36/f38 [4194304,4194304] 0 2024-09-13T02:50:30.656 INFO:tasks.workunit.client.0.smithi100.stdout:2/310: write d0/db/d21/f22 [714175,1853] 0 2024-09-13T02:50:30.656 INFO:tasks.workunit.client.0.smithi100.stdout:2/311: creat d0/db/d21/f54 x:0 0 0 2024-09-13T02:50:30.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/282: creat dd/d1b/d27/d51/f57 x:0 0 0 2024-09-13T02:50:30.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/283: getdents dd/d1b 0 2024-09-13T02:50:30.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/284: chown dd/d1b/d1d/d28 19 1 2024-09-13T02:50:30.658 INFO:tasks.workunit.client.0.smithi100.stdout:2/312: mkdir d0/d55 0 2024-09-13T02:50:30.659 INFO:tasks.workunit.client.0.smithi100.stdout:6/302: getdents d12/d14/d2f/d45 0 2024-09-13T02:50:30.659 INFO:tasks.workunit.client.0.smithi100.stdout:6/303: stat d12/d43/d4b/d4c/d36/f38 0 2024-09-13T02:50:30.660 INFO:tasks.workunit.client.0.smithi100.stdout:6/304: truncate d12/d14/f2d 1595284 0 2024-09-13T02:50:30.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/305: truncate d12/d14/d2f/d45/f49 1725283 0 2024-09-13T02:50:30.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/306: fdatasync d12/d43/d4b/d4c/d36/f38 0 2024-09-13T02:50:30.666 INFO:tasks.workunit.client.0.smithi100.stdout:8/311: dread df/d13/f16 [0,4194304] 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:8/312: write df/d13/d5c/f6b [262354,10961] 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/383: dwrite db/de/d3e/f4e [0,4194304] 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/384: dread - db/de/d3e/f7a zero size 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:1/353: dwrite de/d14/d2e/d48/f50 [0,4194304] 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/336: dwrite d2/d1a/f4f [0,4194304] 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/385: symlink db/de/d1f/d78/l8a 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/386: readlink db/de/d3e/l6f 0 2024-09-13T02:50:30.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/387: truncate db/de/d3e/f7a 125281 0 2024-09-13T02:50:30.672 INFO:tasks.workunit.client.0.smithi100.stdout:9/285: write dd/d1b/d1d/f2c [2270320,76609] 0 2024-09-13T02:50:30.675 INFO:tasks.workunit.client.0.smithi100.stdout:1/354: creat de/d14/d39/f78 x:0 0 0 2024-09-13T02:50:30.676 INFO:tasks.workunit.client.0.smithi100.stdout:1/355: read - de/d14/d39/f6c zero size 2024-09-13T02:50:30.676 INFO:tasks.workunit.client.0.smithi100.stdout:1/356: dread - de/d14/d22/d52/d65/f74 zero size 2024-09-13T02:50:30.676 INFO:tasks.workunit.client.0.smithi100.stdout:1/357: chown cc 586 1 2024-09-13T02:50:30.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/337: symlink d2/dd/d54/d47/l79 0 2024-09-13T02:50:30.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/338: rename d2 to d2/d9/d6d/d7a 22 2024-09-13T02:50:30.679 INFO:tasks.workunit.client.0.smithi100.stdout:5/388: unlink db/de/d1f/c36 0 2024-09-13T02:50:30.683 INFO:tasks.workunit.client.0.smithi100.stdout:5/389: creat db/de/d3e/d7e/d81/d85/f8b x:0 0 0 2024-09-13T02:50:30.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/286: dread dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:30.685 INFO:tasks.workunit.client.0.smithi100.stdout:9/287: chown dd/d1b/d21/d39/c49 36 1 2024-09-13T02:50:30.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/358: rmdir de/d14/d22/d52 39 2024-09-13T02:50:30.686 INFO:tasks.workunit.client.0.smithi100.stdout:1/359: chown de/d14/l21 1 1 2024-09-13T02:50:30.686 INFO:tasks.workunit.client.0.smithi100.stdout:5/390: mknod db/de/d3e/d71/c8c 0 2024-09-13T02:50:30.687 INFO:tasks.workunit.client.0.smithi100.stdout:5/391: stat db/de/d3e/d71 0 2024-09-13T02:50:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/392: dread db/de/f7b [0,4194304] 0 2024-09-13T02:50:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:5/393: chown db/f57 279982 1 2024-09-13T02:50:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/288: truncate dd/f15 1241255 0 2024-09-13T02:50:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/289: write dd/d1b/d27/d51/f57 [959242,76420] 0 2024-09-13T02:50:30.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/360: dread de/d14/d44/f5d [0,4194304] 0 2024-09-13T02:50:30.689 INFO:tasks.workunit.client.0.smithi100.stdout:9/290: mkdir dd/d1b/d1d/d36/d4e/d58 0 2024-09-13T02:50:30.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/361: mknod de/d14/d2e/d48/c79 0 2024-09-13T02:50:30.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/362: chown de/d12/c16 10 1 2024-09-13T02:50:30.691 INFO:tasks.workunit.client.0.smithi100.stdout:9/291: creat dd/d1b/d27/f59 x:0 0 0 2024-09-13T02:50:30.691 INFO:tasks.workunit.client.0.smithi100.stdout:9/292: write dd/d1b/d1d/d36/d3c/f46 [370647,36168] 0 2024-09-13T02:50:30.691 INFO:tasks.workunit.client.0.smithi100.stdout:0/339: dread d2/dd/d33/f16 [0,4194304] 0 2024-09-13T02:50:30.692 INFO:tasks.workunit.client.0.smithi100.stdout:1/363: mkdir de/d14/d22/d52/d7a 0 2024-09-13T02:50:30.693 INFO:tasks.workunit.client.0.smithi100.stdout:1/364: unlink de/c10 0 2024-09-13T02:50:30.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/313: dwrite d0/db/d21/f22 [0,4194304] 0 2024-09-13T02:50:30.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/314: readlink d0/db/d21/l31 0 2024-09-13T02:50:30.702 INFO:tasks.workunit.client.0.smithi100.stdout:8/313: dwrite df/d13/f16 [0,4194304] 0 2024-09-13T02:50:30.702 INFO:tasks.workunit.client.0.smithi100.stdout:8/314: chown df/d5d/d70/l34 14797913 1 2024-09-13T02:50:30.702 INFO:tasks.workunit.client.0.smithi100.stdout:8/315: readlink df/d13/d21/l51 0 2024-09-13T02:50:30.702 INFO:tasks.workunit.client.0.smithi100.stdout:5/394: dread db/de/f52 [0,4194304] 0 2024-09-13T02:50:30.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/315: creat d0/d55/f56 x:0 0 0 2024-09-13T02:50:30.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/316: truncate d0/f4a 178236 0 2024-09-13T02:50:30.704 INFO:tasks.workunit.client.0.smithi100.stdout:2/317: readlink d0/db/l51 0 2024-09-13T02:50:30.704 INFO:tasks.workunit.client.0.smithi100.stdout:2/318: readlink d0/db/d21/l31 0 2024-09-13T02:50:30.705 INFO:tasks.workunit.client.0.smithi100.stdout:8/316: fdatasync df/d13/d20/f4e 0 2024-09-13T02:50:30.705 INFO:tasks.workunit.client.0.smithi100.stdout:6/307: dread d12/d14/d1c/f3a [4194304,4194304] 0 2024-09-13T02:50:30.706 INFO:tasks.workunit.client.0.smithi100.stdout:5/395: creat db/de/d3e/d7e/d81/f8d x:0 0 0 2024-09-13T02:50:30.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/319: mkdir d0/db/d21/d57 0 2024-09-13T02:50:30.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/317: symlink df/d13/d21/l78 0 2024-09-13T02:50:30.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/318: stat df/d5d/d70/d2c/c60 0 2024-09-13T02:50:30.709 INFO:tasks.workunit.client.0.smithi100.stdout:6/308: symlink d12/d43/d4b/d4c/l4f 0 2024-09-13T02:50:30.710 INFO:tasks.workunit.client.0.smithi100.stdout:2/320: symlink d0/db/d3f/l58 0 2024-09-13T02:50:30.710 INFO:tasks.workunit.client.0.smithi100.stdout:2/321: fsync d0/db/d3f/f4e 0 2024-09-13T02:50:30.711 INFO:tasks.workunit.client.0.smithi100.stdout:8/319: mknod df/d5d/c79 0 2024-09-13T02:50:30.713 INFO:tasks.workunit.client.0.smithi100.stdout:8/320: dread df/f1a [0,4194304] 0 2024-09-13T02:50:30.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/309: rename d12/d14/d1c/c2c to d12/d43/d4b/d4c/d36/c50 0 2024-09-13T02:50:30.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/310: creat d12/d14/d2f/d45/f51 x:0 0 0 2024-09-13T02:50:30.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/311: fsync d12/f16 0 2024-09-13T02:50:30.714 INFO:tasks.workunit.client.0.smithi100.stdout:6/312: rmdir d12/d14/d2f 39 2024-09-13T02:50:30.718 INFO:tasks.workunit.client.0.smithi100.stdout:6/313: dread f7 [0,4194304] 0 2024-09-13T02:50:30.718 INFO:tasks.workunit.client.0.smithi100.stdout:6/314: fdatasync d12/d14/f1a 0 2024-09-13T02:50:30.718 INFO:tasks.workunit.client.0.smithi100.stdout:5/396: dread db/f5b [0,4194304] 0 2024-09-13T02:50:30.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/322: dread d0/db/f40 [0,4194304] 0 2024-09-13T02:50:30.726 INFO:tasks.workunit.client.0.smithi100.stdout:9/293: dwrite dd/f4a [0,4194304] 0 2024-09-13T02:50:30.726 INFO:tasks.workunit.client.0.smithi100.stdout:9/294: fsync dd/d1b/d21/d39/f52 0 2024-09-13T02:50:30.726 INFO:tasks.workunit.client.0.smithi100.stdout:1/365: dwrite de/d12/f30 [0,4194304] 0 2024-09-13T02:50:30.726 INFO:tasks.workunit.client.0.smithi100.stdout:1/366: truncate de/d14/d39/f78 539249 0 2024-09-13T02:50:30.728 INFO:tasks.workunit.client.0.smithi100.stdout:0/340: dwrite d2/dd/d54/d28/f6a [0,4194304] 0 2024-09-13T02:50:30.732 INFO:tasks.workunit.client.0.smithi100.stdout:0/341: write d2/dd/d54/d47/f2d [4057378,104279] 0 2024-09-13T02:50:30.734 INFO:tasks.workunit.client.0.smithi100.stdout:2/323: rmdir d0 39 2024-09-13T02:50:30.735 INFO:tasks.workunit.client.0.smithi100.stdout:1/367: write de/d12/f59 [313319,121599] 0 2024-09-13T02:50:30.742 INFO:tasks.workunit.client.0.smithi100.stdout:6/315: dwrite f7 [0,4194304] 0 2024-09-13T02:50:30.742 INFO:tasks.workunit.client.0.smithi100.stdout:6/316: fdatasync d12/d43/d4b/d4c/d36/f46 0 2024-09-13T02:50:30.744 INFO:tasks.workunit.client.0.smithi100.stdout:0/342: mknod d2/dd/d33/d43/c7b 0 2024-09-13T02:50:30.745 INFO:tasks.workunit.client.0.smithi100.stdout:2/324: truncate d0/db/d21/f25 784268 0 2024-09-13T02:50:30.745 INFO:tasks.workunit.client.0.smithi100.stdout:2/325: fsync d0/db/d21/f30 0 2024-09-13T02:50:30.745 INFO:tasks.workunit.client.0.smithi100.stdout:1/368: creat de/d14/d44/d61/f7b x:0 0 0 2024-09-13T02:50:30.745 INFO:tasks.workunit.client.0.smithi100.stdout:1/369: chown de/c34 48362341 1 2024-09-13T02:50:30.746 INFO:tasks.workunit.client.0.smithi100.stdout:6/317: rename d12/d43/d4b/d4c/d36/c50 to d12/d14/d1c/d28/c52 0 2024-09-13T02:50:30.746 INFO:tasks.workunit.client.0.smithi100.stdout:0/343: creat d2/dd/d33/f7c x:0 0 0 2024-09-13T02:50:30.747 INFO:tasks.workunit.client.0.smithi100.stdout:2/326: creat d0/db/d21/d57/f59 x:0 0 0 2024-09-13T02:50:30.747 INFO:tasks.workunit.client.0.smithi100.stdout:2/327: readlink d0/la 0 2024-09-13T02:50:30.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/328: dread - d0/db/f2d zero size 2024-09-13T02:50:30.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/318: symlink d12/d14/d1c/d28/l53 0 2024-09-13T02:50:30.748 INFO:tasks.workunit.client.0.smithi100.stdout:6/319: fsync d12/d14/d2f/d45/f48 0 2024-09-13T02:50:30.748 INFO:tasks.workunit.client.0.smithi100.stdout:0/344: creat d2/d1a/d51/f7d x:0 0 0 2024-09-13T02:50:30.749 INFO:tasks.workunit.client.0.smithi100.stdout:2/329: mkdir d0/db/d21/d5a 0 2024-09-13T02:50:30.749 INFO:tasks.workunit.client.0.smithi100.stdout:2/330: stat d0/db/d3f 0 2024-09-13T02:50:30.749 INFO:tasks.workunit.client.0.smithi100.stdout:2/331: chown d0/f4d 14 1 2024-09-13T02:50:30.749 INFO:tasks.workunit.client.0.smithi100.stdout:2/332: stat d0/db/d23/f35 0 2024-09-13T02:50:30.750 INFO:tasks.workunit.client.0.smithi100.stdout:2/333: dread d0/f38 [0,4194304] 0 2024-09-13T02:50:30.750 INFO:tasks.workunit.client.0.smithi100.stdout:2/334: mkdir d0/db/d5b 0 2024-09-13T02:50:30.755 INFO:tasks.workunit.client.0.smithi100.stdout:5/397: dwrite db/de/f52 [4194304,4194304] 0 2024-09-13T02:50:30.755 INFO:tasks.workunit.client.0.smithi100.stdout:5/398: truncate db/de/d3e/f4e 4434186 0 2024-09-13T02:50:30.756 INFO:tasks.workunit.client.0.smithi100.stdout:5/399: symlink db/de/d63/d70/l8e 0 2024-09-13T02:50:30.757 INFO:tasks.workunit.client.0.smithi100.stdout:6/320: dread d12/f16 [0,4194304] 0 2024-09-13T02:50:30.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/295: dwrite dd/f12 [0,4194304] 0 2024-09-13T02:50:30.765 INFO:tasks.workunit.client.0.smithi100.stdout:9/296: dread dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:30.765 INFO:tasks.workunit.client.0.smithi100.stdout:9/297: fsync fc 0 2024-09-13T02:50:30.766 INFO:tasks.workunit.client.0.smithi100.stdout:9/298: truncate dd/d1b/d24/f2e 2382668 0 2024-09-13T02:50:30.769 INFO:tasks.workunit.client.0.smithi100.stdout:1/370: dread de/d14/f1a [0,4194304] 0 2024-09-13T02:50:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:2/335: read d0/fe [3180233,85136] 0 2024-09-13T02:50:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/345: dread d2/f56 [0,4194304] 0 2024-09-13T02:50:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/346: write d2/f5 [2124184,31986] 0 2024-09-13T02:50:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/347: fsync d2/d1a/f4f 0 2024-09-13T02:50:30.770 INFO:tasks.workunit.client.0.smithi100.stdout:7/387: sync 2024-09-13T02:50:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:4/387: sync 2024-09-13T02:50:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:2/336: creat d0/db/d5b/f5c x:0 0 0 2024-09-13T02:50:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:2/337: chown d0/db/f40 25 1 2024-09-13T02:50:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:5/400: dwrite db/de/f29 [0,4194304] 0 2024-09-13T02:50:30.771 INFO:tasks.workunit.client.0.smithi100.stdout:5/401: dread - db/f83 zero size 2024-09-13T02:50:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/348: creat d2/d1a/f7e x:0 0 0 2024-09-13T02:50:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:0/349: chown d2/dd/d54/d28 3708978 1 2024-09-13T02:50:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:6/321: write d12/d14/d2f/d45/f48 [1989904,89719] 0 2024-09-13T02:50:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:6/322: write d12/f16 [5026253,23828] 0 2024-09-13T02:50:30.772 INFO:tasks.workunit.client.0.smithi100.stdout:7/388: rmdir d3 39 2024-09-13T02:50:30.773 INFO:tasks.workunit.client.0.smithi100.stdout:4/388: symlink d3/d63/l85 0 2024-09-13T02:50:30.775 INFO:tasks.workunit.client.0.smithi100.stdout:2/338: symlink d0/d36/l5d 0 2024-09-13T02:50:30.775 INFO:tasks.workunit.client.0.smithi100.stdout:9/299: dread dd/f1a [0,4194304] 0 2024-09-13T02:50:30.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/339: dread d0/db/f1a [0,4194304] 0 2024-09-13T02:50:30.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/389: write d3/d5/d1b/d1c/f30 [3948773,42270] 0 2024-09-13T02:50:30.786 INFO:tasks.workunit.client.0.smithi100.stdout:6/323: creat d12/d43/f54 x:0 0 0 2024-09-13T02:50:30.787 INFO:tasks.workunit.client.0.smithi100.stdout:9/300: creat dd/d1b/d1d/d36/d4e/f5a x:0 0 0 2024-09-13T02:50:30.787 INFO:tasks.workunit.client.0.smithi100.stdout:9/301: chown dd/d1b/d1d/d28/c48 57187 1 2024-09-13T02:50:30.787 INFO:tasks.workunit.client.0.smithi100.stdout:9/302: getdents dd/d1b 0 2024-09-13T02:50:30.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/389: dread d3/dc/d4b/d7c/f6b [0,4194304] 0 2024-09-13T02:50:30.788 INFO:tasks.workunit.client.0.smithi100.stdout:2/340: truncate d0/db/f16 1664549 0 2024-09-13T02:50:30.789 INFO:tasks.workunit.client.0.smithi100.stdout:7/390: symlink d3/d16/d55/l76 0 2024-09-13T02:50:30.790 INFO:tasks.workunit.client.0.smithi100.stdout:6/324: creat d12/d14/d21/f55 x:0 0 0 2024-09-13T02:50:30.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/303: truncate dd/f4a 2186423 0 2024-09-13T02:50:30.790 INFO:tasks.workunit.client.0.smithi100.stdout:9/304: creat dd/d1b/d1d/f5b x:0 0 0 2024-09-13T02:50:30.791 INFO:tasks.workunit.client.0.smithi100.stdout:4/390: creat d3/dc/d4b/f86 x:0 0 0 2024-09-13T02:50:30.791 INFO:tasks.workunit.client.0.smithi100.stdout:4/391: creat d3/dc/d4b/f87 x:0 0 0 2024-09-13T02:50:30.791 INFO:tasks.workunit.client.0.smithi100.stdout:4/392: write d3/d6/f38 [1514666,84477] 0 2024-09-13T02:50:30.792 INFO:tasks.workunit.client.0.smithi100.stdout:4/393: fsync d3/d6/d21/f43 0 2024-09-13T02:50:30.792 INFO:tasks.workunit.client.0.smithi100.stdout:4/394: getdents d3/d6/d21/d46/d2d/d3f/d79 0 2024-09-13T02:50:30.792 INFO:tasks.workunit.client.0.smithi100.stdout:1/371: dwrite de/d14/d22/f35 [4194304,4194304] 0 2024-09-13T02:50:30.792 INFO:tasks.workunit.client.0.smithi100.stdout:2/341: unlink d0/db/f1a 0 2024-09-13T02:50:30.793 INFO:tasks.workunit.client.0.smithi100.stdout:9/305: rename dd/d1b/d21/d39/c49 to dd/d1b/d24/c5c 0 2024-09-13T02:50:30.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/395: rmdir d3/d6/d21/d46/d2d/d42 39 2024-09-13T02:50:30.795 INFO:tasks.workunit.client.0.smithi100.stdout:7/391: mknod d3/d5/d1b/d1c/d36/d65/c77 0 2024-09-13T02:50:30.797 INFO:tasks.workunit.client.0.smithi100.stdout:7/392: dread d3/f3c [0,4194304] 0 2024-09-13T02:50:30.797 INFO:tasks.workunit.client.0.smithi100.stdout:7/393: fsync d3/d5/f27 0 2024-09-13T02:50:30.797 INFO:tasks.workunit.client.0.smithi100.stdout:4/396: mkdir d3/dc/d88 0 2024-09-13T02:50:30.799 INFO:tasks.workunit.client.0.smithi100.stdout:4/397: getdents d3/d6/d21/d67 0 2024-09-13T02:50:30.799 INFO:tasks.workunit.client.0.smithi100.stdout:0/350: dwrite d2/dd/f10 [4194304,4194304] 0 2024-09-13T02:50:30.799 INFO:tasks.workunit.client.0.smithi100.stdout:7/394: dread d3/d16/d3b/f45 [0,4194304] 0 2024-09-13T02:50:30.803 INFO:tasks.workunit.client.0.smithi100.stdout:4/398: link d3/d6/l7f d3/d6/d21/d46/d34/l89 0 2024-09-13T02:50:30.803 INFO:tasks.workunit.client.0.smithi100.stdout:5/402: dwrite db/de/d1f/d2b/f2d [4194304,4194304] 0 2024-09-13T02:50:30.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/403: creat db/f8f x:0 0 0 2024-09-13T02:50:30.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/404: truncate db/de/f7b 1858750 0 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:5/405: dread - db/de/d3e/d7e/d81/f8d zero size 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:5/406: write db/f8f [11670,90346] 0 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:7/395: truncate d3/d5/f1e 9985300 0 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:3/438: sync 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:3/439: write d10/d21/d51/d6c/f83 [788195,7798] 0 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/321: sync 2024-09-13T02:50:30.806 INFO:tasks.workunit.client.0.smithi100.stdout:3/440: write d10/d21/d51/f59 [4855345,52720] 0 2024-09-13T02:50:30.807 INFO:tasks.workunit.client.0.smithi100.stdout:7/396: mknod d3/d5/d1b/d1c/d36/c78 0 2024-09-13T02:50:30.807 INFO:tasks.workunit.client.0.smithi100.stdout:7/397: truncate d3/d5/f27 2044368 0 2024-09-13T02:50:30.808 INFO:tasks.workunit.client.0.smithi100.stdout:7/398: stat d3/d16/l3a 0 2024-09-13T02:50:30.809 INFO:tasks.workunit.client.0.smithi100.stdout:8/322: creat df/d13/d20/f7a x:0 0 0 2024-09-13T02:50:30.809 INFO:tasks.workunit.client.0.smithi100.stdout:8/323: chown df/d13/d20/c4f 1827 1 2024-09-13T02:50:30.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/407: dread db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:30.817 INFO:tasks.workunit.client.0.smithi100.stdout:7/399: read d3/d16/d55/f5e [29252,35270] 0 2024-09-13T02:50:30.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/306: unlink dd/d1b/d24/c5c 0 2024-09-13T02:50:30.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/307: write dd/f15 [1960876,122268] 0 2024-09-13T02:50:30.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/324: dread fc [0,4194304] 0 2024-09-13T02:50:30.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/325: creat df/d5d/d70/d2c/d38/f7b x:0 0 0 2024-09-13T02:50:30.818 INFO:tasks.workunit.client.0.smithi100.stdout:5/408: symlink db/de/d1f/l90 0 2024-09-13T02:50:30.819 INFO:tasks.workunit.client.0.smithi100.stdout:7/400: symlink d3/d5/l79 0 2024-09-13T02:50:30.819 INFO:tasks.workunit.client.0.smithi100.stdout:7/401: write d3/d5/f53 [399771,4042] 0 2024-09-13T02:50:30.820 INFO:tasks.workunit.client.0.smithi100.stdout:3/441: dread d10/f40 [0,4194304] 0 2024-09-13T02:50:30.820 INFO:tasks.workunit.client.0.smithi100.stdout:9/308: mkdir dd/d1b/d1d/d43/d5d 0 2024-09-13T02:50:30.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/372: dwrite de/d14/d22/f35 [0,4194304] 0 2024-09-13T02:50:30.823 INFO:tasks.workunit.client.0.smithi100.stdout:5/409: creat db/de/d3e/d7e/f91 x:0 0 0 2024-09-13T02:50:30.824 INFO:tasks.workunit.client.0.smithi100.stdout:7/402: rename d3/d5/l10 to d3/d5/d1b/d1c/d36/l7a 0 2024-09-13T02:50:30.824 INFO:tasks.workunit.client.0.smithi100.stdout:8/326: dread df/d13/d68/f6d [0,4194304] 0 2024-09-13T02:50:30.825 INFO:tasks.workunit.client.0.smithi100.stdout:3/442: mkdir d10/d21/d51/d5a/d5e/d71/d93 0 2024-09-13T02:50:30.826 INFO:tasks.workunit.client.0.smithi100.stdout:9/309: mkdir dd/d1b/d1d/d43/d5e 0 2024-09-13T02:50:30.827 INFO:tasks.workunit.client.0.smithi100.stdout:1/373: symlink de/d14/d22/d52/d7a/l7c 0 2024-09-13T02:50:30.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/342: dwrite d0/db/d21/f22 [0,4194304] 0 2024-09-13T02:50:30.828 INFO:tasks.workunit.client.0.smithi100.stdout:7/403: mknod d3/c7b 0 2024-09-13T02:50:30.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/404: write d3/d2d/f41 [343493,26423] 0 2024-09-13T02:50:30.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/405: chown d3/d5/d1b/l33 36962680 1 2024-09-13T02:50:30.830 INFO:tasks.workunit.client.0.smithi100.stdout:7/406: readlink d3/d16/l73 0 2024-09-13T02:50:30.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/351: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:30.832 INFO:tasks.workunit.client.0.smithi100.stdout:6/325: dwrite d12/f16 [0,4194304] 0 2024-09-13T02:50:30.833 INFO:tasks.workunit.client.0.smithi100.stdout:3/443: mkdir d10/d21/d51/d5a/d5e/d71/d94 0 2024-09-13T02:50:30.833 INFO:tasks.workunit.client.0.smithi100.stdout:9/310: link dd/d1b/d1d/d43/l55 dd/d1b/l5f 0 2024-09-13T02:50:30.833 INFO:tasks.workunit.client.0.smithi100.stdout:3/444: chown d10/d21/d51/d6c/f6d 56294209 1 2024-09-13T02:50:30.833 INFO:tasks.workunit.client.0.smithi100.stdout:1/374: creat de/f7d x:0 0 0 2024-09-13T02:50:30.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/445: write d10/d21/d51/d6c/f6f [4628264,32647] 0 2024-09-13T02:50:30.834 INFO:tasks.workunit.client.0.smithi100.stdout:3/446: chown d10/d21/d57/c77 10168678 1 2024-09-13T02:50:30.841 INFO:tasks.workunit.client.0.smithi100.stdout:1/375: creat de/d14/d22/d29/d64/f7e x:0 0 0 2024-09-13T02:50:30.842 INFO:tasks.workunit.client.0.smithi100.stdout:3/447: symlink d10/d21/d51/d5a/d5e/d89/l95 0 2024-09-13T02:50:30.843 INFO:tasks.workunit.client.0.smithi100.stdout:0/352: rmdir d2/dd/d54/d68 39 2024-09-13T02:50:30.843 INFO:tasks.workunit.client.0.smithi100.stdout:0/353: truncate d2/dd/d54/d47/f77 3214 0 2024-09-13T02:50:30.843 INFO:tasks.workunit.client.0.smithi100.stdout:0/354: dread - d2/dd/d54/d3e/d5d/f62 zero size 2024-09-13T02:50:30.844 INFO:tasks.workunit.client.0.smithi100.stdout:0/355: read d2/dd/d54/d47/d34/d3c/f71 [350690,64025] 0 2024-09-13T02:50:30.845 INFO:tasks.workunit.client.0.smithi100.stdout:0/356: chown d2/dd/d33/d43/d4b/f4d 3068 1 2024-09-13T02:50:30.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/326: write f7 [614539,17243] 0 2024-09-13T02:50:30.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/327: truncate d12/d14/d1c/f44 681394 0 2024-09-13T02:50:30.847 INFO:tasks.workunit.client.0.smithi100.stdout:1/376: dread de/d14/d44/f47 [4194304,4194304] 0 2024-09-13T02:50:30.847 INFO:tasks.workunit.client.0.smithi100.stdout:1/377: stat de/d14/d22/d29/d64/f7e 0 2024-09-13T02:50:30.850 INFO:tasks.workunit.client.0.smithi100.stdout:1/378: unlink de/d14/f1a 0 2024-09-13T02:50:30.857 INFO:tasks.workunit.client.0.smithi100.stdout:5/410: dwrite db/de/d3e/d7e/d81/f8d [0,4194304] 0 2024-09-13T02:50:30.860 INFO:tasks.workunit.client.0.smithi100.stdout:5/411: truncate f4 557124 0 2024-09-13T02:50:30.861 INFO:tasks.workunit.client.0.smithi100.stdout:5/412: unlink db/de/d3e/d7e/d81/d85/l86 0 2024-09-13T02:50:30.862 INFO:tasks.workunit.client.0.smithi100.stdout:1/379: dread f1 [0,4194304] 0 2024-09-13T02:50:30.862 INFO:tasks.workunit.client.0.smithi100.stdout:5/413: link db/de/d1f/f69 db/de/d1f/d2b/f92 0 2024-09-13T02:50:30.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/380: dread de/d14/d2e/f4e [0,4194304] 0 2024-09-13T02:50:30.869 INFO:tasks.workunit.client.0.smithi100.stdout:1/381: chown de/d14/d22/d52/f71 462 1 2024-09-13T02:50:30.869 INFO:tasks.workunit.client.0.smithi100.stdout:1/382: mkdir de/d14/d44/d7f 0 2024-09-13T02:50:30.869 INFO:tasks.workunit.client.0.smithi100.stdout:1/383: fdatasync de/d14/d22/d52/d65/f6f 0 2024-09-13T02:50:30.872 INFO:tasks.workunit.client.0.smithi100.stdout:2/343: dwrite d0/db/d21/f22 [4194304,4194304] 0 2024-09-13T02:50:30.873 INFO:tasks.workunit.client.0.smithi100.stdout:2/344: creat d0/db/d5b/f5e x:0 0 0 2024-09-13T02:50:30.873 INFO:tasks.workunit.client.0.smithi100.stdout:9/311: dwrite dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:30.873 INFO:tasks.workunit.client.0.smithi100.stdout:9/312: fdatasync dd/d1b/d24/f35 0 2024-09-13T02:50:30.873 INFO:tasks.workunit.client.0.smithi100.stdout:1/384: dread de/f3a [4194304,4194304] 0 2024-09-13T02:50:30.874 INFO:tasks.workunit.client.0.smithi100.stdout:2/345: mknod d0/db/d21/d5a/c5f 0 2024-09-13T02:50:30.876 INFO:tasks.workunit.client.0.smithi100.stdout:9/313: mknod dd/d1b/d1d/d43/d5d/c60 0 2024-09-13T02:50:30.876 INFO:tasks.workunit.client.0.smithi100.stdout:9/314: write dd/f12 [4403532,12789] 0 2024-09-13T02:50:30.878 INFO:tasks.workunit.client.0.smithi100.stdout:1/385: rename de/d14/d2e/d60/l67 to de/d14/d22/d29/d64/l80 0 2024-09-13T02:50:30.878 INFO:tasks.workunit.client.0.smithi100.stdout:0/357: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:50:30.879 INFO:tasks.workunit.client.0.smithi100.stdout:0/358: fsync d2/d1a/d51/f7d 0 2024-09-13T02:50:30.879 INFO:tasks.workunit.client.0.smithi100.stdout:6/328: dwrite d12/d14/d1c/f3a [4194304,4194304] 0 2024-09-13T02:50:30.879 INFO:tasks.workunit.client.0.smithi100.stdout:3/448: dwrite f9 [4194304,4194304] 0 2024-09-13T02:50:30.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/327: rmdir df/d5d 39 2024-09-13T02:50:30.881 INFO:tasks.workunit.client.0.smithi100.stdout:8/328: fsync f5 0 2024-09-13T02:50:30.882 INFO:tasks.workunit.client.0.smithi100.stdout:0/359: mkdir d2/d1a/d4c/d7f 0 2024-09-13T02:50:30.887 INFO:tasks.workunit.client.0.smithi100.stdout:0/360: dread d2/dd/d54/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:30.887 INFO:tasks.workunit.client.0.smithi100.stdout:0/361: creat d2/dd/d33/f80 x:0 0 0 2024-09-13T02:50:30.887 INFO:tasks.workunit.client.0.smithi100.stdout:6/329: getdents d12/d43/d4b 0 2024-09-13T02:50:30.888 INFO:tasks.workunit.client.0.smithi100.stdout:3/449: rename d10/d21/d51/d5a/d5e/d89/l95 to d10/d8a/l96 0 2024-09-13T02:50:30.890 INFO:tasks.workunit.client.0.smithi100.stdout:8/329: unlink df/l76 0 2024-09-13T02:50:30.893 INFO:tasks.workunit.client.0.smithi100.stdout:0/362: creat d2/d9/f81 x:0 0 0 2024-09-13T02:50:30.894 INFO:tasks.workunit.client.0.smithi100.stdout:6/330: mknod d12/d14/d1c/c56 0 2024-09-13T02:50:30.897 INFO:tasks.workunit.client.0.smithi100.stdout:3/450: rename d10/d21/d51/d5a/d5e/d82 to d10/d21/d51/d5a/d5e/d71/d97 0 2024-09-13T02:50:30.897 INFO:tasks.workunit.client.0.smithi100.stdout:9/315: dwrite dd/d1b/d1d/d36/f38 [0,4194304] 0 2024-09-13T02:50:30.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/330: mknod df/d13/d5c/c7c 0 2024-09-13T02:50:30.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/331: readlink df/d5d/d70/d2c/l58 0 2024-09-13T02:50:30.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/332: stat df/d5d/d70/d41/f56 0 2024-09-13T02:50:30.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/333: truncate df/d13/d21/f29 1445562 0 2024-09-13T02:50:30.900 INFO:tasks.workunit.client.0.smithi100.stdout:9/316: symlink dd/d1b/d1d/d28/l61 0 2024-09-13T02:50:30.902 INFO:tasks.workunit.client.0.smithi100.stdout:3/451: creat d10/d21/d51/d5a/d5e/f98 x:0 0 0 2024-09-13T02:50:30.905 INFO:tasks.workunit.client.0.smithi100.stdout:3/452: mkdir d10/d21/d51/d5a/d5e/d99 0 2024-09-13T02:50:30.907 INFO:tasks.workunit.client.0.smithi100.stdout:8/334: rename df/d13/l30 to df/d13/d68/l7d 0 2024-09-13T02:50:30.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/317: dread dd/fe [0,4194304] 0 2024-09-13T02:50:30.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/318: write dd/d1b/d27/f53 [814944,13029] 0 2024-09-13T02:50:30.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/319: write dd/d1b/d21/f26 [2434959,57817] 0 2024-09-13T02:50:30.909 INFO:tasks.workunit.client.0.smithi100.stdout:3/453: readlink d10/l47 0 2024-09-13T02:50:30.909 INFO:tasks.workunit.client.0.smithi100.stdout:8/335: mknod df/d13/d68/c7e 0 2024-09-13T02:50:30.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/320: dread dd/d1b/d1d/f3b [0,4194304] 0 2024-09-13T02:50:30.911 INFO:tasks.workunit.client.0.smithi100.stdout:3/454: rename d10/d21/d51/d5a/d5e/f72 to d10/d21/d51/d5a/d5e/d71/d94/f9a 0 2024-09-13T02:50:30.912 INFO:tasks.workunit.client.0.smithi100.stdout:9/321: creat dd/d1b/d21/f62 x:0 0 0 2024-09-13T02:50:30.914 INFO:tasks.workunit.client.0.smithi100.stdout:8/336: rename df/d13/d5c/f72 to df/d5d/d70/d2c/f7f 0 2024-09-13T02:50:30.916 INFO:tasks.workunit.client.0.smithi100.stdout:3/455: symlink d10/d21/d51/d5a/l9b 0 2024-09-13T02:50:30.917 INFO:tasks.workunit.client.0.smithi100.stdout:9/322: rename dd/d1b/d1d/d36/d4e/f5a to dd/d1b/d27/f63 0 2024-09-13T02:50:30.918 INFO:tasks.workunit.client.0.smithi100.stdout:8/337: symlink df/l80 0 2024-09-13T02:50:30.918 INFO:tasks.workunit.client.0.smithi100.stdout:8/338: chown df/d6f 0 1 2024-09-13T02:50:30.919 INFO:tasks.workunit.client.0.smithi100.stdout:3/456: stat d10/f2a 0 2024-09-13T02:50:30.920 INFO:tasks.workunit.client.0.smithi100.stdout:0/363: dwrite d2/dd/d33/d43/d4b/f4d [0,4194304] 0 2024-09-13T02:50:30.921 INFO:tasks.workunit.client.0.smithi100.stdout:6/331: dwrite d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:30.921 INFO:tasks.workunit.client.0.smithi100.stdout:6/332: creat d12/d14/f57 x:0 0 0 2024-09-13T02:50:30.922 INFO:tasks.workunit.client.0.smithi100.stdout:5/414: getdents db/de/d1f/d2b 0 2024-09-13T02:50:30.922 INFO:tasks.workunit.client.0.smithi100.stdout:5/415: stat db/de/d1f/d78 0 2024-09-13T02:50:30.923 INFO:tasks.workunit.client.0.smithi100.stdout:0/364: link d2/dd/d33/c44 d2/dd/d33/d43/d4b/c82 0 2024-09-13T02:50:30.925 INFO:tasks.workunit.client.0.smithi100.stdout:5/416: creat db/de/d63/f93 x:0 0 0 2024-09-13T02:50:30.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:30 smithi100 ceph-mon[27894]: pgmap v246: 65 pgs: 65 active+clean; 565 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 36 MiB/s rd, 53 MiB/s wr, 1.15k op/s 2024-09-13T02:50:30.926 INFO:tasks.workunit.client.0.smithi100.stdout:0/365: link d2/dd/d54/d3e/d5d/l73 d2/d1a/d4c/d7f/l83 0 2024-09-13T02:50:30.928 INFO:tasks.workunit.client.0.smithi100.stdout:1/386: getdents de/d14/d22/d29/d64 0 2024-09-13T02:50:30.928 INFO:tasks.workunit.client.0.smithi100.stdout:6/333: dread d12/d43/d4b/d4c/d36/f38 [0,4194304] 0 2024-09-13T02:50:30.929 INFO:tasks.workunit.client.0.smithi100.stdout:6/334: readlink l4 0 2024-09-13T02:50:30.929 INFO:tasks.workunit.client.0.smithi100.stdout:3/457: dread d10/d21/d51/d6c/f6f [0,4194304] 0 2024-09-13T02:50:30.930 INFO:tasks.workunit.client.0.smithi100.stdout:5/417: dread db/de/f41 [0,4194304] 0 2024-09-13T02:50:30.930 INFO:tasks.workunit.client.0.smithi100.stdout:5/418: write f4 [142224,72572] 0 2024-09-13T02:50:30.932 INFO:tasks.workunit.client.0.smithi100.stdout:1/387: mkdir de/d14/d22/d52/d7a/d81 0 2024-09-13T02:50:30.932 INFO:tasks.workunit.client.0.smithi100.stdout:6/335: creat d12/d14/d1c/d28/f58 x:0 0 0 2024-09-13T02:50:30.933 INFO:tasks.workunit.client.0.smithi100.stdout:4/399: sync 2024-09-13T02:50:30.934 INFO:tasks.workunit.client.0.smithi100.stdout:8/339: dread df/d13/f37 [0,4194304] 0 2024-09-13T02:50:30.935 INFO:tasks.workunit.client.0.smithi100.stdout:5/419: rename db/de/f29 to db/de/d1f/d78/f94 0 2024-09-13T02:50:30.936 INFO:tasks.workunit.client.0.smithi100.stdout:1/388: dread de/d14/d2e/f38 [0,4194304] 0 2024-09-13T02:50:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:30 smithi122 ceph-mon[34559]: pgmap v246: 65 pgs: 65 active+clean; 565 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 36 MiB/s rd, 53 MiB/s wr, 1.15k op/s 2024-09-13T02:50:30.936 INFO:tasks.workunit.client.0.smithi100.stdout:6/336: mkdir d12/d43/d59 0 2024-09-13T02:50:30.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/340: mkdir df/d13/d21/d81 0 2024-09-13T02:50:30.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/341: write fc [5238123,106826] 0 2024-09-13T02:50:30.939 INFO:tasks.workunit.client.0.smithi100.stdout:4/400: dread d3/d6/d2f/f33 [0,4194304] 0 2024-09-13T02:50:30.939 INFO:tasks.workunit.client.0.smithi100.stdout:5/420: mknod db/de/d1f/d78/c95 0 2024-09-13T02:50:30.941 INFO:tasks.workunit.client.0.smithi100.stdout:1/389: dread de/d12/f59 [0,4194304] 0 2024-09-13T02:50:30.941 INFO:tasks.workunit.client.0.smithi100.stdout:8/342: creat df/d13/d21/d81/f82 x:0 0 0 2024-09-13T02:50:30.944 INFO:tasks.workunit.client.0.smithi100.stdout:4/401: unlink d3/d6/d21/d46/d2d/d42/f55 0 2024-09-13T02:50:30.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/421: unlink db/de/d1f/d2b/l62 0 2024-09-13T02:50:30.946 INFO:tasks.workunit.client.0.smithi100.stdout:5/422: readlink db/de/d3e/l5f 0 2024-09-13T02:50:30.948 INFO:tasks.workunit.client.0.smithi100.stdout:8/343: chown df/d13/c6e 77 1 2024-09-13T02:50:30.948 INFO:tasks.workunit.client.0.smithi100.stdout:8/344: creat df/d13/d5c/f83 x:0 0 0 2024-09-13T02:50:30.948 INFO:tasks.workunit.client.0.smithi100.stdout:5/423: symlink db/de/d1f/d2b/l96 0 2024-09-13T02:50:30.952 INFO:tasks.workunit.client.0.smithi100.stdout:0/366: dwrite d2/dd/d33/f18 [4194304,4194304] 0 2024-09-13T02:50:30.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/458: dwrite d10/d21/d51/d5a/f69 [0,4194304] 0 2024-09-13T02:50:30.958 INFO:tasks.workunit.client.0.smithi100.stdout:3/459: read d10/f53 [1025492,34094] 0 2024-09-13T02:50:30.960 INFO:tasks.workunit.client.0.smithi100.stdout:3/460: read d10/d21/d51/d6c/f83 [634532,128355] 0 2024-09-13T02:50:30.960 INFO:tasks.workunit.client.0.smithi100.stdout:6/337: dwrite d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:30.960 INFO:tasks.workunit.client.0.smithi100.stdout:6/338: readlink l3 0 2024-09-13T02:50:30.962 INFO:tasks.workunit.client.0.smithi100.stdout:3/461: rmdir d10/d21/d51/d5a/d5e/d71 39 2024-09-13T02:50:30.963 INFO:tasks.workunit.client.0.smithi100.stdout:5/424: dread db/de/d3e/f60 [0,4194304] 0 2024-09-13T02:50:30.964 INFO:tasks.workunit.client.0.smithi100.stdout:1/390: getdents de/d14/d22/d52/d7a 0 2024-09-13T02:50:30.965 INFO:tasks.workunit.client.0.smithi100.stdout:5/425: unlink db/c25 0 2024-09-13T02:50:30.965 INFO:tasks.workunit.client.0.smithi100.stdout:5/426: stat db/de/d1f/f53 0 2024-09-13T02:50:30.967 INFO:tasks.workunit.client.0.smithi100.stdout:3/462: dread d10/f44 [0,4194304] 0 2024-09-13T02:50:30.967 INFO:tasks.workunit.client.0.smithi100.stdout:1/391: rename de/d14/l21 to de/d14/d2e/d69/l82 0 2024-09-13T02:50:30.969 INFO:tasks.workunit.client.0.smithi100.stdout:3/463: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c 0 2024-09-13T02:50:30.969 INFO:tasks.workunit.client.0.smithi100.stdout:0/367: dread d2/dd/d33/d43/d4b/f4d [0,4194304] 0 2024-09-13T02:50:30.969 INFO:tasks.workunit.client.0.smithi100.stdout:0/368: chown d2/c26 436857 1 2024-09-13T02:50:30.970 INFO:tasks.workunit.client.0.smithi100.stdout:1/392: creat de/d14/f83 x:0 0 0 2024-09-13T02:50:30.971 INFO:tasks.workunit.client.0.smithi100.stdout:3/464: mknod d10/d21/d51/c9d 0 2024-09-13T02:50:30.971 INFO:tasks.workunit.client.0.smithi100.stdout:4/402: dwrite d3/dc/d4b/d52/f59 [0,4194304] 0 2024-09-13T02:50:30.972 INFO:tasks.workunit.client.0.smithi100.stdout:1/393: creat de/d14/d22/d52/d5c/f84 x:0 0 0 2024-09-13T02:50:30.972 INFO:tasks.workunit.client.0.smithi100.stdout:8/345: dwrite df/d5d/d70/d2c/d38/f7b [0,4194304] 0 2024-09-13T02:50:30.973 INFO:tasks.workunit.client.0.smithi100.stdout:8/346: rename df/d13/d5c to df/d13/d5c/d84 22 2024-09-13T02:50:30.976 INFO:tasks.workunit.client.0.smithi100.stdout:3/465: mknod d10/d21/d51/c9e 0 2024-09-13T02:50:30.976 INFO:tasks.workunit.client.0.smithi100.stdout:3/466: chown d10/d21/d51/d5a/d5e/f6b 1398740 1 2024-09-13T02:50:30.976 INFO:tasks.workunit.client.0.smithi100.stdout:6/339: rmdir d12/d43 39 2024-09-13T02:50:30.977 INFO:tasks.workunit.client.0.smithi100.stdout:0/369: mknod d2/dd/d54/c84 0 2024-09-13T02:50:30.977 INFO:tasks.workunit.client.0.smithi100.stdout:8/347: dread df/d13/d21/f29 [0,4194304] 0 2024-09-13T02:50:30.977 INFO:tasks.workunit.client.0.smithi100.stdout:6/340: dread d12/d43/d4b/d4c/d36/f38 [0,4194304] 0 2024-09-13T02:50:30.977 INFO:tasks.workunit.client.0.smithi100.stdout:6/341: chown d12/d14/d1c/d28/f58 3801 1 2024-09-13T02:50:30.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/394: dread de/d12/f33 [0,4194304] 0 2024-09-13T02:50:30.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/395: fsync de/f23 0 2024-09-13T02:50:30.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/396: readlink de/d14/d39/l3f 0 2024-09-13T02:50:30.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/397: chown de/d14/d22/f4a 17 1 2024-09-13T02:50:30.981 INFO:tasks.workunit.client.0.smithi100.stdout:1/398: readlink de/d14/d39/l3f 0 2024-09-13T02:50:30.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/467: fdatasync d10/f2b 0 2024-09-13T02:50:30.984 INFO:tasks.workunit.client.0.smithi100.stdout:8/348: mkdir df/d85 0 2024-09-13T02:50:30.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/427: dwrite db/de/f7b [0,4194304] 0 2024-09-13T02:50:30.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/428: chown db/f84 139315 1 2024-09-13T02:50:30.986 INFO:tasks.workunit.client.0.smithi100.stdout:1/399: symlink de/d14/d2e/d75/l85 0 2024-09-13T02:50:30.988 INFO:tasks.workunit.client.0.smithi100.stdout:3/468: readlink d10/l39 0 2024-09-13T02:50:30.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/429: creat db/de/d3e/d71/f97 x:0 0 0 2024-09-13T02:50:30.993 INFO:tasks.workunit.client.0.smithi100.stdout:5/430: stat db/c2e 0 2024-09-13T02:50:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/469: getdents d10/d8a 0 2024-09-13T02:50:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/470: truncate d10/d21/d51/d5a/d5e/d71/f8b 92179 0 2024-09-13T02:50:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:8/349: getdents df/d13/d21 0 2024-09-13T02:50:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:8/350: write f2 [1528733,32725] 0 2024-09-13T02:50:30.994 INFO:tasks.workunit.client.0.smithi100.stdout:8/351: stat df/d13/f37 0 2024-09-13T02:50:30.995 INFO:tasks.workunit.client.0.smithi100.stdout:5/431: link db/de/d1f/d2b/f92 db/de/d1f/f98 0 2024-09-13T02:50:30.996 INFO:tasks.workunit.client.0.smithi100.stdout:3/471: creat d10/d8a/f9f x:0 0 0 2024-09-13T02:50:30.997 INFO:tasks.workunit.client.0.smithi100.stdout:8/352: mkdir df/d86 0 2024-09-13T02:50:30.997 INFO:tasks.workunit.client.0.smithi100.stdout:7/407: sync 2024-09-13T02:50:30.998 INFO:tasks.workunit.client.0.smithi100.stdout:7/408: truncate d3/d5/d1b/f67 82771 0 2024-09-13T02:50:30.998 INFO:tasks.workunit.client.0.smithi100.stdout:7/409: dread - d3/d2d/f74 zero size 2024-09-13T02:50:30.998 INFO:tasks.workunit.client.0.smithi100.stdout:5/432: mknod db/de/d1f/c99 0 2024-09-13T02:50:30.998 INFO:tasks.workunit.client.0.smithi100.stdout:5/433: creat db/de/d3e/f9a x:0 0 0 2024-09-13T02:50:30.998 INFO:tasks.workunit.client.0.smithi100.stdout:5/434: chown db/de/d3e/f60 319480952 1 2024-09-13T02:50:30.999 INFO:tasks.workunit.client.0.smithi100.stdout:8/353: symlink df/d13/d20/l87 0 2024-09-13T02:50:31.001 INFO:tasks.workunit.client.0.smithi100.stdout:3/472: rename d10/f16 to d10/d21/d51/d5a/d5e/d90/fa0 0 2024-09-13T02:50:31.002 INFO:tasks.workunit.client.0.smithi100.stdout:0/370: dwrite d2/dd/d54/d28/f65 [4194304,4194304] 0 2024-09-13T02:50:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:7/410: rename d3/d16/c62 to d3/d16/d55/d56/c7c 0 2024-09-13T02:50:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:7/411: creat d3/d2d/f7d x:0 0 0 2024-09-13T02:50:31.003 INFO:tasks.workunit.client.0.smithi100.stdout:7/412: fdatasync d3/d16/d3b/f45 0 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:3/473: mkdir d10/d21/d51/d5a/d5e/da1 0 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:3/474: dread - d10/d21/f5d zero size 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:3/475: getdents d10/d21/d51/d5a/d5e/d71/d93 0 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:0/371: write d2/f11 [391265,120183] 0 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:6/342: dwrite d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:31.005 INFO:tasks.workunit.client.0.smithi100.stdout:8/354: truncate df/d5d/d70/d2c/d38/f7b 779894 0 2024-09-13T02:50:31.009 INFO:tasks.workunit.client.0.smithi100.stdout:8/355: dread df/d13/f37 [0,4194304] 0 2024-09-13T02:50:31.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/356: stat df/d13/d21/f40 0 2024-09-13T02:50:31.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/357: fsync df/d5d/d70/d2c/f7f 0 2024-09-13T02:50:31.010 INFO:tasks.workunit.client.0.smithi100.stdout:8/358: dread - df/d13/d5c/f83 zero size 2024-09-13T02:50:31.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/372: stat d2/dd/c13 0 2024-09-13T02:50:31.013 INFO:tasks.workunit.client.0.smithi100.stdout:5/435: dwrite db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:31.013 INFO:tasks.workunit.client.0.smithi100.stdout:3/476: rename d10/d21/d51/d5a/d5e/l62 to d10/d21/d51/d5a/d5e/da1/la2 0 2024-09-13T02:50:31.018 INFO:tasks.workunit.client.0.smithi100.stdout:0/373: mkdir d2/d9/d6d/d85 0 2024-09-13T02:50:31.020 INFO:tasks.workunit.client.0.smithi100.stdout:5/436: mkdir db/de/d1f/d2b/d9b 0 2024-09-13T02:50:31.020 INFO:tasks.workunit.client.0.smithi100.stdout:5/437: chown db/de/d1f/f31 13382 1 2024-09-13T02:50:31.021 INFO:tasks.workunit.client.0.smithi100.stdout:3/477: symlink d10/d21/d51/d5a/d5e/d71/la3 0 2024-09-13T02:50:31.023 INFO:tasks.workunit.client.0.smithi100.stdout:5/438: mkdir db/de/d63/d9c 0 2024-09-13T02:50:31.023 INFO:tasks.workunit.client.0.smithi100.stdout:5/439: read db/de/d3e/f7a [123694,20199] 0 2024-09-13T02:50:31.024 INFO:tasks.workunit.client.0.smithi100.stdout:3/478: mkdir d10/d21/d51/d5a/da4 0 2024-09-13T02:50:31.026 INFO:tasks.workunit.client.0.smithi100.stdout:3/479: link d10/d21/l7e d10/d21/d51/d5a/d5e/da1/la5 0 2024-09-13T02:50:31.028 INFO:tasks.workunit.client.0.smithi100.stdout:9/323: sync 2024-09-13T02:50:31.029 INFO:tasks.workunit.client.0.smithi100.stdout:2/346: sync 2024-09-13T02:50:31.031 INFO:tasks.workunit.client.0.smithi100.stdout:7/413: dwrite d3/d5/f1a [4194304,4194304] 0 2024-09-13T02:50:31.031 INFO:tasks.workunit.client.0.smithi100.stdout:8/359: dwrite df/d13/d21/f57 [0,4194304] 0 2024-09-13T02:50:31.032 INFO:tasks.workunit.client.0.smithi100.stdout:8/360: truncate df/d5d/f69 784513 0 2024-09-13T02:50:31.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/343: truncate d12/d14/d2f/d45/f49 790413 0 2024-09-13T02:50:31.033 INFO:tasks.workunit.client.0.smithi100.stdout:6/344: fdatasync f7 0 2024-09-13T02:50:31.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/361: mkdir df/d5d/d88 0 2024-09-13T02:50:31.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/362: read - df/f6c zero size 2024-09-13T02:50:31.035 INFO:tasks.workunit.client.0.smithi100.stdout:6/345: mkdir d12/d14/d5a 0 2024-09-13T02:50:31.042 INFO:tasks.workunit.client.0.smithi100.stdout:8/363: write df/d5d/d70/f39 [3892639,8807] 0 2024-09-13T02:50:31.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/364: link df/d13/d21/l78 df/d13/d68/l89 0 2024-09-13T02:50:31.045 INFO:tasks.workunit.client.0.smithi100.stdout:6/346: dread d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:31.053 INFO:tasks.workunit.client.0.smithi100.stdout:5/440: dwrite db/de/d1f/d2b/f2d [0,4194304] 0 2024-09-13T02:50:31.053 INFO:tasks.workunit.client.0.smithi100.stdout:2/347: dread d0/db/d21/f30 [0,4194304] 0 2024-09-13T02:50:31.053 INFO:tasks.workunit.client.0.smithi100.stdout:5/441: dread - db/de/d3e/f51 zero size 2024-09-13T02:50:31.054 INFO:tasks.workunit.client.0.smithi100.stdout:2/348: mknod d0/db/d21/c60 0 2024-09-13T02:50:31.054 INFO:tasks.workunit.client.0.smithi100.stdout:2/349: readlink d0/db/d23/l3e 0 2024-09-13T02:50:31.055 INFO:tasks.workunit.client.0.smithi100.stdout:5/442: link l3 db/de/d3e/d7e/d81/d85/l9d 0 2024-09-13T02:50:31.056 INFO:tasks.workunit.client.0.smithi100.stdout:5/443: rename db/de/f41 to db/de/d1f/f9e 0 2024-09-13T02:50:31.056 INFO:tasks.workunit.client.0.smithi100.stdout:5/444: chown db/de/d3e/d7e/d81 104 1 2024-09-13T02:50:31.057 INFO:tasks.workunit.client.0.smithi100.stdout:5/445: chown db/de/d1f 246 1 2024-09-13T02:50:31.057 INFO:tasks.workunit.client.0.smithi100.stdout:5/446: chown db/de/d63/d70/l8e 164790 1 2024-09-13T02:50:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:5/447: rename l3 to db/de/d1f/l9f 0 2024-09-13T02:50:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:5/448: dread - db/de/d1f/d2b/f79 zero size 2024-09-13T02:50:31.058 INFO:tasks.workunit.client.0.smithi100.stdout:5/449: dread - db/f83 zero size 2024-09-13T02:50:31.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/450: rename db/de/d3e/f4d to db/de/d63/fa0 0 2024-09-13T02:50:31.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/451: chown db/de/d1f/d2b/f4a 2677 1 2024-09-13T02:50:31.059 INFO:tasks.workunit.client.0.smithi100.stdout:5/452: write db/de/d1f/d78/f7d [863131,9183] 0 2024-09-13T02:50:31.061 INFO:tasks.workunit.client.0.smithi100.stdout:5/453: rename db/de/d1f/f53 to db/de/d1f/d2b/d9b/fa1 0 2024-09-13T02:50:31.064 INFO:tasks.workunit.client.0.smithi100.stdout:7/414: dwrite d3/d5/f1e [4194304,4194304] 0 2024-09-13T02:50:31.064 INFO:tasks.workunit.client.0.smithi100.stdout:8/365: dread df/d5d/d70/d2c/d38/f71 [0,4194304] 0 2024-09-13T02:50:31.067 INFO:tasks.workunit.client.0.smithi100.stdout:6/347: write d12/d14/d2f/d45/f49 [302898,16844] 0 2024-09-13T02:50:31.067 INFO:tasks.workunit.client.0.smithi100.stdout:7/415: dread d3/d2d/f41 [0,4194304] 0 2024-09-13T02:50:31.068 INFO:tasks.workunit.client.0.smithi100.stdout:6/348: dread d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:31.070 INFO:tasks.workunit.client.0.smithi100.stdout:6/349: unlink d12/d14/l20 0 2024-09-13T02:50:31.071 INFO:tasks.workunit.client.0.smithi100.stdout:9/324: dwrite fc [0,4194304] 0 2024-09-13T02:50:31.071 INFO:tasks.workunit.client.0.smithi100.stdout:3/480: dwrite d10/d21/f60 [0,4194304] 0 2024-09-13T02:50:31.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/350: creat d12/d43/d4b/d4c/f5b x:0 0 0 2024-09-13T02:50:31.074 INFO:tasks.workunit.client.0.smithi100.stdout:2/350: dwrite d0/f2c [0,4194304] 0 2024-09-13T02:50:31.075 INFO:tasks.workunit.client.0.smithi100.stdout:6/351: creat d12/f5c x:0 0 0 2024-09-13T02:50:31.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/351: write d0/db/d23/f2a [1755949,5079] 0 2024-09-13T02:50:31.078 INFO:tasks.workunit.client.0.smithi100.stdout:3/481: dread f8 [0,4194304] 0 2024-09-13T02:50:31.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/352: link d12/d14/c29 d12/d14/d2f/c5d 0 2024-09-13T02:50:31.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/353: write d12/d14/d2f/d45/f51 [693661,100225] 0 2024-09-13T02:50:31.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/354: write d12/d14/d1c/d28/f58 [586728,100861] 0 2024-09-13T02:50:31.079 INFO:tasks.workunit.client.0.smithi100.stdout:2/352: getdents d0/d55 0 2024-09-13T02:50:31.079 INFO:tasks.workunit.client.0.smithi100.stdout:2/353: creat d0/db/d21/d57/f61 x:0 0 0 2024-09-13T02:50:31.081 INFO:tasks.workunit.client.0.smithi100.stdout:3/482: link d10/d21/l3c d10/d21/d51/d5a/la6 0 2024-09-13T02:50:31.081 INFO:tasks.workunit.client.0.smithi100.stdout:5/454: dwrite db/de/d3e/f51 [0,4194304] 0 2024-09-13T02:50:31.083 INFO:tasks.workunit.client.0.smithi100.stdout:6/355: mkdir d12/d14/d5a/d5e 0 2024-09-13T02:50:31.083 INFO:tasks.workunit.client.0.smithi100.stdout:6/356: write d12/f5c [223796,88319] 0 2024-09-13T02:50:31.091 INFO:tasks.workunit.client.0.smithi100.stdout:6/357: symlink d12/d43/d4b/d4c/l5f 0 2024-09-13T02:50:31.092 INFO:tasks.workunit.client.0.smithi100.stdout:5/455: write db/de/d3e/f4e [3357084,111413] 0 2024-09-13T02:50:31.093 INFO:tasks.workunit.client.0.smithi100.stdout:6/358: mknod d12/d43/c60 0 2024-09-13T02:50:31.094 INFO:tasks.workunit.client.0.smithi100.stdout:5/456: mkdir db/de/d3e/da2 0 2024-09-13T02:50:31.094 INFO:tasks.workunit.client.0.smithi100.stdout:5/457: write db/f5c [554984,79929] 0 2024-09-13T02:50:31.094 INFO:tasks.workunit.client.0.smithi100.stdout:5/458: creat db/de/fa3 x:0 0 0 2024-09-13T02:50:31.097 INFO:tasks.workunit.client.0.smithi100.stdout:4/403: sync 2024-09-13T02:50:31.097 INFO:tasks.workunit.client.0.smithi100.stdout:4/404: getdents d3/dc/d88 0 2024-09-13T02:50:31.098 INFO:tasks.workunit.client.0.smithi100.stdout:7/416: dwrite d3/d2d/f74 [0,4194304] 0 2024-09-13T02:50:31.098 INFO:tasks.workunit.client.0.smithi100.stdout:4/405: mkdir d3/dc/d4b/d8a 0 2024-09-13T02:50:31.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/417: creat d3/d5/d1b/d1c/f7e x:0 0 0 2024-09-13T02:50:31.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/418: creat d3/d5/d1b/d1c/f7f x:0 0 0 2024-09-13T02:50:31.100 INFO:tasks.workunit.client.0.smithi100.stdout:7/419: write d3/d16/d55/f6e [1224652,6982] 0 2024-09-13T02:50:31.101 INFO:tasks.workunit.client.0.smithi100.stdout:9/325: dwrite dd/f25 [0,4194304] 0 2024-09-13T02:50:31.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/420: creat d3/d5/d4f/f80 x:0 0 0 2024-09-13T02:50:31.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/421: chown d3/d5/d1b/l2b 7 1 2024-09-13T02:50:31.102 INFO:tasks.workunit.client.0.smithi100.stdout:7/422: write d3/d16/d3b/f45 [695418,36589] 0 2024-09-13T02:50:31.102 INFO:tasks.workunit.client.0.smithi100.stdout:3/483: dwrite d10/d21/d51/d5a/d5e/f6b [0,4194304] 0 2024-09-13T02:50:31.103 INFO:tasks.workunit.client.0.smithi100.stdout:3/484: dread - d10/d21/d51/d6c/f6d zero size 2024-09-13T02:50:31.104 INFO:tasks.workunit.client.0.smithi100.stdout:9/326: creat dd/d1b/d1d/d43/d5d/f64 x:0 0 0 2024-09-13T02:50:31.105 INFO:tasks.workunit.client.0.smithi100.stdout:9/327: creat dd/d1b/d1d/d36/f65 x:0 0 0 2024-09-13T02:50:31.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/359: write d12/d2e/f3b [1614231,53391] 0 2024-09-13T02:50:31.106 INFO:tasks.workunit.client.0.smithi100.stdout:5/459: read db/f3c [3848634,96560] 0 2024-09-13T02:50:31.112 INFO:tasks.workunit.client.0.smithi100.stdout:4/406: dread d3/dc/d4b/d52/f59 [0,4194304] 0 2024-09-13T02:50:31.112 INFO:tasks.workunit.client.0.smithi100.stdout:3/485: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/fa7 x:0 0 0 2024-09-13T02:50:31.117 INFO:tasks.workunit.client.0.smithi100.stdout:6/360: mknod d12/d14/d2f/c61 0 2024-09-13T02:50:31.118 INFO:tasks.workunit.client.0.smithi100.stdout:6/361: dread d12/d14/d1c/f30 [0,4194304] 0 2024-09-13T02:50:31.118 INFO:tasks.workunit.client.0.smithi100.stdout:6/362: creat d12/d14/d1c/f62 x:0 0 0 2024-09-13T02:50:31.118 INFO:tasks.workunit.client.0.smithi100.stdout:5/460: creat db/de/d3e/da2/fa4 x:0 0 0 2024-09-13T02:50:31.121 INFO:tasks.workunit.client.0.smithi100.stdout:6/363: creat d12/d43/d4b/d4c/d36/f63 x:0 0 0 2024-09-13T02:50:31.121 INFO:tasks.workunit.client.0.smithi100.stdout:6/364: rename d12/d14 to d12/d14/d1c/d28/d64 22 2024-09-13T02:50:31.121 INFO:tasks.workunit.client.0.smithi100.stdout:6/365: write d12/d14/f1a [675691,106202] 0 2024-09-13T02:50:31.121 INFO:tasks.workunit.client.0.smithi100.stdout:6/366: chown d12/d2e 245607 1 2024-09-13T02:50:31.124 INFO:tasks.workunit.client.0.smithi100.stdout:4/407: write d3/d6/d21/f76 [3007013,79572] 0 2024-09-13T02:50:31.124 INFO:tasks.workunit.client.0.smithi100.stdout:4/408: fdatasync d3/d63/f6a 0 2024-09-13T02:50:31.124 INFO:tasks.workunit.client.0.smithi100.stdout:1/400: sync 2024-09-13T02:50:31.125 INFO:tasks.workunit.client.0.smithi100.stdout:4/409: mknod d3/dc/d4b/c8b 0 2024-09-13T02:50:31.125 INFO:tasks.workunit.client.0.smithi100.stdout:4/410: creat d3/dc/d4b/d52/f8c x:0 0 0 2024-09-13T02:50:31.125 INFO:tasks.workunit.client.0.smithi100.stdout:4/411: write d3/d6/d21/d46/d2d/d3f/f5b [544134,85113] 0 2024-09-13T02:50:31.126 INFO:tasks.workunit.client.0.smithi100.stdout:1/401: mkdir de/d14/d86 0 2024-09-13T02:50:31.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/423: dwrite d3/d16/d55/f5e [0,4194304] 0 2024-09-13T02:50:31.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/424: write d3/d2d/f41 [320890,44464] 0 2024-09-13T02:50:31.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/412: rmdir d3/d6/d9 39 2024-09-13T02:50:31.133 INFO:tasks.workunit.client.0.smithi100.stdout:1/402: rmdir de/d14/d44 39 2024-09-13T02:50:31.134 INFO:tasks.workunit.client.0.smithi100.stdout:5/461: dwrite db/de/d3e/d71/f97 [0,4194304] 0 2024-09-13T02:50:31.134 INFO:tasks.workunit.client.0.smithi100.stdout:9/328: dwrite dd/d1b/d27/f53 [0,4194304] 0 2024-09-13T02:50:31.134 INFO:tasks.workunit.client.0.smithi100.stdout:9/329: write dd/f1a [3373714,113698] 0 2024-09-13T02:50:31.134 INFO:tasks.workunit.client.0.smithi100.stdout:7/425: rmdir d3/d5/d1b/d1c 39 2024-09-13T02:50:31.141 INFO:tasks.workunit.client.0.smithi100.stdout:5/462: mkdir db/de/d1f/da5 0 2024-09-13T02:50:31.142 INFO:tasks.workunit.client.0.smithi100.stdout:7/426: symlink d3/d5/l81 0 2024-09-13T02:50:31.143 INFO:tasks.workunit.client.0.smithi100.stdout:4/413: getdents d3/d6/d21 0 2024-09-13T02:50:31.144 INFO:tasks.workunit.client.0.smithi100.stdout:8/366: sync 2024-09-13T02:50:31.144 INFO:tasks.workunit.client.0.smithi100.stdout:0/374: sync 2024-09-13T02:50:31.144 INFO:tasks.workunit.client.0.smithi100.stdout:0/375: truncate d2/d1a/d4c/f63 1037536 0 2024-09-13T02:50:31.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/427: rmdir d3/d5/d1b/d1c 39 2024-09-13T02:50:31.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/367: creat df/d5d/d88/f8a x:0 0 0 2024-09-13T02:50:31.147 INFO:tasks.workunit.client.0.smithi100.stdout:7/428: creat d3/d5/f82 x:0 0 0 2024-09-13T02:50:31.147 INFO:tasks.workunit.client.0.smithi100.stdout:4/414: truncate d3/d6/d21/f76 1611137 0 2024-09-13T02:50:31.148 INFO:tasks.workunit.client.0.smithi100.stdout:7/429: symlink d3/d5/d1b/l83 0 2024-09-13T02:50:31.149 INFO:tasks.workunit.client.0.smithi100.stdout:8/368: mknod df/d13/c8b 0 2024-09-13T02:50:31.149 INFO:tasks.workunit.client.0.smithi100.stdout:8/369: readlink ld 0 2024-09-13T02:50:31.150 INFO:tasks.workunit.client.0.smithi100.stdout:8/370: unlink df/d13/d68/l89 0 2024-09-13T02:50:31.151 INFO:tasks.workunit.client.0.smithi100.stdout:1/403: dwrite de/d12/f30 [0,4194304] 0 2024-09-13T02:50:31.151 INFO:tasks.workunit.client.0.smithi100.stdout:8/371: mknod df/d5d/d70/c8c 0 2024-09-13T02:50:31.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/372: dwrite df/f1a [0,4194304] 0 2024-09-13T02:50:31.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/415: dwrite d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:31.173 INFO:tasks.workunit.client.0.smithi100.stdout:8/373: creat df/d13/d21/d81/f8d x:0 0 0 2024-09-13T02:50:31.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/416: symlink d3/dc/d4b/d8a/l8d 0 2024-09-13T02:50:31.176 INFO:tasks.workunit.client.0.smithi100.stdout:4/417: dread - d3/dc/d4b/f86 zero size 2024-09-13T02:50:31.177 INFO:tasks.workunit.client.0.smithi100.stdout:8/374: creat df/d13/d68/f8e x:0 0 0 2024-09-13T02:50:31.178 INFO:tasks.workunit.client.0.smithi100.stdout:4/418: rename d3/d6/d21/d46/c50 to d3/d6/d21/d46/d2d/d3f/c8e 0 2024-09-13T02:50:31.181 INFO:tasks.workunit.client.0.smithi100.stdout:8/375: dread f5 [0,4194304] 0 2024-09-13T02:50:31.183 INFO:tasks.workunit.client.0.smithi100.stdout:4/419: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:31.186 INFO:tasks.workunit.client.0.smithi100.stdout:4/420: dread d3/d6/d21/d46/d2d/d58/f84 [0,4194304] 0 2024-09-13T02:50:31.186 INFO:tasks.workunit.client.0.smithi100.stdout:4/421: readlink d3/d6/d9/l68 0 2024-09-13T02:50:31.187 INFO:tasks.workunit.client.0.smithi100.stdout:4/422: mkdir d3/d6/d21/d46/d2d/d42/d8f 0 2024-09-13T02:50:31.201 INFO:tasks.workunit.client.0.smithi100.stdout:8/376: dwrite df/d13/d5c/f83 [0,4194304] 0 2024-09-13T02:50:31.201 INFO:tasks.workunit.client.0.smithi100.stdout:4/423: dwrite d3/f80 [0,4194304] 0 2024-09-13T02:50:31.201 INFO:tasks.workunit.client.0.smithi100.stdout:4/424: write d3/d6/d21/f43 [5717675,11262] 0 2024-09-13T02:50:31.205 INFO:tasks.workunit.client.0.smithi100.stdout:2/354: sync 2024-09-13T02:50:31.205 INFO:tasks.workunit.client.0.smithi100.stdout:4/425: dread d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:31.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/355: symlink d0/d55/l62 0 2024-09-13T02:50:31.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/356: readlink d0/db/d21/l50 0 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/357: symlink d0/db/d21/l63 0 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/358: write d0/db/f45 [469837,62821] 0 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/359: dread - d0/d55/f56 zero size 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/360: dread - d0/db/d3f/f4e zero size 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/361: read - d0/db/d3f/f4e zero size 2024-09-13T02:50:31.208 INFO:tasks.workunit.client.0.smithi100.stdout:2/362: chown d0/db/d23/f35 46128 1 2024-09-13T02:50:31.209 INFO:tasks.workunit.client.0.smithi100.stdout:2/363: creat d0/f64 x:0 0 0 2024-09-13T02:50:31.209 INFO:tasks.workunit.client.0.smithi100.stdout:2/364: fdatasync d0/db/f26 0 2024-09-13T02:50:31.210 INFO:tasks.workunit.client.0.smithi100.stdout:2/365: truncate d0/db/d23/d39/f49 474859 0 2024-09-13T02:50:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/366: mknod d0/d55/c65 0 2024-09-13T02:50:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/367: write d0/f1 [1560475,107867] 0 2024-09-13T02:50:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/368: chown d0/l34 0 1 2024-09-13T02:50:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/369: dread - d0/f64 zero size 2024-09-13T02:50:31.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/370: symlink d0/d36/l66 0 2024-09-13T02:50:31.216 INFO:tasks.workunit.client.0.smithi100.stdout:2/371: mknod d0/db/d23/d39/c67 0 2024-09-13T02:50:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:2/372: mkdir d0/db/d68 0 2024-09-13T02:50:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:2/373: write d0/db/d3f/f4e [405747,57415] 0 2024-09-13T02:50:31.217 INFO:tasks.workunit.client.0.smithi100.stdout:2/374: fsync d0/db/f2d 0 2024-09-13T02:50:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:2/375: mkdir d0/db/d21/d69 0 2024-09-13T02:50:31.218 INFO:tasks.workunit.client.0.smithi100.stdout:2/376: readlink d0/la 0 2024-09-13T02:50:31.219 INFO:tasks.workunit.client.0.smithi100.stdout:2/377: mkdir d0/db/d3f/d6a 0 2024-09-13T02:50:31.223 INFO:tasks.workunit.client.0.smithi100.stdout:8/377: dwrite f3 [0,4194304] 0 2024-09-13T02:50:31.224 INFO:tasks.workunit.client.0.smithi100.stdout:4/426: dwrite d3/d6/d21/d46/d2d/d58/f84 [0,4194304] 0 2024-09-13T02:50:31.224 INFO:tasks.workunit.client.0.smithi100.stdout:4/427: truncate d3/d6/f38 2509167 0 2024-09-13T02:50:31.230 INFO:tasks.workunit.client.0.smithi100.stdout:8/378: dread df/d13/d20/f42 [0,4194304] 0 2024-09-13T02:50:31.232 INFO:tasks.workunit.client.0.smithi100.stdout:8/379: rename df/d5d/d70/d41/l48 to df/d85/l8f 0 2024-09-13T02:50:31.232 INFO:tasks.workunit.client.0.smithi100.stdout:8/380: chown df/d5d/d70/d2c/d38/f7b 104776 1 2024-09-13T02:50:31.233 INFO:tasks.workunit.client.0.smithi100.stdout:8/381: link df/d5d/d70/d2c/d38/f7b df/d5d/d88/f90 0 2024-09-13T02:50:31.233 INFO:tasks.workunit.client.0.smithi100.stdout:4/428: write d3/d6/d21/d46/d2d/d58/f84 [821952,104242] 0 2024-09-13T02:50:31.241 INFO:tasks.workunit.client.0.smithi100.stdout:2/378: dwrite d0/db/d23/d39/f43 [0,4194304] 0 2024-09-13T02:50:31.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/379: unlink d0/db/l13 0 2024-09-13T02:50:31.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/380: dread - d0/f3d zero size 2024-09-13T02:50:31.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/381: stat d0/db/d21/l63 0 2024-09-13T02:50:31.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/382: dread - d0/db/f2d zero size 2024-09-13T02:50:31.246 INFO:tasks.workunit.client.0.smithi100.stdout:2/383: rename d0/d55 to d0/db/d68/d6b 0 2024-09-13T02:50:31.247 INFO:tasks.workunit.client.0.smithi100.stdout:2/384: creat d0/db/d21/f6c x:0 0 0 2024-09-13T02:50:31.253 INFO:tasks.workunit.client.0.smithi100.stdout:8/382: dwrite df/d5d/d70/f63 [0,4194304] 0 2024-09-13T02:50:31.254 INFO:tasks.workunit.client.0.smithi100.stdout:8/383: rmdir df/d5d/d70 39 2024-09-13T02:50:31.255 INFO:tasks.workunit.client.0.smithi100.stdout:8/384: creat df/d5d/d70/f91 x:0 0 0 2024-09-13T02:50:31.256 INFO:tasks.workunit.client.0.smithi100.stdout:8/385: link f5 df/d6f/f92 0 2024-09-13T02:50:31.259 INFO:tasks.workunit.client.0.smithi100.stdout:8/386: dread df/d13/d20/f42 [0,4194304] 0 2024-09-13T02:50:31.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/429: dwrite d3/d6/d21/d46/f47 [0,4194304] 0 2024-09-13T02:50:31.260 INFO:tasks.workunit.client.0.smithi100.stdout:8/387: mkdir df/d13/d21/d81/d93 0 2024-09-13T02:50:31.260 INFO:tasks.workunit.client.0.smithi100.stdout:8/388: write df/d5d/d70/d41/f56 [851973,26895] 0 2024-09-13T02:50:31.262 INFO:tasks.workunit.client.0.smithi100.stdout:2/385: dwrite d0/db/d23/d39/f49 [0,4194304] 0 2024-09-13T02:50:31.265 INFO:tasks.workunit.client.0.smithi100.stdout:3/486: sync 2024-09-13T02:50:31.265 INFO:tasks.workunit.client.0.smithi100.stdout:6/367: sync 2024-09-13T02:50:31.267 INFO:tasks.workunit.client.0.smithi100.stdout:4/430: creat d3/d6/d21/d67/f90 x:0 0 0 2024-09-13T02:50:31.267 INFO:tasks.workunit.client.0.smithi100.stdout:4/431: creat d3/dc/d4b/f91 x:0 0 0 2024-09-13T02:50:31.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/386: mkdir d0/db/d21/d69/d6d 0 2024-09-13T02:50:31.271 INFO:tasks.workunit.client.0.smithi100.stdout:3/487: rmdir d10/d21/d51/d5a/da4 0 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:6/368: mknod d12/d14/d21/c65 0 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/463: sync 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:0/376: sync 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:1/404: sync 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:9/330: sync 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:9/331: chown dd/d1b/d27/d51/f57 337711358 1 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:0/377: creat d2/d9/f86 x:0 0 0 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:0/378: creat d2/d1a/d51/f87 x:0 0 0 2024-09-13T02:50:31.273 INFO:tasks.workunit.client.0.smithi100.stdout:5/464: write db/de/d1f/f87 [477630,82737] 0 2024-09-13T02:50:31.274 INFO:tasks.workunit.client.0.smithi100.stdout:4/432: getdents d3/d6/d21/d46 0 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:4/433: fsync d3/dc/d4b/f87 0 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:4/434: dread - d3/d6/d9/f73 zero size 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:7/430: sync 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/387: stat d0/db/d23/d39/l3b 0 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/388: chown d0/db/d21/l63 195403647 1 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/389: fdatasync d0/f1f 0 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/390: creat d0/db/d21/d57/f6e x:0 0 0 2024-09-13T02:50:31.275 INFO:tasks.workunit.client.0.smithi100.stdout:3/488: creat d10/d21/fa8 x:0 0 0 2024-09-13T02:50:31.276 INFO:tasks.workunit.client.0.smithi100.stdout:6/369: unlink ld 0 2024-09-13T02:50:31.276 INFO:tasks.workunit.client.0.smithi100.stdout:6/370: fdatasync d12/d14/f57 0 2024-09-13T02:50:31.277 INFO:tasks.workunit.client.0.smithi100.stdout:1/405: symlink de/d14/l87 0 2024-09-13T02:50:31.277 INFO:tasks.workunit.client.0.smithi100.stdout:9/332: symlink dd/d1b/d1d/d36/l66 0 2024-09-13T02:50:31.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/431: creat d3/d5/d1b/d1c/f84 x:0 0 0 2024-09-13T02:50:31.281 INFO:tasks.workunit.client.0.smithi100.stdout:7/432: dread - d3/d5/d1b/f4e zero size 2024-09-13T02:50:31.281 INFO:tasks.workunit.client.0.smithi100.stdout:2/391: getdents d0/db/d23/d39 0 2024-09-13T02:50:31.282 INFO:tasks.workunit.client.0.smithi100.stdout:3/489: dread - d10/f54 zero size 2024-09-13T02:50:31.283 INFO:tasks.workunit.client.0.smithi100.stdout:6/371: symlink d12/d14/l66 0 2024-09-13T02:50:31.284 INFO:tasks.workunit.client.0.smithi100.stdout:1/406: mknod de/d14/d86/c88 0 2024-09-13T02:50:31.284 INFO:tasks.workunit.client.0.smithi100.stdout:0/379: getdents d2/d1a/d4c 0 2024-09-13T02:50:31.284 INFO:tasks.workunit.client.0.smithi100.stdout:8/389: dwrite df/d13/d20/f42 [4194304,4194304] 0 2024-09-13T02:50:31.284 INFO:tasks.workunit.client.0.smithi100.stdout:8/390: write df/d13/d68/f6d [3836818,40126] 0 2024-09-13T02:50:31.285 INFO:tasks.workunit.client.0.smithi100.stdout:4/435: dread d3/d6/d21/d46/d2d/d3f/f5b [0,4194304] 0 2024-09-13T02:50:31.285 INFO:tasks.workunit.client.0.smithi100.stdout:4/436: chown d3/d6 1350 1 2024-09-13T02:50:31.285 INFO:tasks.workunit.client.0.smithi100.stdout:4/437: creat d3/d6/d21/d46/d2d/f92 x:0 0 0 2024-09-13T02:50:31.286 INFO:tasks.workunit.client.0.smithi100.stdout:4/438: fdatasync d3/d6/d21/d46/f83 0 2024-09-13T02:50:31.286 INFO:tasks.workunit.client.0.smithi100.stdout:7/433: creat d3/d16/d55/d56/f85 x:0 0 0 2024-09-13T02:50:31.287 INFO:tasks.workunit.client.0.smithi100.stdout:3/490: unlink d10/d21/d51/d6c/l70 0 2024-09-13T02:50:31.287 INFO:tasks.workunit.client.0.smithi100.stdout:3/491: stat d10/d8a/f9f 0 2024-09-13T02:50:31.289 INFO:tasks.workunit.client.0.smithi100.stdout:6/372: symlink d12/d2e/l67 0 2024-09-13T02:50:31.289 INFO:tasks.workunit.client.0.smithi100.stdout:6/373: write d12/d43/d4b/d4c/d36/f63 [325068,61328] 0 2024-09-13T02:50:31.291 INFO:tasks.workunit.client.0.smithi100.stdout:5/465: dread db/de/d3e/d71/f97 [0,4194304] 0 2024-09-13T02:50:31.291 INFO:tasks.workunit.client.0.smithi100.stdout:5/466: stat db/de/d1f/c43 0 2024-09-13T02:50:31.291 INFO:tasks.workunit.client.0.smithi100.stdout:5/467: readlink db/l59 0 2024-09-13T02:50:31.291 INFO:tasks.workunit.client.0.smithi100.stdout:0/380: creat d2/d1a/f88 x:0 0 0 2024-09-13T02:50:31.291 INFO:tasks.workunit.client.0.smithi100.stdout:0/381: readlink d2/dd/d54/d3e/d5d/l73 0 2024-09-13T02:50:31.295 INFO:tasks.workunit.client.0.smithi100.stdout:8/391: symlink df/d86/l94 0 2024-09-13T02:50:31.299 INFO:tasks.workunit.client.0.smithi100.stdout:3/492: stat d10/l37 0 2024-09-13T02:50:31.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/392: dwrite d0/db/f26 [4194304,4194304] 0 2024-09-13T02:50:31.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/393: fdatasync d0/db/f12 0 2024-09-13T02:50:31.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/394: stat d0/l34 0 2024-09-13T02:50:31.300 INFO:tasks.workunit.client.0.smithi100.stdout:6/374: mkdir d12/d14/d68 0 2024-09-13T02:50:31.302 INFO:tasks.workunit.client.0.smithi100.stdout:1/407: rename de/d12/f70 to de/d14/d22/d29/d64/f89 0 2024-09-13T02:50:31.305 INFO:tasks.workunit.client.0.smithi100.stdout:1/408: dread de/d14/d2e/f37 [0,4194304] 0 2024-09-13T02:50:31.305 INFO:tasks.workunit.client.0.smithi100.stdout:0/382: unlink d2/dd/d33/d43/d4b/l5c 0 2024-09-13T02:50:31.305 INFO:tasks.workunit.client.0.smithi100.stdout:1/409: creat de/d14/d39/f8a x:0 0 0 2024-09-13T02:50:31.307 INFO:tasks.workunit.client.0.smithi100.stdout:8/392: link df/f67 df/d86/f95 0 2024-09-13T02:50:31.307 INFO:tasks.workunit.client.0.smithi100.stdout:8/393: write df/d86/f95 [806280,98672] 0 2024-09-13T02:50:31.309 INFO:tasks.workunit.client.0.smithi100.stdout:6/375: mknod d12/d14/d1c/d28/c69 0 2024-09-13T02:50:31.309 INFO:tasks.workunit.client.0.smithi100.stdout:6/376: write d12/d14/d1c/d28/f58 [1618624,81166] 0 2024-09-13T02:50:31.310 INFO:tasks.workunit.client.0.smithi100.stdout:4/439: rename d3/dc/d4b/d7c/f6b to d3/d6/d2f/d60/f93 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:4/440: write d3/dc/d4b/d52/f59 [4916277,102171] 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:4/441: read d3/dc/d4b/d7c/f70 [82298,25793] 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:4/442: fdatasync d3/d6/d21/f24 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:5/468: getdents db/de/d63 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:5/469: readlink db/de/d1f/l6e 0 2024-09-13T02:50:31.311 INFO:tasks.workunit.client.0.smithi100.stdout:5/470: chown db/de/d63/f65 132171345 1 2024-09-13T02:50:31.313 INFO:tasks.workunit.client.0.smithi100.stdout:8/394: creat df/d13/f96 x:0 0 0 2024-09-13T02:50:31.313 INFO:tasks.workunit.client.0.smithi100.stdout:8/395: write fc [5717408,90561] 0 2024-09-13T02:50:31.314 INFO:tasks.workunit.client.0.smithi100.stdout:7/434: dwrite d3/d16/d55/f5e [4194304,4194304] 0 2024-09-13T02:50:31.315 INFO:tasks.workunit.client.0.smithi100.stdout:2/395: rename d0/db/d21/f33 to d0/d36/f6f 0 2024-09-13T02:50:31.317 INFO:tasks.workunit.client.0.smithi100.stdout:8/396: symlink df/d5d/d70/d2c/l97 0 2024-09-13T02:50:31.317 INFO:tasks.workunit.client.0.smithi100.stdout:3/493: dwrite f9 [0,4194304] 0 2024-09-13T02:50:31.317 INFO:tasks.workunit.client.0.smithi100.stdout:3/494: fdatasync d10/d21/d57/f5b 0 2024-09-13T02:50:31.320 INFO:tasks.workunit.client.0.smithi100.stdout:6/377: rename d12/d14/d5a/d5e to d12/d43/d6a 0 2024-09-13T02:50:31.320 INFO:tasks.workunit.client.0.smithi100.stdout:7/435: rename d3/d5 to d3/d5/d1b/d86 22 2024-09-13T02:50:31.320 INFO:tasks.workunit.client.0.smithi100.stdout:5/471: getdents db/de/d3e/d71 0 2024-09-13T02:50:31.322 INFO:tasks.workunit.client.0.smithi100.stdout:8/397: truncate f8 2409915 0 2024-09-13T02:50:31.326 INFO:tasks.workunit.client.0.smithi100.stdout:2/396: rename d0/db/l1d to d0/db/d21/d57/l70 0 2024-09-13T02:50:31.326 INFO:tasks.workunit.client.0.smithi100.stdout:6/378: link d12/c15 d12/d14/d1c/c6b 0 2024-09-13T02:50:31.326 INFO:tasks.workunit.client.0.smithi100.stdout:6/379: write d12/d14/d1c/f44 [1210581,93937] 0 2024-09-13T02:50:31.326 INFO:tasks.workunit.client.0.smithi100.stdout:6/380: write d12/d43/d4b/d4c/d36/f46 [825114,58152] 0 2024-09-13T02:50:31.326 INFO:tasks.workunit.client.0.smithi100.stdout:6/381: write f7 [2649904,21254] 0 2024-09-13T02:50:31.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/472: rename db/de/d1f/d2b/l4f to db/de/d3e/la6 0 2024-09-13T02:50:31.327 INFO:tasks.workunit.client.0.smithi100.stdout:5/473: creat db/de/d3e/d7e/fa7 x:0 0 0 2024-09-13T02:50:31.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/495: dread d10/f2a [0,4194304] 0 2024-09-13T02:50:31.328 INFO:tasks.workunit.client.0.smithi100.stdout:3/496: chown d10/d21/f42 12926 1 2024-09-13T02:50:31.328 INFO:tasks.workunit.client.0.smithi100.stdout:2/397: mkdir d0/db/d68/d6b/d71 0 2024-09-13T02:50:31.331 INFO:tasks.workunit.client.0.smithi100.stdout:6/382: mkdir d12/d14/d2f/d6c 0 2024-09-13T02:50:31.332 INFO:tasks.workunit.client.0.smithi100.stdout:6/383: read d12/d14/d2f/d45/f49 [424429,17400] 0 2024-09-13T02:50:31.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/436: mkdir d3/d5/d1b/d1c/d36/d65/d87 0 2024-09-13T02:50:31.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/437: chown d3/d5/d1b/d1c/d36/d65/l54 10149483 1 2024-09-13T02:50:31.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/438: stat d3/d5/d1b/c3d 0 2024-09-13T02:50:31.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/497: symlink d10/d21/d51/d5a/d5e/d71/d94/d9c/la9 0 2024-09-13T02:50:31.333 INFO:tasks.workunit.client.0.smithi100.stdout:3/498: dread - d10/d21/d51/d6c/f8c zero size 2024-09-13T02:50:31.333 INFO:tasks.workunit.client.0.smithi100.stdout:3/499: creat d10/d21/d57/faa x:0 0 0 2024-09-13T02:50:31.333 INFO:tasks.workunit.client.0.smithi100.stdout:2/398: symlink d0/db/d3f/d6a/l72 0 2024-09-13T02:50:31.345 INFO:tasks.workunit.client.0.smithi100.stdout:2/399: dread d0/db/d3f/f4b [0,4194304] 0 2024-09-13T02:50:31.346 INFO:tasks.workunit.client.0.smithi100.stdout:0/383: dwrite d2/dd/d54/d28/f65 [0,4194304] 0 2024-09-13T02:50:31.346 INFO:tasks.workunit.client.0.smithi100.stdout:7/439: dread d3/d5/d1b/d1c/f30 [0,4194304] 0 2024-09-13T02:50:31.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/400: mkdir d0/db/d68/d6b/d71/d73 0 2024-09-13T02:50:31.348 INFO:tasks.workunit.client.0.smithi100.stdout:7/440: rmdir d3/d16 39 2024-09-13T02:50:31.348 INFO:tasks.workunit.client.0.smithi100.stdout:7/441: write d3/d16/d55/d56/f61 [4611235,277] 0 2024-09-13T02:50:31.349 INFO:tasks.workunit.client.0.smithi100.stdout:2/401: mknod d0/db/d21/d69/c74 0 2024-09-13T02:50:31.350 INFO:tasks.workunit.client.0.smithi100.stdout:2/402: dread d0/db/f52 [0,4194304] 0 2024-09-13T02:50:31.351 INFO:tasks.workunit.client.0.smithi100.stdout:7/442: rename d3/d2d/l2e to d3/d5/d1b/d1c/d36/d65/l88 0 2024-09-13T02:50:31.351 INFO:tasks.workunit.client.0.smithi100.stdout:7/443: chown d3/d16/d55 183303570 1 2024-09-13T02:50:31.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/403: creat d0/d36/f75 x:0 0 0 2024-09-13T02:50:31.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/404: readlink d0/db/l48 0 2024-09-13T02:50:31.355 INFO:tasks.workunit.client.0.smithi100.stdout:7/444: unlink d3/d5/d1b/f67 0 2024-09-13T02:50:31.356 INFO:tasks.workunit.client.0.smithi100.stdout:4/443: dwrite f0 [4194304,4194304] 0 2024-09-13T02:50:31.356 INFO:tasks.workunit.client.0.smithi100.stdout:1/410: dwrite de/d14/d22/f4a [0,4194304] 0 2024-09-13T02:50:31.357 INFO:tasks.workunit.client.0.smithi100.stdout:2/405: creat d0/db/d68/d6b/f76 x:0 0 0 2024-09-13T02:50:31.357 INFO:tasks.workunit.client.0.smithi100.stdout:2/406: dread - d0/f3d zero size 2024-09-13T02:50:31.357 INFO:tasks.workunit.client.0.smithi100.stdout:2/407: readlink d0/l53 0 2024-09-13T02:50:31.357 INFO:tasks.workunit.client.0.smithi100.stdout:2/408: chown d0/db/d23/f35 3 1 2024-09-13T02:50:31.357 INFO:tasks.workunit.client.0.smithi100.stdout:7/445: mkdir d3/d16/d89 0 2024-09-13T02:50:31.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/446: write d3/fa [1753939,95545] 0 2024-09-13T02:50:31.358 INFO:tasks.workunit.client.0.smithi100.stdout:7/447: dread - d3/d5/d1b/f71 zero size 2024-09-13T02:50:31.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/409: rename d0/db/d5b/f5e to d0/db/d68/d6b/f77 0 2024-09-13T02:50:31.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/410: read d0/f38 [176743,38223] 0 2024-09-13T02:50:31.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/411: write d0/f4a [267010,91237] 0 2024-09-13T02:50:31.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/412: write d0/db/f2d [57856,52992] 0 2024-09-13T02:50:31.362 INFO:tasks.workunit.client.0.smithi100.stdout:2/413: read - d0/f3d zero size 2024-09-13T02:50:31.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/448: rmdir d3/d16 39 2024-09-13T02:50:31.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/449: write d3/d5/f53 [623489,125715] 0 2024-09-13T02:50:31.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/450: write d3/d16/d3b/f45 [355982,53156] 0 2024-09-13T02:50:31.363 INFO:tasks.workunit.client.0.smithi100.stdout:7/451: chown d3/d16/d3b/f5d 79669258 1 2024-09-13T02:50:31.365 INFO:tasks.workunit.client.0.smithi100.stdout:7/452: rename d3/d5/d1b/c72 to d3/d2d/c8a 0 2024-09-13T02:50:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:5/474: dwrite db/de/d1f/d2b/f34 [0,4194304] 0 2024-09-13T02:50:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:6/384: dwrite d12/d14/d2f/f33 [0,4194304] 0 2024-09-13T02:50:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:6/385: chown d12/d43/d4b/d4c/d36 28408 1 2024-09-13T02:50:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:5/475: creat db/de/d1f/fa8 x:0 0 0 2024-09-13T02:50:31.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/398: dwrite df/d5d/f69 [0,4194304] 0 2024-09-13T02:50:31.376 INFO:tasks.workunit.client.0.smithi100.stdout:2/414: write d0/db/d21/f22 [2696501,23147] 0 2024-09-13T02:50:31.378 INFO:tasks.workunit.client.0.smithi100.stdout:3/500: dwrite d10/d21/d51/f59 [0,4194304] 0 2024-09-13T02:50:31.378 INFO:tasks.workunit.client.0.smithi100.stdout:0/384: dwrite d2/dd/d54/d47/d34/d3c/f71 [0,4194304] 0 2024-09-13T02:50:31.378 INFO:tasks.workunit.client.0.smithi100.stdout:0/385: write d2/dd/d54/d28/f6a [4597377,128524] 0 2024-09-13T02:50:31.379 INFO:tasks.workunit.client.0.smithi100.stdout:5/476: dread db/de/f52 [0,4194304] 0 2024-09-13T02:50:31.379 INFO:tasks.workunit.client.0.smithi100.stdout:6/386: creat d12/d14/d2f/d6c/f6d x:0 0 0 2024-09-13T02:50:31.382 INFO:tasks.workunit.client.0.smithi100.stdout:8/399: mkdir df/d13/d20/d98 0 2024-09-13T02:50:31.382 INFO:tasks.workunit.client.0.smithi100.stdout:8/400: fsync df/f64 0 2024-09-13T02:50:31.384 INFO:tasks.workunit.client.0.smithi100.stdout:2/415: rename d0/d36/l5d to d0/db/d68/l78 0 2024-09-13T02:50:31.387 INFO:tasks.workunit.client.0.smithi100.stdout:1/411: dwrite de/d14/d2e/f4e [0,4194304] 0 2024-09-13T02:50:31.388 INFO:tasks.workunit.client.0.smithi100.stdout:4/444: dwrite d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:31.397 INFO:tasks.workunit.client.0.smithi100.stdout:6/387: dwrite d12/d14/d1c/f30 [0,4194304] 0 2024-09-13T02:50:31.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/501: mknod d10/d21/d51/d5a/cab 0 2024-09-13T02:50:31.399 INFO:tasks.workunit.client.0.smithi100.stdout:6/388: dread d12/d14/d1c/f44 [0,4194304] 0 2024-09-13T02:50:31.399 INFO:tasks.workunit.client.0.smithi100.stdout:6/389: getdents d12/d43/d6a 0 2024-09-13T02:50:31.400 INFO:tasks.workunit.client.0.smithi100.stdout:0/386: unlink d2/l4 0 2024-09-13T02:50:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:0/387: fdatasync d2/dd/d54/d28/f4a 0 2024-09-13T02:50:31.401 INFO:tasks.workunit.client.0.smithi100.stdout:0/388: truncate d2/dd/d33/f7c 864033 0 2024-09-13T02:50:31.402 INFO:tasks.workunit.client.0.smithi100.stdout:8/401: mknod df/d13/d20/d98/c99 0 2024-09-13T02:50:31.402 INFO:tasks.workunit.client.0.smithi100.stdout:8/402: stat df/d86 0 2024-09-13T02:50:31.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/416: mkdir d0/db/d79 0 2024-09-13T02:50:31.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/417: fsync d0/db/f52 0 2024-09-13T02:50:31.403 INFO:tasks.workunit.client.0.smithi100.stdout:2/418: creat d0/db/d5b/f7a x:0 0 0 2024-09-13T02:50:31.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/412: creat de/d14/d44/d7f/f8b x:0 0 0 2024-09-13T02:50:31.408 INFO:tasks.workunit.client.0.smithi100.stdout:4/445: mknod d3/d6/d2f/d7a/c94 0 2024-09-13T02:50:31.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/502: link d10/d21/d51/d6c/f6f d10/d21/d51/d5a/d5e/d71/d94/fac 0 2024-09-13T02:50:31.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/503: fdatasync d10/d21/f67 0 2024-09-13T02:50:31.412 INFO:tasks.workunit.client.0.smithi100.stdout:0/389: dread d2/dd/d33/f18 [4194304,4194304] 0 2024-09-13T02:50:31.413 INFO:tasks.workunit.client.0.smithi100.stdout:6/390: unlink d12/d14/f2d 0 2024-09-13T02:50:31.413 INFO:tasks.workunit.client.0.smithi100.stdout:6/391: chown d12/d14/d5a 5663367 1 2024-09-13T02:50:31.414 INFO:tasks.workunit.client.0.smithi100.stdout:8/403: unlink df/d13/f16 0 2024-09-13T02:50:31.414 INFO:tasks.workunit.client.0.smithi100.stdout:8/404: creat df/d13/d20/f9a x:0 0 0 2024-09-13T02:50:31.416 INFO:tasks.workunit.client.0.smithi100.stdout:2/419: link d0/db/l51 d0/db/d23/d39/l7b 0 2024-09-13T02:50:31.417 INFO:tasks.workunit.client.0.smithi100.stdout:3/504: creat d10/d21/d51/d5a/d73/fad x:0 0 0 2024-09-13T02:50:31.417 INFO:tasks.workunit.client.0.smithi100.stdout:3/505: chown d10/d21/d51/c9e 2 1 2024-09-13T02:50:31.417 INFO:tasks.workunit.client.0.smithi100.stdout:3/506: write d10/f54 [399632,35108] 0 2024-09-13T02:50:31.418 INFO:tasks.workunit.client.0.smithi100.stdout:1/413: write de/d12/f30 [1929521,13782] 0 2024-09-13T02:50:31.418 INFO:tasks.workunit.client.0.smithi100.stdout:1/414: readlink l3 0 2024-09-13T02:50:31.418 INFO:tasks.workunit.client.0.smithi100.stdout:1/415: readlink de/d14/d2e/d75/l85 0 2024-09-13T02:50:31.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/392: mkdir d12/d14/d1c/d6e 0 2024-09-13T02:50:31.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/393: write d12/d14/d2f/d45/f48 [1408702,112201] 0 2024-09-13T02:50:31.419 INFO:tasks.workunit.client.0.smithi100.stdout:8/405: mknod df/d13/d21/c9b 0 2024-09-13T02:50:31.419 INFO:tasks.workunit.client.0.smithi100.stdout:8/406: write fc [2541592,22820] 0 2024-09-13T02:50:31.421 INFO:tasks.workunit.client.0.smithi100.stdout:2/420: rmdir d0/db/d68 39 2024-09-13T02:50:31.425 INFO:tasks.workunit.client.0.smithi100.stdout:6/394: mknod d12/d43/c6f 0 2024-09-13T02:50:31.425 INFO:tasks.workunit.client.0.smithi100.stdout:3/507: dread d10/f40 [0,4194304] 0 2024-09-13T02:50:31.427 INFO:tasks.workunit.client.0.smithi100.stdout:2/421: creat d0/db/d68/d6b/d71/d73/f7c x:0 0 0 2024-09-13T02:50:31.427 INFO:tasks.workunit.client.0.smithi100.stdout:2/422: write d0/f1 [3308530,894] 0 2024-09-13T02:50:31.430 INFO:tasks.workunit.client.0.smithi100.stdout:3/508: creat d10/d21/d51/d5a/d5e/d71/fae x:0 0 0 2024-09-13T02:50:31.432 INFO:tasks.workunit.client.0.smithi100.stdout:2/423: mknod d0/c7d 0 2024-09-13T02:50:31.433 INFO:tasks.workunit.client.0.smithi100.stdout:4/446: dwrite d3/d6/d2f/f33 [0,4194304] 0 2024-09-13T02:50:31.433 INFO:tasks.workunit.client.0.smithi100.stdout:3/509: fdatasync d10/f79 0 2024-09-13T02:50:31.435 INFO:tasks.workunit.client.0.smithi100.stdout:6/395: rmdir d12/d43/d6a 0 2024-09-13T02:50:31.436 INFO:tasks.workunit.client.0.smithi100.stdout:6/396: chown d12/d43/d4b/d4c/f5b 112 1 2024-09-13T02:50:31.436 INFO:tasks.workunit.client.0.smithi100.stdout:6/397: read d12/d14/d1c/f3a [2210216,113873] 0 2024-09-13T02:50:31.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/390: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:31.440 INFO:tasks.workunit.client.0.smithi100.stdout:4/447: rename d3/dc/d4b/d7c/f70 to d3/d6/d21/d46/d2d/f95 0 2024-09-13T02:50:31.441 INFO:tasks.workunit.client.0.smithi100.stdout:3/510: truncate d10/d21/d51/f59 3593545 0 2024-09-13T02:50:31.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/398: getdents d12/d14/d5a 0 2024-09-13T02:50:31.442 INFO:tasks.workunit.client.0.smithi100.stdout:6/399: write d12/d14/d2f/d45/f49 [1550977,92963] 0 2024-09-13T02:50:31.445 INFO:tasks.workunit.client.0.smithi100.stdout:4/448: mkdir d3/d6/d21/d46/d34/d96 0 2024-09-13T02:50:31.445 INFO:tasks.workunit.client.0.smithi100.stdout:3/511: dread d10/f2a [0,4194304] 0 2024-09-13T02:50:31.446 INFO:tasks.workunit.client.0.smithi100.stdout:0/391: rmdir d2/dd/d54/d47 39 2024-09-13T02:50:31.448 INFO:tasks.workunit.client.0.smithi100.stdout:3/512: link d10/d21/d51/d5a/d5e/d71/fae d10/d21/d51/d5a/faf 0 2024-09-13T02:50:31.449 INFO:tasks.workunit.client.0.smithi100.stdout:0/392: creat d2/dd/d54/d47/d34/d3c/f89 x:0 0 0 2024-09-13T02:50:31.449 INFO:tasks.workunit.client.0.smithi100.stdout:3/513: rmdir d10/d21/d51/d5a 39 2024-09-13T02:50:31.452 INFO:tasks.workunit.client.0.smithi100.stdout:0/393: unlink d2/dd/l30 0 2024-09-13T02:50:31.454 INFO:tasks.workunit.client.0.smithi100.stdout:0/394: mkdir d2/dd/d54/d47/d8a 0 2024-09-13T02:50:31.456 INFO:tasks.workunit.client.0.smithi100.stdout:0/395: symlink d2/dd/d54/d47/d34/l8b 0 2024-09-13T02:50:31.457 INFO:tasks.workunit.client.0.smithi100.stdout:0/396: mknod d2/d9/c8c 0 2024-09-13T02:50:31.458 INFO:tasks.workunit.client.0.smithi100.stdout:0/397: dread - d2/dd/d33/d3b/f67 zero size 2024-09-13T02:50:31.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/407: dwrite f3 [0,4194304] 0 2024-09-13T02:50:31.458 INFO:tasks.workunit.client.0.smithi100.stdout:8/408: getdents df/d5d 0 2024-09-13T02:50:31.461 INFO:tasks.workunit.client.0.smithi100.stdout:1/416: dwrite de/d12/f59 [0,4194304] 0 2024-09-13T02:50:31.462 INFO:tasks.workunit.client.0.smithi100.stdout:2/424: dwrite d0/f64 [0,4194304] 0 2024-09-13T02:50:31.464 INFO:tasks.workunit.client.0.smithi100.stdout:6/400: dread d12/d14/d2f/f33 [0,4194304] 0 2024-09-13T02:50:31.464 INFO:tasks.workunit.client.0.smithi100.stdout:9/333: sync 2024-09-13T02:50:31.465 INFO:tasks.workunit.client.0.smithi100.stdout:1/417: chown de/d12/l1d 377663 1 2024-09-13T02:50:31.465 INFO:tasks.workunit.client.0.smithi100.stdout:6/401: read d12/d43/d4b/d4c/d36/f63 [253823,95559] 0 2024-09-13T02:50:31.465 INFO:tasks.workunit.client.0.smithi100.stdout:6/402: creat d12/d14/d2f/d6c/f70 x:0 0 0 2024-09-13T02:50:31.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/409: rename df/d13/c54 to df/d13/d68/c9c 0 2024-09-13T02:50:31.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/410: chown df/l2f 6 1 2024-09-13T02:50:31.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/411: truncate df/d5d/d70/d2c/d38/f5b 761868 0 2024-09-13T02:50:31.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/412: creat df/d13/d68/f9d x:0 0 0 2024-09-13T02:50:31.468 INFO:tasks.workunit.client.0.smithi100.stdout:4/449: dwrite d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:31.468 INFO:tasks.workunit.client.0.smithi100.stdout:3/514: dwrite d10/d21/f42 [0,4194304] 0 2024-09-13T02:50:31.471 INFO:tasks.workunit.client.0.smithi100.stdout:9/334: creat dd/d1b/d24/f67 x:0 0 0 2024-09-13T02:50:31.477 INFO:tasks.workunit.client.0.smithi100.stdout:6/403: mkdir d12/d14/d1c/d6e/d71 0 2024-09-13T02:50:31.477 INFO:tasks.workunit.client.0.smithi100.stdout:2/425: rename d0/db/d5b/f5c to d0/db/d68/d6b/d71/d73/f7e 0 2024-09-13T02:50:31.477 INFO:tasks.workunit.client.0.smithi100.stdout:2/426: chown d0/db/d21/d57/f61 37956 1 2024-09-13T02:50:31.477 INFO:tasks.workunit.client.0.smithi100.stdout:6/404: dread d12/d14/d1c/f44 [0,4194304] 0 2024-09-13T02:50:31.479 INFO:tasks.workunit.client.0.smithi100.stdout:4/450: symlink d3/d3a/l97 0 2024-09-13T02:50:31.479 INFO:tasks.workunit.client.0.smithi100.stdout:4/451: stat d3/d6/d9/l68 0 2024-09-13T02:50:31.481 INFO:tasks.workunit.client.0.smithi100.stdout:3/515: rmdir d10/d21/d51/d5a 39 2024-09-13T02:50:31.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/418: rmdir de/d14 39 2024-09-13T02:50:31.489 INFO:tasks.workunit.client.0.smithi100.stdout:1/419: write de/d14/d39/f6c [798955,127919] 0 2024-09-13T02:50:31.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/427: mkdir d0/db/d3f/d6a/d7f 0 2024-09-13T02:50:31.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/428: truncate d0/db/d68/d6b/f77 763405 0 2024-09-13T02:50:31.490 INFO:tasks.workunit.client.0.smithi100.stdout:2/429: truncate d0/db/d23/f3a 969946 0 2024-09-13T02:50:31.491 INFO:tasks.workunit.client.0.smithi100.stdout:4/452: symlink d3/dc/d88/l98 0 2024-09-13T02:50:31.492 INFO:tasks.workunit.client.0.smithi100.stdout:3/516: creat d10/d21/d51/d5a/d5e/d71/d94/fb0 x:0 0 0 2024-09-13T02:50:31.494 INFO:tasks.workunit.client.0.smithi100.stdout:1/420: creat de/d14/d22/d29/d64/f8c x:0 0 0 2024-09-13T02:50:31.496 INFO:tasks.workunit.client.0.smithi100.stdout:4/453: mkdir d3/d6/d21/d46/d34/d96/d99 0 2024-09-13T02:50:31.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/421: creat de/d14/d22/d29/f8d x:0 0 0 2024-09-13T02:50:31.498 INFO:tasks.workunit.client.0.smithi100.stdout:1/422: symlink de/d14/d39/l8e 0 2024-09-13T02:50:31.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/413: dwrite df/d13/f59 [0,4194304] 0 2024-09-13T02:50:31.499 INFO:tasks.workunit.client.0.smithi100.stdout:8/414: truncate df/d13/d21/d81/f82 230516 0 2024-09-13T02:50:31.503 INFO:tasks.workunit.client.0.smithi100.stdout:2/430: dread d0/db/d21/f47 [0,4194304] 0 2024-09-13T02:50:31.503 INFO:tasks.workunit.client.0.smithi100.stdout:2/431: chown d0/db/d21/d57/f61 1905 1 2024-09-13T02:50:31.504 INFO:tasks.workunit.client.0.smithi100.stdout:2/432: creat d0/db/f80 x:0 0 0 2024-09-13T02:50:31.507 INFO:tasks.workunit.client.0.smithi100.stdout:2/433: getdents d0/d36 0 2024-09-13T02:50:31.508 INFO:tasks.workunit.client.0.smithi100.stdout:4/454: read d3/dc/d4b/d52/f59 [135808,104478] 0 2024-09-13T02:50:31.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/434: unlink d0/db/d68/d6b/l62 0 2024-09-13T02:50:31.509 INFO:tasks.workunit.client.0.smithi100.stdout:2/435: truncate d0/db/d21/f54 1024494 0 2024-09-13T02:50:31.513 INFO:tasks.workunit.client.0.smithi100.stdout:4/455: mknod d3/d63/c9a 0 2024-09-13T02:50:31.515 INFO:tasks.workunit.client.0.smithi100.stdout:4/456: mkdir d3/dc/d4b/d9b 0 2024-09-13T02:50:31.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/405: dwrite d12/d14/d1c/f3a [8388608,4194304] 0 2024-09-13T02:50:31.526 INFO:tasks.workunit.client.0.smithi100.stdout:8/415: dwrite df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:31.527 INFO:tasks.workunit.client.0.smithi100.stdout:3/517: dwrite d10/d21/d57/f5b [0,4194304] 0 2024-09-13T02:50:31.527 INFO:tasks.workunit.client.0.smithi100.stdout:3/518: chown d10/d21/f56 32 1 2024-09-13T02:50:31.530 INFO:tasks.workunit.client.0.smithi100.stdout:1/423: dwrite de/d14/d2e/f27 [0,4194304] 0 2024-09-13T02:50:31.533 INFO:tasks.workunit.client.0.smithi100.stdout:6/406: dread d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:31.533 INFO:tasks.workunit.client.0.smithi100.stdout:6/407: fdatasync d12/d14/f57 0 2024-09-13T02:50:31.541 INFO:tasks.workunit.client.0.smithi100.stdout:2/436: dwrite d0/db/d68/d6b/f76 [0,4194304] 0 2024-09-13T02:50:31.541 INFO:tasks.workunit.client.0.smithi100.stdout:2/437: chown d0/d36/f4f 146483 1 2024-09-13T02:50:31.541 INFO:tasks.workunit.client.0.smithi100.stdout:4/457: dwrite d3/d6/d21/d46/d2d/d58/f84 [4194304,4194304] 0 2024-09-13T02:50:31.541 INFO:tasks.workunit.client.0.smithi100.stdout:4/458: creat d3/d6/d2f/f9c x:0 0 0 2024-09-13T02:50:31.542 INFO:tasks.workunit.client.0.smithi100.stdout:1/424: creat de/d12/f8f x:0 0 0 2024-09-13T02:50:31.542 INFO:tasks.workunit.client.0.smithi100.stdout:1/425: write de/d14/d22/d29/d64/f8c [932432,38915] 0 2024-09-13T02:50:31.542 INFO:tasks.workunit.client.0.smithi100.stdout:1/426: readlink de/d14/d44/l4d 0 2024-09-13T02:50:31.542 INFO:tasks.workunit.client.0.smithi100.stdout:1/427: fsync de/d14/d22/d52/d65/f6f 0 2024-09-13T02:50:31.543 INFO:tasks.workunit.client.0.smithi100.stdout:2/438: dread d0/db/d21/f25 [0,4194304] 0 2024-09-13T02:50:31.543 INFO:tasks.workunit.client.0.smithi100.stdout:6/408: mknod d12/d14/d2f/c72 0 2024-09-13T02:50:31.548 INFO:tasks.workunit.client.0.smithi100.stdout:1/428: rename de/f6b to de/d14/d44/d61/f90 0 2024-09-13T02:50:31.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/439: mkdir d0/db/d21/d57/d81 0 2024-09-13T02:50:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/440: dread d0/db/f52 [0,4194304] 0 2024-09-13T02:50:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/441: fdatasync d0/f2c 0 2024-09-13T02:50:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/442: dread - d0/db/d21/d57/f61 zero size 2024-09-13T02:50:31.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/409: mkdir d12/d14/d2f/d45/d73 0 2024-09-13T02:50:31.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/443: write d0/f19 [1853811,39177] 0 2024-09-13T02:50:31.554 INFO:tasks.workunit.client.0.smithi100.stdout:1/429: rename de/d14/d22/d52/d65/f74 to de/d14/d44/d61/f91 0 2024-09-13T02:50:31.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/410: creat d12/d43/d4b/f74 x:0 0 0 2024-09-13T02:50:31.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/411: creat d12/d14/f75 x:0 0 0 2024-09-13T02:50:31.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/412: creat d12/d14/d21/f76 x:0 0 0 2024-09-13T02:50:31.556 INFO:tasks.workunit.client.0.smithi100.stdout:6/413: creat d12/d14/d1c/f77 x:0 0 0 2024-09-13T02:50:31.556 INFO:tasks.workunit.client.0.smithi100.stdout:1/430: symlink de/d14/d22/d52/d5c/l92 0 2024-09-13T02:50:31.558 INFO:tasks.workunit.client.0.smithi100.stdout:4/459: dwrite d3/d6/d2f/f33 [0,4194304] 0 2024-09-13T02:50:31.558 INFO:tasks.workunit.client.0.smithi100.stdout:4/460: dread - d3/dc/d4b/f91 zero size 2024-09-13T02:50:31.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/414: rmdir d12/d43 39 2024-09-13T02:50:31.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/415: write d12/f27 [4962879,110644] 0 2024-09-13T02:50:31.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/416: creat d12/d14/d1c/d28/f78 x:0 0 0 2024-09-13T02:50:31.561 INFO:tasks.workunit.client.0.smithi100.stdout:6/417: fdatasync d12/d43/d4b/d4c/f5b 0 2024-09-13T02:50:31.562 INFO:tasks.workunit.client.0.smithi100.stdout:1/431: link de/d14/d44/f47 de/d14/d2e/d60/f93 0 2024-09-13T02:50:31.563 INFO:tasks.workunit.client.0.smithi100.stdout:5/477: sync 2024-09-13T02:50:31.563 INFO:tasks.workunit.client.0.smithi100.stdout:7/453: sync 2024-09-13T02:50:31.563 INFO:tasks.workunit.client.0.smithi100.stdout:4/461: write d3/d6/f10 [4670783,75834] 0 2024-09-13T02:50:31.566 INFO:tasks.workunit.client.0.smithi100.stdout:6/418: creat d12/d14/d1c/d6e/f79 x:0 0 0 2024-09-13T02:50:31.568 INFO:tasks.workunit.client.0.smithi100.stdout:7/454: truncate d3/f15 3600171 0 2024-09-13T02:50:31.568 INFO:tasks.workunit.client.0.smithi100.stdout:7/455: fsync d3/d2d/f52 0 2024-09-13T02:50:31.569 INFO:tasks.workunit.client.0.smithi100.stdout:5/478: rename db/de/d3e/f60 to db/de/d3e/d7e/d81/d85/fa9 0 2024-09-13T02:50:31.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/456: rmdir d3 39 2024-09-13T02:50:31.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/479: unlink db/l6c 0 2024-09-13T02:50:31.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/480: rename db/de/d1f to db/de/d1f/da5/daa 22 2024-09-13T02:50:31.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/481: creat db/de/d3e/fab x:0 0 0 2024-09-13T02:50:31.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/482: dread - db/f83 zero size 2024-09-13T02:50:31.572 INFO:tasks.workunit.client.0.smithi100.stdout:7/457: mknod d3/d5/d1b/d1c/d36/d65/d87/c8b 0 2024-09-13T02:50:31.572 INFO:tasks.workunit.client.0.smithi100.stdout:7/458: chown d3/d2d/f52 39 1 2024-09-13T02:50:31.572 INFO:tasks.workunit.client.0.smithi100.stdout:7/459: chown d3/d2d/f74 237848 1 2024-09-13T02:50:31.572 INFO:tasks.workunit.client.0.smithi100.stdout:7/460: readlink d3/d5/d1b/l6b 0 2024-09-13T02:50:31.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/461: stat d3/d2d/c8a 0 2024-09-13T02:50:31.573 INFO:tasks.workunit.client.0.smithi100.stdout:7/462: unlink d3/c7b 0 2024-09-13T02:50:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/463: readlink d3/d5/d1b/l6b 0 2024-09-13T02:50:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:7/464: chown d3/d16/c19 1 1 2024-09-13T02:50:31.574 INFO:tasks.workunit.client.0.smithi100.stdout:4/462: dread d3/d63/f6a [0,4194304] 0 2024-09-13T02:50:31.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/465: mkdir d3/d16/d3b/d8c 0 2024-09-13T02:50:31.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/466: creat d3/d5/f8d x:0 0 0 2024-09-13T02:50:31.575 INFO:tasks.workunit.client.0.smithi100.stdout:7/467: fdatasync d3/d5/d1b/d1c/f39 0 2024-09-13T02:50:31.576 INFO:tasks.workunit.client.0.smithi100.stdout:5/483: read db/de/d1f/d2b/d9b/fa1 [3916383,122469] 0 2024-09-13T02:50:31.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/444: dwrite d0/db/d21/f25 [0,4194304] 0 2024-09-13T02:50:31.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/445: truncate d0/db/d21/d57/f59 647648 0 2024-09-13T02:50:31.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/446: chown d0/db/d21/d57/f59 478 1 2024-09-13T02:50:31.576 INFO:tasks.workunit.client.0.smithi100.stdout:2/447: chown d0/f38 211725 1 2024-09-13T02:50:31.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/468: rename d3/d5/f27 to d3/d16/d55/f8e 0 2024-09-13T02:50:31.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/469: write d3/d16/d3b/f6f [197924,1802] 0 2024-09-13T02:50:31.581 INFO:tasks.workunit.client.0.smithi100.stdout:1/432: write de/d14/d2e/d60/f93 [1355138,29146] 0 2024-09-13T02:50:31.582 INFO:tasks.workunit.client.0.smithi100.stdout:5/484: mkdir db/de/d3e/da2/dac 0 2024-09-13T02:50:31.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/448: unlink d0/db/f2d 0 2024-09-13T02:50:31.583 INFO:tasks.workunit.client.0.smithi100.stdout:2/449: fdatasync d0/db/d68/d6b/d71/d73/f7e 0 2024-09-13T02:50:31.583 INFO:tasks.workunit.client.0.smithi100.stdout:6/419: read d12/d14/d1c/f3a [7257564,101176] 0 2024-09-13T02:50:31.583 INFO:tasks.workunit.client.0.smithi100.stdout:7/470: rmdir d3/d16 39 2024-09-13T02:50:31.583 INFO:tasks.workunit.client.0.smithi100.stdout:7/471: readlink d3/d16/d3b/l64 0 2024-09-13T02:50:31.586 INFO:tasks.workunit.client.0.smithi100.stdout:7/472: write d3/d16/d3b/f6f [71529,9103] 0 2024-09-13T02:50:31.588 INFO:tasks.workunit.client.0.smithi100.stdout:4/463: dread d3/d6/d21/d46/f5e [0,4194304] 0 2024-09-13T02:50:31.589 INFO:tasks.workunit.client.0.smithi100.stdout:1/433: fdatasync de/d12/f2a 0 2024-09-13T02:50:31.593 INFO:tasks.workunit.client.0.smithi100.stdout:6/420: unlink d12/d14/d1c/d28/c3d 0 2024-09-13T02:50:31.593 INFO:tasks.workunit.client.0.smithi100.stdout:7/473: mknod d3/d5/d1b/d1c/c8f 0 2024-09-13T02:50:31.595 INFO:tasks.workunit.client.0.smithi100.stdout:7/474: creat d3/d5/d4f/f90 x:0 0 0 2024-09-13T02:50:31.595 INFO:tasks.workunit.client.0.smithi100.stdout:7/475: chown d3/d16/c19 445039 1 2024-09-13T02:50:31.597 INFO:tasks.workunit.client.0.smithi100.stdout:4/464: mkdir d3/dc/d9d 0 2024-09-13T02:50:31.597 INFO:tasks.workunit.client.0.smithi100.stdout:4/465: readlink d3/d6/l2c 0 2024-09-13T02:50:31.602 INFO:tasks.workunit.client.0.smithi100.stdout:6/421: rename d12/d14/d1c/d28/c52 to d12/d43/d4b/c7a 0 2024-09-13T02:50:31.603 INFO:tasks.workunit.client.0.smithi100.stdout:4/466: truncate d3/d6/d21/d46/f5e 65841 0 2024-09-13T02:50:31.604 INFO:tasks.workunit.client.0.smithi100.stdout:6/422: mkdir d12/d14/d1c/d7b 0 2024-09-13T02:50:31.604 INFO:tasks.workunit.client.0.smithi100.stdout:6/423: creat d12/d14/d2f/d6c/f7c x:0 0 0 2024-09-13T02:50:31.608 INFO:tasks.workunit.client.0.smithi100.stdout:6/424: rename d12/l47 to d12/d2e/l7d 0 2024-09-13T02:50:31.613 INFO:tasks.workunit.client.0.smithi100.stdout:2/450: dwrite d0/db/d68/d6b/f77 [0,4194304] 0 2024-09-13T02:50:31.614 INFO:tasks.workunit.client.0.smithi100.stdout:1/434: dwrite de/d14/d2e/f4e [0,4194304] 0 2024-09-13T02:50:31.617 INFO:tasks.workunit.client.0.smithi100.stdout:1/435: dread de/d12/f33 [0,4194304] 0 2024-09-13T02:50:31.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/436: symlink de/d14/d22/d29/d68/l94 0 2024-09-13T02:50:31.619 INFO:tasks.workunit.client.0.smithi100.stdout:1/437: mknod de/d14/d22/d52/d7a/c95 0 2024-09-13T02:50:31.619 INFO:tasks.workunit.client.0.smithi100.stdout:9/335: sync 2024-09-13T02:50:31.619 INFO:tasks.workunit.client.0.smithi100.stdout:0/398: sync 2024-09-13T02:50:31.619 INFO:tasks.workunit.client.0.smithi100.stdout:0/399: chown d2/dd/d54/d47/d34/d3c/f89 1649240 1 2024-09-13T02:50:31.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/400: symlink d2/d9/l8d 0 2024-09-13T02:50:31.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/401: rename d2/dd/d54/d3e/l74 to d2/dd/d54/d68/l8e 0 2024-09-13T02:50:31.623 INFO:tasks.workunit.client.0.smithi100.stdout:9/336: write dd/f19 [459894,50053] 0 2024-09-13T02:50:31.623 INFO:tasks.workunit.client.0.smithi100.stdout:9/337: write dd/d1b/d1d/d43/d5d/f64 [426538,23765] 0 2024-09-13T02:50:31.623 INFO:tasks.workunit.client.0.smithi100.stdout:0/402: link d2/dd/d54/d47/f77 d2/dd/d54/d47/d34/d3c/f8f 0 2024-09-13T02:50:31.624 INFO:tasks.workunit.client.0.smithi100.stdout:0/403: chown d2/dd/d54/d47/d34/d3c/f89 14683703 1 2024-09-13T02:50:31.626 INFO:tasks.workunit.client.0.smithi100.stdout:9/338: creat dd/d1b/d1d/d36/d4e/d58/f68 x:0 0 0 2024-09-13T02:50:31.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/404: fsync d2/d1a/f88 0 2024-09-13T02:50:31.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/405: write d2/d1a/f88 [246487,120991] 0 2024-09-13T02:50:31.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/406: truncate d2/dd/d54/d47/d34/d3c/f89 428397 0 2024-09-13T02:50:31.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/425: getdents d12/d14/d1c/d28 0 2024-09-13T02:50:31.627 INFO:tasks.workunit.client.0.smithi100.stdout:6/426: fsync d12/d14/d1c/d28/f78 0 2024-09-13T02:50:31.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/438: write de/d14/d2e/f27 [1555331,25339] 0 2024-09-13T02:50:31.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/407: creat d2/dd/d54/d47/d8a/f90 x:0 0 0 2024-09-13T02:50:31.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/476: dread d3/f15 [0,4194304] 0 2024-09-13T02:50:31.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/477: chown d3/d2d/f74 334 1 2024-09-13T02:50:31.631 INFO:tasks.workunit.client.0.smithi100.stdout:4/467: dwrite d3/d6/d21/d46/f39 [0,4194304] 0 2024-09-13T02:50:31.632 INFO:tasks.workunit.client.0.smithi100.stdout:6/427: rmdir d12/d43/d59 0 2024-09-13T02:50:31.633 INFO:tasks.workunit.client.0.smithi100.stdout:6/428: write d12/d14/d1c/f77 [86787,61501] 0 2024-09-13T02:50:31.634 INFO:tasks.workunit.client.0.smithi100.stdout:2/451: dread d0/db/f2e [0,4194304] 0 2024-09-13T02:50:31.635 INFO:tasks.workunit.client.0.smithi100.stdout:1/439: unlink de/d14/d2e/d48/c79 0 2024-09-13T02:50:31.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/440: write de/f7d [290990,123911] 0 2024-09-13T02:50:31.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/441: truncate de/d14/d44/d61/f90 316875 0 2024-09-13T02:50:31.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/442: stat de/d14/d22/d52/d5c/l92 0 2024-09-13T02:50:31.636 INFO:tasks.workunit.client.0.smithi100.stdout:7/478: mknod d3/d5/c91 0 2024-09-13T02:50:31.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/479: write d3/d16/d55/f8e [916721,90836] 0 2024-09-13T02:50:31.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/468: mkdir d3/d6/d9/d9e 0 2024-09-13T02:50:31.642 INFO:tasks.workunit.client.0.smithi100.stdout:6/429: mknod d12/d14/d1c/d7b/c7e 0 2024-09-13T02:50:31.643 INFO:tasks.workunit.client.0.smithi100.stdout:1/443: creat de/d14/d44/d7f/f96 x:0 0 0 2024-09-13T02:50:31.645 INFO:tasks.workunit.client.0.smithi100.stdout:7/480: mkdir d3/d16/d55/d92 0 2024-09-13T02:50:31.645 INFO:tasks.workunit.client.0.smithi100.stdout:7/481: chown d3/d5/d1b/d1c/d36/d65 11407993 1 2024-09-13T02:50:31.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/469: symlink d3/d6/d21/d46/l9f 0 2024-09-13T02:50:31.646 INFO:tasks.workunit.client.0.smithi100.stdout:4/470: chown d3/d6/d2f/d60/f93 6194454 1 2024-09-13T02:50:31.648 INFO:tasks.workunit.client.0.smithi100.stdout:6/430: symlink d12/d14/d21/l7f 0 2024-09-13T02:50:31.648 INFO:tasks.workunit.client.0.smithi100.stdout:6/431: read d12/d14/d2f/d45/f48 [2183535,83451] 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:9/339: dread dd/d1b/d1d/f1f [0,4194304] 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:4/471: creat d3/d63/fa0 x:0 0 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:6/432: read d12/d14/d2f/d45/f51 [500326,123162] 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:0/408: dread d2/dd/d54/d28/f4a [0,4194304] 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:9/340: mknod dd/d1b/d1d/d43/c69 0 2024-09-13T02:50:31.650 INFO:tasks.workunit.client.0.smithi100.stdout:7/482: dread d3/d16/d3b/f6a [0,4194304] 0 2024-09-13T02:50:31.651 INFO:tasks.workunit.client.0.smithi100.stdout:4/472: creat d3/d6/d2f/d7a/fa1 x:0 0 0 2024-09-13T02:50:31.653 INFO:tasks.workunit.client.0.smithi100.stdout:6/433: creat d12/d14/d2f/d45/d73/f80 x:0 0 0 2024-09-13T02:50:31.656 INFO:tasks.workunit.client.0.smithi100.stdout:0/409: mkdir d2/dd/d54/d47/d34/d91 0 2024-09-13T02:50:31.656 INFO:tasks.workunit.client.0.smithi100.stdout:0/410: chown d2/dd/d54/d3e/d5d/f62 57 1 2024-09-13T02:50:31.657 INFO:tasks.workunit.client.0.smithi100.stdout:7/483: symlink d3/d5/d1b/d1c/d36/d65/d87/l93 0 2024-09-13T02:50:31.659 INFO:tasks.workunit.client.0.smithi100.stdout:4/473: link d3/d6/f38 d3/d6/d2f/d60/fa2 0 2024-09-13T02:50:31.659 INFO:tasks.workunit.client.0.smithi100.stdout:4/474: dread - d3/d6/d9/f3c zero size 2024-09-13T02:50:31.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/434: link d12/d14/d1c/f44 d12/d14/d2f/d45/d73/f81 0 2024-09-13T02:50:31.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/435: readlink l11 0 2024-09-13T02:50:31.663 INFO:tasks.workunit.client.0.smithi100.stdout:2/452: dwrite d0/db/f26 [4194304,4194304] 0 2024-09-13T02:50:31.663 INFO:tasks.workunit.client.0.smithi100.stdout:2/453: write d0/db/d5b/f7a [510332,43972] 0 2024-09-13T02:50:31.666 INFO:tasks.workunit.client.0.smithi100.stdout:1/444: dwrite f1 [8388608,4194304] 0 2024-09-13T02:50:31.675 INFO:tasks.workunit.client.0.smithi100.stdout:1/445: chown de/d12/l13 17 1 2024-09-13T02:50:31.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/436: rmdir d12/d14/d2f/d6c 39 2024-09-13T02:50:31.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/437: write d12/d14/d1c/f30 [4863495,39867] 0 2024-09-13T02:50:31.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/446: write de/f4f [280067,37799] 0 2024-09-13T02:50:31.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/447: symlink de/d14/d22/d29/d64/l97 0 2024-09-13T02:50:31.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/448: fdatasync de/d14/d2e/d48/f50 0 2024-09-13T02:50:31.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/449: fdatasync de/d12/f2a 0 2024-09-13T02:50:31.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/450: write de/d14/d22/d29/d64/f5e [521682,28912] 0 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/451: symlink de/d14/d22/d52/l98 0 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/452: readlink de/d14/d39/l3f 0 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/453: write de/d14/d22/d29/d64/f8c [1051267,23903] 0 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/454: dread - de/d14/d44/d7f/f8b zero size 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/455: write de/f23 [2711681,42764] 0 2024-09-13T02:50:31.690 INFO:tasks.workunit.client.0.smithi100.stdout:1/456: chown de/d14/d22/d29/d68/l94 352910392 1 2024-09-13T02:50:31.695 INFO:tasks.workunit.client.0.smithi100.stdout:9/341: dwrite dd/d1b/d21/d39/f4c [0,4194304] 0 2024-09-13T02:50:31.696 INFO:tasks.workunit.client.0.smithi100.stdout:7/484: dwrite d3/d5/f8d [0,4194304] 0 2024-09-13T02:50:31.696 INFO:tasks.workunit.client.0.smithi100.stdout:0/411: dwrite d2/dd/d33/f7c [0,4194304] 0 2024-09-13T02:50:31.699 INFO:tasks.workunit.client.0.smithi100.stdout:4/475: dwrite d3/d6/d2f/d60/f93 [0,4194304] 0 2024-09-13T02:50:31.699 INFO:tasks.workunit.client.0.smithi100.stdout:2/454: dwrite d0/d36/f75 [0,4194304] 0 2024-09-13T02:50:31.700 INFO:tasks.workunit.client.0.smithi100.stdout:2/455: truncate d0/db/d68/d6b/d71/d73/f7e 520069 0 2024-09-13T02:50:31.700 INFO:tasks.workunit.client.0.smithi100.stdout:6/438: dwrite d12/d14/d1c/d28/f78 [0,4194304] 0 2024-09-13T02:50:31.702 INFO:tasks.workunit.client.0.smithi100.stdout:9/342: symlink dd/d1b/d1d/d28/l6a 0 2024-09-13T02:50:31.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/485: mkdir d3/d16/d89/d94 0 2024-09-13T02:50:31.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/486: chown d3/d16/d3b/f5d 18517958 1 2024-09-13T02:50:31.705 INFO:tasks.workunit.client.0.smithi100.stdout:1/457: dread de/f23 [0,4194304] 0 2024-09-13T02:50:31.711 INFO:tasks.workunit.client.0.smithi100.stdout:2/456: truncate d0/db/d3f/f4b 2067792 0 2024-09-13T02:50:31.712 INFO:tasks.workunit.client.0.smithi100.stdout:9/343: rename dd/d1b/d1d/c2d to dd/d1b/d1d/d43/d5d/c6b 0 2024-09-13T02:50:31.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/458: unlink de/d14/l87 0 2024-09-13T02:50:31.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/459: readlink de/d14/d39/l3f 0 2024-09-13T02:50:31.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/460: stat de/d14/d22/f63 0 2024-09-13T02:50:31.714 INFO:tasks.workunit.client.0.smithi100.stdout:1/461: write de/d12/f8f [297431,26824] 0 2024-09-13T02:50:31.715 INFO:tasks.workunit.client.0.smithi100.stdout:1/462: stat de/f3a 0 2024-09-13T02:50:31.716 INFO:tasks.workunit.client.0.smithi100.stdout:4/476: dwrite d3/d6/d21/d46/d2d/f92 [0,4194304] 0 2024-09-13T02:50:31.717 INFO:tasks.workunit.client.0.smithi100.stdout:4/477: write d3/d6/d21/d46/d2d/f82 [961666,108511] 0 2024-09-13T02:50:31.717 INFO:tasks.workunit.client.0.smithi100.stdout:7/487: rename d3/d2d/f52 to d3/d5/d1b/d1c/d36/d65/f95 0 2024-09-13T02:50:31.721 INFO:tasks.workunit.client.0.smithi100.stdout:9/344: rename dd/l29 to dd/d1b/d27/l6c 0 2024-09-13T02:50:31.721 INFO:tasks.workunit.client.0.smithi100.stdout:3/519: sync 2024-09-13T02:50:31.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/416: sync 2024-09-13T02:50:31.721 INFO:tasks.workunit.client.0.smithi100.stdout:8/417: fsync df/d6f/f92 0 2024-09-13T02:50:31.721 INFO:tasks.workunit.client.0.smithi100.stdout:7/488: mknod d3/d5/d1b/d1c/d36/c96 0 2024-09-13T02:50:31.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/463: rename f8 to de/d14/d22/d29/d64/f99 0 2024-09-13T02:50:31.724 INFO:tasks.workunit.client.0.smithi100.stdout:1/464: fdatasync de/d14/d39/f6c 0 2024-09-13T02:50:31.726 INFO:tasks.workunit.client.0.smithi100.stdout:3/520: mkdir d10/d21/d51/d5a/d5e/d71/d97/db1 0 2024-09-13T02:50:31.727 INFO:tasks.workunit.client.0.smithi100.stdout:8/418: mkdir df/d5d/d70/d2c/d38/d9e 0 2024-09-13T02:50:31.729 INFO:tasks.workunit.client.0.smithi100.stdout:7/489: rename d3/d5/l79 to d3/d5/d1b/l97 0 2024-09-13T02:50:31.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/465: link de/d14/d2e/f56 de/d14/d22/f9a 0 2024-09-13T02:50:31.731 INFO:tasks.workunit.client.0.smithi100.stdout:1/466: symlink de/l9b 0 2024-09-13T02:50:31.731 INFO:tasks.workunit.client.0.smithi100.stdout:1/467: truncate de/d14/f83 815627 0 2024-09-13T02:50:31.731 INFO:tasks.workunit.client.0.smithi100.stdout:1/468: truncate de/f20 5105811 0 2024-09-13T02:50:31.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/490: rmdir d3/d16/d55/d56 39 2024-09-13T02:50:31.732 INFO:tasks.workunit.client.0.smithi100.stdout:7/491: stat d3/f3c 0 2024-09-13T02:50:31.732 INFO:tasks.workunit.client.0.smithi100.stdout:1/469: creat de/d14/d2e/d69/f9c x:0 0 0 2024-09-13T02:50:31.733 INFO:tasks.workunit.client.0.smithi100.stdout:7/492: symlink d3/d16/d89/l98 0 2024-09-13T02:50:31.734 INFO:tasks.workunit.client.0.smithi100.stdout:7/493: mknod d3/d16/d89/d94/c99 0 2024-09-13T02:50:31.735 INFO:tasks.workunit.client.0.smithi100.stdout:5/485: sync 2024-09-13T02:50:31.735 INFO:tasks.workunit.client.0.smithi100.stdout:7/494: mknod d3/d5/d1b/d1c/d36/c9a 0 2024-09-13T02:50:31.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/495: mkdir d3/d9b 0 2024-09-13T02:50:31.737 INFO:tasks.workunit.client.0.smithi100.stdout:7/496: stat d3/d16/l46 0 2024-09-13T02:50:31.738 INFO:tasks.workunit.client.0.smithi100.stdout:4/478: dwrite d3/d6/d21/d46/f5e [0,4194304] 0 2024-09-13T02:50:31.738 INFO:tasks.workunit.client.0.smithi100.stdout:4/479: fdatasync d3/d6/d9/fd 0 2024-09-13T02:50:31.738 INFO:tasks.workunit.client.0.smithi100.stdout:4/480: getdents d3/dc/d4b/d9b 0 2024-09-13T02:50:31.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/457: dwrite d0/db/d3f/f4e [0,4194304] 0 2024-09-13T02:50:31.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/458: fdatasync d0/db/f12 0 2024-09-13T02:50:31.740 INFO:tasks.workunit.client.0.smithi100.stdout:3/521: write d10/d21/f67 [40897,58040] 0 2024-09-13T02:50:31.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/481: creat d3/d6/d21/d46/fa3 x:0 0 0 2024-09-13T02:50:31.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/482: creat d3/d6/d21/d46/fa4 x:0 0 0 2024-09-13T02:50:31.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/419: dread df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:31.744 INFO:tasks.workunit.client.0.smithi100.stdout:8/420: creat df/d5d/d70/f9f x:0 0 0 2024-09-13T02:50:31.745 INFO:tasks.workunit.client.0.smithi100.stdout:7/497: rmdir d3/d16/d3b 39 2024-09-13T02:50:31.748 INFO:tasks.workunit.client.0.smithi100.stdout:9/345: link dd/d1b/d27/l6c dd/d1b/d1d/d43/d4f/l6d 0 2024-09-13T02:50:31.748 INFO:tasks.workunit.client.0.smithi100.stdout:9/346: fsync f5 0 2024-09-13T02:50:31.748 INFO:tasks.workunit.client.0.smithi100.stdout:9/347: stat dd/d1b/d1d/d28/l61 0 2024-09-13T02:50:31.751 INFO:tasks.workunit.client.0.smithi100.stdout:3/522: rename d10/d21/d51/d6c/f74 to d10/d21/d51/d5a/d5e/da1/fb2 0 2024-09-13T02:50:31.753 INFO:tasks.workunit.client.0.smithi100.stdout:4/483: creat d3/d6/d21/d46/d2d/d42/fa5 x:0 0 0 2024-09-13T02:50:31.756 INFO:tasks.workunit.client.0.smithi100.stdout:8/421: symlink df/d5d/d70/d2c/d38/la0 0 2024-09-13T02:50:31.757 INFO:tasks.workunit.client.0.smithi100.stdout:9/348: symlink dd/d1b/d1d/d43/d5d/l6e 0 2024-09-13T02:50:31.758 INFO:tasks.workunit.client.0.smithi100.stdout:3/523: stat d10/l4f 0 2024-09-13T02:50:31.758 INFO:tasks.workunit.client.0.smithi100.stdout:4/484: mkdir d3/d6/da6 0 2024-09-13T02:50:31.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/422: truncate df/f67 1178518 0 2024-09-13T02:50:31.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/423: fsync df/d13/d20/f9a 0 2024-09-13T02:50:31.759 INFO:tasks.workunit.client.0.smithi100.stdout:8/424: readlink df/d13/d20/l31 0 2024-09-13T02:50:31.760 INFO:tasks.workunit.client.0.smithi100.stdout:9/349: symlink dd/d1b/d1d/d43/d5e/l6f 0 2024-09-13T02:50:31.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/350: creat dd/d1b/f70 x:0 0 0 2024-09-13T02:50:31.761 INFO:tasks.workunit.client.0.smithi100.stdout:9/351: dread - dd/d1b/d27/f59 zero size 2024-09-13T02:50:31.761 INFO:tasks.workunit.client.0.smithi100.stdout:3/524: unlink d10/l36 0 2024-09-13T02:50:31.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/352: mknod dd/d1b/d21/d39/c71 0 2024-09-13T02:50:31.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/353: fdatasync dd/d1b/d27/f59 0 2024-09-13T02:50:31.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/354: creat dd/d1b/d1d/d43/d5d/f72 x:0 0 0 2024-09-13T02:50:31.762 INFO:tasks.workunit.client.0.smithi100.stdout:9/355: stat dd/d1b/d1d/d36/f38 0 2024-09-13T02:50:31.763 INFO:tasks.workunit.client.0.smithi100.stdout:3/525: mknod d10/d21/d51/d5a/d5e/cb3 0 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:4/485: dread d3/d6/f38 [0,4194304] 0 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:4/486: chown d3/d6/d9/l6c 748 1 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/470: dwrite de/d14/d44/d7f/f8b [0,4194304] 0 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/471: read - de/d14/f41 zero size 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:1/472: write de/f45 [256693,55882] 0 2024-09-13T02:50:31.764 INFO:tasks.workunit.client.0.smithi100.stdout:9/356: mknod dd/d1b/d1d/d28/c73 0 2024-09-13T02:50:31.765 INFO:tasks.workunit.client.0.smithi100.stdout:4/487: symlink d3/d3a/d5c/la7 0 2024-09-13T02:50:31.765 INFO:tasks.workunit.client.0.smithi100.stdout:4/488: chown d3/dc/d4b/d52/f59 2336 1 2024-09-13T02:50:31.765 INFO:tasks.workunit.client.0.smithi100.stdout:4/489: stat d3/d6/d21/d46/fa3 0 2024-09-13T02:50:31.766 INFO:tasks.workunit.client.0.smithi100.stdout:9/357: unlink dd/f25 0 2024-09-13T02:50:31.766 INFO:tasks.workunit.client.0.smithi100.stdout:9/358: dread - dd/d1b/d21/d39/f52 zero size 2024-09-13T02:50:31.767 INFO:tasks.workunit.client.0.smithi100.stdout:3/526: dread d10/f54 [0,4194304] 0 2024-09-13T02:50:31.767 INFO:tasks.workunit.client.0.smithi100.stdout:5/486: dwrite db/de/d3e/d7e/d81/d85/fa9 [0,4194304] 0 2024-09-13T02:50:31.767 INFO:tasks.workunit.client.0.smithi100.stdout:2/459: dwrite d0/d36/f4f [0,4194304] 0 2024-09-13T02:50:31.768 INFO:tasks.workunit.client.0.smithi100.stdout:4/490: rename d3/d63/l85 to d3/d6/d21/d46/d2d/la8 0 2024-09-13T02:50:31.768 INFO:tasks.workunit.client.0.smithi100.stdout:4/491: truncate d3/d6/d21/d46/fa4 781547 0 2024-09-13T02:50:31.768 INFO:tasks.workunit.client.0.smithi100.stdout:8/425: dread df/d13/d68/f6d [0,4194304] 0 2024-09-13T02:50:31.768 INFO:tasks.workunit.client.0.smithi100.stdout:4/492: write d3/d6/d2f/f9c [24197,100153] 0 2024-09-13T02:50:31.768 INFO:tasks.workunit.client.0.smithi100.stdout:7/498: dwrite d3/d5/d4f/f90 [0,4194304] 0 2024-09-13T02:50:31.769 INFO:tasks.workunit.client.0.smithi100.stdout:3/527: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/db4 0 2024-09-13T02:50:31.769 INFO:tasks.workunit.client.0.smithi100.stdout:3/528: chown d10/d21/d57/l63 1879 1 2024-09-13T02:50:31.769 INFO:tasks.workunit.client.0.smithi100.stdout:3/529: chown d10/d21/d51/c9d 1567275217 1 2024-09-13T02:50:31.770 INFO:tasks.workunit.client.0.smithi100.stdout:2/460: dread d0/db/d23/f3a [0,4194304] 0 2024-09-13T02:50:31.770 INFO:tasks.workunit.client.0.smithi100.stdout:5/487: link db/de/d1f/d78/c95 db/de/d63/d70/cad 0 2024-09-13T02:50:31.770 INFO:tasks.workunit.client.0.smithi100.stdout:5/488: dread - db/de/d1f/d2b/f92 zero size 2024-09-13T02:50:31.773 INFO:tasks.workunit.client.0.smithi100.stdout:2/461: dread d0/db/d5b/f7a [0,4194304] 0 2024-09-13T02:50:31.773 INFO:tasks.workunit.client.0.smithi100.stdout:2/462: fsync d0/db/d23/d39/f49 0 2024-09-13T02:50:31.775 INFO:tasks.workunit.client.0.smithi100.stdout:4/493: symlink d3/dc/la9 0 2024-09-13T02:50:31.780 INFO:tasks.workunit.client.0.smithi100.stdout:7/499: mkdir d3/d5/d1b/d1c/d36/d9c 0 2024-09-13T02:50:31.781 INFO:tasks.workunit.client.0.smithi100.stdout:3/530: mknod d10/d21/d51/d5a/d5e/cb5 0 2024-09-13T02:50:31.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/463: mknod d0/db/d21/d69/c82 0 2024-09-13T02:50:31.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/500: rmdir d3/d16/d89 39 2024-09-13T02:50:31.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/501: creat d3/d16/d55/f9d x:0 0 0 2024-09-13T02:50:31.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/502: fsync d3/d5/f8d 0 2024-09-13T02:50:31.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/503: stat d3/d16/d55/d56/f5b 0 2024-09-13T02:50:31.785 INFO:tasks.workunit.client.0.smithi100.stdout:7/504: getdents d3/d16/d3b/d8c 0 2024-09-13T02:50:31.786 INFO:tasks.workunit.client.0.smithi100.stdout:3/531: link d10/d21/c6e d10/d21/d51/d5a/d5e/d90/cb6 0 2024-09-13T02:50:31.787 INFO:tasks.workunit.client.0.smithi100.stdout:2/464: creat d0/db/d3f/d6a/d7f/f83 x:0 0 0 2024-09-13T02:50:31.788 INFO:tasks.workunit.client.0.smithi100.stdout:9/359: rename dd/d1b/d1d/d36 to dd/d1b/d24/d74 0 2024-09-13T02:50:31.790 INFO:tasks.workunit.client.0.smithi100.stdout:7/505: mkdir d3/d16/d55/d56/d9e 0 2024-09-13T02:50:31.790 INFO:tasks.workunit.client.0.smithi100.stdout:7/506: read - d3/d5/d1b/d1c/f7e zero size 2024-09-13T02:50:31.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/532: mkdir d10/d21/d51/d6c/db7 0 2024-09-13T02:50:31.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/533: creat d10/d21/d51/d5a/d73/fb8 x:0 0 0 2024-09-13T02:50:31.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/534: dread - d10/d8a/f9f zero size 2024-09-13T02:50:31.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/535: fsync d10/d21/d51/d5a/d5e/f78 0 2024-09-13T02:50:31.791 INFO:tasks.workunit.client.0.smithi100.stdout:3/536: chown d10/d21/f42 30 1 2024-09-13T02:50:31.792 INFO:tasks.workunit.client.0.smithi100.stdout:2/465: creat d0/db/d68/d6b/d71/f84 x:0 0 0 2024-09-13T02:50:31.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/473: dwrite de/d12/f59 [0,4194304] 0 2024-09-13T02:50:31.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/474: readlink l3 0 2024-09-13T02:50:31.794 INFO:tasks.workunit.client.0.smithi100.stdout:8/426: rename df/d13/d68/c7e to df/d86/ca1 0 2024-09-13T02:50:31.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/537: rename d10/d21 to d10/d21/d51/d6c/db7/db9 22 2024-09-13T02:50:31.794 INFO:tasks.workunit.client.0.smithi100.stdout:3/538: write d10/d21/d51/d6c/f76 [1002326,22118] 0 2024-09-13T02:50:31.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/494: dwrite d3/d6/d9/fd [0,4194304] 0 2024-09-13T02:50:31.794 INFO:tasks.workunit.client.0.smithi100.stdout:4/495: fdatasync d3/fb 0 2024-09-13T02:50:31.795 INFO:tasks.workunit.client.0.smithi100.stdout:5/489: dwrite db/de/d3e/d7e/d81/f8d [4194304,4194304] 0 2024-09-13T02:50:31.795 INFO:tasks.workunit.client.0.smithi100.stdout:9/360: symlink dd/d1b/d1d/d28/l75 0 2024-09-13T02:50:31.796 INFO:tasks.workunit.client.0.smithi100.stdout:7/507: mkdir d3/d16/d55/d56/d9e/d9f 0 2024-09-13T02:50:31.796 INFO:tasks.workunit.client.0.smithi100.stdout:7/508: read d3/d16/d3b/f6f [118745,43017] 0 2024-09-13T02:50:31.798 INFO:tasks.workunit.client.0.smithi100.stdout:2/466: mkdir d0/db/d68/d6b/d85 0 2024-09-13T02:50:31.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/467: stat d0/db/d5b/f7a 0 2024-09-13T02:50:31.801 INFO:tasks.workunit.client.0.smithi100.stdout:1/475: mknod de/d14/d86/c9d 0 2024-09-13T02:50:31.802 INFO:tasks.workunit.client.0.smithi100.stdout:8/427: mkdir df/d13/d20/da2 0 2024-09-13T02:50:31.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/490: dread db/f5b [0,4194304] 0 2024-09-13T02:50:31.805 INFO:tasks.workunit.client.0.smithi100.stdout:5/491: fdatasync db/de/d3e/d7e/fa7 0 2024-09-13T02:50:31.806 INFO:tasks.workunit.client.0.smithi100.stdout:4/496: rename d3/d6/d21/d46/c4e to d3/dc/d88/caa 0 2024-09-13T02:50:31.810 INFO:tasks.workunit.client.0.smithi100.stdout:2/468: symlink d0/db/d3f/l86 0 2024-09-13T02:50:31.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/476: creat de/d14/d86/f9e x:0 0 0 2024-09-13T02:50:31.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/477: write de/d14/d22/f77 [775167,4572] 0 2024-09-13T02:50:31.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/478: write de/d14/f41 [477573,14202] 0 2024-09-13T02:50:31.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/479: fsync de/d14/d44/d61/f91 0 2024-09-13T02:50:31.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/480: truncate de/d14/d22/d29/d64/f89 624485 0 2024-09-13T02:50:31.814 INFO:tasks.workunit.client.0.smithi100.stdout:1/481: chown de/d14 130717497 1 2024-09-13T02:50:31.814 INFO:tasks.workunit.client.0.smithi100.stdout:8/428: mkdir df/d86/da3 0 2024-09-13T02:50:31.814 INFO:tasks.workunit.client.0.smithi100.stdout:8/429: dread - df/d13/d21/f40 zero size 2024-09-13T02:50:31.814 INFO:tasks.workunit.client.0.smithi100.stdout:3/539: mknod d10/cba 0 2024-09-13T02:50:31.815 INFO:tasks.workunit.client.0.smithi100.stdout:2/469: truncate d0/db/f2e 2827590 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/482: link de/d12/f33 de/d14/d2e/d75/f9f 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/483: dread - de/d14/d2e/d69/f9c zero size 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/484: write de/d14/d22/d29/f4b [1378186,58730] 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/485: stat de/f11 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:1/486: write f7 [1013886,28341] 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/430: mknod df/d5d/d70/ca4 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/431: write df/d13/f14 [208266,65929] 0 2024-09-13T02:50:31.817 INFO:tasks.workunit.client.0.smithi100.stdout:8/432: truncate df/f67 1527031 0 2024-09-13T02:50:31.818 INFO:tasks.workunit.client.0.smithi100.stdout:2/470: symlink d0/db/d21/d69/l87 0 2024-09-13T02:50:31.818 INFO:tasks.workunit.client.0.smithi100.stdout:1/487: rename de/d14/d22/d29/f4b to de/d14/d2e/d60/fa0 0 2024-09-13T02:50:31.821 INFO:tasks.workunit.client.0.smithi100.stdout:2/471: write d0/db/d3f/f4b [662906,68446] 0 2024-09-13T02:50:31.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/488: mknod de/d14/d44/ca1 0 2024-09-13T02:50:31.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/489: write de/d12/f30 [3828041,54508] 0 2024-09-13T02:50:31.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/472: dread d0/db/d68/d6b/d71/d73/f7e [0,4194304] 0 2024-09-13T02:50:31.823 INFO:tasks.workunit.client.0.smithi100.stdout:9/361: dwrite dd/d1b/d24/d74/f47 [0,4194304] 0 2024-09-13T02:50:31.823 INFO:tasks.workunit.client.0.smithi100.stdout:2/473: rename d0/db/d23/d39 to d0/db/d21/d88 0 2024-09-13T02:50:31.827 INFO:tasks.workunit.client.0.smithi100.stdout:8/433: dread df/d5d/d70/f63 [0,4194304] 0 2024-09-13T02:50:31.827 INFO:tasks.workunit.client.0.smithi100.stdout:9/362: link dd/d1b/d27/f59 dd/f76 0 2024-09-13T02:50:31.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/434: symlink df/d86/la5 0 2024-09-13T02:50:31.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/435: write df/d5d/d70/f63 [4929788,70641] 0 2024-09-13T02:50:31.830 INFO:tasks.workunit.client.0.smithi100.stdout:9/363: rename dd/d1b/d1d/d43/d5d/c6b to dd/d1b/d24/d74/d4e/c77 0 2024-09-13T02:50:31.830 INFO:tasks.workunit.client.0.smithi100.stdout:9/364: dread - dd/d1b/d1d/d28/f54 zero size 2024-09-13T02:50:31.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/436: creat df/d13/d20/d98/fa6 x:0 0 0 2024-09-13T02:50:31.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/437: chown df/d5d/d70/d2c/d38 17925 1 2024-09-13T02:50:31.834 INFO:tasks.workunit.client.0.smithi100.stdout:7/509: dwrite d3/d16/f32 [4194304,4194304] 0 2024-09-13T02:50:31.835 INFO:tasks.workunit.client.0.smithi100.stdout:3/540: dwrite d10/d21/d57/f91 [0,4194304] 0 2024-09-13T02:50:31.835 INFO:tasks.workunit.client.0.smithi100.stdout:4/497: dwrite d3/d6/d2f/f33 [0,4194304] 0 2024-09-13T02:50:31.835 INFO:tasks.workunit.client.0.smithi100.stdout:4/498: fdatasync d3/d6/d21/d46/f5e 0 2024-09-13T02:50:31.835 INFO:tasks.workunit.client.0.smithi100.stdout:4/499: chown d3/d3a/d56/f7b 506207599 1 2024-09-13T02:50:31.836 INFO:tasks.workunit.client.0.smithi100.stdout:7/510: dread d3/d16/d3b/f6a [0,4194304] 0 2024-09-13T02:50:31.840 INFO:tasks.workunit.client.0.smithi100.stdout:3/541: fsync d10/f31 0 2024-09-13T02:50:31.840 INFO:tasks.workunit.client.0.smithi100.stdout:3/542: truncate d10/d21/d51/d6c/f6d 377707 0 2024-09-13T02:50:31.847 INFO:tasks.workunit.client.0.smithi100.stdout:7/511: creat d3/fa0 x:0 0 0 2024-09-13T02:50:31.847 INFO:tasks.workunit.client.0.smithi100.stdout:3/543: fdatasync d10/f32 0 2024-09-13T02:50:31.847 INFO:tasks.workunit.client.0.smithi100.stdout:3/544: fsync d10/d8a/f9f 0 2024-09-13T02:50:31.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/365: dwrite dd/d1b/d1d/d43/d5d/f64 [0,4194304] 0 2024-09-13T02:50:31.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/366: stat dd/d1b/d24/d74/d3c 0 2024-09-13T02:50:31.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/367: dread - dd/d1b/d21/f62 zero size 2024-09-13T02:50:31.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/368: rename dd/d1b/d1d/c20 to dd/d1b/d1d/c78 0 2024-09-13T02:50:31.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/369: chown dd/d1b/c2b 110 1 2024-09-13T02:50:31.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/370: write dd/d1b/d21/f26 [171339,21909] 0 2024-09-13T02:50:31.859 INFO:tasks.workunit.client.0.smithi100.stdout:7/512: write d3/d16/f32 [7248264,58636] 0 2024-09-13T02:50:31.860 INFO:tasks.workunit.client.0.smithi100.stdout:3/545: read d10/d21/d57/f91 [903760,47367] 0 2024-09-13T02:50:31.860 INFO:tasks.workunit.client.0.smithi100.stdout:3/546: chown d10/d21/f3b 1 1 2024-09-13T02:50:31.861 INFO:tasks.workunit.client.0.smithi100.stdout:7/513: symlink d3/d5/d1b/d1c/d36/d9c/la1 0 2024-09-13T02:50:31.862 INFO:tasks.workunit.client.0.smithi100.stdout:7/514: write d3/d5/d1b/d1c/d36/d65/f95 [270253,98261] 0 2024-09-13T02:50:31.863 INFO:tasks.workunit.client.0.smithi100.stdout:0/412: sync 2024-09-13T02:50:31.863 INFO:tasks.workunit.client.0.smithi100.stdout:0/413: fdatasync d2/dd/d33/d43/d4b/f4d 0 2024-09-13T02:50:31.864 INFO:tasks.workunit.client.0.smithi100.stdout:7/515: mkdir d3/d16/d55/d92/da2 0 2024-09-13T02:50:31.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/414: dread d2/d9/f1b [0,4194304] 0 2024-09-13T02:50:31.866 INFO:tasks.workunit.client.0.smithi100.stdout:0/415: symlink d2/dd/d54/d47/d8a/l92 0 2024-09-13T02:50:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/416: mkdir d2/dd/d93 0 2024-09-13T02:50:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/417: creat d2/dd/d54/d28/f94 x:0 0 0 2024-09-13T02:50:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/418: fsync d2/dd/d33/d43/d4b/f72 0 2024-09-13T02:50:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/419: truncate d2/dd/d54/d47/d8a/f90 305879 0 2024-09-13T02:50:31.868 INFO:tasks.workunit.client.0.smithi100.stdout:0/420: readlink d2/dd/d54/d47/d34/d3c/l5f 0 2024-09-13T02:50:31.869 INFO:tasks.workunit.client.0.smithi100.stdout:0/421: truncate d2/dd/d33/f16 2772334 0 2024-09-13T02:50:31.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/422: link d2/d9/c8c d2/d1a/d4c/d7f/c95 0 2024-09-13T02:50:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:7/516: write d3/d5/d4f/f90 [2732297,126876] 0 2024-09-13T02:50:31.875 INFO:tasks.workunit.client.0.smithi100.stdout:9/371: dwrite dd/d1b/d27/f63 [0,4194304] 0 2024-09-13T02:50:31.880 INFO:tasks.workunit.client.0.smithi100.stdout:9/372: symlink dd/d1b/d1d/l79 0 2024-09-13T02:50:31.885 INFO:tasks.workunit.client.0.smithi100.stdout:9/373: rmdir dd/d1b/d1d/d28 39 2024-09-13T02:50:31.885 INFO:tasks.workunit.client.0.smithi100.stdout:9/374: stat dd/d1b/d27/d51 0 2024-09-13T02:50:31.885 INFO:tasks.workunit.client.0.smithi100.stdout:7/517: write d3/d16/d3b/f5d [839336,101159] 0 2024-09-13T02:50:31.893 INFO:tasks.workunit.client.0.smithi100.stdout:7/518: write d3/d5/f8d [2734599,7709] 0 2024-09-13T02:50:31.893 INFO:tasks.workunit.client.0.smithi100.stdout:7/519: dread - d3/d16/d55/d56/f85 zero size 2024-09-13T02:50:31.894 INFO:tasks.workunit.client.0.smithi100.stdout:7/520: creat d3/d16/d55/d56/d9e/d9f/fa3 x:0 0 0 2024-09-13T02:50:31.895 INFO:tasks.workunit.client.0.smithi100.stdout:7/521: rename d3/d2d/l6d to d3/d16/d3b/d8c/la4 0 2024-09-13T02:50:31.896 INFO:tasks.workunit.client.0.smithi100.stdout:7/522: rename d3/d5/d1b/d1c/d36/d65 to d3/d16/d3b/da5 0 2024-09-13T02:50:31.913 INFO:tasks.workunit.client.0.smithi100.stdout:0/423: dread d2/dd/d54/d28/f65 [0,4194304] 0 2024-09-13T02:50:31.915 INFO:tasks.workunit.client.0.smithi100.stdout:3/547: dwrite d10/d21/f56 [0,4194304] 0 2024-09-13T02:50:31.921 INFO:tasks.workunit.client.0.smithi100.stdout:7/523: dwrite d3/d2d/f41 [0,4194304] 0 2024-09-13T02:50:31.924 INFO:tasks.workunit.client.0.smithi100.stdout:7/524: mknod d3/d5/d4f/ca6 0 2024-09-13T02:50:31.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/525: mknod d3/d16/d3b/da5/d87/ca7 0 2024-09-13T02:50:31.927 INFO:tasks.workunit.client.0.smithi100.stdout:7/526: link d3/d5/d1b/d1c/d36/c96 d3/d16/d3b/da5/ca8 0 2024-09-13T02:50:31.934 INFO:tasks.workunit.client.0.smithi100.stdout:0/424: dwrite d2/dd/d54/d47/f77 [0,4194304] 0 2024-09-13T02:50:31.936 INFO:tasks.workunit.client.0.smithi100.stdout:3/548: dwrite d10/f1b [0,4194304] 0 2024-09-13T02:50:31.939 INFO:tasks.workunit.client.0.smithi100.stdout:7/527: write d3/d5/f1a [3194370,82633] 0 2024-09-13T02:50:31.940 INFO:tasks.workunit.client.0.smithi100.stdout:7/528: fdatasync d3/d5/f17 0 2024-09-13T02:50:31.940 INFO:tasks.workunit.client.0.smithi100.stdout:7/529: dread - d3/d5/d1b/d1c/f84 zero size 2024-09-13T02:50:31.940 INFO:tasks.workunit.client.0.smithi100.stdout:3/549: link d10/c4c d10/d8a/cbb 0 2024-09-13T02:50:31.941 INFO:tasks.workunit.client.0.smithi100.stdout:7/530: mkdir d3/d16/d55/d92/da9 0 2024-09-13T02:50:31.941 INFO:tasks.workunit.client.0.smithi100.stdout:7/531: dread - d3/d16/d55/d56/f85 zero size 2024-09-13T02:50:31.941 INFO:tasks.workunit.client.0.smithi100.stdout:7/532: stat d3/d5/l24 0 2024-09-13T02:50:31.942 INFO:tasks.workunit.client.0.smithi100.stdout:3/550: mknod d10/d21/d51/d5a/d5e/d89/cbc 0 2024-09-13T02:50:31.943 INFO:tasks.workunit.client.0.smithi100.stdout:3/551: symlink d10/d21/d51/d5a/d5e/d71/d93/lbd 0 2024-09-13T02:50:31.950 INFO:tasks.workunit.client.0.smithi100.stdout:3/552: dread d10/f1b [0,4194304] 0 2024-09-13T02:50:31.952 INFO:tasks.workunit.client.0.smithi100.stdout:3/553: rename d10/d21/d51/d5a/d5e/d71/d94/f9a to d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fbe 0 2024-09-13T02:50:31.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/554: creat d10/d21/d51/d6c/db7/fbf x:0 0 0 2024-09-13T02:50:31.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/555: stat d10/d21/d51/d6c/f6f 0 2024-09-13T02:50:31.953 INFO:tasks.workunit.client.0.smithi100.stdout:3/556: truncate d10/d21/d51/d5a/d5e/f78 2472253 0 2024-09-13T02:50:31.954 INFO:tasks.workunit.client.0.smithi100.stdout:3/557: mkdir d10/d21/d51/d5a/d5e/d89/dc0 0 2024-09-13T02:50:31.955 INFO:tasks.workunit.client.0.smithi100.stdout:3/558: truncate d10/f38 7109 0 2024-09-13T02:50:31.955 INFO:tasks.workunit.client.0.smithi100.stdout:3/559: chown d10/d21/d51/d6c/f76 6185 1 2024-09-13T02:50:31.957 INFO:tasks.workunit.client.0.smithi100.stdout:7/533: dwrite d3/d2d/f41 [0,4194304] 0 2024-09-13T02:50:31.976 INFO:tasks.workunit.client.0.smithi100.stdout:7/534: dwrite d3/d5/d1b/d1c/f7e [0,4194304] 0 2024-09-13T02:50:31.976 INFO:tasks.workunit.client.0.smithi100.stdout:7/535: fsync d3/d2d/f4d 0 2024-09-13T02:50:31.977 INFO:tasks.workunit.client.0.smithi100.stdout:7/536: rmdir d3/d5/d1b/d1c/d36/d9c 39 2024-09-13T02:50:31.977 INFO:tasks.workunit.client.0.smithi100.stdout:7/537: chown d3/d5/d4f/f80 3 1 2024-09-13T02:50:31.989 INFO:tasks.workunit.client.0.smithi100.stdout:7/538: dwrite d3/d16/d3b/f45 [0,4194304] 0 2024-09-13T02:50:31.990 INFO:tasks.workunit.client.0.smithi100.stdout:6/439: sync 2024-09-13T02:50:31.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/440: dread d12/f27 [0,4194304] 0 2024-09-13T02:50:32.012 INFO:tasks.workunit.client.0.smithi100.stdout:6/441: dwrite d12/d2e/f3b [0,4194304] 0 2024-09-13T02:50:32.012 INFO:tasks.workunit.client.0.smithi100.stdout:6/442: truncate d12/d14/d21/f76 187046 0 2024-09-13T02:50:32.013 INFO:tasks.workunit.client.0.smithi100.stdout:6/443: symlink d12/d14/d1c/l82 0 2024-09-13T02:50:32.018 INFO:tasks.workunit.client.0.smithi100.stdout:6/444: dread d12/d14/d2f/d45/f48 [0,4194304] 0 2024-09-13T02:50:32.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/445: chown d12/d14/d2f/d6c/f70 717 1 2024-09-13T02:50:32.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/446: mknod d12/d43/c83 0 2024-09-13T02:50:32.019 INFO:tasks.workunit.client.0.smithi100.stdout:6/447: creat d12/d14/d1c/f84 x:0 0 0 2024-09-13T02:50:32.021 INFO:tasks.workunit.client.0.smithi100.stdout:6/448: dread d12/d14/d2f/d45/f49 [0,4194304] 0 2024-09-13T02:50:32.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/449: symlink d12/d14/d21/l85 0 2024-09-13T02:50:32.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/450: getdents d12/d14/d4d 0 2024-09-13T02:50:32.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/451: fdatasync f7 0 2024-09-13T02:50:32.023 INFO:tasks.workunit.client.0.smithi100.stdout:6/452: link d12/d14/f1a d12/d14/d1c/d6e/d71/f86 0 2024-09-13T02:50:32.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/453: write d12/d14/d1c/f30 [4035797,67291] 0 2024-09-13T02:50:32.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/454: creat d12/d43/d4b/d4c/f87 x:0 0 0 2024-09-13T02:50:32.047 INFO:tasks.workunit.client.0.smithi100.stdout:6/455: dwrite d12/d14/d2f/f33 [0,4194304] 0 2024-09-13T02:50:32.049 INFO:tasks.workunit.client.0.smithi100.stdout:6/456: mkdir d12/d14/d1c/d28/d88 0 2024-09-13T02:50:32.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/457: creat d12/d43/d4b/d4c/d36/f89 x:0 0 0 2024-09-13T02:50:32.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/458: write d12/d14/d1c/d28/f58 [2643396,65986] 0 2024-09-13T02:50:32.050 INFO:tasks.workunit.client.0.smithi100.stdout:6/459: creat d12/d14/d2f/d45/f8a x:0 0 0 2024-09-13T02:50:32.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/460: getdents d12/d14/d2f/d45/d73 0 2024-09-13T02:50:32.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/461: readlink l4 0 2024-09-13T02:50:32.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/462: truncate d12/f5c 988581 0 2024-09-13T02:50:32.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/463: stat d12/d14/d2f/d45/d73/f81 0 2024-09-13T02:50:32.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/464: creat d12/d14/d1c/d6e/f8b x:0 0 0 2024-09-13T02:50:32.109 INFO:tasks.workunit.client.0.smithi100.stdout:6/465: truncate d12/d14/d1c/d6e/d71/f86 231229 0 2024-09-13T02:50:32.109 INFO:tasks.workunit.client.0.smithi100.stdout:6/466: chown d12/d14/d1c/c32 36 1 2024-09-13T02:50:32.109 INFO:tasks.workunit.client.0.smithi100.stdout:6/467: fdatasync d12/d14/d2f/d45/f48 0 2024-09-13T02:50:32.109 INFO:tasks.workunit.client.0.smithi100.stdout:5/492: sync 2024-09-13T02:50:32.109 INFO:tasks.workunit.client.0.smithi100.stdout:1/490: sync 2024-09-13T02:50:32.110 INFO:tasks.workunit.client.0.smithi100.stdout:6/468: creat d12/d14/d2f/d6c/f8c x:0 0 0 2024-09-13T02:50:32.110 INFO:tasks.workunit.client.0.smithi100.stdout:6/469: write d12/f5c [795558,22838] 0 2024-09-13T02:50:32.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/493: rename db/de/l72 to db/de/d3e/d71/lae 0 2024-09-13T02:50:32.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/494: creat db/faf x:0 0 0 2024-09-13T02:50:32.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/495: chown db/de/d1f/d2b/d9b/fa1 0 1 2024-09-13T02:50:32.112 INFO:tasks.workunit.client.0.smithi100.stdout:1/491: symlink de/d14/d22/d52/d7a/la2 0 2024-09-13T02:50:32.112 INFO:tasks.workunit.client.0.smithi100.stdout:7/539: sync 2024-09-13T02:50:32.112 INFO:tasks.workunit.client.0.smithi100.stdout:4/500: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/438: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:9/375: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:3/560: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/425: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/439: readlink df/l11 0 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:9/376: chown dd/d1b/d1d/d43/l55 909596396 1 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/440: chown df/d13/d21 130332 1 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/441: stat df/d86/da3 0 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:3/561: getdents d10/d21/d51/d5a/d5e/d89/dc0 0 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:2/474: sync 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:3/562: stat d10/d21/d57/faa 0 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/426: write d2/dd/d54/d47/d8a/f90 [435978,68931] 0 2024-09-13T02:50:32.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/442: write df/f64 [10383,106679] 0 2024-09-13T02:50:32.114 INFO:tasks.workunit.client.0.smithi100.stdout:8/443: dread - df/d13/d21/d81/f8d zero size 2024-09-13T02:50:32.114 INFO:tasks.workunit.client.0.smithi100.stdout:6/470: unlink d12/d43/d4b/d4c/d36/f89 0 2024-09-13T02:50:32.114 INFO:tasks.workunit.client.0.smithi100.stdout:1/492: creat de/d14/d22/d52/d65/fa3 x:0 0 0 2024-09-13T02:50:32.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/540: truncate d3/d5/f1e 3745872 0 2024-09-13T02:50:32.115 INFO:tasks.workunit.client.0.smithi100.stdout:7/541: read d3/d5/f1a [3947068,108276] 0 2024-09-13T02:50:32.116 INFO:tasks.workunit.client.0.smithi100.stdout:4/501: link d3/d6/f38 d3/d6/fab 0 2024-09-13T02:50:32.117 INFO:tasks.workunit.client.0.smithi100.stdout:9/377: mknod dd/d1b/d21/d39/c7a 0 2024-09-13T02:50:32.117 INFO:tasks.workunit.client.0.smithi100.stdout:9/378: fsync dd/d1b/d21/f26 0 2024-09-13T02:50:32.117 INFO:tasks.workunit.client.0.smithi100.stdout:2/475: creat d0/db/d3f/f89 x:0 0 0 2024-09-13T02:50:32.118 INFO:tasks.workunit.client.0.smithi100.stdout:3/563: creat d10/d21/d51/d5a/d5e/d71/d97/fc1 x:0 0 0 2024-09-13T02:50:32.121 INFO:tasks.workunit.client.0.smithi100.stdout:3/564: dread d10/d21/f2f [0,4194304] 0 2024-09-13T02:50:32.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/471: rename d12/d14/d2f/d45/f8a to d12/d14/d68/f8d 0 2024-09-13T02:50:32.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/472: dread - d12/d14/d68/f8d zero size 2024-09-13T02:50:32.122 INFO:tasks.workunit.client.0.smithi100.stdout:6/473: read - d12/d43/d4b/d4c/f87 zero size 2024-09-13T02:50:32.124 INFO:tasks.workunit.client.0.smithi100.stdout:7/542: mknod d3/d16/d55/caa 0 2024-09-13T02:50:32.126 INFO:tasks.workunit.client.0.smithi100.stdout:0/427: symlink d2/d1a/l96 0 2024-09-13T02:50:32.128 INFO:tasks.workunit.client.0.smithi100.stdout:1/493: dread de/d12/f3e [0,4194304] 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:2/476: rename d0/db/d21/d69/d6d to d0/d36/d8a 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:7/543: unlink d3/d5/d1b/f4e 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:4/502: getdents d3/d6/d21/d46 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:3/565: rename d10/d21/f67 to d10/d21/d51/d5a/d5e/d71/d93/fc2 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:4/503: unlink d3/dc/d4b/d52/f6f 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:1/494: getdents de/d14/d86 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:7/544: rename d3/d5/l24 to d3/d16/lab 0 2024-09-13T02:50:32.245 INFO:tasks.workunit.client.0.smithi100.stdout:7/545: chown d3/d16/d3b/da5 10 1 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:7/546: chown d3/d5/d1b/l6b 36718087 1 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/566: link d10/f40 d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/567: dread - d10/d21/d51/d5a/d5e/d71/fae zero size 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/504: mknod d3/d6/d21/d46/d2d/d42/cac 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/495: rename de/d14/c1c to de/d14/d44/d61/ca4 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:7/547: mknod d3/d5/d4f/cac 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/505: rename d3/dc/d4b/d52/f59 to d3/d6/d21/d46/d34/d96/d99/fad 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/496: unlink de/d12/f59 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/568: mknod d10/d21/d51/d5a/cc4 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/569: fsync d10/d21/d57/f91 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:4/506: mkdir d3/d63/dae 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:1/497: symlink de/d14/d2e/d60/la5 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:7/548: symlink d3/d16/d3b/da5/lad 0 2024-09-13T02:50:32.246 INFO:tasks.workunit.client.0.smithi100.stdout:3/570: link d10/l37 d10/d21/d51/d5a/d5e/d71/d93/lc5 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:4/507: mkdir d3/daf 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/498: rename de/d14/d2e/d60/f93 to de/d14/d22/d52/fa6 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:7/549: mknod d3/d16/cae 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:3/571: stat d10/l3d 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:3/572: write d10/f53 [2110271,22490] 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:4/508: creat d3/d6/d9/d9e/fb0 x:0 0 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:4/509: dread - d3/d6/d21/d67/f90 zero size 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:7/550: rename d3/d16/d3b/f6f to d3/d16/d55/faf 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:3/573: truncate d10/f44 117290 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:4/510: symlink d3/dc/d88/lb1 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:5/496: dwrite db/f3c [0,4194304] 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:7/551: mkdir d3/d16/db0 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:7/552: readlink d3/d5/d4f/l66 0 2024-09-13T02:50:32.247 INFO:tasks.workunit.client.0.smithi100.stdout:1/499: write f7 [725469,82106] 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/500: write de/d14/d22/d52/d5c/f84 [68414,68451] 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/501: truncate de/d14/d22/d52/f71 909759 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/502: write de/d14/d2e/d69/f9c [502276,119931] 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:1/503: stat de/d14/d22/d29/d68 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:4/511: unlink d3/d6/d21/d46/l9f 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:4/512: chown d3/d6/d9/f3c 25967079 1 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/497: creat db/de/d63/fb0 x:0 0 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/498: truncate db/de/d3e/f7a 210971 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/499: chown db/c2e 3009221 1 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/500: truncate db/de/d1f/d2b/f34 3005942 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/501: mkdir db/de/d3e/da2/dac/db1 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/502: creat db/de/d1f/fb2 x:0 0 0 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/503: chown db/de/f7b 1 1 2024-09-13T02:50:32.248 INFO:tasks.workunit.client.0.smithi100.stdout:5/504: rename db/de/d3e/d7e to db/de/d3e/d7e/d81/d85/db3 22 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/505: dread - db/de/d3e/f9a zero size 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/506: creat db/de/d3e/d7e/fb4 x:0 0 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:5/507: rmdir db/de/d1f/da5 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/379: dwrite dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/380: fdatasync dd/fe 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/381: truncate dd/d1b/d24/f67 73470 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/382: creat dd/d1b/d1d/d43/d5d/f7b x:0 0 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/383: write dd/f15 [3103288,49219] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/384: write dd/d1b/d21/d39/f4c [4288888,56989] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:9/385: chown dd/f15 128988552 1 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:2/477: dwrite d0/db/f80 [0,4194304] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:1/504: read de/d14/d2e/f4e [3580255,38703] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:3/574: read d10/d21/f29 [298117,119825] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:8/444: dwrite df/d13/d20/f61 [0,4194304] 0 2024-09-13T02:50:32.249 INFO:tasks.workunit.client.0.smithi100.stdout:7/553: dread d3/d5/d1b/d1c/f7e [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/554: read d3/d5/f2a [1580783,15294] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/555: dread - d3/d16/d55/d56/f85 zero size 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:4/513: write d3/d6/d21/d46/f47 [1726840,111368] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/556: dread d3/d5/f53 [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:1/505: creat de/d14/d22/d52/d5c/fa7 x:0 0 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/557: read d3/d16/d3b/f6a [759809,103827] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/478: read d0/db/f16 [1661043,60314] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:8/445: dread df/d5d/d70/d2c/d38/f71 [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/575: stat d10/c1e 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:4/514: dread d3/d6/fab [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:3/576: write d10/d21/d51/d5a/d5e/d89/f8d [875074,99566] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/386: dread dd/d1b/d1d/d43/f44 [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:2/479: dread d0/f11 [4194304,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:5/508: dwrite db/de/d3e/d71/f97 [0,4194304] 0 2024-09-13T02:50:32.250 INFO:tasks.workunit.client.0.smithi100.stdout:4/515: rmdir d3/dc/d9d 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:3/577: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/dc6 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:9/387: creat dd/d1b/d24/d74/d4e/f7c x:0 0 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:9/388: chown l7 2 1 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:9/389: readlink dd/d1b/d1d/d28/l75 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:2/480: creat d0/db/d79/f8b x:0 0 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:5/509: creat db/de/d1f/d2b/d9b/fb5 x:0 0 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/506: dwrite de/d14/f83 [0,4194304] 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/507: write f7 [608511,57778] 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:4/516: mkdir d3/dc/d4b/d9b/db2 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:4/517: chown d3/d6/d21/d67 905234064 1 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:2/481: dread d0/db/d21/f47 [0,4194304] 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:3/578: mkdir d10/d21/d51/d5a/d5e/d99/dc7 0 2024-09-13T02:50:32.251 INFO:tasks.workunit.client.0.smithi100.stdout:7/558: dwrite d3/f3c [0,4194304] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/390: mkdir dd/d1b/d7d 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:4/518: link d3/dc/d88/lb1 d3/d3a/d5c/lb3 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:1/508: dread de/d14/d22/f4a [0,4194304] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/391: dread dd/f12 [0,4194304] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:9/392: stat dd/d1b/d21/d39/c71 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/559: symlink d3/d16/d55/d56/d9e/lb1 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/560: write d3/d16/d55/d56/f5b [845250,86810] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/561: creat d3/d5/d4f/fb2 x:0 0 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:3/579: dread d10/d21/f60 [0,4194304] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:3/580: fdatasync d10/d21/fa8 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:4/519: mkdir d3/dc/d88/db4 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:1/509: link de/d14/f41 de/fa8 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:1/510: write de/d12/f30 [1839443,67276] 0 2024-09-13T02:50:32.252 INFO:tasks.workunit.client.0.smithi100.stdout:2/482: getdents d0/db/d5b 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/393: rename dd/f19 to dd/d1b/d7d/f7e 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:5/510: dwrite db/de/d3e/fab [0,4194304] 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:7/562: mkdir d3/d16/d55/d92/db3 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:7/563: chown d3/d5/d1b/d1c/f7f 176 1 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/511: unlink de/d14/d39/c73 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/512: readlink l3 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/513: dread de/d12/f8f [0,4194304] 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/514: stat de/d14/d44/d7f/f96 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/581: rename d10/c4c to d10/d21/d51/d5a/d5e/d71/d93/cc8 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/515: read f7 [214335,51307] 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/582: chown d10/d21/d51/d5a/d5e/cb3 95357 1 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:3/583: creat d10/d21/d51/d5a/d5e/fc9 x:0 0 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:9/394: creat dd/d1b/d7d/f7f x:0 0 0 2024-09-13T02:50:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:1/516: dread de/d14/d39/f78 [0,4194304] 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:2/483: dread d0/db/d21/d88/f43 [0,4194304] 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/584: truncate f9 7487056 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/585: truncate d10/f92 660185 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/586: write d10/f38 [306376,66954] 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/587: truncate d10/f53 2658634 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:3/588: stat d10/d21/d51/d5a/d5e/d71/d94/d9c 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:9/395: mknod dd/d1b/c80 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:1/517: mkdir de/d14/d44/d61/da9 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:5/511: getdents db/de/d3e/d7e 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:5/512: fsync db/de/d1f/d2b/f55 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:5/513: write db/de/d3e/f7a [395328,31126] 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:7/564: dwrite d3/d16/d55/f6e [0,4194304] 0 2024-09-13T02:50:32.254 INFO:tasks.workunit.client.0.smithi100.stdout:2/484: link d0/db/d21/c60 d0/db/d21/d57/c8c 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:3/589: rename d10/d21/d51/d5a/d5e/f6b to d10/d21/d51/d5a/d5e/fca 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/396: link dd/d1b/d1d/d28/f54 dd/d1b/d1d/f81 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/397: write dd/d1b/d7d/f7f [288640,25439] 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/518: rename de/d14/d2e/d69/f9c to de/d14/d22/d52/d5c/faa 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/519: dread de/d14/d22/d52/f55 [0,4194304] 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:1/520: write de/d14/d44/f47 [2251498,47370] 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:5/514: truncate f8 677249 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:7/565: mkdir d3/d5/db4 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:2/485: mkdir d0/db/d23/d8d 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/398: mknod dd/d1b/d1d/d28/c82 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/399: creat dd/d1b/d24/f83 x:0 0 0 2024-09-13T02:50:32.255 INFO:tasks.workunit.client.0.smithi100.stdout:5/515: mknod db/de/d3e/cb6 0 2024-09-13T02:50:32.256 INFO:tasks.workunit.client.0.smithi100.stdout:2/486: dread d0/db/d21/f25 [0,4194304] 0 2024-09-13T02:50:32.256 INFO:tasks.workunit.client.0.smithi100.stdout:2/487: chown d0/db/c3c 65128 1 2024-09-13T02:50:32.256 INFO:tasks.workunit.client.0.smithi100.stdout:3/590: dwrite d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 [0,4194304] 0 2024-09-13T02:50:32.256 INFO:tasks.workunit.client.0.smithi100.stdout:3/591: chown d10/d21/d51/c9e 30 1 2024-09-13T02:50:32.257 INFO:tasks.workunit.client.0.smithi100.stdout:6/474: sync 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:0/428: sync 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:0/429: write d2/d9/f81 [326151,44940] 0 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:0/430: fdatasync d2/dd/d54/d47/d34/f39 0 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:5/516: dread db/f11 [0,4194304] 0 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:5/517: chown db/de/d63/d70/l8e 49672 1 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/592: creat d10/d21/d51/d5a/d5e/d71/d97/db1/fcb x:0 0 0 2024-09-13T02:50:32.258 INFO:tasks.workunit.client.0.smithi100.stdout:6/475: symlink d12/d14/d5a/l8e 0 2024-09-13T02:50:32.259 INFO:tasks.workunit.client.0.smithi100.stdout:6/476: read - d12/d43/d4b/d4c/f5b zero size 2024-09-13T02:50:32.259 INFO:tasks.workunit.client.0.smithi100.stdout:0/431: mkdir d2/dd/d33/d43/d97 0 2024-09-13T02:50:32.259 INFO:tasks.workunit.client.0.smithi100.stdout:2/488: dread d0/db/d21/f30 [0,4194304] 0 2024-09-13T02:50:32.260 INFO:tasks.workunit.client.0.smithi100.stdout:3/593: creat d10/d21/d51/d5a/d5e/da1/fcc x:0 0 0 2024-09-13T02:50:32.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/521: dwrite de/d12/f2a [0,4194304] 0 2024-09-13T02:50:32.261 INFO:tasks.workunit.client.0.smithi100.stdout:7/566: dwrite d3/fa [0,4194304] 0 2024-09-13T02:50:32.261 INFO:tasks.workunit.client.0.smithi100.stdout:6/477: mkdir d12/d14/d4d/d8f 0 2024-09-13T02:50:32.261 INFO:tasks.workunit.client.0.smithi100.stdout:6/478: dread - d12/d43/f54 zero size 2024-09-13T02:50:32.262 INFO:tasks.workunit.client.0.smithi100.stdout:9/400: dwrite dd/d1b/d24/f83 [0,4194304] 0 2024-09-13T02:50:32.262 INFO:tasks.workunit.client.0.smithi100.stdout:0/432: creat d2/d1a/d4c/f98 x:0 0 0 2024-09-13T02:50:32.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/489: creat d0/d36/f8e x:0 0 0 2024-09-13T02:50:32.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/490: readlink d0/l53 0 2024-09-13T02:50:32.263 INFO:tasks.workunit.client.0.smithi100.stdout:2/491: truncate d0/db/d21/d57/f59 1250958 0 2024-09-13T02:50:32.268 INFO:tasks.workunit.client.0.smithi100.stdout:9/401: dread dd/f4a [0,4194304] 0 2024-09-13T02:50:32.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/518: rmdir db/de 39 2024-09-13T02:50:32.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/519: write db/f83 [508759,84391] 0 2024-09-13T02:50:32.268 INFO:tasks.workunit.client.0.smithi100.stdout:5/520: chown db/de/d1f/fa8 185 1 2024-09-13T02:50:32.269 INFO:tasks.workunit.client.0.smithi100.stdout:3/594: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd 0 2024-09-13T02:50:32.269 INFO:tasks.workunit.client.0.smithi100.stdout:3/595: fdatasync d10/d21/d51/d5a/d5e/f78 0 2024-09-13T02:50:32.272 INFO:tasks.workunit.client.0.smithi100.stdout:1/522: mkdir de/d14/d2e/d69/dab 0 2024-09-13T02:50:32.273 INFO:tasks.workunit.client.0.smithi100.stdout:7/567: symlink d3/d16/d55/d92/db3/lb5 0 2024-09-13T02:50:32.273 INFO:tasks.workunit.client.0.smithi100.stdout:7/568: dread - d3/f4c zero size 2024-09-13T02:50:32.274 INFO:tasks.workunit.client.0.smithi100.stdout:5/521: dread db/f5b [0,4194304] 0 2024-09-13T02:50:32.274 INFO:tasks.workunit.client.0.smithi100.stdout:5/522: write db/de/d3e/f9a [823763,93460] 0 2024-09-13T02:50:32.275 INFO:tasks.workunit.client.0.smithi100.stdout:5/523: chown db/de/d1f/d2b/c56 323 1 2024-09-13T02:50:32.280 INFO:tasks.workunit.client.0.smithi100.stdout:0/433: link d2/dd/c31 d2/dd/d33/d43/d4b/c99 0 2024-09-13T02:50:32.281 INFO:tasks.workunit.client.0.smithi100.stdout:9/402: symlink dd/d1b/d1d/d43/l84 0 2024-09-13T02:50:32.282 INFO:tasks.workunit.client.0.smithi100.stdout:3/596: chown d10/c30 1859 1 2024-09-13T02:50:32.283 INFO:tasks.workunit.client.0.smithi100.stdout:7/569: mknod d3/d16/d55/d92/da9/cb6 0 2024-09-13T02:50:32.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/403: dread dd/f4a [0,4194304] 0 2024-09-13T02:50:32.283 INFO:tasks.workunit.client.0.smithi100.stdout:3/597: dread d10/d21/f2d [0,4194304] 0 2024-09-13T02:50:32.283 INFO:tasks.workunit.client.0.smithi100.stdout:3/598: fdatasync d10/f79 0 2024-09-13T02:50:32.284 INFO:tasks.workunit.client.0.smithi100.stdout:6/479: rmdir d12/d14/d1c 39 2024-09-13T02:50:32.285 INFO:tasks.workunit.client.0.smithi100.stdout:8/446: sync 2024-09-13T02:50:32.285 INFO:tasks.workunit.client.0.smithi100.stdout:5/524: creat db/de/d3e/da2/dac/db1/fb7 x:0 0 0 2024-09-13T02:50:32.287 INFO:tasks.workunit.client.0.smithi100.stdout:0/434: symlink d2/dd/d33/l9a 0 2024-09-13T02:50:32.287 INFO:tasks.workunit.client.0.smithi100.stdout:0/435: chown d2/dd/d54/d28/f4a 396953915 1 2024-09-13T02:50:32.288 INFO:tasks.workunit.client.0.smithi100.stdout:2/492: rmdir d0/db/d68/d6b/d71 39 2024-09-13T02:50:32.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/570: creat d3/d16/d55/d92/da2/fb7 x:0 0 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:7/571: chown d3/d16 64500 1 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:6/480: mkdir d12/d2e/d90 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:1/523: dwrite f7 [0,4194304] 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:5/525: rmdir db/de/d1f 39 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:0/436: creat d2/d9/d6d/d85/f9b x:0 0 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/493: mkdir d0/db/d23/d8d/d8f 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/494: write d0/f19 [1297502,2916] 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/495: chown d0/l42 484 1 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/496: fsync d0/db/d3f/f89 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/497: readlink d0/db/d21/d88/l7b 0 2024-09-13T02:50:32.294 INFO:tasks.workunit.client.0.smithi100.stdout:2/498: chown d0/db/c4c 0 1 2024-09-13T02:50:32.296 INFO:tasks.workunit.client.0.smithi100.stdout:1/524: mknod de/cac 0 2024-09-13T02:50:32.297 INFO:tasks.workunit.client.0.smithi100.stdout:5/526: symlink db/de/d1f/d78/lb8 0 2024-09-13T02:50:32.298 INFO:tasks.workunit.client.0.smithi100.stdout:0/437: creat d2/d1a/f9c x:0 0 0 2024-09-13T02:50:32.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/499: mknod d0/db/d23/d8d/c90 0 2024-09-13T02:50:32.300 INFO:tasks.workunit.client.0.smithi100.stdout:5/527: creat db/de/d1f/fb9 x:0 0 0 2024-09-13T02:50:32.300 INFO:tasks.workunit.client.0.smithi100.stdout:0/438: truncate d2/dd/d54/d47/d34/f2b 7777 0 2024-09-13T02:50:32.302 INFO:tasks.workunit.client.0.smithi100.stdout:5/528: unlink db/de/d1f/l5e 0 2024-09-13T02:50:32.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/572: write d3/d16/d55/f6e [1818750,62588] 0 2024-09-13T02:50:32.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/573: readlink d3/d5/d1b/d1c/d36/l7a 0 2024-09-13T02:50:32.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/574: write d3/d5/d1b/d1c/f84 [226947,43601] 0 2024-09-13T02:50:32.304 INFO:tasks.workunit.client.0.smithi100.stdout:5/529: rename db/de/f15 to db/de/d3e/d7e/fba 0 2024-09-13T02:50:32.305 INFO:tasks.workunit.client.0.smithi100.stdout:7/575: getdents d3/d16/d55/d56 0 2024-09-13T02:50:32.305 INFO:tasks.workunit.client.0.smithi100.stdout:5/530: write db/de/d3e/f9a [92254,54023] 0 2024-09-13T02:50:32.306 INFO:tasks.workunit.client.0.smithi100.stdout:0/439: link d2/d1a/l25 d2/dd/d54/d3e/d5d/l9d 0 2024-09-13T02:50:32.306 INFO:tasks.workunit.client.0.smithi100.stdout:7/576: mknod d3/d16/d3b/d8c/cb8 0 2024-09-13T02:50:32.307 INFO:tasks.workunit.client.0.smithi100.stdout:5/531: creat db/de/d63/fbb x:0 0 0 2024-09-13T02:50:32.308 INFO:tasks.workunit.client.0.smithi100.stdout:0/440: creat d2/dd/f9e x:0 0 0 2024-09-13T02:50:32.308 INFO:tasks.workunit.client.0.smithi100.stdout:0/441: fdatasync d2/dd/d54/d47/f77 0 2024-09-13T02:50:32.309 INFO:tasks.workunit.client.0.smithi100.stdout:7/577: getdents d3/d16/d3b/da5 0 2024-09-13T02:50:32.309 INFO:tasks.workunit.client.0.smithi100.stdout:5/532: mknod db/de/d63/d70/cbc 0 2024-09-13T02:50:32.310 INFO:tasks.workunit.client.0.smithi100.stdout:0/442: mknod d2/dd/d54/d47/c9f 0 2024-09-13T02:50:32.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/578: link d3/d5/f53 d3/d16/d3b/da5/d87/fb9 0 2024-09-13T02:50:32.311 INFO:tasks.workunit.client.0.smithi100.stdout:7/579: fsync d3/d16/d55/d56/d9e/d9f/fa3 0 2024-09-13T02:50:32.312 INFO:tasks.workunit.client.0.smithi100.stdout:5/533: creat db/de/fbd x:0 0 0 2024-09-13T02:50:32.313 INFO:tasks.workunit.client.0.smithi100.stdout:5/534: unlink db/de/f45 0 2024-09-13T02:50:32.314 INFO:tasks.workunit.client.0.smithi100.stdout:5/535: mkdir db/de/d1f/d2b/dbe 0 2024-09-13T02:50:32.318 INFO:tasks.workunit.client.0.smithi100.stdout:1/525: dread f7 [0,4194304] 0 2024-09-13T02:50:32.318 INFO:tasks.workunit.client.0.smithi100.stdout:1/526: stat de/d14/d44/f5d 0 2024-09-13T02:50:32.319 INFO:tasks.workunit.client.0.smithi100.stdout:1/527: symlink de/d14/d2e/lad 0 2024-09-13T02:50:32.321 INFO:tasks.workunit.client.0.smithi100.stdout:1/528: write de/f3a [5019699,108138] 0 2024-09-13T02:50:32.322 INFO:tasks.workunit.client.0.smithi100.stdout:1/529: rmdir de/d14/d2e/d69/dab 0 2024-09-13T02:50:32.323 INFO:tasks.workunit.client.0.smithi100.stdout:1/530: mknod de/d14/d22/d29/d68/cae 0 2024-09-13T02:50:32.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/531: rename de/d14/d2e/d75/l85 to de/d14/d2e/d75/laf 0 2024-09-13T02:50:32.325 INFO:tasks.workunit.client.0.smithi100.stdout:9/404: dwrite dd/f76 [0,4194304] 0 2024-09-13T02:50:32.325 INFO:tasks.workunit.client.0.smithi100.stdout:9/405: chown dd/d1b/c34 54321114 1 2024-09-13T02:50:32.325 INFO:tasks.workunit.client.0.smithi100.stdout:9/406: stat dd/d1b/d24/f83 0 2024-09-13T02:50:32.325 INFO:tasks.workunit.client.0.smithi100.stdout:1/532: unlink de/d14/d2e/d48/f4c 0 2024-09-13T02:50:32.326 INFO:tasks.workunit.client.0.smithi100.stdout:7/580: write d3/d16/d3b/f45 [1666465,80910] 0 2024-09-13T02:50:32.326 INFO:tasks.workunit.client.0.smithi100.stdout:9/407: read dd/d1b/d24/d74/f37 [445300,73585] 0 2024-09-13T02:50:32.329 INFO:tasks.workunit.client.0.smithi100.stdout:9/408: unlink dd/d1b/d1d/c78 0 2024-09-13T02:50:32.330 INFO:tasks.workunit.client.0.smithi100.stdout:3/599: dwrite d10/d21/d51/d5a/d5e/d90/fa0 [4194304,4194304] 0 2024-09-13T02:50:32.331 INFO:tasks.workunit.client.0.smithi100.stdout:3/600: rename d10/d21/f46 to d10/d21/d51/d5a/d5e/d71/d94/fce 0 2024-09-13T02:50:32.331 INFO:tasks.workunit.client.0.smithi100.stdout:3/601: fsync d10/d21/f2d 0 2024-09-13T02:50:32.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/602: symlink d10/d21/d51/d5a/d5e/d71/d97/db1/lcf 0 2024-09-13T02:50:32.332 INFO:tasks.workunit.client.0.smithi100.stdout:3/603: fsync d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 0 2024-09-13T02:50:32.336 INFO:tasks.workunit.client.0.smithi100.stdout:8/447: dwrite df/d13/d21/f29 [0,4194304] 0 2024-09-13T02:50:32.336 INFO:tasks.workunit.client.0.smithi100.stdout:8/448: readlink df/d13/d20/l31 0 2024-09-13T02:50:32.337 INFO:tasks.workunit.client.0.smithi100.stdout:8/449: dread - df/d13/d68/f9d zero size 2024-09-13T02:50:32.339 INFO:tasks.workunit.client.0.smithi100.stdout:8/450: link df/d13/c6e df/d13/d21/d81/d93/ca7 0 2024-09-13T02:50:32.341 INFO:tasks.workunit.client.0.smithi100.stdout:7/581: read d3/d16/d3b/da5/f4a [2411898,72034] 0 2024-09-13T02:50:32.342 INFO:tasks.workunit.client.0.smithi100.stdout:7/582: read d3/d16/d55/d56/f5b [375436,104911] 0 2024-09-13T02:50:32.342 INFO:tasks.workunit.client.0.smithi100.stdout:8/451: link df/d13/d21/d81/f8d df/d5d/fa8 0 2024-09-13T02:50:32.342 INFO:tasks.workunit.client.0.smithi100.stdout:8/452: dread - df/d5d/d70/f9f zero size 2024-09-13T02:50:32.344 INFO:tasks.workunit.client.0.smithi100.stdout:0/443: dread d2/d9/f81 [0,4194304] 0 2024-09-13T02:50:32.344 INFO:tasks.workunit.client.0.smithi100.stdout:8/453: symlink df/d13/d21/d81/la9 0 2024-09-13T02:50:32.345 INFO:tasks.workunit.client.0.smithi100.stdout:2/500: dwrite d0/db/f16 [0,4194304] 0 2024-09-13T02:50:32.345 INFO:tasks.workunit.client.0.smithi100.stdout:0/444: mknod d2/dd/d33/ca0 0 2024-09-13T02:50:32.345 INFO:tasks.workunit.client.0.smithi100.stdout:5/536: dwrite db/de/d1f/d2b/f55 [0,4194304] 0 2024-09-13T02:50:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:6/481: dwrite d12/d14/d1c/d6e/d71/f86 [0,4194304] 0 2024-09-13T02:50:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:6/482: write d12/d14/d2f/d45/d73/f81 [1647432,110632] 0 2024-09-13T02:50:32.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/501: stat d0/db/d21/d88/l7b 0 2024-09-13T02:50:32.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/520: sync 2024-09-13T02:50:32.347 INFO:tasks.workunit.client.0.smithi100.stdout:4/521: write d3/dc/d4b/d52/f64 [209475,66522] 0 2024-09-13T02:50:32.352 INFO:tasks.workunit.client.0.smithi100.stdout:9/409: dwrite f5 [0,4194304] 0 2024-09-13T02:50:32.356 INFO:tasks.workunit.client.0.smithi100.stdout:6/483: fdatasync d12/d43/d4b/d4c/d36/f46 0 2024-09-13T02:50:32.356 INFO:tasks.workunit.client.0.smithi100.stdout:8/454: write df/d13/f59 [1694498,61005] 0 2024-09-13T02:50:32.360 INFO:tasks.workunit.client.0.smithi100.stdout:2/502: mknod d0/db/d3f/d6a/d7f/c91 0 2024-09-13T02:50:32.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/522: symlink d3/dc/lb5 0 2024-09-13T02:50:32.363 INFO:tasks.workunit.client.0.smithi100.stdout:4/523: dread - d3/d63/fa0 zero size 2024-09-13T02:50:32.363 INFO:tasks.workunit.client.0.smithi100.stdout:3/604: dwrite d10/d21/d51/d5a/d5e/d71/d93/fc2 [4194304,4194304] 0 2024-09-13T02:50:32.363 INFO:tasks.workunit.client.0.smithi100.stdout:3/605: write d10/d21/d51/d6c/f6d [660553,10676] 0 2024-09-13T02:50:32.364 INFO:tasks.workunit.client.0.smithi100.stdout:0/445: rmdir d2/dd/d54/d28 39 2024-09-13T02:50:32.365 INFO:tasks.workunit.client.0.smithi100.stdout:6/484: getdents d12/d14/d1c/d6e/d71 0 2024-09-13T02:50:32.367 INFO:tasks.workunit.client.0.smithi100.stdout:0/446: dread d2/d9/f1b [0,4194304] 0 2024-09-13T02:50:32.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/455: link df/d13/d21/d81/f82 df/d5d/d70/d2c/faa 0 2024-09-13T02:50:32.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/456: stat df/d5d/d70/d2c/l4b 0 2024-09-13T02:50:32.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/457: dread - df/d13/d20/f7a zero size 2024-09-13T02:50:32.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/458: creat df/d13/d68/fab x:0 0 0 2024-09-13T02:50:32.371 INFO:tasks.workunit.client.0.smithi100.stdout:6/485: mknod d12/d43/d4b/d4c/c91 0 2024-09-13T02:50:32.371 INFO:tasks.workunit.client.0.smithi100.stdout:0/447: creat d2/dd/d54/d28/fa1 x:0 0 0 2024-09-13T02:50:32.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/459: mkdir df/dac 0 2024-09-13T02:50:32.375 INFO:tasks.workunit.client.0.smithi100.stdout:3/606: rename d10/d21/d51/d5a/cab to d10/d21/d51/d5a/d5e/d89/cd0 0 2024-09-13T02:50:32.377 INFO:tasks.workunit.client.0.smithi100.stdout:6/486: unlink l10 0 2024-09-13T02:50:32.378 INFO:tasks.workunit.client.0.smithi100.stdout:0/448: mkdir d2/dd/d93/da2 0 2024-09-13T02:50:32.380 INFO:tasks.workunit.client.0.smithi100.stdout:8/460: mkdir df/d5d/d70/d2c/d38/d9e/dad 0 2024-09-13T02:50:32.382 INFO:tasks.workunit.client.0.smithi100.stdout:6/487: mkdir d12/d2e/d90/d92 0 2024-09-13T02:50:32.383 INFO:tasks.workunit.client.0.smithi100.stdout:8/461: creat df/d13/d20/da2/fae x:0 0 0 2024-09-13T02:50:32.384 INFO:tasks.workunit.client.0.smithi100.stdout:6/488: link d12/d14/c3e d12/d14/d1c/d6e/d71/c93 0 2024-09-13T02:50:32.384 INFO:tasks.workunit.client.0.smithi100.stdout:8/462: dread df/d13/d21/d81/f82 [0,4194304] 0 2024-09-13T02:50:32.384 INFO:tasks.workunit.client.0.smithi100.stdout:8/463: fdatasync df/d5d/d88/f90 0 2024-09-13T02:50:32.387 INFO:tasks.workunit.client.0.smithi100.stdout:8/464: creat df/d85/faf x:0 0 0 2024-09-13T02:50:32.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/489: rmdir d12/d14/d21 39 2024-09-13T02:50:32.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/490: write d12/d14/d2f/d45/d73/f80 [956054,3050] 0 2024-09-13T02:50:32.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/491: symlink d12/d14/d4d/l94 0 2024-09-13T02:50:32.389 INFO:tasks.workunit.client.0.smithi100.stdout:0/449: dread d2/dd/d54/d47/d34/d3c/f8f [0,4194304] 0 2024-09-13T02:50:32.389 INFO:tasks.workunit.client.0.smithi100.stdout:0/450: fsync d2/dd/d33/d43/d4b/f4d 0 2024-09-13T02:50:32.389 INFO:tasks.workunit.client.0.smithi100.stdout:6/492: getdents d12/d14/d68 0 2024-09-13T02:50:32.390 INFO:tasks.workunit.client.0.smithi100.stdout:0/451: mkdir d2/dd/d54/d47/d34/da3 0 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/493: mknod d12/d14/d1c/d28/d88/c95 0 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/494: chown d12/c15 4850 1 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/495: creat d12/d43/d4b/f96 x:0 0 0 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:6/496: fdatasync d12/d14/d1c/d28/f78 0 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:7/583: dwrite d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:32.391 INFO:tasks.workunit.client.0.smithi100.stdout:0/452: creat d2/dd/d93/fa4 x:0 0 0 2024-09-13T02:50:32.393 INFO:tasks.workunit.client.0.smithi100.stdout:6/497: creat d12/d14/d1c/d6e/d71/f97 x:0 0 0 2024-09-13T02:50:32.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/584: symlink d3/d5/d1b/d1c/d36/lba 0 2024-09-13T02:50:32.394 INFO:tasks.workunit.client.0.smithi100.stdout:7/585: creat d3/d5/d4f/fbb x:0 0 0 2024-09-13T02:50:32.395 INFO:tasks.workunit.client.0.smithi100.stdout:6/498: truncate d12/d14/d1c/f3a 779983 0 2024-09-13T02:50:32.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/410: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:50:32.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/411: stat dd/d1b/d1d/l4b 0 2024-09-13T02:50:32.397 INFO:tasks.workunit.client.0.smithi100.stdout:9/412: chown dd/d1b/d1d/d43 495859582 1 2024-09-13T02:50:32.399 INFO:tasks.workunit.client.0.smithi100.stdout:4/524: dwrite d3/d63/fa0 [0,4194304] 0 2024-09-13T02:50:32.399 INFO:tasks.workunit.client.0.smithi100.stdout:9/413: link dd/l11 dd/d1b/d1d/d43/l85 0 2024-09-13T02:50:32.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/607: dwrite d10/f40 [0,4194304] 0 2024-09-13T02:50:32.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/608: chown d10/l4f 0 1 2024-09-13T02:50:32.401 INFO:tasks.workunit.client.0.smithi100.stdout:5/537: dwrite db/de/f7b [4194304,4194304] 0 2024-09-13T02:50:32.405 INFO:tasks.workunit.client.0.smithi100.stdout:4/525: creat d3/dc/d4b/d9b/fb6 x:0 0 0 2024-09-13T02:50:32.405 INFO:tasks.workunit.client.0.smithi100.stdout:6/499: write d12/d14/d2f/f33 [3566585,38693] 0 2024-09-13T02:50:32.406 INFO:tasks.workunit.client.0.smithi100.stdout:3/609: creat d10/d21/d51/d5a/d5e/d99/fd1 x:0 0 0 2024-09-13T02:50:32.410 INFO:tasks.workunit.client.0.smithi100.stdout:4/526: creat d3/d6/d21/d46/fb7 x:0 0 0 2024-09-13T02:50:32.410 INFO:tasks.workunit.client.0.smithi100.stdout:4/527: write d3/d6/d21/d67/f90 [264986,71695] 0 2024-09-13T02:50:32.410 INFO:tasks.workunit.client.0.smithi100.stdout:4/528: write d3/d6/d21/d46/d34/d96/d99/fad [3881269,39710] 0 2024-09-13T02:50:32.412 INFO:tasks.workunit.client.0.smithi100.stdout:3/610: mknod d10/d21/d51/d5a/d5e/d89/cd2 0 2024-09-13T02:50:32.413 INFO:tasks.workunit.client.0.smithi100.stdout:6/500: rename d12/f27 to d12/d43/d4b/d4c/d36/f98 0 2024-09-13T02:50:32.415 INFO:tasks.workunit.client.0.smithi100.stdout:9/414: rename dd/d1b/d21/d39 to dd/d1b/d21/d86 0 2024-09-13T02:50:32.415 INFO:tasks.workunit.client.0.smithi100.stdout:9/415: creat dd/d1b/f87 x:0 0 0 2024-09-13T02:50:32.415 INFO:tasks.workunit.client.0.smithi100.stdout:3/611: mkdir d10/d21/d51/d6c/dd3 0 2024-09-13T02:50:32.416 INFO:tasks.workunit.client.0.smithi100.stdout:6/501: link l1 d12/d14/l99 0 2024-09-13T02:50:32.418 INFO:tasks.workunit.client.0.smithi100.stdout:9/416: creat dd/d1b/d24/d74/d4e/d58/f88 x:0 0 0 2024-09-13T02:50:32.418 INFO:tasks.workunit.client.0.smithi100.stdout:9/417: stat dd/d1b/d24/d74/d4e/d58 0 2024-09-13T02:50:32.418 INFO:tasks.workunit.client.0.smithi100.stdout:9/418: fdatasync dd/fe 0 2024-09-13T02:50:32.419 INFO:tasks.workunit.client.0.smithi100.stdout:7/586: dwrite d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:32.419 INFO:tasks.workunit.client.0.smithi100.stdout:5/538: dwrite db/de/d63/fa0 [0,4194304] 0 2024-09-13T02:50:32.419 INFO:tasks.workunit.client.0.smithi100.stdout:6/502: rename d12/d14/d1c/d28/c69 to d12/d2e/d90/d92/c9a 0 2024-09-13T02:50:32.425 INFO:tasks.workunit.client.0.smithi100.stdout:5/539: write db/de/d63/f65 [1234724,36544] 0 2024-09-13T02:50:32.425 INFO:tasks.workunit.client.0.smithi100.stdout:5/540: write db/f8f [645300,23976] 0 2024-09-13T02:50:32.427 INFO:tasks.workunit.client.0.smithi100.stdout:9/419: rename dd/d1b/c34 to dd/d1b/d21/d86/c89 0 2024-09-13T02:50:32.427 INFO:tasks.workunit.client.0.smithi100.stdout:6/503: truncate d12/d43/d4b/d4c/d36/f63 484618 0 2024-09-13T02:50:32.428 INFO:tasks.workunit.client.0.smithi100.stdout:5/541: symlink db/de/d63/d9c/lbf 0 2024-09-13T02:50:32.429 INFO:tasks.workunit.client.0.smithi100.stdout:5/542: readlink db/l50 0 2024-09-13T02:50:32.429 INFO:tasks.workunit.client.0.smithi100.stdout:9/420: unlink dd/d1b/d24/d74/d3c/f46 0 2024-09-13T02:50:32.431 INFO:tasks.workunit.client.0.smithi100.stdout:5/543: mknod db/de/d1f/cc0 0 2024-09-13T02:50:32.437 INFO:tasks.workunit.client.0.smithi100.stdout:9/421: write dd/d1b/d1d/d43/d5d/f64 [2306852,64372] 0 2024-09-13T02:50:32.437 INFO:tasks.workunit.client.0.smithi100.stdout:9/422: fsync dd/d1b/d21/f62 0 2024-09-13T02:50:32.439 INFO:tasks.workunit.client.0.smithi100.stdout:9/423: getdents dd/d1b/d1d/d43/d5d 0 2024-09-13T02:50:32.440 INFO:tasks.workunit.client.0.smithi100.stdout:9/424: creat dd/d1b/d31/f8a x:0 0 0 2024-09-13T02:50:32.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/425: symlink dd/d1b/d24/d74/d4e/d58/l8b 0 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/426: creat dd/d1b/d1d/d28/f8c x:0 0 0 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/427: write dd/d1b/d24/d74/d4e/d58/f88 [97068,68468] 0 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/428: truncate dd/d1b/d24/f35 1177356 0 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/429: truncate dd/d1b/d27/d51/f57 1224996 0 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/430: chown dd/d1b/d7d/f7f 165784 1 2024-09-13T02:50:32.443 INFO:tasks.workunit.client.0.smithi100.stdout:9/431: chown dd/d1b/d1d/l4b 7 1 2024-09-13T02:50:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:9/432: truncate dd/f4a 1544480 0 2024-09-13T02:50:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:9/433: mknod dd/d1b/d24/d74/c8d 0 2024-09-13T02:50:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:9/434: chown dd/d1b/d1d/f81 905 1 2024-09-13T02:50:32.444 INFO:tasks.workunit.client.0.smithi100.stdout:9/435: truncate dd/d1b/d24/f67 693377 0 2024-09-13T02:50:32.445 INFO:tasks.workunit.client.0.smithi100.stdout:9/436: getdents dd/d1b/d1d 0 2024-09-13T02:50:32.447 INFO:tasks.workunit.client.0.smithi100.stdout:5/544: dwrite db/de/d3e/d7e/fb4 [0,4194304] 0 2024-09-13T02:50:32.447 INFO:tasks.workunit.client.0.smithi100.stdout:9/437: link dd/d1b/d1d/f81 dd/d1b/d24/f8e 0 2024-09-13T02:50:32.451 INFO:tasks.workunit.client.0.smithi100.stdout:1/533: sync 2024-09-13T02:50:32.451 INFO:tasks.workunit.client.0.smithi100.stdout:1/534: write de/d14/d22/d52/d65/fa3 [554759,26739] 0 2024-09-13T02:50:32.452 INFO:tasks.workunit.client.0.smithi100.stdout:1/535: write de/d14/d22/d29/d64/f89 [212621,42398] 0 2024-09-13T02:50:32.452 INFO:tasks.workunit.client.0.smithi100.stdout:1/536: truncate de/fa8 1043528 0 2024-09-13T02:50:32.452 INFO:tasks.workunit.client.0.smithi100.stdout:1/537: write de/f7d [1224407,82574] 0 2024-09-13T02:50:32.452 INFO:tasks.workunit.client.0.smithi100.stdout:1/538: truncate de/d12/f3e 1155879 0 2024-09-13T02:50:32.454 INFO:tasks.workunit.client.0.smithi100.stdout:5/545: mknod db/de/cc1 0 2024-09-13T02:50:32.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/504: dwrite d12/d43/d4b/d4c/d36/f38 [0,4194304] 0 2024-09-13T02:50:32.479 INFO:tasks.workunit.client.0.smithi100.stdout:9/438: dwrite dd/d1b/d24/d74/f37 [0,4194304] 0 2024-09-13T02:50:32.479 INFO:tasks.workunit.client.0.smithi100.stdout:5/546: dwrite db/de/d3e/f7a [0,4194304] 0 2024-09-13T02:50:32.480 INFO:tasks.workunit.client.0.smithi100.stdout:5/547: fsync db/de/d1f/f9e 0 2024-09-13T02:50:32.482 INFO:tasks.workunit.client.0.smithi100.stdout:6/505: truncate d12/d2e/f3b 3537386 0 2024-09-13T02:50:32.482 INFO:tasks.workunit.client.0.smithi100.stdout:6/506: chown d12/d43/d4b/d4c/f5b 28166052 1 2024-09-13T02:50:32.483 INFO:tasks.workunit.client.0.smithi100.stdout:9/439: mknod dd/d1b/d27/d51/c8f 0 2024-09-13T02:50:32.484 INFO:tasks.workunit.client.0.smithi100.stdout:9/440: read dd/d1b/d7d/f7f [19736,124036] 0 2024-09-13T02:50:32.484 INFO:tasks.workunit.client.0.smithi100.stdout:9/441: stat dd/d1b/d24/f8e 0 2024-09-13T02:50:32.486 INFO:tasks.workunit.client.0.smithi100.stdout:5/548: unlink db/de/d1f/f98 0 2024-09-13T02:50:32.486 INFO:tasks.workunit.client.0.smithi100.stdout:5/549: dread - db/de/d3e/d7e/fa7 zero size 2024-09-13T02:50:32.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/507: mknod d12/d14/d1c/d7b/c9b 0 2024-09-13T02:50:32.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/508: creat d12/d14/f9c x:0 0 0 2024-09-13T02:50:32.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/509: truncate d12/d14/d1c/d6e/d71/f97 173042 0 2024-09-13T02:50:32.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/510: write d12/d14/d1c/d6e/d71/f97 [301465,62930] 0 2024-09-13T02:50:32.488 INFO:tasks.workunit.client.0.smithi100.stdout:5/550: symlink db/de/d1f/d78/lc2 0 2024-09-13T02:50:32.490 INFO:tasks.workunit.client.0.smithi100.stdout:9/442: getdents dd/d1b/d24 0 2024-09-13T02:50:32.492 INFO:tasks.workunit.client.0.smithi100.stdout:9/443: stat dd/d1b/d1d/d43/l85 0 2024-09-13T02:50:32.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/444: creat dd/d1b/d21/d86/f90 x:0 0 0 2024-09-13T02:50:32.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/445: creat dd/d1b/d24/d74/d3c/f91 x:0 0 0 2024-09-13T02:50:32.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/446: dread - dd/d1b/d24/f8e zero size 2024-09-13T02:50:32.498 INFO:tasks.workunit.client.0.smithi100.stdout:9/447: symlink dd/d1b/d24/d74/l92 0 2024-09-13T02:50:32.499 INFO:tasks.workunit.client.0.smithi100.stdout:9/448: mkdir dd/d1b/d24/d74/d3c/d93 0 2024-09-13T02:50:32.499 INFO:tasks.workunit.client.0.smithi100.stdout:9/449: fsync dd/d1b/d1d/d43/d5d/f72 0 2024-09-13T02:50:32.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/511: dwrite d12/d14/f1a [4194304,4194304] 0 2024-09-13T02:50:32.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/512: truncate d12/d14/d1c/f84 687110 0 2024-09-13T02:50:32.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/513: chown d12/c15 430535 1 2024-09-13T02:50:32.525 INFO:tasks.workunit.client.0.smithi100.stdout:5/551: dwrite db/de/d3e/d7e/d81/d85/f8b [0,4194304] 0 2024-09-13T02:50:32.525 INFO:tasks.workunit.client.0.smithi100.stdout:9/450: dwrite dd/d1b/d24/d74/f37 [0,4194304] 0 2024-09-13T02:50:32.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/514: stat d12/d2e/c31 0 2024-09-13T02:50:32.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/515: fdatasync d12/d14/d1c/f30 0 2024-09-13T02:50:32.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/516: chown d12/d43/d4b/d4c/d36/f38 23 1 2024-09-13T02:50:32.533 INFO:tasks.workunit.client.0.smithi100.stdout:5/552: mkdir db/de/d3e/dc3 0 2024-09-13T02:50:32.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/517: mkdir d12/d14/d9d 0 2024-09-13T02:50:32.534 INFO:tasks.workunit.client.0.smithi100.stdout:6/518: read d12/d14/d2f/d45/f49 [426739,118372] 0 2024-09-13T02:50:32.535 INFO:tasks.workunit.client.0.smithi100.stdout:9/451: dread dd/d1b/d1d/f1f [0,4194304] 0 2024-09-13T02:50:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/519: dread d12/d14/d21/f76 [0,4194304] 0 2024-09-13T02:50:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/520: chown d12/d14/d2f 6781093 1 2024-09-13T02:50:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/521: fdatasync d12/f5c 0 2024-09-13T02:50:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/522: chown d12/d14/d1c/f62 31 1 2024-09-13T02:50:32.536 INFO:tasks.workunit.client.0.smithi100.stdout:6/523: write d12/d14/d1c/d6e/f8b [774225,39681] 0 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:5/553: write db/f8f [507495,4811] 0 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:9/452: symlink dd/d1b/d21/d86/l94 0 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:9/453: write dd/d1b/d24/f8e [41753,119504] 0 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/524: rmdir d12/d14/d21 39 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/525: write d12/d14/d2f/d45/f49 [2617212,29824] 0 2024-09-13T02:50:32.537 INFO:tasks.workunit.client.0.smithi100.stdout:6/526: creat d12/d43/d4b/d4c/f9e x:0 0 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/554: creat db/de/d1f/d78/fc4 x:0 0 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/555: write db/de/d1f/d2b/f79 [174745,37845] 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/556: write db/de/d3e/f42 [733929,40345] 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/557: fdatasync db/de/d3e/f66 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/558: truncate db/de/d3e/da2/fa4 304758 0 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:5/559: dread - db/de/d3e/d7e/fa7 zero size 2024-09-13T02:50:32.538 INFO:tasks.workunit.client.0.smithi100.stdout:9/454: symlink dd/d1b/d1d/d43/d4f/l95 0 2024-09-13T02:50:32.539 INFO:tasks.workunit.client.0.smithi100.stdout:6/527: rmdir d12/d14/d68 39 2024-09-13T02:50:32.539 INFO:tasks.workunit.client.0.smithi100.stdout:5/560: symlink db/de/d3e/d7e/d81/lc5 0 2024-09-13T02:50:32.540 INFO:tasks.workunit.client.0.smithi100.stdout:6/528: mkdir d12/d14/d1c/d28/d88/d9f 0 2024-09-13T02:50:32.540 INFO:tasks.workunit.client.0.smithi100.stdout:6/529: truncate d12/d14/d21/f55 22948 0 2024-09-13T02:50:32.540 INFO:tasks.workunit.client.0.smithi100.stdout:2/503: sync 2024-09-13T02:50:32.540 INFO:tasks.workunit.client.0.smithi100.stdout:6/530: mknod d12/d43/ca0 0 2024-09-13T02:50:32.541 INFO:tasks.workunit.client.0.smithi100.stdout:5/561: getdents db/de/d3e/da2/dac/db1 0 2024-09-13T02:50:32.542 INFO:tasks.workunit.client.0.smithi100.stdout:6/531: unlink d12/d14/d1c/f84 0 2024-09-13T02:50:32.544 INFO:tasks.workunit.client.0.smithi100.stdout:5/562: symlink db/de/d1f/lc6 0 2024-09-13T02:50:32.547 INFO:tasks.workunit.client.0.smithi100.stdout:6/532: rmdir d12/d14/d2f/d45 39 2024-09-13T02:50:32.549 INFO:tasks.workunit.client.0.smithi100.stdout:6/533: unlink d12/d14/d1c/d7b/c9b 0 2024-09-13T02:50:32.549 INFO:tasks.workunit.client.0.smithi100.stdout:6/534: write d12/d14/d2f/d6c/f6d [680823,48363] 0 2024-09-13T02:50:32.549 INFO:tasks.workunit.client.0.smithi100.stdout:6/535: write d12/d14/d21/f76 [531148,124905] 0 2024-09-13T02:50:32.550 INFO:tasks.workunit.client.0.smithi100.stdout:2/504: read d0/db/d21/f47 [2466438,112865] 0 2024-09-13T02:50:32.551 INFO:tasks.workunit.client.0.smithi100.stdout:6/536: creat d12/d14/d1c/fa1 x:0 0 0 2024-09-13T02:50:32.552 INFO:tasks.workunit.client.0.smithi100.stdout:2/505: mkdir d0/db/d68/d6b/d71/d92 0 2024-09-13T02:50:32.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/537: stat d12/d14/d1c/c4e 0 2024-09-13T02:50:32.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/538: chown d12/d14/d2f/d6c 3054 1 2024-09-13T02:50:32.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/539: fsync d12/d43/d4b/d4c/f5b 0 2024-09-13T02:50:32.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/506: truncate d0/f1f 2104793 0 2024-09-13T02:50:32.553 INFO:tasks.workunit.client.0.smithi100.stdout:2/507: creat d0/db/d21/f93 x:0 0 0 2024-09-13T02:50:32.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/540: rename d12/d14/d2f/d6c to d12/d2e/d90/da2 0 2024-09-13T02:50:32.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/541: write d12/d14/d1c/d6e/f8b [576127,92299] 0 2024-09-13T02:50:32.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/542: fsync d12/d14/d2f/d45/d73/f81 0 2024-09-13T02:50:32.558 INFO:tasks.workunit.client.0.smithi100.stdout:6/543: dread - d12/d43/d4b/d4c/f5b zero size 2024-09-13T02:50:32.559 INFO:tasks.workunit.client.0.smithi100.stdout:6/544: stat d12/d14/d1c/d6e/d71/c93 0 2024-09-13T02:50:32.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/455: dwrite dd/d1b/d1d/d43/f44 [4194304,4194304] 0 2024-09-13T02:50:32.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/456: dread - dd/d1b/d1d/d43/d5d/f7b zero size 2024-09-13T02:50:32.562 INFO:tasks.workunit.client.0.smithi100.stdout:5/563: dwrite db/de/d3e/d7e/d81/d85/fa9 [4194304,4194304] 0 2024-09-13T02:50:32.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/457: creat dd/d1b/d24/d74/d4e/f96 x:0 0 0 2024-09-13T02:50:32.571 INFO:tasks.workunit.client.0.smithi100.stdout:5/564: symlink db/lc7 0 2024-09-13T02:50:32.572 INFO:tasks.workunit.client.0.smithi100.stdout:5/565: getdents db/de/d3e/da2/dac 0 2024-09-13T02:50:32.581 INFO:tasks.workunit.client.0.smithi100.stdout:2/508: dwrite d0/db/d68/d6b/d71/d73/f7e [0,4194304] 0 2024-09-13T02:50:32.581 INFO:tasks.workunit.client.0.smithi100.stdout:2/509: write d0/db/d3f/f89 [337684,17890] 0 2024-09-13T02:50:32.581 INFO:tasks.workunit.client.0.smithi100.stdout:2/510: stat d0/db/f16 0 2024-09-13T02:50:32.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/511: chown d0/db/d21/d57/c8c 2883 1 2024-09-13T02:50:32.582 INFO:tasks.workunit.client.0.smithi100.stdout:2/512: creat d0/db/d21/f94 x:0 0 0 2024-09-13T02:50:32.582 INFO:tasks.workunit.client.0.smithi100.stdout:9/458: dwrite dd/d1b/d21/d86/f52 [0,4194304] 0 2024-09-13T02:50:32.584 INFO:tasks.workunit.client.0.smithi100.stdout:2/513: mkdir d0/db/d3f/d6a/d7f/d95 0 2024-09-13T02:50:32.585 INFO:tasks.workunit.client.0.smithi100.stdout:6/545: dwrite d12/d14/f9c [0,4194304] 0 2024-09-13T02:50:32.585 INFO:tasks.workunit.client.0.smithi100.stdout:6/546: write d12/d43/f54 [5169,53611] 0 2024-09-13T02:50:32.586 INFO:tasks.workunit.client.0.smithi100.stdout:9/459: unlink dd/d1b/d24/d74/l92 0 2024-09-13T02:50:32.588 INFO:tasks.workunit.client.0.smithi100.stdout:2/514: unlink d0/db/d68/d6b/f56 0 2024-09-13T02:50:32.589 INFO:tasks.workunit.client.0.smithi100.stdout:5/566: dwrite db/de/d1f/d2b/d9b/fa1 [0,4194304] 0 2024-09-13T02:50:32.591 INFO:tasks.workunit.client.0.smithi100.stdout:8/465: sync 2024-09-13T02:50:32.591 INFO:tasks.workunit.client.0.smithi100.stdout:4/529: sync 2024-09-13T02:50:32.592 INFO:tasks.workunit.client.0.smithi100.stdout:0/453: sync 2024-09-13T02:50:32.592 INFO:tasks.workunit.client.0.smithi100.stdout:8/466: truncate df/d13/d20/f61 4449790 0 2024-09-13T02:50:32.592 INFO:tasks.workunit.client.0.smithi100.stdout:8/467: truncate df/d86/f95 2124843 0 2024-09-13T02:50:32.592 INFO:tasks.workunit.client.0.smithi100.stdout:8/468: truncate df/d5d/d70/f9f 342454 0 2024-09-13T02:50:32.592 INFO:tasks.workunit.client.0.smithi100.stdout:6/547: symlink d12/d2e/la3 0 2024-09-13T02:50:32.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/515: creat d0/db/d21/d57/d81/f96 x:0 0 0 2024-09-13T02:50:32.594 INFO:tasks.workunit.client.0.smithi100.stdout:5/567: getdents db/de/d3e/d7e 0 2024-09-13T02:50:32.594 INFO:tasks.workunit.client.0.smithi100.stdout:5/568: chown db/de/d1f/f69 1616861194 1 2024-09-13T02:50:32.594 INFO:tasks.workunit.client.0.smithi100.stdout:5/569: stat db/de/d1f/d2b 0 2024-09-13T02:50:32.595 INFO:tasks.workunit.client.0.smithi100.stdout:9/460: dread dd/d1b/d7d/f7e [0,4194304] 0 2024-09-13T02:50:32.595 INFO:tasks.workunit.client.0.smithi100.stdout:6/548: dread d12/d14/d1c/f77 [0,4194304] 0 2024-09-13T02:50:32.596 INFO:tasks.workunit.client.0.smithi100.stdout:4/530: unlink d3/d6/d9/f3c 0 2024-09-13T02:50:32.599 INFO:tasks.workunit.client.0.smithi100.stdout:8/469: rename df/d86 to df/d13/d21/d81/db0 0 2024-09-13T02:50:32.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/461: mkdir dd/d1b/d1d/d43/d97 0 2024-09-13T02:50:32.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/462: stat dd/d1b/d24/d74/c3f 0 2024-09-13T02:50:32.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/454: mkdir d2/d1a/da5 0 2024-09-13T02:50:32.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/455: truncate d2/dd/d54/d47/f4e 842934 0 2024-09-13T02:50:32.602 INFO:tasks.workunit.client.0.smithi100.stdout:0/456: write d2/dd/d54/d47/d34/d3c/f89 [832872,85887] 0 2024-09-13T02:50:32.603 INFO:tasks.workunit.client.0.smithi100.stdout:8/470: truncate df/d13/f59 296203 0 2024-09-13T02:50:32.604 INFO:tasks.workunit.client.0.smithi100.stdout:3/612: sync 2024-09-13T02:50:32.604 INFO:tasks.workunit.client.0.smithi100.stdout:7/587: sync 2024-09-13T02:50:32.604 INFO:tasks.workunit.client.0.smithi100.stdout:1/539: sync 2024-09-13T02:50:32.606 INFO:tasks.workunit.client.0.smithi100.stdout:6/549: dread d12/d14/d1c/d6e/d71/f86 [0,4194304] 0 2024-09-13T02:50:32.606 INFO:tasks.workunit.client.0.smithi100.stdout:6/550: stat d12/d43/d4b/d4c 0 2024-09-13T02:50:32.608 INFO:tasks.workunit.client.0.smithi100.stdout:7/588: mkdir d3/d16/d55/d56/dbc 0 2024-09-13T02:50:32.610 INFO:tasks.workunit.client.0.smithi100.stdout:1/540: rename de/d14/d2e/f27 to de/d14/fb0 0 2024-09-13T02:50:32.610 INFO:tasks.workunit.client.0.smithi100.stdout:1/541: readlink de/d14/d39/l3f 0 2024-09-13T02:50:32.610 INFO:tasks.workunit.client.0.smithi100.stdout:0/457: symlink d2/la6 0 2024-09-13T02:50:32.611 INFO:tasks.workunit.client.0.smithi100.stdout:1/542: truncate de/d14/d2e/d75/f9f 542708 0 2024-09-13T02:50:32.613 INFO:tasks.workunit.client.0.smithi100.stdout:8/471: dread df/d5d/d70/d2c/d38/f71 [0,4194304] 0 2024-09-13T02:50:32.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/458: write d2/dd/d54/d47/f77 [2229197,3630] 0 2024-09-13T02:50:32.619 INFO:tasks.workunit.client.0.smithi100.stdout:8/472: creat df/d5d/fb1 x:0 0 0 2024-09-13T02:50:32.620 INFO:tasks.workunit.client.0.smithi100.stdout:1/543: truncate de/f3a 416998 0 2024-09-13T02:50:32.620 INFO:tasks.workunit.client.0.smithi100.stdout:7/589: dread d3/d2d/f41 [0,4194304] 0 2024-09-13T02:50:32.620 INFO:tasks.workunit.client.0.smithi100.stdout:7/590: dread - d3/d5/d4f/f80 zero size 2024-09-13T02:50:32.620 INFO:tasks.workunit.client.0.smithi100.stdout:5/570: dwrite db/de/d1f/fb9 [0,4194304] 0 2024-09-13T02:50:32.622 INFO:tasks.workunit.client.0.smithi100.stdout:0/459: mkdir d2/dd/d54/d47/d8a/da7 0 2024-09-13T02:50:32.627 INFO:tasks.workunit.client.0.smithi100.stdout:0/460: truncate d2/d1a/d51/f87 352327 0 2024-09-13T02:50:32.627 INFO:tasks.workunit.client.0.smithi100.stdout:0/461: chown d2/dd/d93 33 1 2024-09-13T02:50:32.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/473: dread df/f2b [0,4194304] 0 2024-09-13T02:50:32.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/474: dread - df/d13/d68/f9d zero size 2024-09-13T02:50:32.628 INFO:tasks.workunit.client.0.smithi100.stdout:0/462: symlink d2/dd/d93/la8 0 2024-09-13T02:50:32.628 INFO:tasks.workunit.client.0.smithi100.stdout:0/463: chown d2/dd/d54/d47/d34/d91 2 1 2024-09-13T02:50:32.628 INFO:tasks.workunit.client.0.smithi100.stdout:0/464: readlink d2/d1a/d4c/d7f/l83 0 2024-09-13T02:50:32.630 INFO:tasks.workunit.client.0.smithi100.stdout:8/475: rename f3 to df/dac/fb2 0 2024-09-13T02:50:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/465: dread d2/dd/d54/d47/f2d [0,4194304] 0 2024-09-13T02:50:32.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/466: write d2/dd/d33/f80 [315563,85901] 0 2024-09-13T02:50:32.632 INFO:tasks.workunit.client.0.smithi100.stdout:8/476: symlink df/d5d/d70/d2c/lb3 0 2024-09-13T02:50:32.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/544: write de/d14/d44/d7f/f8b [2869145,62066] 0 2024-09-13T02:50:32.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/545: readlink de/d14/d22/d52/d7a/l7c 0 2024-09-13T02:50:32.638 INFO:tasks.workunit.client.0.smithi100.stdout:9/463: dwrite dd/d1b/d1d/d43/d5d/f64 [0,4194304] 0 2024-09-13T02:50:32.638 INFO:tasks.workunit.client.0.smithi100.stdout:9/464: write dd/d1b/d1d/d43/d4f/f50 [613170,11996] 0 2024-09-13T02:50:32.638 INFO:tasks.workunit.client.0.smithi100.stdout:7/591: dwrite d3/d5/d1b/d1c/f39 [0,4194304] 0 2024-09-13T02:50:32.638 INFO:tasks.workunit.client.0.smithi100.stdout:7/592: dread - d3/d16/d55/d92/da2/fb7 zero size 2024-09-13T02:50:32.639 INFO:tasks.workunit.client.0.smithi100.stdout:0/467: dread d2/dd/d33/d43/d4b/f4d [0,4194304] 0 2024-09-13T02:50:32.639 INFO:tasks.workunit.client.0.smithi100.stdout:3/613: dwrite d10/d21/d51/d5a/d5e/d99/fd1 [0,4194304] 0 2024-09-13T02:50:32.640 INFO:tasks.workunit.client.0.smithi100.stdout:9/465: rmdir dd/d1b/d1d/d43/d97 0 2024-09-13T02:50:32.640 INFO:tasks.workunit.client.0.smithi100.stdout:9/466: chown dd/d1b/d21/d86 113 1 2024-09-13T02:50:32.640 INFO:tasks.workunit.client.0.smithi100.stdout:9/467: write dd/d1b/d24/f2e [3301681,102217] 0 2024-09-13T02:50:32.641 INFO:tasks.workunit.client.0.smithi100.stdout:9/468: fdatasync dd/f4a 0 2024-09-13T02:50:32.641 INFO:tasks.workunit.client.0.smithi100.stdout:9/469: creat dd/d1b/d24/d74/d4e/d58/f98 x:0 0 0 2024-09-13T02:50:32.642 INFO:tasks.workunit.client.0.smithi100.stdout:3/614: dread d10/f1b [0,4194304] 0 2024-09-13T02:50:32.642 INFO:tasks.workunit.client.0.smithi100.stdout:3/615: write d10/d21/d51/d5a/d5e/d71/d94/fb0 [988295,57619] 0 2024-09-13T02:50:32.642 INFO:tasks.workunit.client.0.smithi100.stdout:3/616: read fc [3659769,119830] 0 2024-09-13T02:50:32.642 INFO:tasks.workunit.client.0.smithi100.stdout:3/617: truncate d10/d21/d51/d5a/d5e/fc9 973143 0 2024-09-13T02:50:32.642 INFO:tasks.workunit.client.0.smithi100.stdout:3/618: creat d10/d21/d51/d5a/d5e/d71/d94/fd4 x:0 0 0 2024-09-13T02:50:32.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/593: symlink d3/d5/d1b/d1c/d36/d9c/lbd 0 2024-09-13T02:50:32.649 INFO:tasks.workunit.client.0.smithi100.stdout:1/546: dread de/d14/d2e/f4e [0,4194304] 0 2024-09-13T02:50:32.649 INFO:tasks.workunit.client.0.smithi100.stdout:1/547: chown de/d14/d22/d52/d7a/la2 49616613 1 2024-09-13T02:50:32.649 INFO:tasks.workunit.client.0.smithi100.stdout:9/470: symlink dd/d1b/d7d/l99 0 2024-09-13T02:50:32.652 INFO:tasks.workunit.client.0.smithi100.stdout:0/468: getdents d2/d9/d6d/d85 0 2024-09-13T02:50:32.653 INFO:tasks.workunit.client.0.smithi100.stdout:1/548: creat de/d14/d22/d52/fb1 x:0 0 0 2024-09-13T02:50:32.654 INFO:tasks.workunit.client.0.smithi100.stdout:8/477: dwrite df/d13/f96 [0,4194304] 0 2024-09-13T02:50:32.654 INFO:tasks.workunit.client.0.smithi100.stdout:8/478: chown df/d5d/d70/d2c/l4b 8 1 2024-09-13T02:50:32.655 INFO:tasks.workunit.client.0.smithi100.stdout:3/619: rmdir d10/d21/d51/d5a/d5e/d99 39 2024-09-13T02:50:32.656 INFO:tasks.workunit.client.0.smithi100.stdout:0/469: mkdir d2/dd/d93/da2/da9 0 2024-09-13T02:50:32.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/549: symlink de/d14/d22/d52/lb2 0 2024-09-13T02:50:32.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/550: fsync de/d14/d22/d52/d65/f6f 0 2024-09-13T02:50:32.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/551: fdatasync de/d14/d22/d52/d5c/faa 0 2024-09-13T02:50:32.658 INFO:tasks.workunit.client.0.smithi100.stdout:1/552: creat de/d14/d44/d7f/fb3 x:0 0 0 2024-09-13T02:50:32.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/594: dread d3/d16/d55/f5e [4194304,4194304] 0 2024-09-13T02:50:32.659 INFO:tasks.workunit.client.0.smithi100.stdout:1/553: read de/d14/d39/f78 [486056,128818] 0 2024-09-13T02:50:32.659 INFO:tasks.workunit.client.0.smithi100.stdout:1/554: truncate de/d14/d2e/d60/fa0 4822263 0 2024-09-13T02:50:32.659 INFO:tasks.workunit.client.0.smithi100.stdout:1/555: read de/d14/d44/d61/f90 [203642,39315] 0 2024-09-13T02:50:32.660 INFO:tasks.workunit.client.0.smithi100.stdout:8/479: rename df/d5d/d70/d2c/d38/l52 to df/d13/d21/lb4 0 2024-09-13T02:50:32.661 INFO:tasks.workunit.client.0.smithi100.stdout:3/620: truncate d10/f40 1757797 0 2024-09-13T02:50:32.662 INFO:tasks.workunit.client.0.smithi100.stdout:0/470: unlink d2/dd/d93/fa4 0 2024-09-13T02:50:32.666 INFO:tasks.workunit.client.0.smithi100.stdout:7/595: creat d3/d16/d55/d92/da9/fbe x:0 0 0 2024-09-13T02:50:32.667 INFO:tasks.workunit.client.0.smithi100.stdout:1/556: creat de/d14/d86/fb4 x:0 0 0 2024-09-13T02:50:32.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/621: creat d10/d21/d51/d5a/d5e/d71/d93/fd5 x:0 0 0 2024-09-13T02:50:32.669 INFO:tasks.workunit.client.0.smithi100.stdout:3/622: creat d10/d21/d51/d5a/d5e/da1/fd6 x:0 0 0 2024-09-13T02:50:32.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/596: dread d3/d5/d1b/d1c/f30 [0,4194304] 0 2024-09-13T02:50:32.672 INFO:tasks.workunit.client.0.smithi100.stdout:9/471: getdents dd/d1b/d24/d74/d4e/d58 0 2024-09-13T02:50:32.674 INFO:tasks.workunit.client.0.smithi100.stdout:1/557: symlink de/lb5 0 2024-09-13T02:50:32.675 INFO:tasks.workunit.client.0.smithi100.stdout:8/480: mkdir df/d13/db5 0 2024-09-13T02:50:32.675 INFO:tasks.workunit.client.0.smithi100.stdout:8/481: dread - df/d13/d20/da2/fae zero size 2024-09-13T02:50:32.675 INFO:tasks.workunit.client.0.smithi100.stdout:8/482: readlink df/d13/d21/d81/db0/la5 0 2024-09-13T02:50:32.677 INFO:tasks.workunit.client.0.smithi100.stdout:7/597: getdents d3/d5/d1b/d1c/d36/d9c 0 2024-09-13T02:50:32.677 INFO:tasks.workunit.client.0.smithi100.stdout:7/598: fdatasync d3/d5/f1e 0 2024-09-13T02:50:32.678 INFO:tasks.workunit.client.0.smithi100.stdout:9/472: symlink dd/d1b/d7d/l9a 0 2024-09-13T02:50:32.680 INFO:tasks.workunit.client.0.smithi100.stdout:1/558: unlink de/d14/d22/d52/l98 0 2024-09-13T02:50:32.680 INFO:tasks.workunit.client.0.smithi100.stdout:1/559: readlink de/lb5 0 2024-09-13T02:50:32.680 INFO:tasks.workunit.client.0.smithi100.stdout:1/560: truncate de/f23 3149020 0 2024-09-13T02:50:32.682 INFO:tasks.workunit.client.0.smithi100.stdout:7/599: rename d3/fa0 to d3/d16/d55/d56/d9e/d9f/fbf 0 2024-09-13T02:50:32.682 INFO:tasks.workunit.client.0.smithi100.stdout:7/600: truncate d3/d5/d4f/fb2 186860 0 2024-09-13T02:50:32.683 INFO:tasks.workunit.client.0.smithi100.stdout:9/473: creat dd/d1b/d1d/d43/d5e/f9b x:0 0 0 2024-09-13T02:50:32.683 INFO:tasks.workunit.client.0.smithi100.stdout:3/623: dwrite d10/d21/d57/f5b [0,4194304] 0 2024-09-13T02:50:32.684 INFO:tasks.workunit.client.0.smithi100.stdout:8/483: write fb [1595922,119128] 0 2024-09-13T02:50:32.687 INFO:tasks.workunit.client.0.smithi100.stdout:8/484: dread df/d13/d21/d81/db0/f95 [0,4194304] 0 2024-09-13T02:50:32.690 INFO:tasks.workunit.client.0.smithi100.stdout:3/624: read d10/d21/d51/d5a/d5e/d71/d94/fac [1910196,130069] 0 2024-09-13T02:50:32.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/474: unlink dd/d1b/d24/f8e 0 2024-09-13T02:50:32.691 INFO:tasks.workunit.client.0.smithi100.stdout:3/625: chown d10/d21/d51/d5a/faf 14600499 1 2024-09-13T02:50:32.692 INFO:tasks.workunit.client.0.smithi100.stdout:8/485: getdents df/d13/d68 0 2024-09-13T02:50:32.692 INFO:tasks.workunit.client.0.smithi100.stdout:8/486: write df/d13/d20/f7a [428454,1211] 0 2024-09-13T02:50:32.693 INFO:tasks.workunit.client.0.smithi100.stdout:1/561: dread de/d14/d22/f35 [4194304,4194304] 0 2024-09-13T02:50:32.693 INFO:tasks.workunit.client.0.smithi100.stdout:3/626: mknod d10/d21/d51/d6c/db7/cd7 0 2024-09-13T02:50:32.694 INFO:tasks.workunit.client.0.smithi100.stdout:1/562: mknod de/d14/d22/d52/d65/cb6 0 2024-09-13T02:50:32.694 INFO:tasks.workunit.client.0.smithi100.stdout:1/563: fsync de/d14/d2e/d60/fa0 0 2024-09-13T02:50:32.703 INFO:tasks.workunit.client.0.smithi100.stdout:9/475: dread dd/d1b/d24/d74/f47 [0,4194304] 0 2024-09-13T02:50:32.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/476: creat dd/d1b/d1d/d43/d5d/f9c x:0 0 0 2024-09-13T02:50:32.705 INFO:tasks.workunit.client.0.smithi100.stdout:9/477: stat dd/d1b/d1d/d43/d4f/l6d 0 2024-09-13T02:50:32.706 INFO:tasks.workunit.client.0.smithi100.stdout:3/627: dread d10/f31 [0,4194304] 0 2024-09-13T02:50:32.706 INFO:tasks.workunit.client.0.smithi100.stdout:3/628: creat d10/d21/d51/d6c/fd8 x:0 0 0 2024-09-13T02:50:32.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/478: link dd/d1b/f87 dd/d1b/f9d 0 2024-09-13T02:50:32.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/479: write dd/fe [2116841,59067] 0 2024-09-13T02:50:32.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/480: truncate dd/d1b/d21/f62 707884 0 2024-09-13T02:50:32.707 INFO:tasks.workunit.client.0.smithi100.stdout:9/481: creat dd/d1b/d1d/d43/d5d/f9e x:0 0 0 2024-09-13T02:50:32.708 INFO:tasks.workunit.client.0.smithi100.stdout:7/601: dwrite d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:32.708 INFO:tasks.workunit.client.0.smithi100.stdout:3/629: symlink d10/d21/ld9 0 2024-09-13T02:50:32.708 INFO:tasks.workunit.client.0.smithi100.stdout:3/630: readlink d10/l4f 0 2024-09-13T02:50:32.709 INFO:tasks.workunit.client.0.smithi100.stdout:9/482: mknod dd/d1b/d27/c9f 0 2024-09-13T02:50:32.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/602: symlink d3/d16/d55/d92/lc0 0 2024-09-13T02:50:32.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/603: stat d3/d5/l13 0 2024-09-13T02:50:32.711 INFO:tasks.workunit.client.0.smithi100.stdout:3/631: rename d10/c30 to d10/d21/d51/d5a/d5e/d99/dc7/cda 0 2024-09-13T02:50:32.712 INFO:tasks.workunit.client.0.smithi100.stdout:7/604: link d3/d5/d4f/cac d3/d16/d55/d56/dbc/cc1 0 2024-09-13T02:50:32.713 INFO:tasks.workunit.client.0.smithi100.stdout:3/632: rename d10/d21/d51/d5a/d5e/d71/f8b to d10/d21/d51/d5a/d5e/d89/fdb 0 2024-09-13T02:50:32.713 INFO:tasks.workunit.client.0.smithi100.stdout:3/633: creat d10/d21/d51/d5a/d5e/d71/fdc x:0 0 0 2024-09-13T02:50:32.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/605: mknod d3/d16/d89/cc2 0 2024-09-13T02:50:32.714 INFO:tasks.workunit.client.0.smithi100.stdout:7/606: fdatasync d3/d16/d3b/f5d 0 2024-09-13T02:50:32.715 INFO:tasks.workunit.client.0.smithi100.stdout:1/564: dwrite de/d14/d22/d52/d5c/f84 [0,4194304] 0 2024-09-13T02:50:32.716 INFO:tasks.workunit.client.0.smithi100.stdout:7/607: mkdir d3/d5/d4f/dc3 0 2024-09-13T02:50:32.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/565: unlink de/d14/fb0 0 2024-09-13T02:50:32.719 INFO:tasks.workunit.client.0.smithi100.stdout:1/566: mkdir de/d14/d44/d61/da9/db7 0 2024-09-13T02:50:32.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/634: dread d10/d21/f42 [0,4194304] 0 2024-09-13T02:50:32.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/635: readlink d10/d21/d51/d5a/d5e/d71/d93/lc5 0 2024-09-13T02:50:32.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/636: write d10/d21/d51/d6c/f76 [1531571,34278] 0 2024-09-13T02:50:32.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/637: creat d10/d21/d51/d5a/d5e/d89/fdd x:0 0 0 2024-09-13T02:50:32.725 INFO:tasks.workunit.client.0.smithi100.stdout:3/638: rename d10/d21/d51/d5a/cc4 to d10/d21/d51/d5a/d5e/d71/d97/db1/cde 0 2024-09-13T02:50:32.725 INFO:tasks.workunit.client.0.smithi100.stdout:9/483: dwrite dd/d1b/d1d/f5b [0,4194304] 0 2024-09-13T02:50:32.726 INFO:tasks.workunit.client.0.smithi100.stdout:1/567: dread de/d14/d22/d52/d5c/f6a [0,4194304] 0 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/608: write d3/d16/d55/d56/f70 [701766,66172] 0 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/609: write d3/d16/d3b/f45 [4502250,89834] 0 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/610: write d3/d16/d3b/da5/f95 [1093231,4748] 0 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/611: getdents d3/d16/d3b/da5 0 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/612: chown d3/d16/d3b 1 1 2024-09-13T02:50:32.728 INFO:tasks.workunit.client.0.smithi100.stdout:7/613: chown d3/d5/d1b/d1c/d36/c9a 7829161 1 2024-09-13T02:50:32.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/484: creat dd/d1b/d24/fa0 x:0 0 0 2024-09-13T02:50:32.729 INFO:tasks.workunit.client.0.smithi100.stdout:9/485: dread dd/d1b/d24/d74/d4e/d58/f88 [0,4194304] 0 2024-09-13T02:50:32.733 INFO:tasks.workunit.client.0.smithi100.stdout:3/639: dread d10/d21/d51/d6c/f76 [0,4194304] 0 2024-09-13T02:50:32.734 INFO:tasks.workunit.client.0.smithi100.stdout:3/640: chown d10/d21/d51/d5a/d5e/d71/d93/cc8 2563481 1 2024-09-13T02:50:32.735 INFO:tasks.workunit.client.0.smithi100.stdout:9/486: rename dd/d1b/d1d/l4b to dd/d1b/d24/d74/d3c/la1 0 2024-09-13T02:50:32.738 INFO:tasks.workunit.client.0.smithi100.stdout:3/641: creat d10/fdf x:0 0 0 2024-09-13T02:50:32.738 INFO:tasks.workunit.client.0.smithi100.stdout:3/642: write d10/d21/d51/d6c/f6f [1442683,38135] 0 2024-09-13T02:50:32.738 INFO:tasks.workunit.client.0.smithi100.stdout:9/487: truncate dd/f76 2936540 0 2024-09-13T02:50:32.738 INFO:tasks.workunit.client.0.smithi100.stdout:9/488: creat dd/d1b/d1d/d43/d5d/fa2 x:0 0 0 2024-09-13T02:50:32.739 INFO:tasks.workunit.client.0.smithi100.stdout:1/568: rename de/d14/d22/d52/d5c to de/d14/d22/d52/db8 0 2024-09-13T02:50:32.739 INFO:tasks.workunit.client.0.smithi100.stdout:1/569: chown de/f3a 1405078 1 2024-09-13T02:50:32.740 INFO:tasks.workunit.client.0.smithi100.stdout:1/570: creat de/d14/d86/fb9 x:0 0 0 2024-09-13T02:50:32.740 INFO:tasks.workunit.client.0.smithi100.stdout:3/643: creat d10/d21/d51/d5a/d5e/d89/dc0/fe0 x:0 0 0 2024-09-13T02:50:32.740 INFO:tasks.workunit.client.0.smithi100.stdout:3/644: stat d10/d21/d51/d5a/d5e/d71/fdc 0 2024-09-13T02:50:32.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/489: mkdir dd/d1b/da3 0 2024-09-13T02:50:32.742 INFO:tasks.workunit.client.0.smithi100.stdout:9/490: getdents dd/d1b/da3 0 2024-09-13T02:50:32.743 INFO:tasks.workunit.client.0.smithi100.stdout:7/614: dwrite d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:32.743 INFO:tasks.workunit.client.0.smithi100.stdout:7/615: getdents d3/d16/d3b/da5 0 2024-09-13T02:50:32.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/616: write d3/d5/d4f/f80 [683013,103030] 0 2024-09-13T02:50:32.744 INFO:tasks.workunit.client.0.smithi100.stdout:7/617: stat d3/d16/d3b/c58 0 2024-09-13T02:50:32.744 INFO:tasks.workunit.client.0.smithi100.stdout:1/571: creat de/d14/d2e/d48/fba x:0 0 0 2024-09-13T02:50:32.744 INFO:tasks.workunit.client.0.smithi100.stdout:3/645: truncate d10/f92 287338 0 2024-09-13T02:50:32.745 INFO:tasks.workunit.client.0.smithi100.stdout:9/491: mkdir dd/d1b/d1d/d43/d4f/da4 0 2024-09-13T02:50:32.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/618: creat d3/d16/d55/d56/fc4 x:0 0 0 2024-09-13T02:50:32.747 INFO:tasks.workunit.client.0.smithi100.stdout:1/572: mkdir de/d14/dbb 0 2024-09-13T02:50:32.748 INFO:tasks.workunit.client.0.smithi100.stdout:3/646: dread d10/f53 [0,4194304] 0 2024-09-13T02:50:32.748 INFO:tasks.workunit.client.0.smithi100.stdout:3/647: getdents d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd 0 2024-09-13T02:50:32.749 INFO:tasks.workunit.client.0.smithi100.stdout:1/573: dread de/d14/d22/d52/d65/fa3 [0,4194304] 0 2024-09-13T02:50:32.750 INFO:tasks.workunit.client.0.smithi100.stdout:7/619: link d3/d16/l73 d3/d16/d55/d92/lc5 0 2024-09-13T02:50:32.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/620: mkdir d3/d5/d1b/d1c/d36/dc6 0 2024-09-13T02:50:32.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/621: chown d3/d5/d1b/l35 18639277 1 2024-09-13T02:50:32.751 INFO:tasks.workunit.client.0.smithi100.stdout:7/622: write d3/d16/d55/d92/da9/fbe [1028296,70491] 0 2024-09-13T02:50:32.753 INFO:tasks.workunit.client.0.smithi100.stdout:1/574: dread de/f23 [0,4194304] 0 2024-09-13T02:50:32.755 INFO:tasks.workunit.client.0.smithi100.stdout:9/492: rename dd/d1b/d24/d74/d3c to dd/d1b/d1d/d43/d4f/da5 0 2024-09-13T02:50:32.760 INFO:tasks.workunit.client.0.smithi100.stdout:7/623: rmdir d3/d16/d55/d56 39 2024-09-13T02:50:32.771 INFO:tasks.workunit.client.0.smithi100.stdout:9/493: dread dd/d1b/d27/f59 [0,4194304] 0 2024-09-13T02:50:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:9/494: dread - dd/d1b/d1d/d43/d4f/da5/f91 zero size 2024-09-13T02:50:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:9/495: dread - dd/d1b/d24/d74/d4e/f7c zero size 2024-09-13T02:50:32.772 INFO:tasks.workunit.client.0.smithi100.stdout:9/496: rmdir dd/d1b/d31 39 2024-09-13T02:50:32.773 INFO:tasks.workunit.client.0.smithi100.stdout:1/575: dwrite de/d14/d22/d29/d64/f99 [4194304,4194304] 0 2024-09-13T02:50:32.774 INFO:tasks.workunit.client.0.smithi100.stdout:3/648: dwrite d10/d21/d51/d5a/d5e/d71/d93/fc2 [0,4194304] 0 2024-09-13T02:50:32.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/497: mknod dd/ca6 0 2024-09-13T02:50:32.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/498: truncate dd/f4a 1578169 0 2024-09-13T02:50:32.774 INFO:tasks.workunit.client.0.smithi100.stdout:9/499: write dd/d1b/d24/d74/d4e/f96 [183429,38440] 0 2024-09-13T02:50:32.780 INFO:tasks.workunit.client.0.smithi100.stdout:3/649: dread fc [0,4194304] 0 2024-09-13T02:50:32.780 INFO:tasks.workunit.client.0.smithi100.stdout:9/500: symlink dd/d1b/d1d/d43/d4f/da5/d93/la7 0 2024-09-13T02:50:32.781 INFO:tasks.workunit.client.0.smithi100.stdout:3/650: symlink d10/d21/d51/d5a/d5e/d71/le1 0 2024-09-13T02:50:32.781 INFO:tasks.workunit.client.0.smithi100.stdout:3/651: chown d10/f38 1764983 1 2024-09-13T02:50:32.782 INFO:tasks.workunit.client.0.smithi100.stdout:3/652: chown d10/d21/d51/d5a/d5e/d71/d93 1939412392 1 2024-09-13T02:50:32.782 INFO:tasks.workunit.client.0.smithi100.stdout:3/653: creat d10/d21/d51/d5a/d5e/d71/fe2 x:0 0 0 2024-09-13T02:50:32.787 INFO:tasks.workunit.client.0.smithi100.stdout:1/576: dwrite de/d14/d2e/d48/f50 [4194304,4194304] 0 2024-09-13T02:50:32.787 INFO:tasks.workunit.client.0.smithi100.stdout:1/577: readlink de/d14/d22/d29/d64/l97 0 2024-09-13T02:50:32.788 INFO:tasks.workunit.client.0.smithi100.stdout:1/578: readlink de/d14/d39/l8e 0 2024-09-13T02:50:32.813 INFO:tasks.workunit.client.0.smithi100.stdout:9/501: dwrite dd/f1a [0,4194304] 0 2024-09-13T02:50:32.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/579: dwrite de/d14/d44/f5d [0,4194304] 0 2024-09-13T02:50:32.813 INFO:tasks.workunit.client.0.smithi100.stdout:1/580: truncate de/d14/d39/f78 1148048 0 2024-09-13T02:50:32.813 INFO:tasks.workunit.client.0.smithi100.stdout:3/654: dwrite d10/d21/d51/d5a/d5e/d71/d97/db1/fcb [0,4194304] 0 2024-09-13T02:50:32.813 INFO:tasks.workunit.client.0.smithi100.stdout:9/502: mkdir dd/d1b/d24/da8 0 2024-09-13T02:50:32.814 INFO:tasks.workunit.client.0.smithi100.stdout:9/503: readlink dd/d1b/d1d/d43/l85 0 2024-09-13T02:50:32.817 INFO:tasks.workunit.client.0.smithi100.stdout:3/655: unlink d10/d21/d51/d5a/d5e/d71/d93/fd5 0 2024-09-13T02:50:32.817 INFO:tasks.workunit.client.0.smithi100.stdout:3/656: dread d10/d21/f2d [0,4194304] 0 2024-09-13T02:50:32.817 INFO:tasks.workunit.client.0.smithi100.stdout:9/504: mkdir dd/d1b/d24/da8/da9 0 2024-09-13T02:50:32.818 INFO:tasks.workunit.client.0.smithi100.stdout:3/657: dread d10/d21/d51/d5a/d5e/da1/fb2 [0,4194304] 0 2024-09-13T02:50:32.818 INFO:tasks.workunit.client.0.smithi100.stdout:9/505: symlink dd/d1b/d1d/d43/d5d/laa 0 2024-09-13T02:50:32.825 INFO:tasks.workunit.client.0.smithi100.stdout:6/551: sync 2024-09-13T02:50:32.825 INFO:tasks.workunit.client.0.smithi100.stdout:4/531: sync 2024-09-13T02:50:32.825 INFO:tasks.workunit.client.0.smithi100.stdout:2/516: sync 2024-09-13T02:50:32.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/506: write dd/f12 [31677,103751] 0 2024-09-13T02:50:32.826 INFO:tasks.workunit.client.0.smithi100.stdout:2/517: unlink d0/db/d3f/f4b 0 2024-09-13T02:50:32.827 INFO:tasks.workunit.client.0.smithi100.stdout:4/532: truncate d3/d6/d21/f24 574883 0 2024-09-13T02:50:32.827 INFO:tasks.workunit.client.0.smithi100.stdout:6/552: mkdir d12/d14/d2f/da4 0 2024-09-13T02:50:32.830 INFO:tasks.workunit.client.0.smithi100.stdout:4/533: link d3/d6/d21/d67/f78 d3/d6/d21/d46/d2d/d3f/d79/fb8 0 2024-09-13T02:50:32.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/507: rmdir dd/d1b/d1d/d43/d4f 39 2024-09-13T02:50:32.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/508: truncate dd/d1b/f9d 1033826 0 2024-09-13T02:50:32.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/509: creat dd/d1b/d7d/fab x:0 0 0 2024-09-13T02:50:32.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/510: chown dd/d1b/d21/f26 91274032 1 2024-09-13T02:50:32.831 INFO:tasks.workunit.client.0.smithi100.stdout:9/511: truncate fc 4440986 0 2024-09-13T02:50:32.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/534: mknod d3/d6/d21/d46/d2d/d3f/cb9 0 2024-09-13T02:50:32.832 INFO:tasks.workunit.client.0.smithi100.stdout:4/535: write d3/d6/d21/d46/fa4 [1616456,123062] 0 2024-09-13T02:50:32.838 INFO:tasks.workunit.client.0.smithi100.stdout:3/658: dwrite d10/f54 [0,4194304] 0 2024-09-13T02:50:32.844 INFO:tasks.workunit.client.0.smithi100.stdout:2/518: read d0/d36/f4f [2037575,130427] 0 2024-09-13T02:50:32.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/581: dwrite de/d14/d22/d52/db8/faa [0,4194304] 0 2024-09-13T02:50:32.844 INFO:tasks.workunit.client.0.smithi100.stdout:1/582: readlink de/d14/d39/l3f 0 2024-09-13T02:50:32.847 INFO:tasks.workunit.client.0.smithi100.stdout:2/519: write d0/f19 [1929916,24828] 0 2024-09-13T02:50:32.847 INFO:tasks.workunit.client.0.smithi100.stdout:2/520: truncate d0/db/d3f/f89 642584 0 2024-09-13T02:50:32.847 INFO:tasks.workunit.client.0.smithi100.stdout:2/521: chown d0/db/f52 14309415 1 2024-09-13T02:50:32.848 INFO:tasks.workunit.client.0.smithi100.stdout:1/583: symlink de/d14/d44/d61/da9/db7/lbc 0 2024-09-13T02:50:32.849 INFO:tasks.workunit.client.0.smithi100.stdout:1/584: chown de/d12/c53 10504 1 2024-09-13T02:50:32.851 INFO:tasks.workunit.client.0.smithi100.stdout:1/585: truncate de/d12/f3e 163608 0 2024-09-13T02:50:32.851 INFO:tasks.workunit.client.0.smithi100.stdout:1/586: readlink de/d14/d22/d52/lb2 0 2024-09-13T02:50:32.852 INFO:tasks.workunit.client.0.smithi100.stdout:1/587: symlink de/d14/d39/lbd 0 2024-09-13T02:50:32.854 INFO:tasks.workunit.client.0.smithi100.stdout:1/588: link de/d12/l1d de/d14/d22/d52/lbe 0 2024-09-13T02:50:32.856 INFO:tasks.workunit.client.0.smithi100.stdout:1/589: read de/d14/d22/d52/d65/f6f [590454,25454] 0 2024-09-13T02:50:32.857 INFO:tasks.workunit.client.0.smithi100.stdout:1/590: chown de/d12/c66 266 1 2024-09-13T02:50:32.857 INFO:tasks.workunit.client.0.smithi100.stdout:1/591: readlink de/d14/d2e/lad 0 2024-09-13T02:50:32.858 INFO:tasks.workunit.client.0.smithi100.stdout:1/592: creat de/d14/d22/d29/fbf x:0 0 0 2024-09-13T02:50:32.860 INFO:tasks.workunit.client.0.smithi100.stdout:1/593: rename de/d14/d86/fb4 to de/d14/d44/d7f/fc0 0 2024-09-13T02:50:32.861 INFO:tasks.workunit.client.0.smithi100.stdout:1/594: truncate de/d12/f2a 1899435 0 2024-09-13T02:50:32.863 INFO:tasks.workunit.client.0.smithi100.stdout:1/595: dread de/fa8 [0,4194304] 0 2024-09-13T02:50:32.863 INFO:tasks.workunit.client.0.smithi100.stdout:1/596: readlink de/d14/d22/d52/d7a/l7c 0 2024-09-13T02:50:32.864 INFO:tasks.workunit.client.0.smithi100.stdout:6/553: dwrite d12/d14/f9c [0,4194304] 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/597: mknod de/d14/d39/cc1 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/598: fdatasync de/d14/d22/d52/fa6 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/599: fsync de/d14/d22/d52/fb1 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/600: write de/d14/d22/f9a [204468,13600] 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/601: write de/d12/f8f [365688,107240] 0 2024-09-13T02:50:32.865 INFO:tasks.workunit.client.0.smithi100.stdout:1/602: readlink de/d14/d2e/lad 0 2024-09-13T02:50:32.866 INFO:tasks.workunit.client.0.smithi100.stdout:1/603: mkdir de/d14/d44/d7f/dc2 0 2024-09-13T02:50:32.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/604: creat de/d14/d22/d29/d68/d6d/fc3 x:0 0 0 2024-09-13T02:50:32.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/605: mkdir de/d14/d44/d61/da9/dc4 0 2024-09-13T02:50:32.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/606: stat l2 0 2024-09-13T02:50:32.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/607: creat de/d14/d44/d7f/fc5 x:0 0 0 2024-09-13T02:50:32.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/608: chown de/d14/d22 174981409 1 2024-09-13T02:50:32.868 INFO:tasks.workunit.client.0.smithi100.stdout:1/609: dread - de/d14/d44/d61/f91 zero size 2024-09-13T02:50:32.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/536: dwrite d3/d63/f6a [0,4194304] 0 2024-09-13T02:50:32.870 INFO:tasks.workunit.client.0.smithi100.stdout:3/659: dwrite d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fbe [0,4194304] 0 2024-09-13T02:50:32.871 INFO:tasks.workunit.client.0.smithi100.stdout:6/554: dread d12/d14/d1c/d28/f58 [0,4194304] 0 2024-09-13T02:50:32.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/512: dwrite dd/d1b/d1d/d43/d5d/f72 [0,4194304] 0 2024-09-13T02:50:32.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/513: creat dd/d1b/d27/d51/fac x:0 0 0 2024-09-13T02:50:32.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/514: fsync dd/d1b/d1d/d43/d5e/f9b 0 2024-09-13T02:50:32.871 INFO:tasks.workunit.client.0.smithi100.stdout:2/522: dwrite d0/db/d21/f30 [4194304,4194304] 0 2024-09-13T02:50:32.872 INFO:tasks.workunit.client.0.smithi100.stdout:4/537: truncate d3/d6/d2f/d60/fa2 2084458 0 2024-09-13T02:50:32.880 INFO:tasks.workunit.client.0.smithi100.stdout:9/515: mkdir dd/d1b/d1d/dad 0 2024-09-13T02:50:32.891 INFO:tasks.workunit.client.0.smithi100.stdout:9/516: rename dd/l13 to dd/d1b/d1d/d43/d4f/da5/lae 0 2024-09-13T02:50:32.892 INFO:tasks.workunit.client.0.smithi100.stdout:9/517: creat dd/d1b/d1d/faf x:0 0 0 2024-09-13T02:50:32.893 INFO:tasks.workunit.client.0.smithi100.stdout:2/523: dwrite d0/db/d21/f30 [0,4194304] 0 2024-09-13T02:50:32.893 INFO:tasks.workunit.client.0.smithi100.stdout:3/660: dwrite d10/d21/d57/f91 [0,4194304] 0 2024-09-13T02:50:32.894 INFO:tasks.workunit.client.0.smithi100.stdout:9/518: write dd/f76 [429605,8611] 0 2024-09-13T02:50:32.894 INFO:tasks.workunit.client.0.smithi100.stdout:9/519: stat dd/d1b/d7d/l9a 0 2024-09-13T02:50:32.896 INFO:tasks.workunit.client.0.smithi100.stdout:3/661: symlink d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/le3 0 2024-09-13T02:50:32.897 INFO:tasks.workunit.client.0.smithi100.stdout:2/524: dread d0/f1f [0,4194304] 0 2024-09-13T02:50:32.899 INFO:tasks.workunit.client.0.smithi100.stdout:2/525: read d0/f19 [730365,43] 0 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/624: sync 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:0/471: sync 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:5/571: sync 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:5/572: chown db/de/d1f/f69 1127726 1 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/625: fdatasync d3/d5/d1b/d1c/f30 0 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:5/573: chown db/f3c 46 1 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/626: creat d3/d16/d55/fc7 x:0 0 0 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/627: truncate d3/fa 4708126 0 2024-09-13T02:50:32.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/628: dread - d3/d16/d55/d92/da2/fb7 zero size 2024-09-13T02:50:32.902 INFO:tasks.workunit.client.0.smithi100.stdout:7/629: stat d3/d16/d55/d56/f85 0 2024-09-13T02:50:32.902 INFO:tasks.workunit.client.0.smithi100.stdout:7/630: creat d3/d5/d4f/fc8 x:0 0 0 2024-09-13T02:50:32.902 INFO:tasks.workunit.client.0.smithi100.stdout:8/487: sync 2024-09-13T02:50:32.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/520: write dd/f1a [1851175,63506] 0 2024-09-13T02:50:32.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/521: fsync dd/d1b/d1d/d43/d5d/f9c 0 2024-09-13T02:50:32.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/522: truncate dd/d1b/d24/f2e 3686417 0 2024-09-13T02:50:32.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/523: creat dd/d1b/fb0 x:0 0 0 2024-09-13T02:50:32.909 INFO:tasks.workunit.client.0.smithi100.stdout:5/574: dread db/de/d63/f65 [0,4194304] 0 2024-09-13T02:50:32.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/631: mknod d3/d16/d3b/d8c/cc9 0 2024-09-13T02:50:32.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/632: getdents d3/d16/d55/d56/dbc 0 2024-09-13T02:50:32.917 INFO:tasks.workunit.client.0.smithi100.stdout:8/488: dread df/d5d/f69 [0,4194304] 0 2024-09-13T02:50:32.919 INFO:tasks.workunit.client.0.smithi100.stdout:8/489: symlink df/d5d/d70/lb6 0 2024-09-13T02:50:32.926 INFO:tasks.workunit.client.0.smithi100.stdout:8/490: rename df/d5d/d70/d41/f56 to df/d13/db5/fb7 0 2024-09-13T02:50:32.926 INFO:tasks.workunit.client.0.smithi100.stdout:8/491: chown df/d5d/d70/c8c 412204 1 2024-09-13T02:50:32.926 INFO:tasks.workunit.client.0.smithi100.stdout:3/662: dwrite d10/d21/d51/d5a/d5e/d71/d94/d9c/fa7 [0,4194304] 0 2024-09-13T02:50:32.927 INFO:tasks.workunit.client.0.smithi100.stdout:8/492: mknod df/d5d/d70/cb8 0 2024-09-13T02:50:32.930 INFO:tasks.workunit.client.0.smithi100.stdout:3/663: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fe4 x:0 0 0 2024-09-13T02:50:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:3/664: creat d10/d21/d51/d5a/d5e/d99/fe5 x:0 0 0 2024-09-13T02:50:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:3/665: write d10/d21/d51/d5a/d5e/d71/d94/fce [332189,83133] 0 2024-09-13T02:50:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:3/666: fsync d10/d21/d57/faa 0 2024-09-13T02:50:32.932 INFO:tasks.workunit.client.0.smithi100.stdout:8/493: symlink df/d13/lb9 0 2024-09-13T02:50:32.933 INFO:tasks.workunit.client.0.smithi100.stdout:8/494: rmdir df/d13/d21 39 2024-09-13T02:50:32.933 INFO:tasks.workunit.client.0.smithi100.stdout:8/495: chown df/d5d/fb1 1672650 1 2024-09-13T02:50:32.934 INFO:tasks.workunit.client.0.smithi100.stdout:2/526: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:50:32.935 INFO:tasks.workunit.client.0.smithi100.stdout:8/496: mkdir df/d5d/dba 0 2024-09-13T02:50:32.935 INFO:tasks.workunit.client.0.smithi100.stdout:8/497: readlink df/d13/d68/l7d 0 2024-09-13T02:50:32.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/498: mkdir df/dbb 0 2024-09-13T02:50:32.938 INFO:tasks.workunit.client.0.smithi100.stdout:8/499: rename df/d5d/d70/d2c/d38/c65 to df/d13/d20/cbc 0 2024-09-13T02:50:32.940 INFO:tasks.workunit.client.0.smithi100.stdout:8/500: link df/d5d/d88/f8a df/d13/d21/d81/db0/fbd 0 2024-09-13T02:50:32.942 INFO:tasks.workunit.client.0.smithi100.stdout:8/501: mknod df/d5d/dba/cbe 0 2024-09-13T02:50:32.947 INFO:tasks.workunit.client.0.smithi100.stdout:0/472: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:32.950 INFO:tasks.workunit.client.0.smithi100.stdout:0/473: rmdir d2/d1a 39 2024-09-13T02:50:32.951 INFO:tasks.workunit.client.0.smithi100.stdout:0/474: symlink d2/dd/d54/d47/laa 0 2024-09-13T02:50:32.953 INFO:tasks.workunit.client.0.smithi100.stdout:0/475: link d2/d1a/c3f d2/cab 0 2024-09-13T02:50:32.953 INFO:tasks.workunit.client.0.smithi100.stdout:0/476: fdatasync d2/dd/d54/d47/f4e 0 2024-09-13T02:50:32.954 INFO:tasks.workunit.client.0.smithi100.stdout:8/502: dread df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:32.954 INFO:tasks.workunit.client.0.smithi100.stdout:0/477: dread - d2/d1a/d4c/f98 zero size 2024-09-13T02:50:32.954 INFO:tasks.workunit.client.0.smithi100.stdout:0/478: stat d2/cab 0 2024-09-13T02:50:32.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/479: rmdir d2/d9/d6d 39 2024-09-13T02:50:32.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/480: write d2/dd/d54/d28/fa1 [586202,29678] 0 2024-09-13T02:50:32.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/481: write d2/d1a/f88 [906578,115047] 0 2024-09-13T02:50:32.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/482: write d2/dd/d54/d28/f4a [3823250,91313] 0 2024-09-13T02:50:32.957 INFO:tasks.workunit.client.0.smithi100.stdout:5/575: dwrite db/de/d1f/d78/f7d [0,4194304] 0 2024-09-13T02:50:32.958 INFO:tasks.workunit.client.0.smithi100.stdout:9/524: dwrite fc [0,4194304] 0 2024-09-13T02:50:32.958 INFO:tasks.workunit.client.0.smithi100.stdout:7/633: dwrite d3/d16/d55/d56/fc4 [0,4194304] 0 2024-09-13T02:50:32.959 INFO:tasks.workunit.client.0.smithi100.stdout:5/576: link db/de/d3e/f42 db/de/d3e/da2/dac/fc8 0 2024-09-13T02:50:32.959 INFO:tasks.workunit.client.0.smithi100.stdout:5/577: chown db/c2e 10857998 1 2024-09-13T02:50:32.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/527: dwrite d0/f38 [0,4194304] 0 2024-09-13T02:50:32.961 INFO:tasks.workunit.client.0.smithi100.stdout:7/634: truncate d3/d16/d55/d92/da9/fbe 887087 0 2024-09-13T02:50:32.961 INFO:tasks.workunit.client.0.smithi100.stdout:3/667: dwrite d10/d21/f86 [0,4194304] 0 2024-09-13T02:50:32.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/528: rename d0/db/d23/l2b to d0/d36/d8a/l97 0 2024-09-13T02:50:32.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/529: chown d0/db/d21 7195926 1 2024-09-13T02:50:32.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/530: dread - d0/db/d3f/d6a/d7f/f83 zero size 2024-09-13T02:50:32.967 INFO:tasks.workunit.client.0.smithi100.stdout:0/483: dread d2/dd/d33/d43/d4b/f72 [0,4194304] 0 2024-09-13T02:50:32.969 INFO:tasks.workunit.client.0.smithi100.stdout:7/635: creat d3/d16/d55/d92/db3/fca x:0 0 0 2024-09-13T02:50:32.969 INFO:tasks.workunit.client.0.smithi100.stdout:7/636: readlink d3/d5/d1b/l6b 0 2024-09-13T02:50:32.969 INFO:tasks.workunit.client.0.smithi100.stdout:7/637: stat d3/d16/d3b/da5/d87/ca7 0 2024-09-13T02:50:32.969 INFO:tasks.workunit.client.0.smithi100.stdout:7/638: readlink d3/d5/d1b/l35 0 2024-09-13T02:50:32.970 INFO:tasks.workunit.client.0.smithi100.stdout:0/484: write d2/f11 [1775803,77822] 0 2024-09-13T02:50:32.971 INFO:tasks.workunit.client.0.smithi100.stdout:0/485: read d2/dd/d33/d3b/f40 [527206,118572] 0 2024-09-13T02:50:32.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/668: truncate d10/f49 900875 0 2024-09-13T02:50:32.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/669: chown d10/d21/f5d 2618856 1 2024-09-13T02:50:32.978 INFO:tasks.workunit.client.0.smithi100.stdout:2/531: link d0/db/d3f/f89 d0/db/d21/d57/f98 0 2024-09-13T02:50:32.979 INFO:tasks.workunit.client.0.smithi100.stdout:7/639: symlink d3/d16/d3b/lcb 0 2024-09-13T02:50:32.981 INFO:tasks.workunit.client.0.smithi100.stdout:0/486: mkdir d2/dd/d54/d28/dac 0 2024-09-13T02:50:32.982 INFO:tasks.workunit.client.0.smithi100.stdout:0/487: write d2/d1a/f88 [326443,116610] 0 2024-09-13T02:50:32.982 INFO:tasks.workunit.client.0.smithi100.stdout:0/488: chown d2/dd/d54/d47/d8a/da7 59 1 2024-09-13T02:50:32.982 INFO:tasks.workunit.client.0.smithi100.stdout:0/489: chown d2/d9 50 1 2024-09-13T02:50:32.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/670: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/dc6/fe6 x:0 0 0 2024-09-13T02:50:32.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/671: read d10/f44 [53372,57648] 0 2024-09-13T02:50:32.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/672: creat d10/d21/d51/d5a/d5e/fe7 x:0 0 0 2024-09-13T02:50:32.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/673: creat d10/d21/d51/d5a/d5e/d89/dc0/fe8 x:0 0 0 2024-09-13T02:50:32.983 INFO:tasks.workunit.client.0.smithi100.stdout:3/674: chown d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/le3 7 1 2024-09-13T02:50:32.985 INFO:tasks.workunit.client.0.smithi100.stdout:7/640: rmdir d3/d5/d4f/dc3 0 2024-09-13T02:50:32.985 INFO:tasks.workunit.client.0.smithi100.stdout:7/641: chown d3/d16/d3b/d8c/cc9 29034 1 2024-09-13T02:50:32.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/525: dwrite dd/d1b/d1d/d43/d5d/f7b [0,4194304] 0 2024-09-13T02:50:32.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/526: chown dd/d1b/d1d/d43/l55 7116422 1 2024-09-13T02:50:32.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/527: chown dd/d1b/d1d/d43/d5d/laa 87332 1 2024-09-13T02:50:32.987 INFO:tasks.workunit.client.0.smithi100.stdout:5/578: dwrite db/de/d1f/f31 [4194304,4194304] 0 2024-09-13T02:50:32.990 INFO:tasks.workunit.client.0.smithi100.stdout:3/675: mknod d10/d21/d51/d6c/db7/ce9 0 2024-09-13T02:50:32.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/642: symlink d3/d16/d55/d56/dbc/lcc 0 2024-09-13T02:50:32.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/643: write d3/f15 [3899380,8895] 0 2024-09-13T02:50:32.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/644: fsync d3/d5/f2a 0 2024-09-13T02:50:32.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/645: read d3/d16/d3b/f6a [542403,121921] 0 2024-09-13T02:50:32.991 INFO:tasks.workunit.client.0.smithi100.stdout:7/646: readlink d3/d16/d55/d92/lc0 0 2024-09-13T02:50:32.992 INFO:tasks.workunit.client.0.smithi100.stdout:5/579: write f8 [55747,41471] 0 2024-09-13T02:50:32.994 INFO:tasks.workunit.client.0.smithi100.stdout:9/528: dread dd/d1b/d1d/d43/d5d/f64 [0,4194304] 0 2024-09-13T02:50:32.995 INFO:tasks.workunit.client.0.smithi100.stdout:7/647: creat d3/d16/d3b/fcd x:0 0 0 2024-09-13T02:50:32.996 INFO:tasks.workunit.client.0.smithi100.stdout:9/529: symlink dd/d1b/d24/da8/da9/lb1 0 2024-09-13T02:50:32.997 INFO:tasks.workunit.client.0.smithi100.stdout:2/532: getdents d0/d36/d8a 0 2024-09-13T02:50:32.997 INFO:tasks.workunit.client.0.smithi100.stdout:9/530: dread dd/d1b/d1d/f3b [0,4194304] 0 2024-09-13T02:50:32.998 INFO:tasks.workunit.client.0.smithi100.stdout:9/531: readlink dd/d1b/d7d/l9a 0 2024-09-13T02:50:32.998 INFO:tasks.workunit.client.0.smithi100.stdout:9/532: write dd/d1b/d1d/f2c [5054013,42077] 0 2024-09-13T02:50:32.998 INFO:tasks.workunit.client.0.smithi100.stdout:9/533: write dd/d1b/d1d/d28/f8c [223024,96524] 0 2024-09-13T02:50:32.998 INFO:tasks.workunit.client.0.smithi100.stdout:3/676: write d10/f54 [1018052,92265] 0 2024-09-13T02:50:33.000 INFO:tasks.workunit.client.0.smithi100.stdout:7/648: rename d3/d5/d4f/ca6 to d3/d16/d55/d92/cce 0 2024-09-13T02:50:33.001 INFO:tasks.workunit.client.0.smithi100.stdout:9/534: rmdir dd/d1b/d1d/d43/d4f/da4 0 2024-09-13T02:50:33.002 INFO:tasks.workunit.client.0.smithi100.stdout:3/677: symlink d10/d21/d51/d6c/dd3/lea 0 2024-09-13T02:50:33.002 INFO:tasks.workunit.client.0.smithi100.stdout:3/678: write d10/d21/d51/d5a/d5e/d89/dc0/fe0 [205581,78072] 0 2024-09-13T02:50:33.004 INFO:tasks.workunit.client.0.smithi100.stdout:2/533: rename d0/db/d23/c2f to d0/db/d68/d6b/d85/c99 0 2024-09-13T02:50:33.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/535: unlink dd/d1b/d1d/d43/d4f/l95 0 2024-09-13T02:50:33.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/536: creat dd/d1b/d24/fb2 x:0 0 0 2024-09-13T02:50:33.008 INFO:tasks.workunit.client.0.smithi100.stdout:3/679: rename d10/d21/c2e to d10/d21/d51/ceb 0 2024-09-13T02:50:33.008 INFO:tasks.workunit.client.0.smithi100.stdout:3/680: chown d10/d21/d51/d5a/d5e/cb3 2885 1 2024-09-13T02:50:33.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/555: sync 2024-09-13T02:50:33.008 INFO:tasks.workunit.client.0.smithi100.stdout:1/610: sync 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:6/556: dread - d12/d43/d4b/f96 zero size 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/538: sync 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:4/539: readlink d3/d3a/d5c/lb3 0 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:7/649: getdents d3/d16/d55/d92/db3 0 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:7/650: fdatasync d3/d2d/f4d 0 2024-09-13T02:50:33.009 INFO:tasks.workunit.client.0.smithi100.stdout:7/651: creat d3/fcf x:0 0 0 2024-09-13T02:50:33.010 INFO:tasks.workunit.client.0.smithi100.stdout:0/490: dwrite d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:33.012 INFO:tasks.workunit.client.0.smithi100.stdout:5/580: dwrite db/de/d1f/f9e [0,4194304] 0 2024-09-13T02:50:33.012 INFO:tasks.workunit.client.0.smithi100.stdout:5/581: stat db/de/d1f/c99 0 2024-09-13T02:50:33.012 INFO:tasks.workunit.client.0.smithi100.stdout:1/611: mkdir de/d14/d22/d52/d65/dc6 0 2024-09-13T02:50:33.013 INFO:tasks.workunit.client.0.smithi100.stdout:0/491: dread d2/d9/f81 [0,4194304] 0 2024-09-13T02:50:33.014 INFO:tasks.workunit.client.0.smithi100.stdout:6/557: mkdir d12/d14/d1c/d28/d88/da5 0 2024-09-13T02:50:33.014 INFO:tasks.workunit.client.0.smithi100.stdout:6/558: chown d12/d14/d2f/d45 308 1 2024-09-13T02:50:33.015 INFO:tasks.workunit.client.0.smithi100.stdout:6/559: write d12/f16 [4605247,45929] 0 2024-09-13T02:50:33.017 INFO:tasks.workunit.client.0.smithi100.stdout:7/652: rmdir d3/d16/d55/d56 39 2024-09-13T02:50:33.017 INFO:tasks.workunit.client.0.smithi100.stdout:5/582: rmdir db/de/d3e/da2/dac/db1 39 2024-09-13T02:50:33.017 INFO:tasks.workunit.client.0.smithi100.stdout:5/583: readlink db/de/d1f/l9f 0 2024-09-13T02:50:33.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/537: dread f5 [0,4194304] 0 2024-09-13T02:50:33.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/538: creat dd/d1b/d1d/d43/fb3 x:0 0 0 2024-09-13T02:50:33.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/539: stat dd/d1b/d1d/d43/d5d/f64 0 2024-09-13T02:50:33.018 INFO:tasks.workunit.client.0.smithi100.stdout:1/612: getdents de/d14/d22/d52/d7a 0 2024-09-13T02:50:33.018 INFO:tasks.workunit.client.0.smithi100.stdout:1/613: getdents de/d14/d44/d7f/dc2 0 2024-09-13T02:50:33.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/540: rmdir d3/d6/d21/d67 39 2024-09-13T02:50:33.020 INFO:tasks.workunit.client.0.smithi100.stdout:4/541: readlink d3/d6/d9/l6c 0 2024-09-13T02:50:33.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/560: mkdir d12/d14/d1c/d7b/da6 0 2024-09-13T02:50:33.022 INFO:tasks.workunit.client.0.smithi100.stdout:6/561: truncate d12/d14/f57 493506 0 2024-09-13T02:50:33.023 INFO:tasks.workunit.client.0.smithi100.stdout:3/681: dread d10/d21/d51/d5a/f69 [0,4194304] 0 2024-09-13T02:50:33.024 INFO:tasks.workunit.client.0.smithi100.stdout:5/584: mknod db/de/d3e/d7e/d81/d85/cc9 0 2024-09-13T02:50:33.026 INFO:tasks.workunit.client.0.smithi100.stdout:9/540: symlink dd/d1b/d1d/d43/d5e/lb4 0 2024-09-13T02:50:33.027 INFO:tasks.workunit.client.0.smithi100.stdout:1/614: rename de/d12/f30 to de/d14/d2e/d48/fc7 0 2024-09-13T02:50:33.028 INFO:tasks.workunit.client.0.smithi100.stdout:6/562: mknod d12/d14/d1c/d7b/da6/ca7 0 2024-09-13T02:50:33.035 INFO:tasks.workunit.client.0.smithi100.stdout:7/653: rmdir d3 39 2024-09-13T02:50:33.035 INFO:tasks.workunit.client.0.smithi100.stdout:7/654: fdatasync d3/d16/d55/d56/f5b 0 2024-09-13T02:50:33.036 INFO:tasks.workunit.client.0.smithi100.stdout:5/585: truncate db/de/d3e/d71/f97 1865414 0 2024-09-13T02:50:33.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/542: rename d3/d6/d21/d46/fa4 to d3/dc/d88/fba 0 2024-09-13T02:50:33.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/534: dwrite d0/db/d79/f8b [0,4194304] 0 2024-09-13T02:50:33.038 INFO:tasks.workunit.client.0.smithi100.stdout:2/535: chown d0/db 46 1 2024-09-13T02:50:33.039 INFO:tasks.workunit.client.0.smithi100.stdout:7/655: getdents d3/d16/d55/d56/d9e 0 2024-09-13T02:50:33.040 INFO:tasks.workunit.client.0.smithi100.stdout:3/682: mkdir d10/dec 0 2024-09-13T02:50:33.042 INFO:tasks.workunit.client.0.smithi100.stdout:5/586: creat db/de/d63/d9c/fca x:0 0 0 2024-09-13T02:50:33.043 INFO:tasks.workunit.client.0.smithi100.stdout:9/541: mkdir dd/db5 0 2024-09-13T02:50:33.044 INFO:tasks.workunit.client.0.smithi100.stdout:2/536: dread d0/db/f40 [0,4194304] 0 2024-09-13T02:50:33.046 INFO:tasks.workunit.client.0.smithi100.stdout:4/543: rename d3/d3a/d56/f7b to d3/d6/d21/d46/d34/d96/d99/fbb 0 2024-09-13T02:50:33.047 INFO:tasks.workunit.client.0.smithi100.stdout:0/492: dwrite d2/d1a/d4c/f63 [0,4194304] 0 2024-09-13T02:50:33.047 INFO:tasks.workunit.client.0.smithi100.stdout:0/493: creat d2/d9/fad x:0 0 0 2024-09-13T02:50:33.049 INFO:tasks.workunit.client.0.smithi100.stdout:7/656: creat d3/d16/fd0 x:0 0 0 2024-09-13T02:50:33.049 INFO:tasks.workunit.client.0.smithi100.stdout:1/615: dwrite de/d14/d22/d52/f71 [0,4194304] 0 2024-09-13T02:50:33.049 INFO:tasks.workunit.client.0.smithi100.stdout:1/616: write de/d14/d44/d7f/f96 [617959,68885] 0 2024-09-13T02:50:33.051 INFO:tasks.workunit.client.0.smithi100.stdout:2/537: mkdir d0/db/d68/d9a 0 2024-09-13T02:50:33.057 INFO:tasks.workunit.client.0.smithi100.stdout:0/494: truncate d2/dd/d54/d47/f77 131647 0 2024-09-13T02:50:33.061 INFO:tasks.workunit.client.0.smithi100.stdout:1/617: write de/f7d [1119229,32168] 0 2024-09-13T02:50:33.061 INFO:tasks.workunit.client.0.smithi100.stdout:0/495: dread d2/d9/f81 [0,4194304] 0 2024-09-13T02:50:33.061 INFO:tasks.workunit.client.0.smithi100.stdout:1/618: creat de/d14/d22/d52/d65/fc8 x:0 0 0 2024-09-13T02:50:33.061 INFO:tasks.workunit.client.0.smithi100.stdout:1/619: write de/d14/d2e/d60/fa0 [2309314,96560] 0 2024-09-13T02:50:33.067 INFO:tasks.workunit.client.0.smithi100.stdout:5/587: dwrite db/f5c [0,4194304] 0 2024-09-13T02:50:33.071 INFO:tasks.workunit.client.0.smithi100.stdout:6/563: dwrite d12/f16 [4194304,4194304] 0 2024-09-13T02:50:33.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/657: rename d3/d5/d4f/fc8 to d3/d16/d55/d56/d9e/d9f/fd1 0 2024-09-13T02:50:33.074 INFO:tasks.workunit.client.0.smithi100.stdout:7/658: dread - d3/f4c zero size 2024-09-13T02:50:33.074 INFO:tasks.workunit.client.0.smithi100.stdout:3/683: mkdir d10/ded 0 2024-09-13T02:50:33.076 INFO:tasks.workunit.client.0.smithi100.stdout:4/544: rmdir d3/d6/d21/d46/d2d 39 2024-09-13T02:50:33.078 INFO:tasks.workunit.client.0.smithi100.stdout:0/496: mkdir d2/dd/d54/d68/dae 0 2024-09-13T02:50:33.078 INFO:tasks.workunit.client.0.smithi100.stdout:0/497: fdatasync d2/dd/d54/d28/f35 0 2024-09-13T02:50:33.080 INFO:tasks.workunit.client.0.smithi100.stdout:5/588: link db/de/d1f/c43 db/de/d1f/d2b/ccb 0 2024-09-13T02:50:33.080 INFO:tasks.workunit.client.0.smithi100.stdout:7/659: rmdir d3/d16/d55/d92/da2 39 2024-09-13T02:50:33.082 INFO:tasks.workunit.client.0.smithi100.stdout:2/538: dwrite d0/db/d3f/f4e [0,4194304] 0 2024-09-13T02:50:33.082 INFO:tasks.workunit.client.0.smithi100.stdout:2/539: write d0/db/d21/d57/f6e [485749,43670] 0 2024-09-13T02:50:33.082 INFO:tasks.workunit.client.0.smithi100.stdout:2/540: write d0/db/d21/f93 [761832,78190] 0 2024-09-13T02:50:33.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/545: creat d3/d6/d2f/d60/fbc x:0 0 0 2024-09-13T02:50:33.083 INFO:tasks.workunit.client.0.smithi100.stdout:4/546: dread - d3/dc/d4b/d52/f8c zero size 2024-09-13T02:50:33.084 INFO:tasks.workunit.client.0.smithi100.stdout:9/542: dwrite dd/d1b/d1d/f81 [0,4194304] 0 2024-09-13T02:50:33.085 INFO:tasks.workunit.client.0.smithi100.stdout:0/498: symlink d2/dd/laf 0 2024-09-13T02:50:33.086 INFO:tasks.workunit.client.0.smithi100.stdout:0/499: dread d2/dd/d54/d47/f77 [0,4194304] 0 2024-09-13T02:50:33.087 INFO:tasks.workunit.client.0.smithi100.stdout:5/589: rmdir db/de/d1f/d2b 39 2024-09-13T02:50:33.088 INFO:tasks.workunit.client.0.smithi100.stdout:7/660: link d3/d16/d55/d56/fc4 d3/fd2 0 2024-09-13T02:50:33.088 INFO:tasks.workunit.client.0.smithi100.stdout:2/541: rmdir d0/db/d21/d88 39 2024-09-13T02:50:33.089 INFO:tasks.workunit.client.0.smithi100.stdout:2/542: write d0/f11 [4265660,27594] 0 2024-09-13T02:50:33.090 INFO:tasks.workunit.client.0.smithi100.stdout:4/547: unlink d3/d6/d21/d46/d2d/d3f/d79/fb8 0 2024-09-13T02:50:33.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/543: unlink dd/c42 0 2024-09-13T02:50:33.093 INFO:tasks.workunit.client.0.smithi100.stdout:9/544: creat dd/d1b/d7d/fb6 x:0 0 0 2024-09-13T02:50:33.095 INFO:tasks.workunit.client.0.smithi100.stdout:3/684: dwrite d10/d21/d51/d6c/fd8 [0,4194304] 0 2024-09-13T02:50:33.096 INFO:tasks.workunit.client.0.smithi100.stdout:5/590: truncate db/de/d1f/f9e 2028398 0 2024-09-13T02:50:33.096 INFO:tasks.workunit.client.0.smithi100.stdout:5/591: fsync db/f83 0 2024-09-13T02:50:33.097 INFO:tasks.workunit.client.0.smithi100.stdout:8/503: sync 2024-09-13T02:50:33.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/545: symlink dd/d1b/d27/d51/lb7 0 2024-09-13T02:50:33.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/546: truncate dd/d1b/d24/f67 1609533 0 2024-09-13T02:50:33.104 INFO:tasks.workunit.client.0.smithi100.stdout:3/685: write d10/f2b [3514589,76464] 0 2024-09-13T02:50:33.108 INFO:tasks.workunit.client.0.smithi100.stdout:8/504: getdents df/d13/d21/d81/db0 0 2024-09-13T02:50:33.108 INFO:tasks.workunit.client.0.smithi100.stdout:8/505: chown df/d13/lb9 909489 1 2024-09-13T02:50:33.108 INFO:tasks.workunit.client.0.smithi100.stdout:8/506: chown df/d13/d68/fab 32 1 2024-09-13T02:50:33.109 INFO:tasks.workunit.client.0.smithi100.stdout:9/547: mkdir dd/d1b/d24/d74/d4e/d58/db8 0 2024-09-13T02:50:33.109 INFO:tasks.workunit.client.0.smithi100.stdout:3/686: getdents d10/d21/d51/d5a/d5e/d99/dc7 0 2024-09-13T02:50:33.112 INFO:tasks.workunit.client.0.smithi100.stdout:0/500: rename d2/dd/d33 to d2/dd/db0 0 2024-09-13T02:50:33.112 INFO:tasks.workunit.client.0.smithi100.stdout:5/592: rename db/de/c46 to db/de/d3e/d71/ccc 0 2024-09-13T02:50:33.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/501: symlink d2/dd/d54/d47/d34/d91/lb1 0 2024-09-13T02:50:33.113 INFO:tasks.workunit.client.0.smithi100.stdout:0/502: chown d2/dd/d54/d68/l8e 81 1 2024-09-13T02:50:33.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/507: dread df/d6f/f92 [0,4194304] 0 2024-09-13T02:50:33.113 INFO:tasks.workunit.client.0.smithi100.stdout:8/508: fdatasync df/d13/d21/f40 0 2024-09-13T02:50:33.116 INFO:tasks.workunit.client.0.smithi100.stdout:5/593: creat db/de/d3e/d71/fcd x:0 0 0 2024-09-13T02:50:33.116 INFO:tasks.workunit.client.0.smithi100.stdout:8/509: chown df/d13/l53 224125 1 2024-09-13T02:50:33.116 INFO:tasks.workunit.client.0.smithi100.stdout:8/510: truncate df/f64 172700 0 2024-09-13T02:50:33.118 INFO:tasks.workunit.client.0.smithi100.stdout:5/594: symlink db/de/d3e/d7e/d81/d85/lce 0 2024-09-13T02:50:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/687: rename d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/dc6 to d10/d21/d51/d6c/dee 0 2024-09-13T02:50:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/688: chown d10/d21/f3b 290 1 2024-09-13T02:50:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:5/595: unlink db/de/d1f/c80 0 2024-09-13T02:50:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/689: stat d10/c61 0 2024-09-13T02:50:33.120 INFO:tasks.workunit.client.0.smithi100.stdout:3/690: fsync fc 0 2024-09-13T02:50:33.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/661: dwrite d3/d16/fd0 [0,4194304] 0 2024-09-13T02:50:33.121 INFO:tasks.workunit.client.0.smithi100.stdout:7/662: read d3/d16/d3b/da5/f4a [3834342,64885] 0 2024-09-13T02:50:33.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/548: dwrite d3/d6/d21/d46/fa3 [0,4194304] 0 2024-09-13T02:50:33.122 INFO:tasks.workunit.client.0.smithi100.stdout:5/596: rename db/de/d1f/d2b/c6d to db/de/d3e/da2/dac/db1/ccf 0 2024-09-13T02:50:33.123 INFO:tasks.workunit.client.0.smithi100.stdout:2/543: dwrite d0/f64 [0,4194304] 0 2024-09-13T02:50:33.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/549: dread d3/d6/d21/d46/d2d/f95 [0,4194304] 0 2024-09-13T02:50:33.129 INFO:tasks.workunit.client.0.smithi100.stdout:7/663: dread d3/fa [0,4194304] 0 2024-09-13T02:50:33.131 INFO:tasks.workunit.client.0.smithi100.stdout:5/597: link f8 db/de/d3e/dc3/fd0 0 2024-09-13T02:50:33.131 INFO:tasks.workunit.client.0.smithi100.stdout:5/598: fdatasync db/f57 0 2024-09-13T02:50:33.131 INFO:tasks.workunit.client.0.smithi100.stdout:5/599: chown db/de/d1f/d2b/l58 191770883 1 2024-09-13T02:50:33.132 INFO:tasks.workunit.client.0.smithi100.stdout:9/548: write dd/d1b/d21/d86/f4c [3746367,21038] 0 2024-09-13T02:50:33.132 INFO:tasks.workunit.client.0.smithi100.stdout:9/549: fdatasync dd/d1b/fb0 0 2024-09-13T02:50:33.132 INFO:tasks.workunit.client.0.smithi100.stdout:9/550: chown dd/d1b/d24/d74/d4e/f96 152835 1 2024-09-13T02:50:33.136 INFO:tasks.workunit.client.0.smithi100.stdout:7/664: mkdir d3/d16/d55/d92/da9/dd3 0 2024-09-13T02:50:33.140 INFO:tasks.workunit.client.0.smithi100.stdout:7/665: mkdir d3/d16/db0/dd4 0 2024-09-13T02:50:33.140 INFO:tasks.workunit.client.0.smithi100.stdout:7/666: readlink d3/d16/d3b/da5/d87/l93 0 2024-09-13T02:50:33.140 INFO:tasks.workunit.client.0.smithi100.stdout:7/667: chown d3/d5/d1b/d1c/d36/lba 1887094 1 2024-09-13T02:50:33.142 INFO:tasks.workunit.client.0.smithi100.stdout:7/668: link d3/d16/d3b/da5/f4a d3/d5/fd5 0 2024-09-13T02:50:33.143 INFO:tasks.workunit.client.0.smithi100.stdout:7/669: rename d3/d16/lab to d3/d16/d3b/da5/ld6 0 2024-09-13T02:50:33.151 INFO:tasks.workunit.client.0.smithi100.stdout:5/600: write db/f5c [225385,120612] 0 2024-09-13T02:50:33.151 INFO:tasks.workunit.client.0.smithi100.stdout:5/601: dread - db/de/d63/fbb zero size 2024-09-13T02:50:33.159 INFO:tasks.workunit.client.0.smithi100.stdout:3/691: dwrite d10/d21/d51/d5a/d5e/d89/dc0/fe8 [0,4194304] 0 2024-09-13T02:50:33.159 INFO:tasks.workunit.client.0.smithi100.stdout:8/511: dwrite df/f1a [0,4194304] 0 2024-09-13T02:50:33.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/512: fdatasync df/d5d/d70/f39 0 2024-09-13T02:50:33.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/513: chown df/d13/d20/da2/fae 0 1 2024-09-13T02:50:33.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/514: chown df/d5d/d70/d41 40 1 2024-09-13T02:50:33.160 INFO:tasks.workunit.client.0.smithi100.stdout:8/515: chown df/d13/f37 8663 1 2024-09-13T02:50:33.161 INFO:tasks.workunit.client.0.smithi100.stdout:9/551: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:50:33.161 INFO:tasks.workunit.client.0.smithi100.stdout:4/550: dwrite d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:33.164 INFO:tasks.workunit.client.0.smithi100.stdout:8/516: unlink df/f2b 0 2024-09-13T02:50:33.166 INFO:tasks.workunit.client.0.smithi100.stdout:7/670: write d3/f3c [487390,11039] 0 2024-09-13T02:50:33.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/602: dwrite db/de/fbd [0,4194304] 0 2024-09-13T02:50:33.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/692: read d10/d21/d57/f5b [662114,49368] 0 2024-09-13T02:50:33.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/693: stat d10/d21/d51/d5a/d5e/d89/cd2 0 2024-09-13T02:50:33.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/694: fdatasync d10/d21/d51/f55 0 2024-09-13T02:50:33.171 INFO:tasks.workunit.client.0.smithi100.stdout:9/552: mknod dd/d1b/d24/d74/d4e/d58/cb9 0 2024-09-13T02:50:33.171 INFO:tasks.workunit.client.0.smithi100.stdout:9/553: chown dd/d1b/d1d/d43/f44 4771652 1 2024-09-13T02:50:33.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/551: link d3/d6/d9/l6c d3/dc/d88/db4/lbd 0 2024-09-13T02:50:33.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/552: chown d3/d6/d21/d46/d34 2 1 2024-09-13T02:50:33.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/553: dread - d3/d6/d9/f73 zero size 2024-09-13T02:50:33.175 INFO:tasks.workunit.client.0.smithi100.stdout:8/517: symlink df/d5d/d70/d2c/d38/lbf 0 2024-09-13T02:50:33.176 INFO:tasks.workunit.client.0.smithi100.stdout:8/518: write df/d13/d20/d98/fa6 [985914,5540] 0 2024-09-13T02:50:33.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:32 smithi100 ceph-mon[27894]: pgmap v247: 65 pgs: 65 active+clean; 769 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 61 MiB/s rd, 77 MiB/s wr, 583 op/s 2024-09-13T02:50:33.181 INFO:tasks.workunit.client.0.smithi100.stdout:3/695: fdatasync d10/d21/d51/d5a/d73/fb8 0 2024-09-13T02:50:33.183 INFO:tasks.workunit.client.0.smithi100.stdout:9/554: creat dd/d1b/d1d/d43/d4f/da5/fba x:0 0 0 2024-09-13T02:50:33.184 INFO:tasks.workunit.client.0.smithi100.stdout:8/519: dread df/d13/d21/f57 [0,4194304] 0 2024-09-13T02:50:33.184 INFO:tasks.workunit.client.0.smithi100.stdout:4/554: link d3/d6/d21/f43 d3/d63/dae/fbe 0 2024-09-13T02:50:33.185 INFO:tasks.workunit.client.0.smithi100.stdout:4/555: fsync d3/dc/d4b/f87 0 2024-09-13T02:50:33.185 INFO:tasks.workunit.client.0.smithi100.stdout:9/555: symlink dd/d1b/d24/d74/d4e/d58/lbb 0 2024-09-13T02:50:33.185 INFO:tasks.workunit.client.0.smithi100.stdout:9/556: fdatasync dd/d1b/d1d/f2c 0 2024-09-13T02:50:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:32 smithi122 ceph-mon[34559]: pgmap v247: 65 pgs: 65 active+clean; 769 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 61 MiB/s rd, 77 MiB/s wr, 583 op/s 2024-09-13T02:50:33.186 INFO:tasks.workunit.client.0.smithi100.stdout:7/671: dwrite d3/d5/f1a [4194304,4194304] 0 2024-09-13T02:50:33.187 INFO:tasks.workunit.client.0.smithi100.stdout:8/520: mkdir df/d5d/d88/dc0 0 2024-09-13T02:50:33.189 INFO:tasks.workunit.client.0.smithi100.stdout:3/696: dread d10/f54 [0,4194304] 0 2024-09-13T02:50:33.189 INFO:tasks.workunit.client.0.smithi100.stdout:5/603: dwrite db/f5c [4194304,4194304] 0 2024-09-13T02:50:33.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/557: dread f5 [0,4194304] 0 2024-09-13T02:50:33.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/558: creat dd/d1b/d21/fbc x:0 0 0 2024-09-13T02:50:33.189 INFO:tasks.workunit.client.0.smithi100.stdout:7/672: rename d3/d16/d55/d92/cce to d3/d16/db0/dd4/cd7 0 2024-09-13T02:50:33.190 INFO:tasks.workunit.client.0.smithi100.stdout:4/556: getdents d3/d6/d9 0 2024-09-13T02:50:33.192 INFO:tasks.workunit.client.0.smithi100.stdout:5/604: dread db/de/d63/d70/f74 [0,4194304] 0 2024-09-13T02:50:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/564: sync 2024-09-13T02:50:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:1/620: sync 2024-09-13T02:50:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:6/565: fdatasync d12/d14/d1c/f3a 0 2024-09-13T02:50:33.195 INFO:tasks.workunit.client.0.smithi100.stdout:3/697: mknod d10/d21/d57/cef 0 2024-09-13T02:50:33.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/673: dread d3/d16/d55/f5e [0,4194304] 0 2024-09-13T02:50:33.198 INFO:tasks.workunit.client.0.smithi100.stdout:9/559: unlink dd/ca6 0 2024-09-13T02:50:33.201 INFO:tasks.workunit.client.0.smithi100.stdout:1/621: unlink de/d14/d22/d52/fa6 0 2024-09-13T02:50:33.204 INFO:tasks.workunit.client.0.smithi100.stdout:9/560: link dd/d1b/d1d/d28/l6a dd/d1b/d21/lbd 0 2024-09-13T02:50:33.209 INFO:tasks.workunit.client.0.smithi100.stdout:5/605: rmdir db/de/d3e/d71 39 2024-09-13T02:50:33.209 INFO:tasks.workunit.client.0.smithi100.stdout:7/674: read d3/d16/d55/d56/f61 [1873682,117284] 0 2024-09-13T02:50:33.210 INFO:tasks.workunit.client.0.smithi100.stdout:9/561: mknod dd/d1b/d21/cbe 0 2024-09-13T02:50:33.211 INFO:tasks.workunit.client.0.smithi100.stdout:5/606: mknod db/de/d1f/d2b/d9b/cd1 0 2024-09-13T02:50:33.211 INFO:tasks.workunit.client.0.smithi100.stdout:5/607: fdatasync db/f57 0 2024-09-13T02:50:33.212 INFO:tasks.workunit.client.0.smithi100.stdout:7/675: mknod d3/d16/cd8 0 2024-09-13T02:50:33.213 INFO:tasks.workunit.client.0.smithi100.stdout:7/676: dread d3/d16/d3b/f6a [0,4194304] 0 2024-09-13T02:50:33.214 INFO:tasks.workunit.client.0.smithi100.stdout:0/503: sync 2024-09-13T02:50:33.214 INFO:tasks.workunit.client.0.smithi100.stdout:2/544: sync 2024-09-13T02:50:33.215 INFO:tasks.workunit.client.0.smithi100.stdout:2/545: creat d0/db/d68/d6b/d85/f9b x:0 0 0 2024-09-13T02:50:33.217 INFO:tasks.workunit.client.0.smithi100.stdout:2/546: rename d0/db/d23/l3e to d0/db/d3f/l9c 0 2024-09-13T02:50:33.225 INFO:tasks.workunit.client.0.smithi100.stdout:9/562: write dd/f15 [2952086,100504] 0 2024-09-13T02:50:33.226 INFO:tasks.workunit.client.0.smithi100.stdout:9/563: creat dd/d1b/d24/d74/fbf x:0 0 0 2024-09-13T02:50:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:8/521: dwrite df/d13/d21/d81/db0/fbd [0,4194304] 0 2024-09-13T02:50:33.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/566: dwrite d12/d2e/d90/da2/f6d [0,4194304] 0 2024-09-13T02:50:33.243 INFO:tasks.workunit.client.0.smithi100.stdout:6/567: dread d12/d14/f57 [0,4194304] 0 2024-09-13T02:50:33.245 INFO:tasks.workunit.client.0.smithi100.stdout:6/568: symlink d12/d14/d68/la8 0 2024-09-13T02:50:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:6/569: truncate d12/d14/d2f/d45/f48 855654 0 2024-09-13T02:50:33.246 INFO:tasks.workunit.client.0.smithi100.stdout:6/570: write d12/d14/d2f/d45/f51 [736004,108011] 0 2024-09-13T02:50:33.247 INFO:tasks.workunit.client.0.smithi100.stdout:6/571: creat d12/d2e/d90/fa9 x:0 0 0 2024-09-13T02:50:33.247 INFO:tasks.workunit.client.0.smithi100.stdout:8/522: dread df/d13/d68/f6d [4194304,4194304] 0 2024-09-13T02:50:33.248 INFO:tasks.workunit.client.0.smithi100.stdout:6/572: rmdir d12/d14/d1c/d28/d88 39 2024-09-13T02:50:33.250 INFO:tasks.workunit.client.0.smithi100.stdout:6/573: dread d12/d14/d2f/d45/d73/f80 [0,4194304] 0 2024-09-13T02:50:33.256 INFO:tasks.workunit.client.0.smithi100.stdout:4/557: dwrite d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:33.256 INFO:tasks.workunit.client.0.smithi100.stdout:4/558: write d3/dc/d4b/d9b/fb6 [525100,45238] 0 2024-09-13T02:50:33.256 INFO:tasks.workunit.client.0.smithi100.stdout:4/559: chown d3/d6/d21/d46/d2d/d3f/f5b 754557549 1 2024-09-13T02:50:33.257 INFO:tasks.workunit.client.0.smithi100.stdout:1/622: dwrite de/f2c [0,4194304] 0 2024-09-13T02:50:33.257 INFO:tasks.workunit.client.0.smithi100.stdout:7/677: dwrite d3/d16/d55/d56/d9e/d9f/fd1 [0,4194304] 0 2024-09-13T02:50:33.257 INFO:tasks.workunit.client.0.smithi100.stdout:3/698: dwrite d10/f92 [0,4194304] 0 2024-09-13T02:50:33.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/560: rmdir d3/d6/d2f/d60/d69 0 2024-09-13T02:50:33.258 INFO:tasks.workunit.client.0.smithi100.stdout:7/678: dread d3/d16/d3b/f6a [0,4194304] 0 2024-09-13T02:50:33.260 INFO:tasks.workunit.client.0.smithi100.stdout:1/623: dread de/d14/d39/f6c [0,4194304] 0 2024-09-13T02:50:33.262 INFO:tasks.workunit.client.0.smithi100.stdout:4/561: rename d3/d6/l2c to d3/d6/d21/d46/d2d/d3f/lbf 0 2024-09-13T02:50:33.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/679: mknod d3/d16/d55/d56/dbc/cd9 0 2024-09-13T02:50:33.263 INFO:tasks.workunit.client.0.smithi100.stdout:7/680: fsync d3/f3c 0 2024-09-13T02:50:33.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/624: link de/d14/d22/d52/d65/fa3 de/d14/d22/fc9 0 2024-09-13T02:50:33.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/625: write de/d14/d44/d61/f91 [239699,11894] 0 2024-09-13T02:50:33.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/626: stat de/d14/d22/d29/d64/l80 0 2024-09-13T02:50:33.267 INFO:tasks.workunit.client.0.smithi100.stdout:0/504: dwrite d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:33.270 INFO:tasks.workunit.client.0.smithi100.stdout:4/562: mknod d3/d6/d21/d46/d34/d96/d99/cc0 0 2024-09-13T02:50:33.270 INFO:tasks.workunit.client.0.smithi100.stdout:4/563: truncate d3/d6/d9/f73 1019183 0 2024-09-13T02:50:33.273 INFO:tasks.workunit.client.0.smithi100.stdout:0/505: mknod d2/dd/d54/d68/dae/cb2 0 2024-09-13T02:50:33.274 INFO:tasks.workunit.client.0.smithi100.stdout:4/564: link d3/d6/d2f/d60/fbc d3/d6/d21/d67/fc1 0 2024-09-13T02:50:33.274 INFO:tasks.workunit.client.0.smithi100.stdout:9/564: dwrite dd/d1b/d27/d51/fac [0,4194304] 0 2024-09-13T02:50:33.274 INFO:tasks.workunit.client.0.smithi100.stdout:2/547: dwrite d0/d36/f75 [0,4194304] 0 2024-09-13T02:50:33.275 INFO:tasks.workunit.client.0.smithi100.stdout:0/506: mkdir d2/d9/d6d/d85/db3 0 2024-09-13T02:50:33.275 INFO:tasks.workunit.client.0.smithi100.stdout:0/507: dread - d2/d9/f86 zero size 2024-09-13T02:50:33.275 INFO:tasks.workunit.client.0.smithi100.stdout:4/565: link d3/dc/d4b/c7e d3/dc/d4b/d7c/cc2 0 2024-09-13T02:50:33.276 INFO:tasks.workunit.client.0.smithi100.stdout:0/508: dread d2/dd/d54/d47/f77 [0,4194304] 0 2024-09-13T02:50:33.278 INFO:tasks.workunit.client.0.smithi100.stdout:9/565: mkdir dd/d1b/d1d/d43/d5e/dc0 0 2024-09-13T02:50:33.288 INFO:tasks.workunit.client.0.smithi100.stdout:1/627: dread de/d14/d44/f47 [0,4194304] 0 2024-09-13T02:50:33.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/523: dwrite df/f1a [0,4194304] 0 2024-09-13T02:50:33.288 INFO:tasks.workunit.client.0.smithi100.stdout:3/699: dwrite d10/f79 [0,4194304] 0 2024-09-13T02:50:33.289 INFO:tasks.workunit.client.0.smithi100.stdout:3/700: fsync d10/f40 0 2024-09-13T02:50:33.289 INFO:tasks.workunit.client.0.smithi100.stdout:0/509: dread d2/d1a/d4c/f63 [0,4194304] 0 2024-09-13T02:50:33.293 INFO:tasks.workunit.client.0.smithi100.stdout:6/574: dwrite d12/d2e/d90/da2/f7c [0,4194304] 0 2024-09-13T02:50:33.293 INFO:tasks.workunit.client.0.smithi100.stdout:6/575: chown d12/d14/d1c/d6e 391 1 2024-09-13T02:50:33.293 INFO:tasks.workunit.client.0.smithi100.stdout:6/576: read d12/d14/d2f/d45/d73/f80 [721319,7400] 0 2024-09-13T02:50:33.294 INFO:tasks.workunit.client.0.smithi100.stdout:7/681: dwrite d3/d16/d55/d56/fc4 [4194304,4194304] 0 2024-09-13T02:50:33.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/548: dwrite d0/db/d21/d88/f49 [0,4194304] 0 2024-09-13T02:50:33.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/549: creat d0/d36/f9d x:0 0 0 2024-09-13T02:50:33.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/550: fsync d0/d36/f6f 0 2024-09-13T02:50:33.301 INFO:tasks.workunit.client.0.smithi100.stdout:2/551: creat d0/db/d3f/f9e x:0 0 0 2024-09-13T02:50:33.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/566: dwrite dd/d1b/d1d/f5b [0,4194304] 0 2024-09-13T02:50:33.310 INFO:tasks.workunit.client.0.smithi100.stdout:3/701: dwrite d10/f32 [0,4194304] 0 2024-09-13T02:50:33.310 INFO:tasks.workunit.client.0.smithi100.stdout:1/628: rmdir de/d14/d44/d61 39 2024-09-13T02:50:33.313 INFO:tasks.workunit.client.0.smithi100.stdout:8/524: symlink df/d5d/d70/d2c/d38/d9e/dad/lc1 0 2024-09-13T02:50:33.322 INFO:tasks.workunit.client.0.smithi100.stdout:0/510: mkdir d2/dd/db0/d43/d4b/db4 0 2024-09-13T02:50:33.327 INFO:tasks.workunit.client.0.smithi100.stdout:0/511: read d2/f56 [2054399,93754] 0 2024-09-13T02:50:33.327 INFO:tasks.workunit.client.0.smithi100.stdout:0/512: dread - d2/dd/f9e zero size 2024-09-13T02:50:33.328 INFO:tasks.workunit.client.0.smithi100.stdout:0/513: chown d2/dd/db0/d43/c57 54552992 1 2024-09-13T02:50:33.328 INFO:tasks.workunit.client.0.smithi100.stdout:0/514: chown d2/cab 1174 1 2024-09-13T02:50:33.328 INFO:tasks.workunit.client.0.smithi100.stdout:0/515: write d2/dd/d54/d47/d8a/f90 [679240,34750] 0 2024-09-13T02:50:33.335 INFO:tasks.workunit.client.0.smithi100.stdout:6/577: creat d12/d14/d21/faa x:0 0 0 2024-09-13T02:50:33.335 INFO:tasks.workunit.client.0.smithi100.stdout:6/578: truncate d12/d14/d2f/d45/f49 3480033 0 2024-09-13T02:50:33.337 INFO:tasks.workunit.client.0.smithi100.stdout:7/682: link d3/d16/d89/cc2 d3/d5/d1b/d1c/d36/d9c/cda 0 2024-09-13T02:50:33.337 INFO:tasks.workunit.client.0.smithi100.stdout:6/579: dread d12/d14/d1c/d6e/f8b [0,4194304] 0 2024-09-13T02:50:33.345 INFO:tasks.workunit.client.0.smithi100.stdout:2/552: symlink d0/db/d21/d57/d81/l9f 0 2024-09-13T02:50:33.347 INFO:tasks.workunit.client.0.smithi100.stdout:9/567: truncate dd/d1b/d1d/d43/d5d/f7b 3509577 0 2024-09-13T02:50:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/702: rename d10/d21/c3e to d10/d21/d51/d6c/dee/cf0 0 2024-09-13T02:50:33.388 INFO:tasks.workunit.client.0.smithi100.stdout:3/703: chown d10/d21/d51/d5a/d73 27735 1 2024-09-13T02:50:33.390 INFO:tasks.workunit.client.0.smithi100.stdout:8/525: creat df/d5d/d70/d2c/fc2 x:0 0 0 2024-09-13T02:50:33.390 INFO:tasks.workunit.client.0.smithi100.stdout:8/526: chown df/d5d/d70/d2c/d38/c3a 66 1 2024-09-13T02:50:33.391 INFO:tasks.workunit.client.0.smithi100.stdout:0/516: unlink d2/dd/d54/d68/l8e 0 2024-09-13T02:50:33.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/683: mknod d3/d16/db0/cdb 0 2024-09-13T02:50:33.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/684: chown d3/d5/d1b/d1c/d36 5091828 1 2024-09-13T02:50:33.392 INFO:tasks.workunit.client.0.smithi100.stdout:6/580: mknod d12/d14/d1c/d28/d88/da5/cab 0 2024-09-13T02:50:33.396 INFO:tasks.workunit.client.0.smithi100.stdout:2/553: truncate d0/db/d21/d88/f43 1517756 0 2024-09-13T02:50:33.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/704: truncate f8 2401844 0 2024-09-13T02:50:33.400 INFO:tasks.workunit.client.0.smithi100.stdout:1/629: getdents de/d14/d2e/d69 0 2024-09-13T02:50:33.401 INFO:tasks.workunit.client.0.smithi100.stdout:5/608: sync 2024-09-13T02:50:33.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/705: dread d10/f49 [0,4194304] 0 2024-09-13T02:50:33.403 INFO:tasks.workunit.client.0.smithi100.stdout:3/706: write d10/d21/d51/d5a/d5e/d71/d97/db1/fcb [4554218,31143] 0 2024-09-13T02:50:33.404 INFO:tasks.workunit.client.0.smithi100.stdout:6/581: creat d12/d14/d1c/d28/d88/fac x:0 0 0 2024-09-13T02:50:33.407 INFO:tasks.workunit.client.0.smithi100.stdout:2/554: write d0/db/f16 [2212761,63522] 0 2024-09-13T02:50:33.407 INFO:tasks.workunit.client.0.smithi100.stdout:1/630: rename de/d14/d22/c28 to de/d14/d2e/d75/cca 0 2024-09-13T02:50:33.410 INFO:tasks.workunit.client.0.smithi100.stdout:6/582: symlink d12/d14/d1c/lad 0 2024-09-13T02:50:33.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/583: dread - d12/d14/d1c/d6e/f79 zero size 2024-09-13T02:50:33.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/584: truncate d12/d43/d4b/d4c/d36/f46 1866019 0 2024-09-13T02:50:33.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/585: chown d12/d2e/d90/da2/f8c 0 1 2024-09-13T02:50:33.411 INFO:tasks.workunit.client.0.smithi100.stdout:6/586: chown d12/d14/d4d/d8f 205769 1 2024-09-13T02:50:33.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/555: rmdir d0/db/d68/d6b/d71/d92 0 2024-09-13T02:50:33.412 INFO:tasks.workunit.client.0.smithi100.stdout:2/556: chown d0/db/d5b 256361 1 2024-09-13T02:50:33.413 INFO:tasks.workunit.client.0.smithi100.stdout:1/631: mknod de/d14/d22/d52/ccb 0 2024-09-13T02:50:33.413 INFO:tasks.workunit.client.0.smithi100.stdout:1/632: chown de/d12/f33 5 1 2024-09-13T02:50:33.413 INFO:tasks.workunit.client.0.smithi100.stdout:1/633: truncate de/d14/d39/f8a 864305 0 2024-09-13T02:50:33.413 INFO:tasks.workunit.client.0.smithi100.stdout:1/634: stat de/d14/d22/d29/d64/f8c 0 2024-09-13T02:50:33.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/635: write de/d14/d2e/f56 [965450,103539] 0 2024-09-13T02:50:33.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/636: fdatasync de/d14/d44/d7f/fc0 0 2024-09-13T02:50:33.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/637: readlink de/d14/d39/l8e 0 2024-09-13T02:50:33.414 INFO:tasks.workunit.client.0.smithi100.stdout:1/638: readlink de/d14/d44/l4d 0 2024-09-13T02:50:33.414 INFO:tasks.workunit.client.0.smithi100.stdout:3/707: mkdir d10/d8a/df1 0 2024-09-13T02:50:33.415 INFO:tasks.workunit.client.0.smithi100.stdout:6/587: symlink d12/d14/d1c/d6e/d71/lae 0 2024-09-13T02:50:33.416 INFO:tasks.workunit.client.0.smithi100.stdout:6/588: write d12/f5c [830077,43340] 0 2024-09-13T02:50:33.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/557: creat d0/db/d23/d8d/fa0 x:0 0 0 2024-09-13T02:50:33.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/558: write d0/f1f [1280970,112406] 0 2024-09-13T02:50:33.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/527: dwrite df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:33.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/528: truncate df/d13/d68/fab 379441 0 2024-09-13T02:50:33.419 INFO:tasks.workunit.client.0.smithi100.stdout:1/639: creat de/d14/d22/d52/db8/fcc x:0 0 0 2024-09-13T02:50:33.419 INFO:tasks.workunit.client.0.smithi100.stdout:7/685: dwrite d3/d5/f8d [0,4194304] 0 2024-09-13T02:50:33.421 INFO:tasks.workunit.client.0.smithi100.stdout:3/708: creat d10/d21/d51/d5a/d5e/d71/d97/ff2 x:0 0 0 2024-09-13T02:50:33.426 INFO:tasks.workunit.client.0.smithi100.stdout:8/529: mkdir df/d13/db5/dc3 0 2024-09-13T02:50:33.430 INFO:tasks.workunit.client.0.smithi100.stdout:3/709: dread d10/d21/d51/d5a/d5e/d71/d93/fc2 [0,4194304] 0 2024-09-13T02:50:33.430 INFO:tasks.workunit.client.0.smithi100.stdout:3/710: chown d10/d21/d51/d6c/dee/cf0 45398289 1 2024-09-13T02:50:33.430 INFO:tasks.workunit.client.0.smithi100.stdout:3/711: dread d10/f44 [0,4194304] 0 2024-09-13T02:50:33.436 INFO:tasks.workunit.client.0.smithi100.stdout:7/686: dwrite d3/d16/d55/f8e [0,4194304] 0 2024-09-13T02:50:33.436 INFO:tasks.workunit.client.0.smithi100.stdout:7/687: chown d3/d16/d3b/c58 5 1 2024-09-13T02:50:33.438 INFO:tasks.workunit.client.0.smithi100.stdout:6/589: rmdir d12/d43/d4b/d4c/d36 39 2024-09-13T02:50:33.439 INFO:tasks.workunit.client.0.smithi100.stdout:8/530: mknod df/d13/d21/d81/db0/cc4 0 2024-09-13T02:50:33.439 INFO:tasks.workunit.client.0.smithi100.stdout:8/531: readlink df/d13/lb9 0 2024-09-13T02:50:33.440 INFO:tasks.workunit.client.0.smithi100.stdout:3/712: symlink d10/d21/d51/d5a/d5e/d99/lf3 0 2024-09-13T02:50:33.441 INFO:tasks.workunit.client.0.smithi100.stdout:3/713: write d10/d21/d51/d6c/f6d [316261,89547] 0 2024-09-13T02:50:33.443 INFO:tasks.workunit.client.0.smithi100.stdout:7/688: mkdir d3/d9b/ddc 0 2024-09-13T02:50:33.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/590: getdents d12/d2e/d90/d92 0 2024-09-13T02:50:33.444 INFO:tasks.workunit.client.0.smithi100.stdout:8/532: fsync df/d13/f44 0 2024-09-13T02:50:33.445 INFO:tasks.workunit.client.0.smithi100.stdout:8/533: write df/d5d/fa8 [904500,62382] 0 2024-09-13T02:50:33.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/566: sync 2024-09-13T02:50:33.450 INFO:tasks.workunit.client.0.smithi100.stdout:4/567: write d3/d6/d2f/f54 [877851,45813] 0 2024-09-13T02:50:33.453 INFO:tasks.workunit.client.0.smithi100.stdout:6/591: dread d12/f16 [4194304,4194304] 0 2024-09-13T02:50:33.455 INFO:tasks.workunit.client.0.smithi100.stdout:6/592: mknod d12/d14/d2f/da4/caf 0 2024-09-13T02:50:33.457 INFO:tasks.workunit.client.0.smithi100.stdout:6/593: truncate d12/d14/d2f/d45/f51 259699 0 2024-09-13T02:50:33.458 INFO:tasks.workunit.client.0.smithi100.stdout:6/594: mknod d12/d14/d2f/cb0 0 2024-09-13T02:50:33.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/595: fdatasync d12/d14/d1c/fa1 0 2024-09-13T02:50:33.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/596: chown d12 847 1 2024-09-13T02:50:33.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/597: fsync d12/d43/d4b/f74 0 2024-09-13T02:50:33.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/598: link d12/d14/d68/la8 d12/d43/lb1 0 2024-09-13T02:50:33.460 INFO:tasks.workunit.client.0.smithi100.stdout:6/599: write d12/d43/d4b/d4c/f87 [90346,115881] 0 2024-09-13T02:50:33.460 INFO:tasks.workunit.client.0.smithi100.stdout:6/600: creat d12/d14/d9d/fb2 x:0 0 0 2024-09-13T02:50:33.461 INFO:tasks.workunit.client.0.smithi100.stdout:2/559: creat d0/fa1 x:0 0 0 2024-09-13T02:50:33.462 INFO:tasks.workunit.client.0.smithi100.stdout:4/568: dread d3/d63/dae/fbe [0,4194304] 0 2024-09-13T02:50:33.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/560: creat d0/d36/d8a/fa2 x:0 0 0 2024-09-13T02:50:33.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/561: write d0/d36/d8a/fa2 [118828,3226] 0 2024-09-13T02:50:33.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/562: chown d0/db/d21/d57/c8c 579118 1 2024-09-13T02:50:33.463 INFO:tasks.workunit.client.0.smithi100.stdout:2/563: stat d0/d36/f9d 0 2024-09-13T02:50:33.463 INFO:tasks.workunit.client.0.smithi100.stdout:4/569: rmdir d3/d6/d21/d46/d2d/d58 39 2024-09-13T02:50:33.464 INFO:tasks.workunit.client.0.smithi100.stdout:0/517: mknod d2/cb5 0 2024-09-13T02:50:33.465 INFO:tasks.workunit.client.0.smithi100.stdout:0/518: creat d2/dd/db0/d43/d4b/db4/fb6 x:0 0 0 2024-09-13T02:50:33.471 INFO:tasks.workunit.client.0.smithi100.stdout:7/689: dwrite d3/fd2 [0,4194304] 0 2024-09-13T02:50:33.471 INFO:tasks.workunit.client.0.smithi100.stdout:8/534: dwrite df/d13/d20/f7a [0,4194304] 0 2024-09-13T02:50:33.471 INFO:tasks.workunit.client.0.smithi100.stdout:8/535: chown df/l10 1306087 1 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:3/714: rmdir d10/d21/d51/d5a/d5e/d99 39 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:3/715: fdatasync d10/d21/d51/d5a/d5e/d71/fae 0 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:3/716: creat d10/d21/d51/d5a/d5e/d71/d97/db1/ff4 x:0 0 0 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:3/717: write d10/d21/d51/d5a/d5e/da1/fcc [15301,121196] 0 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:3/718: write d10/d21/d51/d5a/d5e/d71/d97/db1/ff4 [665676,89406] 0 2024-09-13T02:50:33.472 INFO:tasks.workunit.client.0.smithi100.stdout:1/640: rmdir de/d14/d22 39 2024-09-13T02:50:33.473 INFO:tasks.workunit.client.0.smithi100.stdout:1/641: readlink de/d14/d2e/lad 0 2024-09-13T02:50:33.473 INFO:tasks.workunit.client.0.smithi100.stdout:4/570: dread d3/dc/d88/fba [0,4194304] 0 2024-09-13T02:50:33.482 INFO:tasks.workunit.client.0.smithi100.stdout:7/690: write d3/d16/d55/d56/f70 [3870944,43939] 0 2024-09-13T02:50:33.483 INFO:tasks.workunit.client.0.smithi100.stdout:8/536: write df/d13/d21/d81/db0/fbd [3610071,87071] 0 2024-09-13T02:50:33.485 INFO:tasks.workunit.client.0.smithi100.stdout:4/571: rename d3/d6/d21/d46/c2a to d3/d6/d21/d46/d34/d96/d99/cc3 0 2024-09-13T02:50:33.485 INFO:tasks.workunit.client.0.smithi100.stdout:4/572: truncate d3/d6/d2f/d7a/fa1 392987 0 2024-09-13T02:50:33.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/642: write de/d14/d44/f5d [4117241,116080] 0 2024-09-13T02:50:33.490 INFO:tasks.workunit.client.0.smithi100.stdout:1/643: write de/d14/d22/d29/d64/f7e [119284,70864] 0 2024-09-13T02:50:33.492 INFO:tasks.workunit.client.0.smithi100.stdout:1/644: creat de/d14/d44/d61/da9/db7/fcd x:0 0 0 2024-09-13T02:50:33.497 INFO:tasks.workunit.client.0.smithi100.stdout:2/564: dwrite d0/db/d23/f2a [0,4194304] 0 2024-09-13T02:50:33.499 INFO:tasks.workunit.client.0.smithi100.stdout:1/645: read de/d14/d22/d29/d64/f8c [591732,122138] 0 2024-09-13T02:50:33.501 INFO:tasks.workunit.client.0.smithi100.stdout:2/565: rename d0/db/ff to d0/db/d68/d9a/fa3 0 2024-09-13T02:50:33.502 INFO:tasks.workunit.client.0.smithi100.stdout:1/646: symlink de/d14/d22/d29/d68/d6d/lce 0 2024-09-13T02:50:33.502 INFO:tasks.workunit.client.0.smithi100.stdout:1/647: chown de/d14/f36 5066 1 2024-09-13T02:50:33.503 INFO:tasks.workunit.client.0.smithi100.stdout:1/648: read de/d12/f33 [118094,50889] 0 2024-09-13T02:50:33.503 INFO:tasks.workunit.client.0.smithi100.stdout:1/649: chown de/l18 48 1 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/650: fdatasync de/d12/f33 0 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/651: write de/d14/d2e/d75/f9f [1361833,53946] 0 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/652: fdatasync de/d14/f83 0 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/653: write de/d14/d44/d7f/fc5 [673586,61516] 0 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:9/568: sync 2024-09-13T02:50:33.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/654: unlink de/d14/f36 0 2024-09-13T02:50:33.506 INFO:tasks.workunit.client.0.smithi100.stdout:9/569: mknod dd/d1b/d27/cc1 0 2024-09-13T02:50:33.506 INFO:tasks.workunit.client.0.smithi100.stdout:9/570: chown dd/d1b/d24/d74/d4e/d58/cb9 41579 1 2024-09-13T02:50:33.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/655: mknod de/d14/d2e/d60/ccf 0 2024-09-13T02:50:33.507 INFO:tasks.workunit.client.0.smithi100.stdout:9/571: rename dd/d1b/d1d/d28/l61 to dd/d1b/d1d/d28/lc2 0 2024-09-13T02:50:33.508 INFO:tasks.workunit.client.0.smithi100.stdout:9/572: stat dd/db5 0 2024-09-13T02:50:33.508 INFO:tasks.workunit.client.0.smithi100.stdout:9/573: chown dd/d1b/d1d/f5b 28 1 2024-09-13T02:50:33.509 INFO:tasks.workunit.client.0.smithi100.stdout:1/656: rmdir de/d14/d39 39 2024-09-13T02:50:33.509 INFO:tasks.workunit.client.0.smithi100.stdout:1/657: chown de/d14/d44/ca1 11654 1 2024-09-13T02:50:33.510 INFO:tasks.workunit.client.0.smithi100.stdout:1/658: mkdir de/d14/d86/dd0 0 2024-09-13T02:50:33.511 INFO:tasks.workunit.client.0.smithi100.stdout:1/659: mkdir de/d14/d86/dd1 0 2024-09-13T02:50:33.512 INFO:tasks.workunit.client.0.smithi100.stdout:1/660: creat de/d14/d22/d52/d7a/d81/fd2 x:0 0 0 2024-09-13T02:50:33.515 INFO:tasks.workunit.client.0.smithi100.stdout:0/519: dwrite d2/dd/d54/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:33.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/520: mknod d2/dd/d93/cb7 0 2024-09-13T02:50:33.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/521: readlink d2/dd/d54/d47/d34/l59 0 2024-09-13T02:50:33.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/522: write d2/dd/db0/d3b/f40 [926823,39901] 0 2024-09-13T02:50:33.521 INFO:tasks.workunit.client.0.smithi100.stdout:0/523: write d2/d9/f81 [187667,72792] 0 2024-09-13T02:50:33.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/524: link d2/dd/d54/d28/fa1 d2/dd/d54/d28/dac/fb8 0 2024-09-13T02:50:33.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/525: write d2/d9/f1b [208302,125911] 0 2024-09-13T02:50:33.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/526: fdatasync d2/d1a/f1e 0 2024-09-13T02:50:33.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/527: fdatasync d2/dd/f9e 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:3/719: dwrite d10/f3a [0,4194304] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:7/691: dwrite d3/d16/d55/faf [0,4194304] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:8/537: dwrite df/d13/d20/f7a [0,4194304] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:8/538: write df/d5d/d70/d2c/d38/f5b [808869,32573] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:8/539: chown df/d13/d21/lb4 37773902 1 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:8/540: write df/d5d/d70/d2c/fc2 [632912,25120] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:9/574: dwrite dd/d1b/d24/d74/d4e/f7c [0,4194304] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:2/566: dwrite d0/db/d3f/d6a/d7f/f83 [0,4194304] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:9/575: write dd/f12 [4558105,13770] 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:2/567: creat d0/db/d3f/fa4 x:0 0 0 2024-09-13T02:50:33.534 INFO:tasks.workunit.client.0.smithi100.stdout:2/568: dread - d0/db/d21/d57/f61 zero size 2024-09-13T02:50:33.535 INFO:tasks.workunit.client.0.smithi100.stdout:9/576: write dd/d1b/d1d/f2c [2336952,72000] 0 2024-09-13T02:50:33.535 INFO:tasks.workunit.client.0.smithi100.stdout:2/569: readlink d0/db/d3f/d6a/l72 0 2024-09-13T02:50:33.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/573: dwrite d3/d6/d9/f2e [0,4194304] 0 2024-09-13T02:50:33.539 INFO:tasks.workunit.client.0.smithi100.stdout:7/692: mknod d3/cdd 0 2024-09-13T02:50:33.540 INFO:tasks.workunit.client.0.smithi100.stdout:7/693: chown d3/d16/d55/caa 718 1 2024-09-13T02:50:33.543 INFO:tasks.workunit.client.0.smithi100.stdout:8/541: creat df/d5d/d88/dc0/fc5 x:0 0 0 2024-09-13T02:50:33.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/542: dread df/d5d/d70/f9f [0,4194304] 0 2024-09-13T02:50:33.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/543: write df/d13/d68/fab [228697,102949] 0 2024-09-13T02:50:33.546 INFO:tasks.workunit.client.0.smithi100.stdout:0/528: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:33.548 INFO:tasks.workunit.client.0.smithi100.stdout:9/577: symlink dd/d1b/d24/d74/lc3 0 2024-09-13T02:50:33.549 INFO:tasks.workunit.client.0.smithi100.stdout:5/609: sync 2024-09-13T02:50:33.550 INFO:tasks.workunit.client.0.smithi100.stdout:4/574: mknod d3/dc/d4b/d8a/cc4 0 2024-09-13T02:50:33.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/694: mkdir d3/d16/d55/d92/da9/dde 0 2024-09-13T02:50:33.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/695: fsync d3/d16/d55/d56/fc4 0 2024-09-13T02:50:33.552 INFO:tasks.workunit.client.0.smithi100.stdout:7/696: write d3/f15 [3793415,41210] 0 2024-09-13T02:50:33.553 INFO:tasks.workunit.client.0.smithi100.stdout:7/697: write d3/fa [2604713,21193] 0 2024-09-13T02:50:33.553 INFO:tasks.workunit.client.0.smithi100.stdout:8/544: link df/d13/d20/f4e df/d5d/d70/d2c/d38/d9e/dad/fc6 0 2024-09-13T02:50:33.554 INFO:tasks.workunit.client.0.smithi100.stdout:0/529: getdents d2/dd/d54/d47/d34/d91 0 2024-09-13T02:50:33.555 INFO:tasks.workunit.client.0.smithi100.stdout:0/530: chown d2/dd/d93/la8 11 1 2024-09-13T02:50:33.555 INFO:tasks.workunit.client.0.smithi100.stdout:0/531: truncate d2/dd/db0/d3b/f40 1610648 0 2024-09-13T02:50:33.555 INFO:tasks.workunit.client.0.smithi100.stdout:9/578: mkdir dd/d1b/d24/d74/d4e/dc4 0 2024-09-13T02:50:33.556 INFO:tasks.workunit.client.0.smithi100.stdout:5/610: creat db/de/d3e/dc3/fd2 x:0 0 0 2024-09-13T02:50:33.558 INFO:tasks.workunit.client.0.smithi100.stdout:2/570: rename d0/db/d23/d8d to d0/db/d68/d6b/da5 0 2024-09-13T02:50:33.559 INFO:tasks.workunit.client.0.smithi100.stdout:0/532: unlink d2/d1a/l55 0 2024-09-13T02:50:33.561 INFO:tasks.workunit.client.0.smithi100.stdout:7/698: fdatasync d3/d5/f1e 0 2024-09-13T02:50:33.561 INFO:tasks.workunit.client.0.smithi100.stdout:3/720: dwrite d10/f31 [4194304,4194304] 0 2024-09-13T02:50:33.562 INFO:tasks.workunit.client.0.smithi100.stdout:2/571: unlink d0/f1f 0 2024-09-13T02:50:33.562 INFO:tasks.workunit.client.0.smithi100.stdout:2/572: chown d0/db/d23/c28 21 1 2024-09-13T02:50:33.563 INFO:tasks.workunit.client.0.smithi100.stdout:8/545: read df/d5d/d88/f90 [668372,83536] 0 2024-09-13T02:50:33.563 INFO:tasks.workunit.client.0.smithi100.stdout:1/661: dwrite de/d14/d44/f5d [0,4194304] 0 2024-09-13T02:50:33.563 INFO:tasks.workunit.client.0.smithi100.stdout:4/575: rename d3/dc/d88/l98 to d3/d3a/lc5 0 2024-09-13T02:50:33.564 INFO:tasks.workunit.client.0.smithi100.stdout:2/573: write d0/db/d23/f3a [350748,50025] 0 2024-09-13T02:50:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:1/662: dread de/d14/d44/d61/f91 [0,4194304] 0 2024-09-13T02:50:33.566 INFO:tasks.workunit.client.0.smithi100.stdout:3/721: symlink d10/d21/d51/d5a/d5e/d99/dc7/lf5 0 2024-09-13T02:50:33.567 INFO:tasks.workunit.client.0.smithi100.stdout:0/533: write d2/dd/d54/d28/f6a [1412350,73870] 0 2024-09-13T02:50:33.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/699: dread d3/d16/d55/d56/d9e/d9f/fd1 [0,4194304] 0 2024-09-13T02:50:33.570 INFO:tasks.workunit.client.0.smithi100.stdout:7/700: chown d3/d16/d3b/da5/c77 340179076 1 2024-09-13T02:50:33.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/546: mkdir df/d13/d21/d81/db0/da3/dc7 0 2024-09-13T02:50:33.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/574: write d0/db/d21/d88/f43 [346307,99328] 0 2024-09-13T02:50:33.574 INFO:tasks.workunit.client.0.smithi100.stdout:9/579: rename dd/d1b/d1d/l79 to dd/d1b/d27/lc5 0 2024-09-13T02:50:33.574 INFO:tasks.workunit.client.0.smithi100.stdout:1/663: unlink de/d14/d39/f8a 0 2024-09-13T02:50:33.576 INFO:tasks.workunit.client.0.smithi100.stdout:7/701: mknod d3/d16/d55/d56/d9e/d9f/cdf 0 2024-09-13T02:50:33.577 INFO:tasks.workunit.client.0.smithi100.stdout:7/702: truncate d3/d16/d55/faf 3297442 0 2024-09-13T02:50:33.579 INFO:tasks.workunit.client.0.smithi100.stdout:4/576: dread f0 [4194304,4194304] 0 2024-09-13T02:50:33.579 INFO:tasks.workunit.client.0.smithi100.stdout:7/703: unlink d3/d16/d55/d56/dbc/lcc 0 2024-09-13T02:50:33.582 INFO:tasks.workunit.client.0.smithi100.stdout:4/577: unlink d3/d6/d2f/f33 0 2024-09-13T02:50:33.584 INFO:tasks.workunit.client.0.smithi100.stdout:7/704: creat d3/d5/fe0 x:0 0 0 2024-09-13T02:50:33.585 INFO:tasks.workunit.client.0.smithi100.stdout:7/705: dread - d3/d16/d55/d92/da2/fb7 zero size 2024-09-13T02:50:33.588 INFO:tasks.workunit.client.0.smithi100.stdout:0/534: dread d2/d1a/f1e [0,4194304] 0 2024-09-13T02:50:33.588 INFO:tasks.workunit.client.0.smithi100.stdout:0/535: chown d2/d9/d6d/d85 51624 1 2024-09-13T02:50:33.588 INFO:tasks.workunit.client.0.smithi100.stdout:5/611: dwrite db/f57 [0,4194304] 0 2024-09-13T02:50:33.590 INFO:tasks.workunit.client.0.smithi100.stdout:2/575: write d0/db/d68/d6b/d71/d73/f7e [1441457,123667] 0 2024-09-13T02:50:33.591 INFO:tasks.workunit.client.0.smithi100.stdout:2/576: chown d0/db/d21/d88/l7b 421323 1 2024-09-13T02:50:33.591 INFO:tasks.workunit.client.0.smithi100.stdout:2/577: creat d0/db/d21/fa6 x:0 0 0 2024-09-13T02:50:33.595 INFO:tasks.workunit.client.0.smithi100.stdout:2/578: dread d0/db/d23/f35 [0,4194304] 0 2024-09-13T02:50:33.599 INFO:tasks.workunit.client.0.smithi100.stdout:0/536: dread d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:33.601 INFO:tasks.workunit.client.0.smithi100.stdout:1/664: rename de/d14/d39 to de/d14/d22/d29/d68/d6d/dd3 0 2024-09-13T02:50:33.601 INFO:tasks.workunit.client.0.smithi100.stdout:1/665: dread - de/d14/d22/d29/f8d zero size 2024-09-13T02:50:33.602 INFO:tasks.workunit.client.0.smithi100.stdout:1/666: read de/d14/d22/d29/d64/f5e [82295,85774] 0 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:6/601: sync 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/667: write de/d14/d44/d7f/fb3 [474334,95885] 0 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/668: readlink de/d14/d22/d29/d68/l94 0 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/669: creat de/d14/d44/d61/da9/db7/fd4 x:0 0 0 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/670: chown de/d14/d22/d52/db8/f6a 688178 1 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:1/671: chown l2 438 1 2024-09-13T02:50:33.603 INFO:tasks.workunit.client.0.smithi100.stdout:5/612: rename db/de/d3e/d7e/fb4 to db/de/d1f/d2b/fd3 0 2024-09-13T02:50:33.604 INFO:tasks.workunit.client.0.smithi100.stdout:5/613: dread - db/de/d1f/fb2 zero size 2024-09-13T02:50:33.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/602: truncate d12/d43/d4b/d4c/f87 121701 0 2024-09-13T02:50:33.606 INFO:tasks.workunit.client.0.smithi100.stdout:6/603: creat d12/d43/d4b/d4c/fb3 x:0 0 0 2024-09-13T02:50:33.606 INFO:tasks.workunit.client.0.smithi100.stdout:6/604: readlink l1 0 2024-09-13T02:50:33.614 INFO:tasks.workunit.client.0.smithi100.stdout:3/722: dwrite d10/d21/d51/d5a/d5e/da1/fcc [0,4194304] 0 2024-09-13T02:50:33.614 INFO:tasks.workunit.client.0.smithi100.stdout:3/723: chown d10/d21/d57/f5b 2076 1 2024-09-13T02:50:33.615 INFO:tasks.workunit.client.0.smithi100.stdout:0/537: write d2/dd/f10 [1310686,33410] 0 2024-09-13T02:50:33.617 INFO:tasks.workunit.client.0.smithi100.stdout:0/538: truncate d2/d9/fb 1932551 0 2024-09-13T02:50:33.617 INFO:tasks.workunit.client.0.smithi100.stdout:0/539: write d2/dd/d54/d28/f4a [1887776,111219] 0 2024-09-13T02:50:33.624 INFO:tasks.workunit.client.0.smithi100.stdout:4/578: dwrite d3/dc/d4b/f91 [0,4194304] 0 2024-09-13T02:50:33.625 INFO:tasks.workunit.client.0.smithi100.stdout:9/580: dwrite dd/d1b/d27/d51/f57 [0,4194304] 0 2024-09-13T02:50:33.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/724: write d10/d21/f86 [2457312,18262] 0 2024-09-13T02:50:33.629 INFO:tasks.workunit.client.0.smithi100.stdout:3/725: write d10/d21/d51/d5a/d5e/d89/dc0/fe0 [6457,22210] 0 2024-09-13T02:50:33.630 INFO:tasks.workunit.client.0.smithi100.stdout:3/726: write d10/d21/d51/d5a/d5e/d71/d97/ff2 [750462,85745] 0 2024-09-13T02:50:33.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/540: dread d2/dd/d54/d28/f35 [0,4194304] 0 2024-09-13T02:50:33.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/541: getdents d2/dd/d93/da2/da9 0 2024-09-13T02:50:33.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/542: fdatasync d2/d1a/f88 0 2024-09-13T02:50:33.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/543: truncate d2/dd/d54/d28/f65 2844555 0 2024-09-13T02:50:33.631 INFO:tasks.workunit.client.0.smithi100.stdout:0/544: chown d2/d1a/l2c 4 1 2024-09-13T02:50:33.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/545: mkdir d2/d1a/da5/db9 0 2024-09-13T02:50:33.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/546: getdents d2/d1a/da5/db9 0 2024-09-13T02:50:33.632 INFO:tasks.workunit.client.0.smithi100.stdout:0/547: readlink d2/d1a/d51/l76 0 2024-09-13T02:50:33.634 INFO:tasks.workunit.client.0.smithi100.stdout:4/579: write d3/dc/f6e [7369194,34257] 0 2024-09-13T02:50:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:0/548: write d2/d1a/d51/f87 [244679,73502] 0 2024-09-13T02:50:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:0/549: dread - d2/d9/f86 zero size 2024-09-13T02:50:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/706: dwrite d3/d5/f2a [0,4194304] 0 2024-09-13T02:50:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/707: fdatasync d3/d16/d55/d56/d9e/d9f/fd1 0 2024-09-13T02:50:33.635 INFO:tasks.workunit.client.0.smithi100.stdout:7/708: write d3/d5/d1b/f71 [391995,82677] 0 2024-09-13T02:50:33.636 INFO:tasks.workunit.client.0.smithi100.stdout:6/605: dwrite d12/d2e/d90/da2/f6d [0,4194304] 0 2024-09-13T02:50:33.636 INFO:tasks.workunit.client.0.smithi100.stdout:1/672: dwrite de/d14/d22/f35 [4194304,4194304] 0 2024-09-13T02:50:33.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/550: truncate d2/dd/d54/d28/dac/fb8 472982 0 2024-09-13T02:50:33.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/551: chown d2/dd/db0/d43/d4b/c99 426980763 1 2024-09-13T02:50:33.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/552: write d2/f11 [164138,86992] 0 2024-09-13T02:50:33.637 INFO:tasks.workunit.client.0.smithi100.stdout:4/580: rmdir d3/d6/d21/d46/d34 39 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:9/581: write dd/d1b/d24/f83 [1257991,110451] 0 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:9/582: fdatasync dd/d1b/f9d 0 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:9/583: readlink l7 0 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:9/584: readlink dd/d1b/d1d/d28/lc2 0 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/673: creat de/d14/d22/fd5 x:0 0 0 2024-09-13T02:50:33.639 INFO:tasks.workunit.client.0.smithi100.stdout:1/674: truncate de/d14/d22/fd5 355326 0 2024-09-13T02:50:33.640 INFO:tasks.workunit.client.0.smithi100.stdout:0/553: mknod d2/d1a/da5/db9/cba 0 2024-09-13T02:50:33.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/554: symlink d2/dd/d93/da2/lbb 0 2024-09-13T02:50:33.642 INFO:tasks.workunit.client.0.smithi100.stdout:0/555: chown d2/dd/d54/d47/l3a 2 1 2024-09-13T02:50:33.643 INFO:tasks.workunit.client.0.smithi100.stdout:0/556: mknod d2/dd/cbc 0 2024-09-13T02:50:33.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/557: stat d2/d9/cc 0 2024-09-13T02:50:33.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/558: dread d2/f56 [0,4194304] 0 2024-09-13T02:50:33.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/585: write dd/d1b/d24/d74/f47 [2756514,46214] 0 2024-09-13T02:50:33.652 INFO:tasks.workunit.client.0.smithi100.stdout:9/586: chown dd/d1b/d24/d74/lc3 3378295 1 2024-09-13T02:50:33.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/587: truncate fc 3881038 0 2024-09-13T02:50:33.655 INFO:tasks.workunit.client.0.smithi100.stdout:9/588: dread - dd/d1b/d21/fbc zero size 2024-09-13T02:50:33.656 INFO:tasks.workunit.client.0.smithi100.stdout:4/581: dwrite d3/d6/d21/d46/f47 [0,4194304] 0 2024-09-13T02:50:33.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/589: mkdir dd/d1b/d1d/d43/dc6 0 2024-09-13T02:50:33.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/590: dread - dd/d1b/d1d/d43/d4f/da5/f91 zero size 2024-09-13T02:50:33.660 INFO:tasks.workunit.client.0.smithi100.stdout:9/591: rename dd/d1b/d24/d74/d4e/f7c to dd/d1b/d27/fc7 0 2024-09-13T02:50:33.663 INFO:tasks.workunit.client.0.smithi100.stdout:9/592: creat dd/fc8 x:0 0 0 2024-09-13T02:50:33.664 INFO:tasks.workunit.client.0.smithi100.stdout:9/593: mkdir dd/d1b/da3/dc9 0 2024-09-13T02:50:33.665 INFO:tasks.workunit.client.0.smithi100.stdout:4/582: dread d3/d6/d21/d46/fa3 [0,4194304] 0 2024-09-13T02:50:33.666 INFO:tasks.workunit.client.0.smithi100.stdout:9/594: rmdir dd/d1b/d1d/d43/dc6 0 2024-09-13T02:50:33.666 INFO:tasks.workunit.client.0.smithi100.stdout:9/595: chown dd/d1b/d24/f83 4776867 1 2024-09-13T02:50:33.666 INFO:tasks.workunit.client.0.smithi100.stdout:4/583: mknod d3/d6/d2f/d7a/cc6 0 2024-09-13T02:50:33.667 INFO:tasks.workunit.client.0.smithi100.stdout:0/559: dwrite d2/dd/d54/d47/f4e [0,4194304] 0 2024-09-13T02:50:33.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/560: mkdir d2/dd/db0/d43/d97/dbd 0 2024-09-13T02:50:33.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/561: stat d2/dd/d54/d28/f6a 0 2024-09-13T02:50:33.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/562: rename d2/dd/d54/d47/d34/d3c/f8f to d2/d1a/d4c/d7f/fbe 0 2024-09-13T02:50:33.673 INFO:tasks.workunit.client.0.smithi100.stdout:0/563: truncate d2/dd/db0/f7c 5071818 0 2024-09-13T02:50:33.680 INFO:tasks.workunit.client.0.smithi100.stdout:9/596: dwrite dd/f76 [0,4194304] 0 2024-09-13T02:50:33.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/597: dread - dd/d1b/d31/f8a zero size 2024-09-13T02:50:33.681 INFO:tasks.workunit.client.0.smithi100.stdout:9/598: truncate dd/d1b/d31/f8a 242883 0 2024-09-13T02:50:33.682 INFO:tasks.workunit.client.0.smithi100.stdout:0/564: write d2/dd/f10 [4303564,33588] 0 2024-09-13T02:50:33.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/565: link d2/dd/f10 d2/dd/db0/d43/d4b/db4/fbf 0 2024-09-13T02:50:33.691 INFO:tasks.workunit.client.0.smithi100.stdout:3/727: dwrite d10/d21/d51/d5a/d5e/f78 [0,4194304] 0 2024-09-13T02:50:33.694 INFO:tasks.workunit.client.0.smithi100.stdout:3/728: creat d10/d8a/df1/ff6 x:0 0 0 2024-09-13T02:50:33.695 INFO:tasks.workunit.client.0.smithi100.stdout:0/566: write d2/dd/d54/d47/d34/f2b [3984358,86895] 0 2024-09-13T02:50:33.696 INFO:tasks.workunit.client.0.smithi100.stdout:3/729: unlink d10/d21/d51/d5a/d5e/d71/d94/fac 0 2024-09-13T02:50:33.700 INFO:tasks.workunit.client.0.smithi100.stdout:1/675: dwrite de/f11 [0,4194304] 0 2024-09-13T02:50:33.700 INFO:tasks.workunit.client.0.smithi100.stdout:9/599: dwrite dd/d1b/d24/fb2 [0,4194304] 0 2024-09-13T02:50:33.704 INFO:tasks.workunit.client.0.smithi100.stdout:3/730: chown d10/d8a/c8e 3 1 2024-09-13T02:50:33.705 INFO:tasks.workunit.client.0.smithi100.stdout:3/731: truncate d10/f38 1360891 0 2024-09-13T02:50:33.705 INFO:tasks.workunit.client.0.smithi100.stdout:1/676: rename de/d14/d44/d7f/fc0 to de/d14/d22/d52/d65/fd6 0 2024-09-13T02:50:33.707 INFO:tasks.workunit.client.0.smithi100.stdout:1/677: dread de/f45 [0,4194304] 0 2024-09-13T02:50:33.708 INFO:tasks.workunit.client.0.smithi100.stdout:1/678: stat c0 0 2024-09-13T02:50:33.708 INFO:tasks.workunit.client.0.smithi100.stdout:1/679: fsync de/d14/f83 0 2024-09-13T02:50:33.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/680: creat de/d14/d86/dd1/fd7 x:0 0 0 2024-09-13T02:50:33.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/681: dread - de/d14/d86/fb9 zero size 2024-09-13T02:50:33.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/682: chown de/d14/d2e/d48/fc7 0 1 2024-09-13T02:50:33.709 INFO:tasks.workunit.client.0.smithi100.stdout:1/683: read de/fa8 [323892,55017] 0 2024-09-13T02:50:33.714 INFO:tasks.workunit.client.0.smithi100.stdout:0/567: dwrite d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:33.715 INFO:tasks.workunit.client.0.smithi100.stdout:0/568: symlink d2/d1a/da5/lc0 0 2024-09-13T02:50:33.719 INFO:tasks.workunit.client.0.smithi100.stdout:0/569: rmdir d2/dd/d93 39 2024-09-13T02:50:33.722 INFO:tasks.workunit.client.0.smithi100.stdout:3/732: dread d10/d21/d51/d6c/fd8 [0,4194304] 0 2024-09-13T02:50:33.723 INFO:tasks.workunit.client.0.smithi100.stdout:3/733: symlink d10/d21/d51/d5a/d5e/d99/dc7/lf7 0 2024-09-13T02:50:33.723 INFO:tasks.workunit.client.0.smithi100.stdout:8/547: sync 2024-09-13T02:50:33.723 INFO:tasks.workunit.client.0.smithi100.stdout:8/548: creat df/d13/d21/d81/fc8 x:0 0 0 2024-09-13T02:50:33.724 INFO:tasks.workunit.client.0.smithi100.stdout:0/570: dread d2/dd/db0/d43/d4b/f72 [0,4194304] 0 2024-09-13T02:50:33.724 INFO:tasks.workunit.client.0.smithi100.stdout:3/734: symlink d10/d21/d51/d6c/dee/lf8 0 2024-09-13T02:50:33.724 INFO:tasks.workunit.client.0.smithi100.stdout:3/735: chown d10/d21/d51/d5a/d5e/d71/fae 467623 1 2024-09-13T02:50:33.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/549: link df/d13/d21/l73 df/d5d/d70/d41/lc9 0 2024-09-13T02:50:33.729 INFO:tasks.workunit.client.0.smithi100.stdout:1/684: dwrite de/d14/d2e/f38 [0,4194304] 0 2024-09-13T02:50:33.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/550: link ce df/d13/d20/da2/cca 0 2024-09-13T02:50:33.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/551: write f5 [1291765,58891] 0 2024-09-13T02:50:33.729 INFO:tasks.workunit.client.0.smithi100.stdout:3/736: dread d10/f33 [0,4194304] 0 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/685: mknod de/d14/d22/cd8 0 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/686: chown de/f2c 133210 1 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/687: chown de/d12/c66 153 1 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/688: readlink de/l9b 0 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/689: write de/d14/d22/d52/d65/fd6 [418869,97869] 0 2024-09-13T02:50:33.730 INFO:tasks.workunit.client.0.smithi100.stdout:1/690: write de/d14/f41 [1784298,90481] 0 2024-09-13T02:50:33.732 INFO:tasks.workunit.client.0.smithi100.stdout:8/552: unlink df/d13/d68/f6d 0 2024-09-13T02:50:33.733 INFO:tasks.workunit.client.0.smithi100.stdout:1/691: mknod de/d14/d2e/d69/cd9 0 2024-09-13T02:50:33.733 INFO:tasks.workunit.client.0.smithi100.stdout:1/692: stat de/d14/d22/fd5 0 2024-09-13T02:50:33.735 INFO:tasks.workunit.client.0.smithi100.stdout:8/553: mkdir df/d5d/dba/dcb 0 2024-09-13T02:50:33.736 INFO:tasks.workunit.client.0.smithi100.stdout:1/693: creat de/d14/d22/d29/d68/fda x:0 0 0 2024-09-13T02:50:33.737 INFO:tasks.workunit.client.0.smithi100.stdout:1/694: getdents de/d14/d22/d52/d65/dc6 0 2024-09-13T02:50:33.737 INFO:tasks.workunit.client.0.smithi100.stdout:8/554: mknod df/d85/ccc 0 2024-09-13T02:50:33.739 INFO:tasks.workunit.client.0.smithi100.stdout:1/695: mknod de/d14/d44/d61/da9/db7/cdb 0 2024-09-13T02:50:33.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/555: link df/d5d/d70/c6a df/dbb/ccd 0 2024-09-13T02:50:33.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/556: chown df/l10 75860689 1 2024-09-13T02:50:33.740 INFO:tasks.workunit.client.0.smithi100.stdout:8/557: chown df/d13/c28 9572 1 2024-09-13T02:50:33.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/558: dread fb [0,4194304] 0 2024-09-13T02:50:33.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/559: truncate df/d5d/d88/dc0/fc5 280682 0 2024-09-13T02:50:33.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/560: symlink df/d13/d21/d81/d93/lce 0 2024-09-13T02:50:33.747 INFO:tasks.workunit.client.0.smithi100.stdout:8/561: symlink df/d5d/d88/dc0/lcf 0 2024-09-13T02:50:33.747 INFO:tasks.workunit.client.0.smithi100.stdout:3/737: dwrite d10/d21/d51/f59 [0,4194304] 0 2024-09-13T02:50:33.747 INFO:tasks.workunit.client.0.smithi100.stdout:3/738: chown d10/d21/d51/d5a/d5e/d71/d97/db1 482138 1 2024-09-13T02:50:33.748 INFO:tasks.workunit.client.0.smithi100.stdout:8/562: link df/d5d/d70/c8c df/d13/d20/d98/cd0 0 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/563: chown df/d5d/d70/d41 3415 1 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/564: fsync df/d5d/d70/d2c/d38/f71 0 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:1/696: write de/d12/f2a [494206,3105] 0 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:0/571: dwrite d2/dd/db0/d43/d4b/db4/fbf [0,4194304] 0 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:0/572: write d2/dd/db0/d3b/f67 [290483,12816] 0 2024-09-13T02:50:33.749 INFO:tasks.workunit.client.0.smithi100.stdout:0/573: chown d2/dd/d54/d3e/d5d/l73 1380535 1 2024-09-13T02:50:33.750 INFO:tasks.workunit.client.0.smithi100.stdout:1/697: mkdir de/d14/d2e/ddc 0 2024-09-13T02:50:33.753 INFO:tasks.workunit.client.0.smithi100.stdout:1/698: creat de/d14/d22/d29/d68/d6d/dd3/fdd x:0 0 0 2024-09-13T02:50:33.754 INFO:tasks.workunit.client.0.smithi100.stdout:1/699: write de/d14/d22/d52/f55 [1648361,54736] 0 2024-09-13T02:50:33.754 INFO:tasks.workunit.client.0.smithi100.stdout:3/739: dread d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 [0,4194304] 0 2024-09-13T02:50:33.754 INFO:tasks.workunit.client.0.smithi100.stdout:1/700: symlink de/d14/d22/d52/d65/lde 0 2024-09-13T02:50:33.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/701: creat de/d14/d44/d7f/dc2/fdf x:0 0 0 2024-09-13T02:50:33.756 INFO:tasks.workunit.client.0.smithi100.stdout:1/702: truncate de/d14/d2e/d75/f9f 2176207 0 2024-09-13T02:50:33.759 INFO:tasks.workunit.client.0.smithi100.stdout:3/740: write d10/d21/f60 [947519,53242] 0 2024-09-13T02:50:33.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/574: write d2/d1a/f4f [997817,65001] 0 2024-09-13T02:50:33.760 INFO:tasks.workunit.client.0.smithi100.stdout:3/741: mknod d10/d21/d51/d5a/d5e/d71/cf9 0 2024-09-13T02:50:33.762 INFO:tasks.workunit.client.0.smithi100.stdout:0/575: creat d2/dd/fc1 x:0 0 0 2024-09-13T02:50:33.763 INFO:tasks.workunit.client.0.smithi100.stdout:3/742: dread d10/f40 [0,4194304] 0 2024-09-13T02:50:33.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/576: unlink d2/dd/d54/d28/f4a 0 2024-09-13T02:50:33.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/577: readlink d2/dd/d93/da2/lbb 0 2024-09-13T02:50:33.763 INFO:tasks.workunit.client.0.smithi100.stdout:0/578: fdatasync d2/dd/d54/d3e/d5d/f6b 0 2024-09-13T02:50:33.764 INFO:tasks.workunit.client.0.smithi100.stdout:0/579: creat d2/dd/db0/fc2 x:0 0 0 2024-09-13T02:50:33.764 INFO:tasks.workunit.client.0.smithi100.stdout:0/580: getdents d2/dd/d54/d28/dac 0 2024-09-13T02:50:33.765 INFO:tasks.workunit.client.0.smithi100.stdout:0/581: dread d2/dd/d54/d28/fa1 [0,4194304] 0 2024-09-13T02:50:33.767 INFO:tasks.workunit.client.0.smithi100.stdout:8/565: dwrite df/d6f/f92 [0,4194304] 0 2024-09-13T02:50:33.768 INFO:tasks.workunit.client.0.smithi100.stdout:8/566: chown df/d13/d21/d81 0 1 2024-09-13T02:50:33.768 INFO:tasks.workunit.client.0.smithi100.stdout:8/567: write df/d13/d20/f4e [878701,79533] 0 2024-09-13T02:50:33.768 INFO:tasks.workunit.client.0.smithi100.stdout:1/703: dread de/d14/d22/d52/db8/f84 [0,4194304] 0 2024-09-13T02:50:33.770 INFO:tasks.workunit.client.0.smithi100.stdout:8/568: truncate df/d13/d21/f29 894001 0 2024-09-13T02:50:33.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/569: readlink df/d5d/d70/d2c/lb3 0 2024-09-13T02:50:33.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/570: chown df/d13/d20/f9a 15169 1 2024-09-13T02:50:33.771 INFO:tasks.workunit.client.0.smithi100.stdout:8/571: creat df/d13/d20/da2/fd1 x:0 0 0 2024-09-13T02:50:33.771 INFO:tasks.workunit.client.0.smithi100.stdout:3/743: read d10/d21/d51/d5a/d5e/d90/fa0 [792844,50329] 0 2024-09-13T02:50:33.772 INFO:tasks.workunit.client.0.smithi100.stdout:1/704: unlink de/d14/d22/d29/d68/c6e 0 2024-09-13T02:50:33.774 INFO:tasks.workunit.client.0.smithi100.stdout:3/744: mkdir d10/d21/d51/d5a/d5e/d99/dc7/dfa 0 2024-09-13T02:50:33.776 INFO:tasks.workunit.client.0.smithi100.stdout:1/705: getdents de/d14/d22 0 2024-09-13T02:50:33.781 INFO:tasks.workunit.client.0.smithi100.stdout:2/579: sync 2024-09-13T02:50:33.782 INFO:tasks.workunit.client.0.smithi100.stdout:0/582: read d2/dd/d54/d47/d34/d3c/f71 [1256560,42014] 0 2024-09-13T02:50:33.782 INFO:tasks.workunit.client.0.smithi100.stdout:0/583: fsync d2/dd/d54/d28/dac/fb8 0 2024-09-13T02:50:33.782 INFO:tasks.workunit.client.0.smithi100.stdout:2/580: creat d0/db/d68/d6b/d71/fa7 x:0 0 0 2024-09-13T02:50:33.784 INFO:tasks.workunit.client.0.smithi100.stdout:2/581: dread d0/db/d21/f54 [0,4194304] 0 2024-09-13T02:50:33.785 INFO:tasks.workunit.client.0.smithi100.stdout:0/584: rename d2/dd/d54/l2e to d2/d1a/lc3 0 2024-09-13T02:50:33.786 INFO:tasks.workunit.client.0.smithi100.stdout:0/585: stat d2/f5 0 2024-09-13T02:50:33.801 INFO:tasks.workunit.client.0.smithi100.stdout:0/586: write d2/d1a/f1e [1724243,104818] 0 2024-09-13T02:50:33.819 INFO:tasks.workunit.client.0.smithi100.stdout:3/745: dwrite d10/d21/d51/d5a/d5e/d71/d97/ff2 [0,4194304] 0 2024-09-13T02:50:33.819 INFO:tasks.workunit.client.0.smithi100.stdout:3/746: readlink d10/d21/d51/d5a/d5e/d71/d93/lbd 0 2024-09-13T02:50:33.820 INFO:tasks.workunit.client.0.smithi100.stdout:8/572: dwrite df/d5d/d70/d2c/d38/d9e/dad/fc6 [0,4194304] 0 2024-09-13T02:50:33.820 INFO:tasks.workunit.client.0.smithi100.stdout:2/582: dwrite d0/db/d21/f94 [0,4194304] 0 2024-09-13T02:50:33.820 INFO:tasks.workunit.client.0.smithi100.stdout:1/706: dwrite de/fa8 [0,4194304] 0 2024-09-13T02:50:33.820 INFO:tasks.workunit.client.0.smithi100.stdout:1/707: stat de/f3a 0 2024-09-13T02:50:33.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/587: fdatasync d2/d1a/f4f 0 2024-09-13T02:50:33.824 INFO:tasks.workunit.client.0.smithi100.stdout:8/573: unlink df/d13/d21/f29 0 2024-09-13T02:50:33.825 INFO:tasks.workunit.client.0.smithi100.stdout:9/600: sync 2024-09-13T02:50:33.825 INFO:tasks.workunit.client.0.smithi100.stdout:5/614: sync 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:7/709: sync 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/584: sync 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/585: dread - d3/dc/d4b/f86 zero size 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:9/601: creat dd/d1b/d21/d86/fca x:0 0 0 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:6/606: sync 2024-09-13T02:50:33.826 INFO:tasks.workunit.client.0.smithi100.stdout:6/607: fsync d12/d14/f75 0 2024-09-13T02:50:33.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/583: getdents d0/db/d21/d69 0 2024-09-13T02:50:33.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/584: stat d0/d36/f75 0 2024-09-13T02:50:33.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/585: fdatasync d0/d36/f8e 0 2024-09-13T02:50:33.829 INFO:tasks.workunit.client.0.smithi100.stdout:1/708: mkdir de/d14/d22/d52/d7a/d81/de0 0 2024-09-13T02:50:33.829 INFO:tasks.workunit.client.0.smithi100.stdout:0/588: stat d2/d1a/c3f 0 2024-09-13T02:50:33.830 INFO:tasks.workunit.client.0.smithi100.stdout:0/589: write d2/dd/d54/d47/f77 [360642,58815] 0 2024-09-13T02:50:33.831 INFO:tasks.workunit.client.0.smithi100.stdout:7/710: truncate d3/d2d/f4d 912803 0 2024-09-13T02:50:33.831 INFO:tasks.workunit.client.0.smithi100.stdout:7/711: chown d3/d5/f17 10948728 1 2024-09-13T02:50:33.831 INFO:tasks.workunit.client.0.smithi100.stdout:7/712: write d3/d16/d55/f6e [3432611,123762] 0 2024-09-13T02:50:33.835 INFO:tasks.workunit.client.0.smithi100.stdout:6/608: mknod d12/d14/d1c/d6e/d71/cb4 0 2024-09-13T02:50:33.835 INFO:tasks.workunit.client.0.smithi100.stdout:6/609: write d12/d14/d1c/d6e/f8b [656964,9718] 0 2024-09-13T02:50:33.837 INFO:tasks.workunit.client.0.smithi100.stdout:6/610: dread d12/d14/d1c/f77 [0,4194304] 0 2024-09-13T02:50:33.848 INFO:tasks.workunit.client.0.smithi100.stdout:9/602: dread dd/d1b/d1d/d43/d5d/f72 [0,4194304] 0 2024-09-13T02:50:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:9/603: readlink dd/l11 0 2024-09-13T02:50:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:9/604: dread dd/d1b/d21/f62 [0,4194304] 0 2024-09-13T02:50:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:9/605: chown dd/d1b/d21/d86/c71 1355077 1 2024-09-13T02:50:33.849 INFO:tasks.workunit.client.0.smithi100.stdout:9/606: chown dd/d1b/d1d/d43/d5d 1405 1 2024-09-13T02:50:33.850 INFO:tasks.workunit.client.0.smithi100.stdout:2/586: dread d0/f15 [0,4194304] 0 2024-09-13T02:50:33.851 INFO:tasks.workunit.client.0.smithi100.stdout:2/587: chown d0/db/d21/d57/l70 9472 1 2024-09-13T02:50:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/607: link dd/d1b/d1d/d43/d5e/l6f dd/lcb 0 2024-09-13T02:50:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:9/608: readlink dd/l11 0 2024-09-13T02:50:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:2/588: truncate d0/db/d23/f35 2217903 0 2024-09-13T02:50:33.852 INFO:tasks.workunit.client.0.smithi100.stdout:2/589: write d0/fa1 [196807,121087] 0 2024-09-13T02:50:33.853 INFO:tasks.workunit.client.0.smithi100.stdout:2/590: chown d0/db/d21/fa6 121493011 1 2024-09-13T02:50:33.854 INFO:tasks.workunit.client.0.smithi100.stdout:9/609: rename l7 to dd/d1b/da3/lcc 0 2024-09-13T02:50:33.868 INFO:tasks.workunit.client.0.smithi100.stdout:3/747: dwrite d10/d21/d51/d6c/f76 [0,4194304] 0 2024-09-13T02:50:33.868 INFO:tasks.workunit.client.0.smithi100.stdout:3/748: write d10/d8a/df1/ff6 [999224,88995] 0 2024-09-13T02:50:33.868 INFO:tasks.workunit.client.0.smithi100.stdout:3/749: fdatasync d10/d21/d51/d5a/d5e/d89/dc0/fe0 0 2024-09-13T02:50:33.869 INFO:tasks.workunit.client.0.smithi100.stdout:4/586: dwrite d3/d63/f6a [0,4194304] 0 2024-09-13T02:50:33.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/587: chown d3/dc/d4b/d8a/cc4 11134392 1 2024-09-13T02:50:33.870 INFO:tasks.workunit.client.0.smithi100.stdout:3/750: mknod d10/d21/d51/d5a/d5e/cfb 0 2024-09-13T02:50:33.870 INFO:tasks.workunit.client.0.smithi100.stdout:9/610: dread dd/d1b/d27/f53 [0,4194304] 0 2024-09-13T02:50:33.870 INFO:tasks.workunit.client.0.smithi100.stdout:9/611: chown dd/d1b/d24/d74/d4e/d58/lbb 0 1 2024-09-13T02:50:33.871 INFO:tasks.workunit.client.0.smithi100.stdout:9/612: creat dd/d1b/d1d/d43/d5d/fcd x:0 0 0 2024-09-13T02:50:33.881 INFO:tasks.workunit.client.0.smithi100.stdout:5/615: dwrite db/de/d1f/f87 [0,4194304] 0 2024-09-13T02:50:33.885 INFO:tasks.workunit.client.0.smithi100.stdout:5/616: mknod db/de/cd4 0 2024-09-13T02:50:33.886 INFO:tasks.workunit.client.0.smithi100.stdout:1/709: dwrite f1 [4194304,4194304] 0 2024-09-13T02:50:33.886 INFO:tasks.workunit.client.0.smithi100.stdout:0/590: dwrite d2/d1a/d4c/f63 [0,4194304] 0 2024-09-13T02:50:33.887 INFO:tasks.workunit.client.0.smithi100.stdout:7/713: dwrite d3/d16/d55/d56/f5b [0,4194304] 0 2024-09-13T02:50:33.887 INFO:tasks.workunit.client.0.smithi100.stdout:6/611: dwrite d12/d14/d1c/f44 [0,4194304] 0 2024-09-13T02:50:33.888 INFO:tasks.workunit.client.0.smithi100.stdout:1/710: mknod de/d14/d44/d7f/dc2/ce1 0 2024-09-13T02:50:33.889 INFO:tasks.workunit.client.0.smithi100.stdout:0/591: symlink d2/dd/d54/d68/dae/lc4 0 2024-09-13T02:50:33.889 INFO:tasks.workunit.client.0.smithi100.stdout:0/592: dread - d2/dd/db0/fc2 zero size 2024-09-13T02:50:33.890 INFO:tasks.workunit.client.0.smithi100.stdout:0/593: stat d2/dd/d54/d3e/d5d/l5e 0 2024-09-13T02:50:33.890 INFO:tasks.workunit.client.0.smithi100.stdout:4/588: dread d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:33.890 INFO:tasks.workunit.client.0.smithi100.stdout:4/589: creat d3/d6/d2f/d7a/fc7 x:0 0 0 2024-09-13T02:50:33.894 INFO:tasks.workunit.client.0.smithi100.stdout:7/714: mknod d3/d16/d55/d56/ce1 0 2024-09-13T02:50:33.894 INFO:tasks.workunit.client.0.smithi100.stdout:7/715: stat d3/d5/c91 0 2024-09-13T02:50:33.894 INFO:tasks.workunit.client.0.smithi100.stdout:7/716: write d3/d5/d4f/f90 [4463666,120841] 0 2024-09-13T02:50:33.894 INFO:tasks.workunit.client.0.smithi100.stdout:5/617: read db/de/d3e/f51 [365838,96027] 0 2024-09-13T02:50:33.895 INFO:tasks.workunit.client.0.smithi100.stdout:6/612: rename d12/d14/d21/faa to d12/d14/d9d/fb5 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:9/613: dwrite dd/d1b/d1d/d43/d5d/f9c [0,4194304] 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:3/751: dwrite d10/d21/d51/d5a/d5e/f81 [0,4194304] 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:3/752: fsync d10/d21/f2d 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:3/753: creat d10/d21/d51/d6c/ffc x:0 0 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:1/711: creat de/d14/d22/d52/d65/dc6/fe2 x:0 0 0 2024-09-13T02:50:33.898 INFO:tasks.workunit.client.0.smithi100.stdout:1/712: creat de/d14/d2e/d48/fe3 x:0 0 0 2024-09-13T02:50:33.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/594: link d2/dd/d54/d28/f35 d2/dd/d54/d28/dac/fc5 0 2024-09-13T02:50:33.899 INFO:tasks.workunit.client.0.smithi100.stdout:0/595: dread - d2/dd/db0/d43/d4b/db4/fb6 zero size 2024-09-13T02:50:33.901 INFO:tasks.workunit.client.0.smithi100.stdout:5/618: symlink db/de/d1f/d2b/ld5 0 2024-09-13T02:50:33.905 INFO:tasks.workunit.client.0.smithi100.stdout:9/614: rename dd/d1b/d24/fa0 to dd/d1b/d24/d74/fce 0 2024-09-13T02:50:33.908 INFO:tasks.workunit.client.0.smithi100.stdout:6/613: dread f7 [0,4194304] 0 2024-09-13T02:50:33.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/596: creat d2/dd/d54/d68/fc6 x:0 0 0 2024-09-13T02:50:33.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/597: creat d2/dd/d54/d28/fc7 x:0 0 0 2024-09-13T02:50:33.911 INFO:tasks.workunit.client.0.smithi100.stdout:5/619: mknod db/de/d3e/d7e/d81/d85/cd6 0 2024-09-13T02:50:33.913 INFO:tasks.workunit.client.0.smithi100.stdout:1/713: rename de/d14/d22/d29/d64/f8c to de/d14/d2e/d60/fe4 0 2024-09-13T02:50:33.913 INFO:tasks.workunit.client.0.smithi100.stdout:3/754: getdents d10/d21/d51/d5a/d5e/d71 0 2024-09-13T02:50:33.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/590: dwrite d3/d6/d2f/d60/fbc [0,4194304] 0 2024-09-13T02:50:33.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/591: read - d3/d6/d2f/d7a/fc7 zero size 2024-09-13T02:50:33.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/592: write d3/fb [4614116,47131] 0 2024-09-13T02:50:33.914 INFO:tasks.workunit.client.0.smithi100.stdout:7/717: dwrite d3/d5/fd5 [4194304,4194304] 0 2024-09-13T02:50:33.915 INFO:tasks.workunit.client.0.smithi100.stdout:3/755: dread d10/d21/d51/d5a/d5e/d89/dc0/fe0 [0,4194304] 0 2024-09-13T02:50:33.915 INFO:tasks.workunit.client.0.smithi100.stdout:3/756: chown d10/d21/d51/ceb 201 1 2024-09-13T02:50:33.916 INFO:tasks.workunit.client.0.smithi100.stdout:0/598: unlink d2/la6 0 2024-09-13T02:50:33.916 INFO:tasks.workunit.client.0.smithi100.stdout:0/599: fsync d2/dd/d54/d28/dac/fb8 0 2024-09-13T02:50:33.916 INFO:tasks.workunit.client.0.smithi100.stdout:5/620: getdents db/de/d3e/d71 0 2024-09-13T02:50:33.916 INFO:tasks.workunit.client.0.smithi100.stdout:5/621: stat db/de/d3e/d71 0 2024-09-13T02:50:33.917 INFO:tasks.workunit.client.0.smithi100.stdout:3/757: write d10/d21/d51/d5a/d5e/d71/d94/fb0 [802206,31892] 0 2024-09-13T02:50:33.919 INFO:tasks.workunit.client.0.smithi100.stdout:9/615: rename dd/d1b/d24/d74/f47 to dd/d1b/d21/fcf 0 2024-09-13T02:50:33.919 INFO:tasks.workunit.client.0.smithi100.stdout:9/616: dread - dd/d1b/d1d/d43/d5d/f9e zero size 2024-09-13T02:50:33.919 INFO:tasks.workunit.client.0.smithi100.stdout:9/617: write dd/d1b/d1d/f3b [851712,123639] 0 2024-09-13T02:50:33.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/714: write de/d14/d2e/d48/fc7 [5915078,127336] 0 2024-09-13T02:50:33.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/715: chown de/d14/d2e/f4e 10 1 2024-09-13T02:50:33.921 INFO:tasks.workunit.client.0.smithi100.stdout:1/716: creat de/d14/d22/d52/fe5 x:0 0 0 2024-09-13T02:50:33.924 INFO:tasks.workunit.client.0.smithi100.stdout:4/593: mknod d3/dc/d4b/d8a/cc8 0 2024-09-13T02:50:33.928 INFO:tasks.workunit.client.0.smithi100.stdout:0/600: rmdir d2/dd/d93/da2 39 2024-09-13T02:50:33.929 INFO:tasks.workunit.client.0.smithi100.stdout:5/622: creat db/de/d3e/d7e/d81/d85/fd7 x:0 0 0 2024-09-13T02:50:33.930 INFO:tasks.workunit.client.0.smithi100.stdout:3/758: creat d10/ded/ffd x:0 0 0 2024-09-13T02:50:33.936 INFO:tasks.workunit.client.0.smithi100.stdout:1/717: mknod de/d14/d22/d52/d7a/ce6 0 2024-09-13T02:50:33.936 INFO:tasks.workunit.client.0.smithi100.stdout:4/594: dread d3/dc/f6e [0,4194304] 0 2024-09-13T02:50:33.937 INFO:tasks.workunit.client.0.smithi100.stdout:0/601: creat d2/d1a/da5/fc8 x:0 0 0 2024-09-13T02:50:33.937 INFO:tasks.workunit.client.0.smithi100.stdout:0/602: creat d2/dd/d54/d28/fc9 x:0 0 0 2024-09-13T02:50:33.938 INFO:tasks.workunit.client.0.smithi100.stdout:7/718: dwrite d3/d16/d55/f9d [0,4194304] 0 2024-09-13T02:50:33.938 INFO:tasks.workunit.client.0.smithi100.stdout:5/623: mkdir db/de/d3e/d7e/dd8 0 2024-09-13T02:50:33.939 INFO:tasks.workunit.client.0.smithi100.stdout:8/574: sync 2024-09-13T02:50:33.939 INFO:tasks.workunit.client.0.smithi100.stdout:8/575: creat df/d13/d5c/fd2 x:0 0 0 2024-09-13T02:50:33.940 INFO:tasks.workunit.client.0.smithi100.stdout:3/759: mkdir d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe 0 2024-09-13T02:50:33.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/718: rename de/d14/d22/cd8 to de/d14/d2e/ddc/ce7 0 2024-09-13T02:50:33.945 INFO:tasks.workunit.client.0.smithi100.stdout:4/595: mknod d3/d6/d9/cc9 0 2024-09-13T02:50:33.947 INFO:tasks.workunit.client.0.smithi100.stdout:0/603: creat d2/dd/d54/d47/d34/fca x:0 0 0 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:9/618: dwrite dd/d1b/d27/f63 [0,4194304] 0 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:7/719: dread d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:7/720: fsync d3/f15 0 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:2/591: sync 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:2/592: fsync d0/db/d21/f25 0 2024-09-13T02:50:33.949 INFO:tasks.workunit.client.0.smithi100.stdout:2/593: readlink d0/db/d21/l31 0 2024-09-13T02:50:33.951 INFO:tasks.workunit.client.0.smithi100.stdout:5/624: rmdir db/de/d3e/d7e 39 2024-09-13T02:50:33.954 INFO:tasks.workunit.client.0.smithi100.stdout:8/576: mkdir df/dac/dd3 0 2024-09-13T02:50:33.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/604: dread d2/dd/db0/f16 [0,4194304] 0 2024-09-13T02:50:33.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/605: chown d2/dd/db0 7400 1 2024-09-13T02:50:33.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/606: write d2/d1a/d51/f87 [491325,49212] 0 2024-09-13T02:50:33.957 INFO:tasks.workunit.client.0.smithi100.stdout:9/619: truncate dd/d1b/d21/d86/f52 945957 0 2024-09-13T02:50:33.957 INFO:tasks.workunit.client.0.smithi100.stdout:9/620: write dd/d1b/d24/d74/fbf [735851,110857] 0 2024-09-13T02:50:33.958 INFO:tasks.workunit.client.0.smithi100.stdout:7/721: creat d3/d16/d3b/d8c/fe2 x:0 0 0 2024-09-13T02:50:33.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/594: link d0/db/d21/d88/c67 d0/db/d3f/d6a/d7f/ca8 0 2024-09-13T02:50:33.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/595: fsync d0/db/d3f/d6a/d7f/f83 0 2024-09-13T02:50:33.961 INFO:tasks.workunit.client.0.smithi100.stdout:5/625: mkdir db/de/d3e/d71/dd9 0 2024-09-13T02:50:33.962 INFO:tasks.workunit.client.0.smithi100.stdout:0/607: unlink d2/dd/db0/f18 0 2024-09-13T02:50:33.963 INFO:tasks.workunit.client.0.smithi100.stdout:9/621: unlink dd/d1b/d24/fb2 0 2024-09-13T02:50:33.963 INFO:tasks.workunit.client.0.smithi100.stdout:7/722: creat d3/d16/d89/fe3 x:0 0 0 2024-09-13T02:50:33.963 INFO:tasks.workunit.client.0.smithi100.stdout:7/723: dread - d3/f4c zero size 2024-09-13T02:50:33.964 INFO:tasks.workunit.client.0.smithi100.stdout:2/596: symlink d0/db/d3f/la9 0 2024-09-13T02:50:33.964 INFO:tasks.workunit.client.0.smithi100.stdout:2/597: truncate d0/db/d3f/fa4 1005794 0 2024-09-13T02:50:33.964 INFO:tasks.workunit.client.0.smithi100.stdout:9/622: symlink dd/d1b/d27/d51/ld0 0 2024-09-13T02:50:33.966 INFO:tasks.workunit.client.0.smithi100.stdout:7/724: rename d3/f3c to d3/d16/d55/d92/da9/dde/fe4 0 2024-09-13T02:50:33.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/598: creat d0/db/d21/d88/faa x:0 0 0 2024-09-13T02:50:33.967 INFO:tasks.workunit.client.0.smithi100.stdout:2/599: stat d0/db/d23/c28 0 2024-09-13T02:50:33.968 INFO:tasks.workunit.client.0.smithi100.stdout:7/725: mknod d3/d16/d55/d92/da9/ce5 0 2024-09-13T02:50:33.968 INFO:tasks.workunit.client.0.smithi100.stdout:2/600: mknod d0/db/d68/d6b/cab 0 2024-09-13T02:50:33.971 INFO:tasks.workunit.client.0.smithi100.stdout:0/608: write d2/dd/db0/f16 [156394,99895] 0 2024-09-13T02:50:33.971 INFO:tasks.workunit.client.0.smithi100.stdout:0/609: readlink d2/dd/db0/d3b/l5a 0 2024-09-13T02:50:33.971 INFO:tasks.workunit.client.0.smithi100.stdout:0/610: truncate d2/dd/db0/d3b/f67 1013045 0 2024-09-13T02:50:33.971 INFO:tasks.workunit.client.0.smithi100.stdout:0/611: truncate d2/dd/d54/d47/d34/f39 866543 0 2024-09-13T02:50:33.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/601: rename d0/db/d5b to d0/db/d3f/d6a/dac 0 2024-09-13T02:50:33.973 INFO:tasks.workunit.client.0.smithi100.stdout:9/623: dread dd/d1b/d1d/f2c [4194304,4194304] 0 2024-09-13T02:50:33.973 INFO:tasks.workunit.client.0.smithi100.stdout:9/624: stat dd/d1b/d21/d86/fca 0 2024-09-13T02:50:33.976 INFO:tasks.workunit.client.0.smithi100.stdout:9/625: rename dd/c18 to dd/d1b/da3/cd1 0 2024-09-13T02:50:33.977 INFO:tasks.workunit.client.0.smithi100.stdout:3/760: dwrite d10/d21/f86 [0,4194304] 0 2024-09-13T02:50:33.977 INFO:tasks.workunit.client.0.smithi100.stdout:3/761: write d10/f92 [4773726,1921] 0 2024-09-13T02:50:33.978 INFO:tasks.workunit.client.0.smithi100.stdout:4/596: dwrite d3/d6/d21/d46/d2d/f82 [0,4194304] 0 2024-09-13T02:50:33.978 INFO:tasks.workunit.client.0.smithi100.stdout:4/597: creat d3/d6/d2f/d7a/fca x:0 0 0 2024-09-13T02:50:33.978 INFO:tasks.workunit.client.0.smithi100.stdout:9/626: creat dd/d1b/d24/d74/d4e/dc4/fd2 x:0 0 0 2024-09-13T02:50:33.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/719: dwrite de/d14/d44/d7f/f8b [0,4194304] 0 2024-09-13T02:50:33.979 INFO:tasks.workunit.client.0.smithi100.stdout:1/720: readlink de/d14/d22/d52/lbe 0 2024-09-13T02:50:33.987 INFO:tasks.workunit.client.0.smithi100.stdout:9/627: symlink dd/d1b/d21/ld3 0 2024-09-13T02:50:33.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/612: dread d2/dd/db0/d43/d4b/f4d [0,4194304] 0 2024-09-13T02:50:33.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/613: dread - d2/d1a/d51/f7d zero size 2024-09-13T02:50:33.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/614: chown d2/c26 1171749 1 2024-09-13T02:50:33.992 INFO:tasks.workunit.client.0.smithi100.stdout:8/577: dwrite df/d13/d5c/f83 [0,4194304] 0 2024-09-13T02:50:33.992 INFO:tasks.workunit.client.0.smithi100.stdout:3/762: dread d10/f2a [0,4194304] 0 2024-09-13T02:50:33.993 INFO:tasks.workunit.client.0.smithi100.stdout:3/763: chown d10/c80 173 1 2024-09-13T02:50:33.993 INFO:tasks.workunit.client.0.smithi100.stdout:8/578: mknod df/d5d/dba/cd4 0 2024-09-13T02:50:33.995 INFO:tasks.workunit.client.0.smithi100.stdout:3/764: rmdir d10/d21/d51/d5a/d5e/d71/d94/d9c 39 2024-09-13T02:50:33.997 INFO:tasks.workunit.client.0.smithi100.stdout:3/765: truncate d10/d21/d51/d5a/d5e/d71/d94/fce 181583 0 2024-09-13T02:50:33.998 INFO:tasks.workunit.client.0.smithi100.stdout:3/766: symlink d10/d21/lff 0 2024-09-13T02:50:33.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/767: dread - d10/d8a/f9f zero size 2024-09-13T02:50:33.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/768: fdatasync d10/d21/d51/d5a/f69 0 2024-09-13T02:50:33.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/769: read d10/f54 [310176,62089] 0 2024-09-13T02:50:33.999 INFO:tasks.workunit.client.0.smithi100.stdout:3/770: rename d10/d21/d51/d6c/f76 to d10/d21/d51/d5a/d5e/d71/f100 0 2024-09-13T02:50:34.000 INFO:tasks.workunit.client.0.smithi100.stdout:3/771: truncate d10/f2b 4256926 0 2024-09-13T02:50:34.002 INFO:tasks.workunit.client.0.smithi100.stdout:4/598: dwrite d3/d6/d2f/d7a/fa1 [0,4194304] 0 2024-09-13T02:50:34.004 INFO:tasks.workunit.client.0.smithi100.stdout:5/626: dwrite db/de/d3e/d7e/d81/d85/f8b [0,4194304] 0 2024-09-13T02:50:34.004 INFO:tasks.workunit.client.0.smithi100.stdout:7/726: dwrite d3/d2d/f74 [0,4194304] 0 2024-09-13T02:50:34.005 INFO:tasks.workunit.client.0.smithi100.stdout:7/727: truncate d3/d16/fd0 5141766 0 2024-09-13T02:50:34.011 INFO:tasks.workunit.client.0.smithi100.stdout:5/627: truncate db/de/d3e/d7e/d81/f8d 3095502 0 2024-09-13T02:50:34.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/602: dwrite d0/f64 [0,4194304] 0 2024-09-13T02:50:34.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/603: creat d0/fad x:0 0 0 2024-09-13T02:50:34.020 INFO:tasks.workunit.client.0.smithi100.stdout:3/772: dread d10/f32 [0,4194304] 0 2024-09-13T02:50:34.028 INFO:tasks.workunit.client.0.smithi100.stdout:5/628: dread db/de/d3e/f7a [0,4194304] 0 2024-09-13T02:50:34.028 INFO:tasks.workunit.client.0.smithi100.stdout:5/629: write db/de/d3e/f9a [1927979,5640] 0 2024-09-13T02:50:34.033 INFO:tasks.workunit.client.0.smithi100.stdout:3/773: write d10/f31 [1303425,74042] 0 2024-09-13T02:50:34.034 INFO:tasks.workunit.client.0.smithi100.stdout:0/615: dwrite d2/dd/d54/d28/fc9 [0,4194304] 0 2024-09-13T02:50:34.034 INFO:tasks.workunit.client.0.smithi100.stdout:3/774: truncate d10/d21/d51/d5a/d5e/d71/fae 638977 0 2024-09-13T02:50:34.034 INFO:tasks.workunit.client.0.smithi100.stdout:3/775: chown d10/d21/d51/d5a/d5e/d99/fe5 0 1 2024-09-13T02:50:34.036 INFO:tasks.workunit.client.0.smithi100.stdout:8/579: dwrite df/d13/d5c/f83 [0,4194304] 0 2024-09-13T02:50:34.037 INFO:tasks.workunit.client.0.smithi100.stdout:7/728: dwrite d3/d16/d55/f5e [0,4194304] 0 2024-09-13T02:50:34.037 INFO:tasks.workunit.client.0.smithi100.stdout:0/616: mknod d2/dd/ccb 0 2024-09-13T02:50:34.037 INFO:tasks.workunit.client.0.smithi100.stdout:0/617: getdents d2/dd/db0/d43/d97/dbd 0 2024-09-13T02:50:34.038 INFO:tasks.workunit.client.0.smithi100.stdout:0/618: write d2/dd/fc1 [34778,81170] 0 2024-09-13T02:50:34.038 INFO:tasks.workunit.client.0.smithi100.stdout:0/619: fdatasync d2/dd/d54/d47/d8a/f90 0 2024-09-13T02:50:34.038 INFO:tasks.workunit.client.0.smithi100.stdout:4/599: dwrite d3/dc/d88/fba [0,4194304] 0 2024-09-13T02:50:34.039 INFO:tasks.workunit.client.0.smithi100.stdout:3/776: link d10/f44 d10/ded/f101 0 2024-09-13T02:50:34.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/580: creat df/d13/d21/d81/db0/fd5 x:0 0 0 2024-09-13T02:50:34.042 INFO:tasks.workunit.client.0.smithi100.stdout:7/729: link d3/d5/d1b/f71 d3/fe6 0 2024-09-13T02:50:34.043 INFO:tasks.workunit.client.0.smithi100.stdout:8/581: dread df/d5d/d70/f63 [4194304,4194304] 0 2024-09-13T02:50:34.046 INFO:tasks.workunit.client.0.smithi100.stdout:2/604: dread d0/db/d3f/f4e [0,4194304] 0 2024-09-13T02:50:34.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/620: mknod d2/d9/d6d/d85/ccc 0 2024-09-13T02:50:34.048 INFO:tasks.workunit.client.0.smithi100.stdout:0/621: read - d2/dd/d54/d28/f94 zero size 2024-09-13T02:50:34.049 INFO:tasks.workunit.client.0.smithi100.stdout:0/622: read d2/dd/d54/d47/f2d [2184031,77374] 0 2024-09-13T02:50:34.049 INFO:tasks.workunit.client.0.smithi100.stdout:4/600: creat d3/dc/d88/fcb x:0 0 0 2024-09-13T02:50:34.049 INFO:tasks.workunit.client.0.smithi100.stdout:4/601: creat d3/dc/d4b/d9b/fcc x:0 0 0 2024-09-13T02:50:34.051 INFO:tasks.workunit.client.0.smithi100.stdout:8/582: rename df/d13/d20/l87 to df/d5d/d88/ld6 0 2024-09-13T02:50:34.051 INFO:tasks.workunit.client.0.smithi100.stdout:8/583: fdatasync df/d5d/d70/d2c/d38/f5b 0 2024-09-13T02:50:34.053 INFO:tasks.workunit.client.0.smithi100.stdout:4/602: creat d3/dc/d88/db4/fcd x:0 0 0 2024-09-13T02:50:34.055 INFO:tasks.workunit.client.0.smithi100.stdout:2/605: rename d0/db/f26 to d0/db/d68/d6b/da5/fae 0 2024-09-13T02:50:34.056 INFO:tasks.workunit.client.0.smithi100.stdout:8/584: creat df/d6f/fd7 x:0 0 0 2024-09-13T02:50:34.058 INFO:tasks.workunit.client.0.smithi100.stdout:2/606: creat d0/db/d68/d6b/da5/d8f/faf x:0 0 0 2024-09-13T02:50:34.058 INFO:tasks.workunit.client.0.smithi100.stdout:2/607: creat d0/db/d68/d6b/d71/fb0 x:0 0 0 2024-09-13T02:50:34.059 INFO:tasks.workunit.client.0.smithi100.stdout:8/585: mknod df/d13/d21/d81/db0/da3/dc7/cd8 0 2024-09-13T02:50:34.059 INFO:tasks.workunit.client.0.smithi100.stdout:4/603: getdents d3/d63 0 2024-09-13T02:50:34.060 INFO:tasks.workunit.client.0.smithi100.stdout:4/604: stat d3/d6/d21/d46/d2d/d3f 0 2024-09-13T02:50:34.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/586: getdents df/d13 0 2024-09-13T02:50:34.063 INFO:tasks.workunit.client.0.smithi100.stdout:8/587: truncate df/d13/db5/fb7 1136873 0 2024-09-13T02:50:34.064 INFO:tasks.workunit.client.0.smithi100.stdout:4/605: unlink d3/dc/d88/fcb 0 2024-09-13T02:50:34.065 INFO:tasks.workunit.client.0.smithi100.stdout:8/588: mknod df/d5d/d70/d2c/cd9 0 2024-09-13T02:50:34.065 INFO:tasks.workunit.client.0.smithi100.stdout:8/589: chown df/d5d/fb1 9088499 1 2024-09-13T02:50:34.066 INFO:tasks.workunit.client.0.smithi100.stdout:4/606: unlink d3/l6d 0 2024-09-13T02:50:34.067 INFO:tasks.workunit.client.0.smithi100.stdout:8/590: mknod df/d85/cda 0 2024-09-13T02:50:34.068 INFO:tasks.workunit.client.0.smithi100.stdout:4/607: link d3/dc/c22 d3/dc/d4b/d8a/cce 0 2024-09-13T02:50:34.068 INFO:tasks.workunit.client.0.smithi100.stdout:4/608: symlink d3/d6/d2f/d60/lcf 0 2024-09-13T02:50:34.070 INFO:tasks.workunit.client.0.smithi100.stdout:4/609: rename d3/d6/d21/d46/d2d/d3f/c8e to d3/dc/cd0 0 2024-09-13T02:50:34.071 INFO:tasks.workunit.client.0.smithi100.stdout:6/614: sync 2024-09-13T02:50:34.071 INFO:tasks.workunit.client.0.smithi100.stdout:4/610: mkdir d3/dc/d4b/d52/dd1 0 2024-09-13T02:50:34.071 INFO:tasks.workunit.client.0.smithi100.stdout:5/630: dwrite db/f8f [0,4194304] 0 2024-09-13T02:50:34.072 INFO:tasks.workunit.client.0.smithi100.stdout:3/777: dwrite d10/d21/d51/d5a/d5e/d71/fdc [0,4194304] 0 2024-09-13T02:50:34.072 INFO:tasks.workunit.client.0.smithi100.stdout:3/778: dread - d10/d21/d51/d5a/d5e/d71/d97/fc1 zero size 2024-09-13T02:50:34.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/615: getdents d12/d14/d2f/da4 0 2024-09-13T02:50:34.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/616: readlink l1 0 2024-09-13T02:50:34.072 INFO:tasks.workunit.client.0.smithi100.stdout:6/617: dread - d12/d43/d4b/f74 zero size 2024-09-13T02:50:34.073 INFO:tasks.workunit.client.0.smithi100.stdout:7/730: dwrite d3/d16/d3b/f6a [0,4194304] 0 2024-09-13T02:50:34.074 INFO:tasks.workunit.client.0.smithi100.stdout:0/623: dwrite d2/dd/d54/d28/f35 [0,4194304] 0 2024-09-13T02:50:34.075 INFO:tasks.workunit.client.0.smithi100.stdout:3/779: mknod d10/d8a/df1/c102 0 2024-09-13T02:50:34.075 INFO:tasks.workunit.client.0.smithi100.stdout:3/780: fdatasync d10/f1b 0 2024-09-13T02:50:34.076 INFO:tasks.workunit.client.0.smithi100.stdout:0/624: write d2/dd/d54/d47/d34/d3c/f89 [799366,91613] 0 2024-09-13T02:50:34.077 INFO:tasks.workunit.client.0.smithi100.stdout:6/618: link d12/d14/d2f/d45/f51 d12/d14/d1c/d6e/d71/fb6 0 2024-09-13T02:50:34.079 INFO:tasks.workunit.client.0.smithi100.stdout:7/731: getdents d3/d16/db0/dd4 0 2024-09-13T02:50:34.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/591: write df/f1a [2478895,4456] 0 2024-09-13T02:50:34.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/592: write df/d13/d20/da2/fae [719172,77347] 0 2024-09-13T02:50:34.080 INFO:tasks.workunit.client.0.smithi100.stdout:8/593: write df/d13/db5/fb7 [1891666,77454] 0 2024-09-13T02:50:34.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/781: creat d10/dec/f103 x:0 0 0 2024-09-13T02:50:34.082 INFO:tasks.workunit.client.0.smithi100.stdout:3/782: write d10/d21/d51/d5a/d73/fad [968815,60233] 0 2024-09-13T02:50:34.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/631: write db/de/d3e/d7e/fba [2200991,64795] 0 2024-09-13T02:50:34.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/632: chown db/de/d1f/c21 0 1 2024-09-13T02:50:34.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/633: chown db/de/d3e/d7e/d81/d85/l9d 0 1 2024-09-13T02:50:34.085 INFO:tasks.workunit.client.0.smithi100.stdout:0/625: unlink d2/dd/db0/f80 0 2024-09-13T02:50:34.085 INFO:tasks.workunit.client.0.smithi100.stdout:0/626: chown d2/dd/d54/d28/dac/fb8 9643 1 2024-09-13T02:50:34.085 INFO:tasks.workunit.client.0.smithi100.stdout:0/627: fdatasync d2/dd/db0/d3b/f40 0 2024-09-13T02:50:34.086 INFO:tasks.workunit.client.0.smithi100.stdout:5/634: dread f8 [0,4194304] 0 2024-09-13T02:50:34.086 INFO:tasks.workunit.client.0.smithi100.stdout:7/732: rename d3/d16/l3a to d3/d16/d3b/da5/le7 0 2024-09-13T02:50:34.088 INFO:tasks.workunit.client.0.smithi100.stdout:2/608: getdents d0/db/d68/d6b/da5 0 2024-09-13T02:50:34.089 INFO:tasks.workunit.client.0.smithi100.stdout:8/594: dread df/d13/f37 [0,4194304] 0 2024-09-13T02:50:34.090 INFO:tasks.workunit.client.0.smithi100.stdout:3/783: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/d104 0 2024-09-13T02:50:34.092 INFO:tasks.workunit.client.0.smithi100.stdout:7/733: mknod d3/d9b/ddc/ce8 0 2024-09-13T02:50:34.093 INFO:tasks.workunit.client.0.smithi100.stdout:4/611: rmdir d3/dc/d88 39 2024-09-13T02:50:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:3/784: creat d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/f105 x:0 0 0 2024-09-13T02:50:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:3/785: fdatasync d10/d21/f56 0 2024-09-13T02:50:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:3/786: readlink d10/d21/d57/l87 0 2024-09-13T02:50:34.095 INFO:tasks.workunit.client.0.smithi100.stdout:5/635: dread db/f5c [0,4194304] 0 2024-09-13T02:50:34.096 INFO:tasks.workunit.client.0.smithi100.stdout:0/628: dread d2/dd/d54/d28/dac/fc5 [4194304,4194304] 0 2024-09-13T02:50:34.096 INFO:tasks.workunit.client.0.smithi100.stdout:4/612: mkdir d3/d6/d21/d67/dd2 0 2024-09-13T02:50:34.097 INFO:tasks.workunit.client.0.smithi100.stdout:3/787: rmdir d10/d21/d51/d6c/dee 39 2024-09-13T02:50:34.097 INFO:tasks.workunit.client.0.smithi100.stdout:3/788: truncate d10/d21/d51/d6c/dee/fe6 134468 0 2024-09-13T02:50:34.099 INFO:tasks.workunit.client.0.smithi100.stdout:5/636: mknod db/de/d3e/d7e/d81/d85/cda 0 2024-09-13T02:50:34.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/619: dwrite d12/d14/d1c/f30 [0,4194304] 0 2024-09-13T02:50:34.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/620: chown d12/d14/l99 14322784 1 2024-09-13T02:50:34.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/621: fdatasync d12/d14/d2f/d45/f51 0 2024-09-13T02:50:34.100 INFO:tasks.workunit.client.0.smithi100.stdout:6/622: dread - d12/d2e/d90/fa9 zero size 2024-09-13T02:50:34.101 INFO:tasks.workunit.client.0.smithi100.stdout:0/629: mkdir d2/d9/d6d/d85/dcd 0 2024-09-13T02:50:34.101 INFO:tasks.workunit.client.0.smithi100.stdout:0/630: fsync d2/dd/db0/d3b/f6f 0 2024-09-13T02:50:34.103 INFO:tasks.workunit.client.0.smithi100.stdout:4/613: creat d3/d63/fd3 x:0 0 0 2024-09-13T02:50:34.104 INFO:tasks.workunit.client.0.smithi100.stdout:7/734: dread d3/d16/d55/d56/f5b [0,4194304] 0 2024-09-13T02:50:34.106 INFO:tasks.workunit.client.0.smithi100.stdout:6/623: creat d12/d14/fb7 x:0 0 0 2024-09-13T02:50:34.107 INFO:tasks.workunit.client.0.smithi100.stdout:0/631: link d2/dd/d93/cb7 d2/d9/d6d/d85/dcd/cce 0 2024-09-13T02:50:34.109 INFO:tasks.workunit.client.0.smithi100.stdout:4/614: link d3/d6/d21/d46/d34/l49 d3/d6/d21/d46/ld4 0 2024-09-13T02:50:34.111 INFO:tasks.workunit.client.0.smithi100.stdout:0/632: creat d2/dd/db0/d43/d4b/fcf x:0 0 0 2024-09-13T02:50:34.114 INFO:tasks.workunit.client.0.smithi100.stdout:0/633: link d2/dd/db0/d3b/f40 d2/d1a/da5/db9/fd0 0 2024-09-13T02:50:34.114 INFO:tasks.workunit.client.0.smithi100.stdout:8/595: dwrite df/d13/d68/f8e [0,4194304] 0 2024-09-13T02:50:34.114 INFO:tasks.workunit.client.0.smithi100.stdout:2/609: dwrite d0/f4a [0,4194304] 0 2024-09-13T02:50:34.116 INFO:tasks.workunit.client.0.smithi100.stdout:0/634: symlink d2/dd/d54/d47/d8a/ld1 0 2024-09-13T02:50:34.116 INFO:tasks.workunit.client.0.smithi100.stdout:0/635: creat d2/d1a/da5/fd2 x:0 0 0 2024-09-13T02:50:34.118 INFO:tasks.workunit.client.0.smithi100.stdout:9/628: sync 2024-09-13T02:50:34.118 INFO:tasks.workunit.client.0.smithi100.stdout:1/721: sync 2024-09-13T02:50:34.118 INFO:tasks.workunit.client.0.smithi100.stdout:9/629: chown dd/d1b/d1d/d43/d5d/fcd 3028 1 2024-09-13T02:50:34.118 INFO:tasks.workunit.client.0.smithi100.stdout:5/637: dwrite db/de/d63/fbb [0,4194304] 0 2024-09-13T02:50:34.119 INFO:tasks.workunit.client.0.smithi100.stdout:1/722: read de/d12/f8f [21331,113003] 0 2024-09-13T02:50:34.120 INFO:tasks.workunit.client.0.smithi100.stdout:8/596: truncate df/d13/d21/f57 3311661 0 2024-09-13T02:50:34.122 INFO:tasks.workunit.client.0.smithi100.stdout:0/636: truncate d2/dd/d54/d47/d34/f2b 3490145 0 2024-09-13T02:50:34.122 INFO:tasks.workunit.client.0.smithi100.stdout:0/637: chown d2/dd/d93/da2/lbb 1872 1 2024-09-13T02:50:34.123 INFO:tasks.workunit.client.0.smithi100.stdout:9/630: mkdir dd/d1b/d24/d74/d4e/dc4/dd4 0 2024-09-13T02:50:34.123 INFO:tasks.workunit.client.0.smithi100.stdout:9/631: getdents dd/d1b/d1d/dad 0 2024-09-13T02:50:34.131 INFO:tasks.workunit.client.0.smithi100.stdout:2/610: dread d0/db/d68/d6b/f77 [0,4194304] 0 2024-09-13T02:50:34.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/611: chown d0/db 25671 1 2024-09-13T02:50:34.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/612: truncate d0/db/f2e 2992801 0 2024-09-13T02:50:34.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/613: creat d0/db/d79/fb1 x:0 0 0 2024-09-13T02:50:34.132 INFO:tasks.workunit.client.0.smithi100.stdout:2/614: dread - d0/db/d21/fa6 zero size 2024-09-13T02:50:34.135 INFO:tasks.workunit.client.0.smithi100.stdout:2/615: mkdir d0/db/d3f/d6a/db2 0 2024-09-13T02:50:34.135 INFO:tasks.workunit.client.0.smithi100.stdout:2/616: write d0/db/d68/d6b/d71/fa7 [1035643,10013] 0 2024-09-13T02:50:34.136 INFO:tasks.workunit.client.0.smithi100.stdout:2/617: fsync d0/d36/f9d 0 2024-09-13T02:50:34.154 INFO:tasks.workunit.client.0.smithi100.stdout:7/735: dwrite d3/fa [4194304,4194304] 0 2024-09-13T02:50:34.155 INFO:tasks.workunit.client.0.smithi100.stdout:7/736: mkdir d3/d16/d55/d56/d9e/d9f/de9 0 2024-09-13T02:50:34.156 INFO:tasks.workunit.client.0.smithi100.stdout:7/737: mknod d3/d9b/ddc/cea 0 2024-09-13T02:50:34.156 INFO:tasks.workunit.client.0.smithi100.stdout:7/738: creat d3/feb x:0 0 0 2024-09-13T02:50:34.157 INFO:tasks.workunit.client.0.smithi100.stdout:7/739: mknod d3/d16/d3b/da5/d87/cec 0 2024-09-13T02:50:34.158 INFO:tasks.workunit.client.0.smithi100.stdout:7/740: getdents d3/d5/d1b 0 2024-09-13T02:50:34.159 INFO:tasks.workunit.client.0.smithi100.stdout:7/741: rename d3/d16/d55/d56/d9e/d9f/fd1 to d3/d9b/ddc/fed 0 2024-09-13T02:50:34.159 INFO:tasks.workunit.client.0.smithi100.stdout:7/742: creat d3/d16/d55/d92/da9/fee x:0 0 0 2024-09-13T02:50:34.161 INFO:tasks.workunit.client.0.smithi100.stdout:7/743: rename d3/d2d/f4d to d3/d16/d55/d56/d9e/d9f/fef 0 2024-09-13T02:50:34.163 INFO:tasks.workunit.client.0.smithi100.stdout:6/624: dwrite d12/d14/d1c/d28/f78 [0,4194304] 0 2024-09-13T02:50:34.174 INFO:tasks.workunit.client.0.smithi100.stdout:8/597: dwrite df/d5d/f69 [0,4194304] 0 2024-09-13T02:50:34.174 INFO:tasks.workunit.client.0.smithi100.stdout:8/598: fdatasync df/f1a 0 2024-09-13T02:50:34.177 INFO:tasks.workunit.client.0.smithi100.stdout:0/638: dwrite d2/d9/d6d/d85/f9b [0,4194304] 0 2024-09-13T02:50:34.181 INFO:tasks.workunit.client.0.smithi100.stdout:0/639: dread d2/d1a/da5/db9/fd0 [0,4194304] 0 2024-09-13T02:50:34.181 INFO:tasks.workunit.client.0.smithi100.stdout:0/640: chown d2/dd/db0/fc2 799862 1 2024-09-13T02:50:34.182 INFO:tasks.workunit.client.0.smithi100.stdout:0/641: creat d2/dd/d93/da2/fd3 x:0 0 0 2024-09-13T02:50:34.182 INFO:tasks.workunit.client.0.smithi100.stdout:0/642: chown d2/d9/f81 550295595 1 2024-09-13T02:50:34.183 INFO:tasks.workunit.client.0.smithi100.stdout:0/643: getdents d2/d9/d6d/d85/dcd 0 2024-09-13T02:50:34.184 INFO:tasks.workunit.client.0.smithi100.stdout:1/723: dwrite de/d14/d22/d52/d65/dc6/fe2 [0,4194304] 0 2024-09-13T02:50:34.184 INFO:tasks.workunit.client.0.smithi100.stdout:0/644: rename d2/dd/db0/d43/c57 to d2/dd/d54/d47/d34/cd4 0 2024-09-13T02:50:34.184 INFO:tasks.workunit.client.0.smithi100.stdout:1/724: write de/d12/f33 [2120449,6839] 0 2024-09-13T02:50:34.185 INFO:tasks.workunit.client.0.smithi100.stdout:1/725: chown de/d14/d22/d52/c76 5 1 2024-09-13T02:50:34.186 INFO:tasks.workunit.client.0.smithi100.stdout:0/645: rmdir d2/dd/d54/d47/d8a/da7 0 2024-09-13T02:50:34.187 INFO:tasks.workunit.client.0.smithi100.stdout:0/646: symlink d2/dd/d54/d47/d34/da3/ld5 0 2024-09-13T02:50:34.189 INFO:tasks.workunit.client.0.smithi100.stdout:7/744: dwrite d3/d16/d55/d56/f70 [0,4194304] 0 2024-09-13T02:50:34.189 INFO:tasks.workunit.client.0.smithi100.stdout:7/745: chown d3/d16/d55/d56/dbc/cd9 3277 1 2024-09-13T02:50:34.189 INFO:tasks.workunit.client.0.smithi100.stdout:7/746: chown d3/fc 6146894 1 2024-09-13T02:50:34.189 INFO:tasks.workunit.client.0.smithi100.stdout:9/632: dwrite dd/d1b/d1d/d43/d5d/fa2 [0,4194304] 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:7/747: write d3/d16/d55/d56/d9e/d9f/fa3 [778527,94021] 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:7/748: fdatasync d3/d16/d55/d56/f85 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:2/618: dwrite d0/db/d79/f8b [0,4194304] 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:5/638: dwrite db/de/d3e/fab [0,4194304] 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:8/599: dread df/d13/d68/f8e [0,4194304] 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:8/600: chown df/d5d/dba 3 1 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/647: rename d2/dd/d54/d47/d34/d3c/l5f to d2/dd/db0/d43/d97/ld6 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/648: fdatasync d2/dd/f10 0 2024-09-13T02:50:34.190 INFO:tasks.workunit.client.0.smithi100.stdout:0/649: dread - d2/dd/d54/d3e/d5d/f6b zero size 2024-09-13T02:50:34.191 INFO:tasks.workunit.client.0.smithi100.stdout:6/625: dwrite d12/d14/d2f/f33 [0,4194304] 0 2024-09-13T02:50:34.191 INFO:tasks.workunit.client.0.smithi100.stdout:6/626: chown d12/d43/d4b/f96 129055 1 2024-09-13T02:50:34.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/633: symlink dd/d1b/d1d/d43/d4f/da5/ld5 0 2024-09-13T02:50:34.191 INFO:tasks.workunit.client.0.smithi100.stdout:9/634: write dd/d1b/d7d/f7e [879665,67866] 0 2024-09-13T02:50:34.192 INFO:tasks.workunit.client.0.smithi100.stdout:7/749: mkdir d3/d16/d55/d56/d9e/d9f/de9/df0 0 2024-09-13T02:50:34.195 INFO:tasks.workunit.client.0.smithi100.stdout:2/619: mkdir d0/db/d21/d57/d81/db3 0 2024-09-13T02:50:34.203 INFO:tasks.workunit.client.0.smithi100.stdout:5/639: mkdir db/de/d3e/da2/ddb 0 2024-09-13T02:50:34.203 INFO:tasks.workunit.client.0.smithi100.stdout:8/601: rename df/c62 to df/d13/d68/cdb 0 2024-09-13T02:50:34.204 INFO:tasks.workunit.client.0.smithi100.stdout:8/602: creat df/d13/d21/d81/db0/fdc x:0 0 0 2024-09-13T02:50:34.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/650: creat d2/dd/d54/fd7 x:0 0 0 2024-09-13T02:50:34.204 INFO:tasks.workunit.client.0.smithi100.stdout:0/651: readlink d2/dd/d93/da2/lbb 0 2024-09-13T02:50:34.205 INFO:tasks.workunit.client.0.smithi100.stdout:6/627: mkdir d12/d14/d9d/db8 0 2024-09-13T02:50:34.205 INFO:tasks.workunit.client.0.smithi100.stdout:7/750: creat d3/d5/d1b/d1c/d36/d9c/ff1 x:0 0 0 2024-09-13T02:50:34.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/620: write d0/d36/f75 [3217760,78798] 0 2024-09-13T02:50:34.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/621: dread - d0/db/d68/d6b/d85/f9b zero size 2024-09-13T02:50:34.206 INFO:tasks.workunit.client.0.smithi100.stdout:2/622: stat d0/db/d21/f25 0 2024-09-13T02:50:34.207 INFO:tasks.workunit.client.0.smithi100.stdout:8/603: mknod df/dac/cdd 0 2024-09-13T02:50:34.207 INFO:tasks.workunit.client.0.smithi100.stdout:8/604: chown df/d5d/d70/f39 233477746 1 2024-09-13T02:50:34.207 INFO:tasks.workunit.client.0.smithi100.stdout:0/652: truncate d2/dd/db0/d3b/f67 782968 0 2024-09-13T02:50:34.208 INFO:tasks.workunit.client.0.smithi100.stdout:6/628: mkdir d12/d14/d2f/d45/db9 0 2024-09-13T02:50:34.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/629: chown d12/d14/c17 19 1 2024-09-13T02:50:34.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/630: read - d12/d14/d1c/d6e/f79 zero size 2024-09-13T02:50:34.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/631: stat d12/d14/d1c/d6e/f8b 0 2024-09-13T02:50:34.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/632: truncate d12/d43/d4b/d4c/d36/f63 992161 0 2024-09-13T02:50:34.209 INFO:tasks.workunit.client.0.smithi100.stdout:6/633: truncate d12/d14/d1c/d28/f58 3016450 0 2024-09-13T02:50:34.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/726: dwrite de/f20 [4194304,4194304] 0 2024-09-13T02:50:34.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/727: truncate de/d14/d2e/d60/fe4 1111914 0 2024-09-13T02:50:34.210 INFO:tasks.workunit.client.0.smithi100.stdout:1/728: chown de/d14/d22/d29/d64/l97 34 1 2024-09-13T02:50:34.210 INFO:tasks.workunit.client.0.smithi100.stdout:7/751: unlink d3/d5/d4f/cac 0 2024-09-13T02:50:34.210 INFO:tasks.workunit.client.0.smithi100.stdout:9/635: dwrite dd/d1b/d21/fbc [0,4194304] 0 2024-09-13T02:50:34.211 INFO:tasks.workunit.client.0.smithi100.stdout:5/640: mkdir db/de/ddc 0 2024-09-13T02:50:34.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/605: creat df/d5d/dba/dcb/fde x:0 0 0 2024-09-13T02:50:34.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/606: chown df/d5d/d70/d2c/d38/d9e/dad/lc1 4707 1 2024-09-13T02:50:34.213 INFO:tasks.workunit.client.0.smithi100.stdout:8/607: dread - df/d13/d20/f9a zero size 2024-09-13T02:50:34.214 INFO:tasks.workunit.client.0.smithi100.stdout:0/653: creat d2/dd/db0/d43/fd8 x:0 0 0 2024-09-13T02:50:34.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/634: symlink d12/d14/d1c/d7b/da6/lba 0 2024-09-13T02:50:34.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/635: fdatasync d12/d14/d1c/f30 0 2024-09-13T02:50:34.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/636: chown d12/d43/d4b/d4c/l5f 10252786 1 2024-09-13T02:50:34.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/637: truncate d12/d14/d1c/d28/d88/fac 906142 0 2024-09-13T02:50:34.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/638: fdatasync d12/d14/d1c/d6e/f8b 0 2024-09-13T02:50:34.217 INFO:tasks.workunit.client.0.smithi100.stdout:2/623: write d0/f2c [3030707,30790] 0 2024-09-13T02:50:34.217 INFO:tasks.workunit.client.0.smithi100.stdout:1/729: mknod de/d14/d44/d61/da9/ce8 0 2024-09-13T02:50:34.217 INFO:tasks.workunit.client.0.smithi100.stdout:7/752: symlink d3/d16/d55/lf2 0 2024-09-13T02:50:34.221 INFO:tasks.workunit.client.0.smithi100.stdout:9/636: rename dd/d1b/d21/f62 to dd/d1b/d24/d74/d4e/dc4/fd6 0 2024-09-13T02:50:34.221 INFO:tasks.workunit.client.0.smithi100.stdout:9/637: creat dd/d1b/d27/fd7 x:0 0 0 2024-09-13T02:50:34.221 INFO:tasks.workunit.client.0.smithi100.stdout:5/641: symlink db/de/d63/ldd 0 2024-09-13T02:50:34.222 INFO:tasks.workunit.client.0.smithi100.stdout:3/789: sync 2024-09-13T02:50:34.222 INFO:tasks.workunit.client.0.smithi100.stdout:4/615: sync 2024-09-13T02:50:34.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/654: truncate d2/dd/d54/d28/fc9 2555725 0 2024-09-13T02:50:34.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/655: chown d2/dd/d54/d3e/d5d 419469 1 2024-09-13T02:50:34.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/656: truncate d2/dd/d54/d47/d34/d3c/f89 1054197 0 2024-09-13T02:50:34.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/657: dread - d2/dd/d54/d3e/d5d/f62 zero size 2024-09-13T02:50:34.225 INFO:tasks.workunit.client.0.smithi100.stdout:6/639: symlink d12/d14/d9d/lbb 0 2024-09-13T02:50:34.228 INFO:tasks.workunit.client.0.smithi100.stdout:2/624: mknod d0/db/d68/d6b/da5/cb4 0 2024-09-13T02:50:34.228 INFO:tasks.workunit.client.0.smithi100.stdout:2/625: read d0/db/d23/f35 [896060,121662] 0 2024-09-13T02:50:34.228 INFO:tasks.workunit.client.0.smithi100.stdout:2/626: dread - d0/db/d79/fb1 zero size 2024-09-13T02:50:34.228 INFO:tasks.workunit.client.0.smithi100.stdout:2/627: chown d0/db/d3f/la9 6 1 2024-09-13T02:50:34.229 INFO:tasks.workunit.client.0.smithi100.stdout:9/638: write dd/d1b/d1d/f1f [3643349,63291] 0 2024-09-13T02:50:34.229 INFO:tasks.workunit.client.0.smithi100.stdout:9/639: write dd/d1b/d7d/f7e [4718633,68540] 0 2024-09-13T02:50:34.229 INFO:tasks.workunit.client.0.smithi100.stdout:7/753: mkdir d3/d5/df3 0 2024-09-13T02:50:34.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/730: rename de/d14/d2e/f4e to de/d14/d22/d52/d65/dc6/fe9 0 2024-09-13T02:50:34.232 INFO:tasks.workunit.client.0.smithi100.stdout:5/642: rmdir db/de/d3e/da2/dac/db1 39 2024-09-13T02:50:34.235 INFO:tasks.workunit.client.0.smithi100.stdout:8/608: rmdir df/d13/d21/d81 39 2024-09-13T02:50:34.236 INFO:tasks.workunit.client.0.smithi100.stdout:9/640: dread dd/d1b/d21/fcf [0,4194304] 0 2024-09-13T02:50:34.236 INFO:tasks.workunit.client.0.smithi100.stdout:9/641: dread - dd/d1b/d1d/d43/d5d/fcd zero size 2024-09-13T02:50:34.238 INFO:tasks.workunit.client.0.smithi100.stdout:3/790: mknod d10/d21/d57/c106 0 2024-09-13T02:50:34.240 INFO:tasks.workunit.client.0.smithi100.stdout:4/616: symlink d3/dc/d4b/d52/ld5 0 2024-09-13T02:50:34.241 INFO:tasks.workunit.client.0.smithi100.stdout:6/640: mkdir d12/d2e/d90/da2/dbc 0 2024-09-13T02:50:34.242 INFO:tasks.workunit.client.0.smithi100.stdout:7/754: mknod d3/d16/d55/d56/d9e/d9f/de9/df0/cf4 0 2024-09-13T02:50:34.243 INFO:tasks.workunit.client.0.smithi100.stdout:0/658: rename d2/c26 to d2/d9/d6d/d85/cd9 0 2024-09-13T02:50:34.243 INFO:tasks.workunit.client.0.smithi100.stdout:0/659: chown d2/dd/d54/d3e/d5d/l9d 60 1 2024-09-13T02:50:34.244 INFO:tasks.workunit.client.0.smithi100.stdout:5/643: creat db/de/ddc/fde x:0 0 0 2024-09-13T02:50:34.245 INFO:tasks.workunit.client.0.smithi100.stdout:8/609: link df/d13/f44 df/d13/d20/d98/fdf 0 2024-09-13T02:50:34.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/642: getdents dd/d1b/d24/da8 0 2024-09-13T02:50:34.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/643: creat dd/d1b/d1d/d43/d5d/fd8 x:0 0 0 2024-09-13T02:50:34.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/644: chown dd/d1b/d27 1035399617 1 2024-09-13T02:50:34.246 INFO:tasks.workunit.client.0.smithi100.stdout:9/645: chown dd/d1b/d7d 9975 1 2024-09-13T02:50:34.250 INFO:tasks.workunit.client.0.smithi100.stdout:4/617: link d3/d6/d9/l16 d3/d3a/d5c/ld6 0 2024-09-13T02:50:34.251 INFO:tasks.workunit.client.0.smithi100.stdout:6/641: getdents d12/d14/d1c/d7b/da6 0 2024-09-13T02:50:34.251 INFO:tasks.workunit.client.0.smithi100.stdout:6/642: fdatasync d12/d43/d4b/d4c/d36/f63 0 2024-09-13T02:50:34.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/755: mkdir d3/d16/d3b/da5/df5 0 2024-09-13T02:50:34.252 INFO:tasks.workunit.client.0.smithi100.stdout:7/756: chown d3/d5/c7 372709392 1 2024-09-13T02:50:34.253 INFO:tasks.workunit.client.0.smithi100.stdout:0/660: creat d2/d9/d6d/d85/dcd/fda x:0 0 0 2024-09-13T02:50:34.253 INFO:tasks.workunit.client.0.smithi100.stdout:8/610: mkdir df/d13/db5/dc3/de0 0 2024-09-13T02:50:34.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/646: rename dd/d1b/d24/d74/d4e/d58/f98 to dd/d1b/d1d/d43/d4f/fd9 0 2024-09-13T02:50:34.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/618: mknod d3/d6/d2f/d7a/cd7 0 2024-09-13T02:50:34.255 INFO:tasks.workunit.client.0.smithi100.stdout:4/619: readlink d3/d6/d9/l6c 0 2024-09-13T02:50:34.256 INFO:tasks.workunit.client.0.smithi100.stdout:4/620: readlink d3/d6/d21/d46/d2d/d42/l62 0 2024-09-13T02:50:34.256 INFO:tasks.workunit.client.0.smithi100.stdout:5/644: dread db/f3c [0,4194304] 0 2024-09-13T02:50:34.256 INFO:tasks.workunit.client.0.smithi100.stdout:6/643: unlink d12/d14/d1c/f44 0 2024-09-13T02:50:34.257 INFO:tasks.workunit.client.0.smithi100.stdout:7/757: mknod d3/d16/d55/d92/da2/cf6 0 2024-09-13T02:50:34.257 INFO:tasks.workunit.client.0.smithi100.stdout:7/758: getdents d3/d5/db4 0 2024-09-13T02:50:34.257 INFO:tasks.workunit.client.0.smithi100.stdout:7/759: stat d3/d5/c8 0 2024-09-13T02:50:34.259 INFO:tasks.workunit.client.0.smithi100.stdout:1/731: dwrite de/d12/f33 [0,4194304] 0 2024-09-13T02:50:34.260 INFO:tasks.workunit.client.0.smithi100.stdout:8/611: unlink df/d13/f96 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/621: mkdir d3/d6/d21/d67/dd2/dd8 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/622: fdatasync d3/dc/d4b/d9b/fb6 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:3/791: dwrite d10/d21/d51/d5a/d5e/d99/fd1 [4194304,4194304] 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:4/623: chown d3/d63/c9a 15062 1 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:5/645: read db/de/d1f/f4b [4099718,68264] 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:5/646: truncate db/de/d3e/d7e/f91 121607 0 2024-09-13T02:50:34.261 INFO:tasks.workunit.client.0.smithi100.stdout:2/628: dwrite d0/db/f40 [0,4194304] 0 2024-09-13T02:50:34.262 INFO:tasks.workunit.client.0.smithi100.stdout:7/760: creat d3/d16/d55/d92/da9/dd3/ff7 x:0 0 0 2024-09-13T02:50:34.263 INFO:tasks.workunit.client.0.smithi100.stdout:0/661: getdents d2/dd/d54/d47/d34/d3c 0 2024-09-13T02:50:34.264 INFO:tasks.workunit.client.0.smithi100.stdout:8/612: mkdir df/d13/de1 0 2024-09-13T02:50:34.267 INFO:tasks.workunit.client.0.smithi100.stdout:6/644: write d12/d2e/d90/da2/f6d [924973,18739] 0 2024-09-13T02:50:34.268 INFO:tasks.workunit.client.0.smithi100.stdout:4/624: symlink d3/dc/d4b/d9b/db2/ld9 0 2024-09-13T02:50:34.270 INFO:tasks.workunit.client.0.smithi100.stdout:5/647: rmdir db/de/d3e/d7e 39 2024-09-13T02:50:34.273 INFO:tasks.workunit.client.0.smithi100.stdout:2/629: rename d0/l37 to d0/db/d21/d5a/lb5 0 2024-09-13T02:50:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:8/613: symlink df/d5d/dba/le2 0 2024-09-13T02:50:34.274 INFO:tasks.workunit.client.0.smithi100.stdout:8/614: chown df/d13/d20/f42 209960913 1 2024-09-13T02:50:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:6/645: creat d12/d14/d9d/db8/fbd x:0 0 0 2024-09-13T02:50:34.275 INFO:tasks.workunit.client.0.smithi100.stdout:0/662: dread d2/dd/db0/d43/d4b/db4/fbf [0,4194304] 0 2024-09-13T02:50:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:0/663: write d2/d9/d6d/d85/dcd/fda [736570,59287] 0 2024-09-13T02:50:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:5/648: link db/de/d1f/d2b/ccb db/de/d1f/d2b/cdf 0 2024-09-13T02:50:34.278 INFO:tasks.workunit.client.0.smithi100.stdout:5/649: creat db/de/d3e/dc3/fe0 x:0 0 0 2024-09-13T02:50:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:2/630: mknod d0/db/d68/cb6 0 2024-09-13T02:50:34.279 INFO:tasks.workunit.client.0.smithi100.stdout:2/631: fsync d0/db/d21/f93 0 2024-09-13T02:50:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:8/615: mkdir df/d5d/d70/d2c/de3 0 2024-09-13T02:50:34.280 INFO:tasks.workunit.client.0.smithi100.stdout:8/616: read df/d13/f14 [142700,122414] 0 2024-09-13T02:50:34.284 INFO:tasks.workunit.client.0.smithi100.stdout:6/646: symlink d12/d43/d4b/lbe 0 2024-09-13T02:50:34.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/617: dread df/d5d/d88/f90 [0,4194304] 0 2024-09-13T02:50:34.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/618: write df/d13/d20/f9a [952132,22283] 0 2024-09-13T02:50:34.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/647: dwrite dd/d1b/d1d/d43/d5d/f9e [0,4194304] 0 2024-09-13T02:50:34.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/648: creat dd/d1b/d21/d86/fda x:0 0 0 2024-09-13T02:50:34.289 INFO:tasks.workunit.client.0.smithi100.stdout:9/649: creat dd/d1b/d1d/d43/d4f/da5/fdb x:0 0 0 2024-09-13T02:50:34.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/732: dwrite de/d14/d2e/f38 [4194304,4194304] 0 2024-09-13T02:50:34.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/733: creat de/d14/d22/d29/d68/fea x:0 0 0 2024-09-13T02:50:34.290 INFO:tasks.workunit.client.0.smithi100.stdout:5/650: creat db/de/d3e/fe1 x:0 0 0 2024-09-13T02:50:34.292 INFO:tasks.workunit.client.0.smithi100.stdout:6/647: symlink d12/d14/d2f/d45/lbf 0 2024-09-13T02:50:34.292 INFO:tasks.workunit.client.0.smithi100.stdout:7/761: dwrite d3/d16/d55/d56/fc4 [8388608,4194304] 0 2024-09-13T02:50:34.292 INFO:tasks.workunit.client.0.smithi100.stdout:6/648: fdatasync d12/d14/d2f/d45/d73/f80 0 2024-09-13T02:50:34.292 INFO:tasks.workunit.client.0.smithi100.stdout:3/792: dwrite d10/d21/d51/d6c/f6d [0,4194304] 0 2024-09-13T02:50:34.293 INFO:tasks.workunit.client.0.smithi100.stdout:9/650: dread dd/d1b/d24/d74/d4e/f96 [0,4194304] 0 2024-09-13T02:50:34.293 INFO:tasks.workunit.client.0.smithi100.stdout:0/664: symlink d2/d1a/ldb 0 2024-09-13T02:50:34.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/619: stat df/d13/d21/d81/d93/ca7 0 2024-09-13T02:50:34.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/620: dread - df/f6c zero size 2024-09-13T02:50:34.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/621: write df/d13/d20/da2/fd1 [257809,60743] 0 2024-09-13T02:50:34.294 INFO:tasks.workunit.client.0.smithi100.stdout:8/622: readlink df/d5d/d70/lb6 0 2024-09-13T02:50:34.298 INFO:tasks.workunit.client.0.smithi100.stdout:4/625: dwrite d3/d6/d21/d67/f78 [0,4194304] 0 2024-09-13T02:50:34.300 INFO:tasks.workunit.client.0.smithi100.stdout:2/632: dwrite d0/f3d [0,4194304] 0 2024-09-13T02:50:34.301 INFO:tasks.workunit.client.0.smithi100.stdout:1/734: creat de/d14/d22/d52/d7a/feb x:0 0 0 2024-09-13T02:50:34.302 INFO:tasks.workunit.client.0.smithi100.stdout:5/651: mknod db/de/d3e/da2/ce2 0 2024-09-13T02:50:34.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/762: mknod d3/d2d/cf8 0 2024-09-13T02:50:34.304 INFO:tasks.workunit.client.0.smithi100.stdout:7/763: truncate d3/d5/d4f/fbb 193093 0 2024-09-13T02:50:34.304 INFO:tasks.workunit.client.0.smithi100.stdout:6/649: getdents d12/d14/d68 0 2024-09-13T02:50:34.305 INFO:tasks.workunit.client.0.smithi100.stdout:6/650: write d12/d14/d1c/d6e/d71/f97 [1113219,13691] 0 2024-09-13T02:50:34.305 INFO:tasks.workunit.client.0.smithi100.stdout:7/764: dread d3/d5/f53 [0,4194304] 0 2024-09-13T02:50:34.305 INFO:tasks.workunit.client.0.smithi100.stdout:7/765: fdatasync d3/d5/d4f/f80 0 2024-09-13T02:50:34.311 INFO:tasks.workunit.client.0.smithi100.stdout:0/665: truncate d2/d1a/f88 840846 0 2024-09-13T02:50:34.311 INFO:tasks.workunit.client.0.smithi100.stdout:0/666: write d2/dd/d93/da2/fd3 [89495,76554] 0 2024-09-13T02:50:34.311 INFO:tasks.workunit.client.0.smithi100.stdout:0/667: write d2/d9/f86 [624285,129667] 0 2024-09-13T02:50:34.311 INFO:tasks.workunit.client.0.smithi100.stdout:0/668: chown d2/dd/db0/d43 12763 1 2024-09-13T02:50:34.311 INFO:tasks.workunit.client.0.smithi100.stdout:2/633: read d0/db/d21/f25 [3320784,97607] 0 2024-09-13T02:50:34.314 INFO:tasks.workunit.client.0.smithi100.stdout:4/626: rmdir d3/d6 39 2024-09-13T02:50:34.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/651: creat d12/d2e/d90/da2/dbc/fc0 x:0 0 0 2024-09-13T02:50:34.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/652: chown d12/d43/f54 315 1 2024-09-13T02:50:34.319 INFO:tasks.workunit.client.0.smithi100.stdout:5/652: write db/f57 [2594894,98016] 0 2024-09-13T02:50:34.320 INFO:tasks.workunit.client.0.smithi100.stdout:7/766: unlink d3/d16/d3b/f6a 0 2024-09-13T02:50:34.321 INFO:tasks.workunit.client.0.smithi100.stdout:3/793: getdents d10/d21 0 2024-09-13T02:50:34.323 INFO:tasks.workunit.client.0.smithi100.stdout:9/651: getdents dd/d1b/d24 0 2024-09-13T02:50:34.323 INFO:tasks.workunit.client.0.smithi100.stdout:9/652: truncate dd/d1b/d24/d74/f65 229122 0 2024-09-13T02:50:34.324 INFO:tasks.workunit.client.0.smithi100.stdout:2/634: write d0/db/d79/f8b [741463,78460] 0 2024-09-13T02:50:34.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/669: getdents d2/dd/db0/d43/d97 0 2024-09-13T02:50:34.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/670: read - d2/dd/db0/d43/fd8 zero size 2024-09-13T02:50:34.325 INFO:tasks.workunit.client.0.smithi100.stdout:0/671: fsync d2/d1a/f4f 0 2024-09-13T02:50:34.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/623: rmdir df/d13/d20/da2 39 2024-09-13T02:50:34.326 INFO:tasks.workunit.client.0.smithi100.stdout:8/624: write df/d5d/d70/d2c/fc2 [1369808,5886] 0 2024-09-13T02:50:34.328 INFO:tasks.workunit.client.0.smithi100.stdout:6/653: unlink d12/d14/d68/la8 0 2024-09-13T02:50:34.330 INFO:tasks.workunit.client.0.smithi100.stdout:5/653: mknod db/de/d3e/da2/ddb/ce3 0 2024-09-13T02:50:34.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/767: creat d3/d16/d55/d56/dbc/ff9 x:0 0 0 2024-09-13T02:50:34.332 INFO:tasks.workunit.client.0.smithi100.stdout:7/768: write d3/d16/d55/d92/da9/dd3/ff7 [51300,42856] 0 2024-09-13T02:50:34.336 INFO:tasks.workunit.client.0.smithi100.stdout:1/735: dwrite de/d14/d44/d7f/dc2/fdf [0,4194304] 0 2024-09-13T02:50:34.338 INFO:tasks.workunit.client.0.smithi100.stdout:1/736: read de/d14/d44/d7f/f96 [499862,81408] 0 2024-09-13T02:50:34.338 INFO:tasks.workunit.client.0.smithi100.stdout:9/653: creat dd/d1b/fdc x:0 0 0 2024-09-13T02:50:34.340 INFO:tasks.workunit.client.0.smithi100.stdout:9/654: dread dd/d1b/d1d/f2c [4194304,4194304] 0 2024-09-13T02:50:34.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/672: rename d2/d1a/da5/fc8 to d2/d1a/d4c/d7f/fdc 0 2024-09-13T02:50:34.341 INFO:tasks.workunit.client.0.smithi100.stdout:0/673: chown d2/d9/fad 4098327 1 2024-09-13T02:50:34.342 INFO:tasks.workunit.client.0.smithi100.stdout:8/625: mknod df/d6f/ce4 0 2024-09-13T02:50:34.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/654: mknod d12/d14/d2f/cc1 0 2024-09-13T02:50:34.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/655: dread - d12/d14/d9d/db8/fbd zero size 2024-09-13T02:50:34.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/656: chown d12/d14/d21/l85 56640 1 2024-09-13T02:50:34.343 INFO:tasks.workunit.client.0.smithi100.stdout:6/657: fsync d12/d14/d1c/d28/f78 0 2024-09-13T02:50:34.344 INFO:tasks.workunit.client.0.smithi100.stdout:7/769: mknod d3/d16/d55/d92/da9/cfa 0 2024-09-13T02:50:34.351 INFO:tasks.workunit.client.0.smithi100.stdout:3/794: getdents d10/d21/d51/d5a/d5e 0 2024-09-13T02:50:34.351 INFO:tasks.workunit.client.0.smithi100.stdout:4/627: dwrite d3/dc/f6e [4194304,4194304] 0 2024-09-13T02:50:34.351 INFO:tasks.workunit.client.0.smithi100.stdout:9/655: rmdir dd/d1b/d24/da8/da9 39 2024-09-13T02:50:34.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/635: dwrite d0/db/f2e [0,4194304] 0 2024-09-13T02:50:34.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/737: rename de/d14/d22/d52/db8/fcc to de/d14/d44/d7f/fec 0 2024-09-13T02:50:34.352 INFO:tasks.workunit.client.0.smithi100.stdout:1/738: chown de/d14/d44/d61/da9 152 1 2024-09-13T02:50:34.352 INFO:tasks.workunit.client.0.smithi100.stdout:0/674: symlink d2/dd/db0/d43/d97/ldd 0 2024-09-13T02:50:34.352 INFO:tasks.workunit.client.0.smithi100.stdout:0/675: write d2/f56 [4525435,104623] 0 2024-09-13T02:50:34.352 INFO:tasks.workunit.client.0.smithi100.stdout:8/626: getdents df/d5d/d70/d2c/d38/d9e 0 2024-09-13T02:50:34.353 INFO:tasks.workunit.client.0.smithi100.stdout:3/795: mkdir d10/d21/d51/d107 0 2024-09-13T02:50:34.353 INFO:tasks.workunit.client.0.smithi100.stdout:6/658: dread d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:34.353 INFO:tasks.workunit.client.0.smithi100.stdout:6/659: write d12/d14/d1c/d6e/f8b [1692962,89745] 0 2024-09-13T02:50:34.353 INFO:tasks.workunit.client.0.smithi100.stdout:6/660: fdatasync d12/d2e/d90/da2/f6d 0 2024-09-13T02:50:34.359 INFO:tasks.workunit.client.0.smithi100.stdout:4/628: read d3/d6/d21/d67/f78 [2476610,53067] 0 2024-09-13T02:50:34.360 INFO:tasks.workunit.client.0.smithi100.stdout:4/629: write d3/d6/d21/d46/d2d/f95 [1409228,25660] 0 2024-09-13T02:50:34.361 INFO:tasks.workunit.client.0.smithi100.stdout:7/770: rename d3/d16/d3b/da5/c77 to d3/d16/d55/d92/da9/dde/cfb 0 2024-09-13T02:50:34.375 INFO:tasks.workunit.client.0.smithi100.stdout:2/636: dwrite d0/f64 [0,4194304] 0 2024-09-13T02:50:34.375 INFO:tasks.workunit.client.0.smithi100.stdout:0/676: stat d2/dd/db0/c44 0 2024-09-13T02:50:34.376 INFO:tasks.workunit.client.0.smithi100.stdout:8/627: mknod df/d13/de1/ce5 0 2024-09-13T02:50:34.376 INFO:tasks.workunit.client.0.smithi100.stdout:8/628: write df/d13/d21/d81/db0/fdc [695851,34546] 0 2024-09-13T02:50:34.376 INFO:tasks.workunit.client.0.smithi100.stdout:7/771: dwrite d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:34.376 INFO:tasks.workunit.client.0.smithi100.stdout:3/796: mknod d10/d21/d51/d5a/d5e/d89/dc0/c108 0 2024-09-13T02:50:34.379 INFO:tasks.workunit.client.0.smithi100.stdout:6/661: creat d12/d43/fc2 x:0 0 0 2024-09-13T02:50:34.379 INFO:tasks.workunit.client.0.smithi100.stdout:6/662: dread - d12/d14/d9d/db8/fbd zero size 2024-09-13T02:50:34.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/656: rename dd/d1b/d21/fcf to dd/d1b/d1d/d43/d5e/dc0/fdd 0 2024-09-13T02:50:34.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/657: creat dd/d1b/d21/fde x:0 0 0 2024-09-13T02:50:34.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/637: creat d0/db/d68/d9a/fb7 x:0 0 0 2024-09-13T02:50:34.383 INFO:tasks.workunit.client.0.smithi100.stdout:2/638: write d0/db/d21/d57/f6e [1084174,80682] 0 2024-09-13T02:50:34.383 INFO:tasks.workunit.client.0.smithi100.stdout:0/677: chown d2/dd/d54/c22 450 1 2024-09-13T02:50:34.385 INFO:tasks.workunit.client.0.smithi100.stdout:2/639: dread d0/db/d23/f3a [0,4194304] 0 2024-09-13T02:50:34.385 INFO:tasks.workunit.client.0.smithi100.stdout:7/772: mknod d3/d16/d55/cfc 0 2024-09-13T02:50:34.386 INFO:tasks.workunit.client.0.smithi100.stdout:3/797: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/f109 x:0 0 0 2024-09-13T02:50:34.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/663: unlink d12/d14/d2f/d45/f48 0 2024-09-13T02:50:34.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/664: creat d12/d14/fc3 x:0 0 0 2024-09-13T02:50:34.388 INFO:tasks.workunit.client.0.smithi100.stdout:6/665: write d12/d14/f75 [767290,32932] 0 2024-09-13T02:50:34.389 INFO:tasks.workunit.client.0.smithi100.stdout:1/739: rename de/d14/d2e/d69 to de/d14/d44/d61/ded 0 2024-09-13T02:50:34.390 INFO:tasks.workunit.client.0.smithi100.stdout:1/740: chown de/d14/d22/d29/d64/f5e 80677 1 2024-09-13T02:50:34.391 INFO:tasks.workunit.client.0.smithi100.stdout:9/658: creat dd/fdf x:0 0 0 2024-09-13T02:50:34.391 INFO:tasks.workunit.client.0.smithi100.stdout:9/659: write fc [4248282,126017] 0 2024-09-13T02:50:34.391 INFO:tasks.workunit.client.0.smithi100.stdout:9/660: write dd/d1b/d1d/d43/d4f/f50 [797404,65720] 0 2024-09-13T02:50:34.393 INFO:tasks.workunit.client.0.smithi100.stdout:2/640: symlink d0/db/d68/d9a/lb8 0 2024-09-13T02:50:34.393 INFO:tasks.workunit.client.0.smithi100.stdout:2/641: chown d0/db/d68/d6b/da5/d8f/faf 16486681 1 2024-09-13T02:50:34.393 INFO:tasks.workunit.client.0.smithi100.stdout:7/773: mknod d3/d5/d1b/d1c/d36/d9c/cfd 0 2024-09-13T02:50:34.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/642: dread d0/db/d21/f93 [0,4194304] 0 2024-09-13T02:50:34.397 INFO:tasks.workunit.client.0.smithi100.stdout:2/643: dread - d0/db/d3f/f9e zero size 2024-09-13T02:50:34.398 INFO:tasks.workunit.client.0.smithi100.stdout:4/630: rename d3/d6/d21/d46/d34/d96 to d3/dc/d4b/d52/dda 0 2024-09-13T02:50:34.398 INFO:tasks.workunit.client.0.smithi100.stdout:4/631: chown d3/d6/d21/d46/f39 24355067 1 2024-09-13T02:50:34.398 INFO:tasks.workunit.client.0.smithi100.stdout:8/629: rmdir df/d13 39 2024-09-13T02:50:34.401 INFO:tasks.workunit.client.0.smithi100.stdout:0/678: dwrite d2/d1a/f1e [4194304,4194304] 0 2024-09-13T02:50:34.402 INFO:tasks.workunit.client.0.smithi100.stdout:9/661: creat dd/d1b/d1d/d43/d5e/dc0/fe0 x:0 0 0 2024-09-13T02:50:34.403 INFO:tasks.workunit.client.0.smithi100.stdout:6/666: symlink d12/d43/d4b/d4c/lc4 0 2024-09-13T02:50:34.405 INFO:tasks.workunit.client.0.smithi100.stdout:2/644: link d0/d36/l66 d0/d36/lb9 0 2024-09-13T02:50:34.407 INFO:tasks.workunit.client.0.smithi100.stdout:7/774: rename d3/d5/db4 to d3/d16/db0/dd4/dfe 0 2024-09-13T02:50:34.407 INFO:tasks.workunit.client.0.smithi100.stdout:4/632: symlink d3/d6/d2f/d60/ldb 0 2024-09-13T02:50:34.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/630: mknod df/d5d/d70/d2c/ce6 0 2024-09-13T02:50:34.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/631: chown df/d13/d21/l73 105637832 1 2024-09-13T02:50:34.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/741: rmdir de/d14/d22/d29/d64 39 2024-09-13T02:50:34.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/645: dread d0/d36/f6f [0,4194304] 0 2024-09-13T02:50:34.417 INFO:tasks.workunit.client.0.smithi100.stdout:9/662: creat dd/d1b/da3/fe1 x:0 0 0 2024-09-13T02:50:34.418 INFO:tasks.workunit.client.0.smithi100.stdout:3/798: dwrite d10/d21/d51/d5a/d5e/fca [0,4194304] 0 2024-09-13T02:50:34.418 INFO:tasks.workunit.client.0.smithi100.stdout:6/667: creat d12/fc5 x:0 0 0 2024-09-13T02:50:34.420 INFO:tasks.workunit.client.0.smithi100.stdout:7/775: link d3/cdd d3/d16/d55/d92/db3/cff 0 2024-09-13T02:50:34.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/742: rename de/d14/d22/d52/db8/fa7 to de/d14/d22/d52/d65/dc6/fee 0 2024-09-13T02:50:34.422 INFO:tasks.workunit.client.0.smithi100.stdout:9/663: dread dd/d1b/d21/d86/f4c [0,4194304] 0 2024-09-13T02:50:34.427 INFO:tasks.workunit.client.0.smithi100.stdout:0/679: dwrite d2/dd/d54/d28/dac/fb8 [0,4194304] 0 2024-09-13T02:50:34.429 INFO:tasks.workunit.client.0.smithi100.stdout:6/668: link d12/d43/d4b/lbe d12/d14/d1c/lc6 0 2024-09-13T02:50:34.429 INFO:tasks.workunit.client.0.smithi100.stdout:6/669: dread - d12/d43/d4b/d4c/f5b zero size 2024-09-13T02:50:34.429 INFO:tasks.workunit.client.0.smithi100.stdout:6/670: chown d12/d14/d1c/c4e 0 1 2024-09-13T02:50:34.429 INFO:tasks.workunit.client.0.smithi100.stdout:6/671: chown d12/d14/d1c/d28/d88/fac 66003 1 2024-09-13T02:50:34.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/799: write d10/d21/f86 [1157243,38175] 0 2024-09-13T02:50:34.431 INFO:tasks.workunit.client.0.smithi100.stdout:4/633: dwrite d3/f80 [0,4194304] 0 2024-09-13T02:50:34.432 INFO:tasks.workunit.client.0.smithi100.stdout:4/634: fdatasync d3/d6/d2f/d7a/fa1 0 2024-09-13T02:50:34.432 INFO:tasks.workunit.client.0.smithi100.stdout:4/635: write d3/dc/d4b/d9b/fcc [913827,19839] 0 2024-09-13T02:50:34.432 INFO:tasks.workunit.client.0.smithi100.stdout:2/646: rename d0/fad to d0/db/d3f/fba 0 2024-09-13T02:50:34.433 INFO:tasks.workunit.client.0.smithi100.stdout:8/632: dwrite df/d13/d68/fab [0,4194304] 0 2024-09-13T02:50:34.433 INFO:tasks.workunit.client.0.smithi100.stdout:8/633: truncate df/d5d/d88/f90 968711 0 2024-09-13T02:50:34.433 INFO:tasks.workunit.client.0.smithi100.stdout:1/743: mknod de/d14/d44/d7f/cef 0 2024-09-13T02:50:34.435 INFO:tasks.workunit.client.0.smithi100.stdout:0/680: mknod d2/dd/d54/d47/d34/cde 0 2024-09-13T02:50:34.435 INFO:tasks.workunit.client.0.smithi100.stdout:0/681: truncate d2/dd/d54/d47/d34/f39 1614221 0 2024-09-13T02:50:34.436 INFO:tasks.workunit.client.0.smithi100.stdout:6/672: truncate d12/d14/d1c/d28/f58 549911 0 2024-09-13T02:50:34.438 INFO:tasks.workunit.client.0.smithi100.stdout:3/800: symlink d10/d21/d51/d5a/d5e/d99/dc7/dfa/l10a 0 2024-09-13T02:50:34.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/682: write d2/dd/d54/d47/d34/f39 [378431,40294] 0 2024-09-13T02:50:34.439 INFO:tasks.workunit.client.0.smithi100.stdout:0/683: readlink d2/dd/db0/d43/d97/ldd 0 2024-09-13T02:50:34.439 INFO:tasks.workunit.client.0.smithi100.stdout:7/776: mknod d3/d16/d55/d56/dbc/c100 0 2024-09-13T02:50:34.441 INFO:tasks.workunit.client.0.smithi100.stdout:5/654: sync 2024-09-13T02:50:34.444 INFO:tasks.workunit.client.0.smithi100.stdout:2/647: mkdir d0/db/d3f/d6a/d7f/dbb 0 2024-09-13T02:50:34.448 INFO:tasks.workunit.client.0.smithi100.stdout:1/744: symlink de/d14/d44/d7f/dc2/lf0 0 2024-09-13T02:50:34.449 INFO:tasks.workunit.client.0.smithi100.stdout:7/777: read d3/d5/f1e [3829712,65712] 0 2024-09-13T02:50:34.449 INFO:tasks.workunit.client.0.smithi100.stdout:7/778: write d3/fcf [743058,54047] 0 2024-09-13T02:50:34.449 INFO:tasks.workunit.client.0.smithi100.stdout:7/779: fsync d3/d16/d55/d56/f5b 0 2024-09-13T02:50:34.449 INFO:tasks.workunit.client.0.smithi100.stdout:7/780: creat d3/d5/f101 x:0 0 0 2024-09-13T02:50:34.450 INFO:tasks.workunit.client.0.smithi100.stdout:8/634: write df/d13/d20/f61 [3319461,25844] 0 2024-09-13T02:50:34.450 INFO:tasks.workunit.client.0.smithi100.stdout:8/635: chown df/c5a 8826659 1 2024-09-13T02:50:34.451 INFO:tasks.workunit.client.0.smithi100.stdout:6/673: unlink d12/d14/l19 0 2024-09-13T02:50:34.454 INFO:tasks.workunit.client.0.smithi100.stdout:5/655: symlink db/de/d3e/dc3/le4 0 2024-09-13T02:50:34.456 INFO:tasks.workunit.client.0.smithi100.stdout:1/745: rename de/f7d to de/d14/d22/d52/d7a/d81/de0/ff1 0 2024-09-13T02:50:34.457 INFO:tasks.workunit.client.0.smithi100.stdout:4/636: dwrite d3/d6/d21/f76 [0,4194304] 0 2024-09-13T02:50:34.457 INFO:tasks.workunit.client.0.smithi100.stdout:4/637: chown d3/d6/d9/fd 45107970 1 2024-09-13T02:50:34.457 INFO:tasks.workunit.client.0.smithi100.stdout:4/638: fdatasync d3/d6/f38 0 2024-09-13T02:50:34.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/674: mknod d12/d14/d1c/d28/d88/d9f/cc7 0 2024-09-13T02:50:34.459 INFO:tasks.workunit.client.0.smithi100.stdout:6/675: creat d12/d2e/d90/fc8 x:0 0 0 2024-09-13T02:50:34.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/656: symlink db/de/d3e/d7e/d81/d85/le5 0 2024-09-13T02:50:34.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/657: truncate f4 1487885 0 2024-09-13T02:50:34.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/658: dread - db/de/d1f/d2b/d9b/fb5 zero size 2024-09-13T02:50:34.461 INFO:tasks.workunit.client.0.smithi100.stdout:5/659: dread - db/f84 zero size 2024-09-13T02:50:34.462 INFO:tasks.workunit.client.0.smithi100.stdout:5/660: write db/de/d1f/d2b/f79 [668501,40969] 0 2024-09-13T02:50:34.462 INFO:tasks.workunit.client.0.smithi100.stdout:5/661: truncate db/de/d1f/d78/fc4 584148 0 2024-09-13T02:50:34.462 INFO:tasks.workunit.client.0.smithi100.stdout:5/662: fdatasync db/de/d3e/d7e/d81/d85/fd7 0 2024-09-13T02:50:34.462 INFO:tasks.workunit.client.0.smithi100.stdout:5/663: chown db/de/d63/d70 25176 1 2024-09-13T02:50:34.463 INFO:tasks.workunit.client.0.smithi100.stdout:6/676: creat d12/d14/d1c/d7b/da6/fc9 x:0 0 0 2024-09-13T02:50:34.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/781: dread d3/d16/d3b/f5d [0,4194304] 0 2024-09-13T02:50:34.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/782: write d3/d16/d3b/da5/d87/fb9 [89537,83297] 0 2024-09-13T02:50:34.464 INFO:tasks.workunit.client.0.smithi100.stdout:7/783: fdatasync d3/fc 0 2024-09-13T02:50:34.466 INFO:tasks.workunit.client.0.smithi100.stdout:7/784: rename d3/d5/d1b/d1c/d36/c9a to d3/d16/d55/d92/da2/c102 0 2024-09-13T02:50:34.466 INFO:tasks.workunit.client.0.smithi100.stdout:8/636: read df/d13/d5c/f83 [1467284,34977] 0 2024-09-13T02:50:34.471 INFO:tasks.workunit.client.0.smithi100.stdout:0/684: dwrite d2/dd/d54/d47/f2d [0,4194304] 0 2024-09-13T02:50:34.472 INFO:tasks.workunit.client.0.smithi100.stdout:0/685: read - d2/dd/db0/fc2 zero size 2024-09-13T02:50:34.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/677: dread d12/d43/d4b/d4c/d36/f46 [0,4194304] 0 2024-09-13T02:50:34.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/678: dread - d12/d2e/d90/da2/dbc/fc0 zero size 2024-09-13T02:50:34.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/686: unlink d2/dd/db0/c44 0 2024-09-13T02:50:34.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/687: truncate d2/dd/d54/d28/fc7 9705 0 2024-09-13T02:50:34.473 INFO:tasks.workunit.client.0.smithi100.stdout:0/688: chown d2/d1a/l25 10387523 1 2024-09-13T02:50:34.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/664: dread db/de/d63/fa0 [0,4194304] 0 2024-09-13T02:50:34.478 INFO:tasks.workunit.client.0.smithi100.stdout:5/665: creat db/de/d3e/d7e/fe6 x:0 0 0 2024-09-13T02:50:34.484 INFO:tasks.workunit.client.0.smithi100.stdout:3/801: dwrite d10/d21/d51/d5a/d5e/d71/d97/db1/fcb [0,4194304] 0 2024-09-13T02:50:34.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/802: symlink d10/d21/d51/d5a/d5e/d71/d94/l10b 0 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:2/648: dwrite d0/db/d21/f94 [0,4194304] 0 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/689: dread d2/fa [0,4194304] 0 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:2/649: chown d0/db/c3c 3 1 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:2/650: fsync d0/db/d21/f25 0 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/690: write d2/dd/d54/d68/fc6 [914319,114981] 0 2024-09-13T02:50:34.486 INFO:tasks.workunit.client.0.smithi100.stdout:0/691: chown d2/d1a 0 1 2024-09-13T02:50:34.487 INFO:tasks.workunit.client.0.smithi100.stdout:0/692: mkdir d2/dd/d54/d28/ddf 0 2024-09-13T02:50:34.488 INFO:tasks.workunit.client.0.smithi100.stdout:7/785: dread d3/d2d/f74 [0,4194304] 0 2024-09-13T02:50:34.489 INFO:tasks.workunit.client.0.smithi100.stdout:0/693: mkdir d2/dd/db0/de0 0 2024-09-13T02:50:34.489 INFO:tasks.workunit.client.0.smithi100.stdout:4/639: dwrite d3/d6/d21/d46/d2d/d42/fa5 [0,4194304] 0 2024-09-13T02:50:34.489 INFO:tasks.workunit.client.0.smithi100.stdout:7/786: symlink d3/l103 0 2024-09-13T02:50:34.490 INFO:tasks.workunit.client.0.smithi100.stdout:0/694: symlink d2/dd/db0/le1 0 2024-09-13T02:50:34.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/640: unlink d3/d6/d9/fd 0 2024-09-13T02:50:34.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/641: fdatasync d3/f80 0 2024-09-13T02:50:34.494 INFO:tasks.workunit.client.0.smithi100.stdout:7/787: creat d3/d5/d1b/f104 x:0 0 0 2024-09-13T02:50:34.496 INFO:tasks.workunit.client.0.smithi100.stdout:0/695: rename d2/f5 to d2/dd/d54/d47/d8a/fe2 0 2024-09-13T02:50:34.497 INFO:tasks.workunit.client.0.smithi100.stdout:3/803: dread d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fbe [0,4194304] 0 2024-09-13T02:50:34.498 INFO:tasks.workunit.client.0.smithi100.stdout:7/788: creat d3/d5/d1b/d1c/f105 x:0 0 0 2024-09-13T02:50:34.501 INFO:tasks.workunit.client.0.smithi100.stdout:7/789: creat d3/d16/d3b/f106 x:0 0 0 2024-09-13T02:50:34.501 INFO:tasks.workunit.client.0.smithi100.stdout:7/790: readlink d3/d16/d55/d92/db3/lb5 0 2024-09-13T02:50:34.501 INFO:tasks.workunit.client.0.smithi100.stdout:7/791: write d3/d16/d55/d56/d9e/d9f/fa3 [1765025,44017] 0 2024-09-13T02:50:34.503 INFO:tasks.workunit.client.0.smithi100.stdout:8/637: dwrite fb [0,4194304] 0 2024-09-13T02:50:34.503 INFO:tasks.workunit.client.0.smithi100.stdout:8/638: write df/d5d/d70/d2c/d38/f5b [1389147,78630] 0 2024-09-13T02:50:34.504 INFO:tasks.workunit.client.0.smithi100.stdout:1/746: dwrite de/f23 [0,4194304] 0 2024-09-13T02:50:34.504 INFO:tasks.workunit.client.0.smithi100.stdout:5/666: dread db/de/d1f/d2b/fd3 [0,4194304] 0 2024-09-13T02:50:34.506 INFO:tasks.workunit.client.0.smithi100.stdout:1/747: truncate de/d14/d44/f5d 4017850 0 2024-09-13T02:50:34.506 INFO:tasks.workunit.client.0.smithi100.stdout:8/639: getdents df/d6f 0 2024-09-13T02:50:34.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/679: dwrite d12/d43/f54 [0,4194304] 0 2024-09-13T02:50:34.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/680: write d12/d14/d21/f55 [342825,47] 0 2024-09-13T02:50:34.508 INFO:tasks.workunit.client.0.smithi100.stdout:1/748: symlink de/d14/d86/dd0/lf2 0 2024-09-13T02:50:34.508 INFO:tasks.workunit.client.0.smithi100.stdout:1/749: stat de/d14/d22/d52/db8/l92 0 2024-09-13T02:50:34.508 INFO:tasks.workunit.client.0.smithi100.stdout:1/750: readlink de/d12/l13 0 2024-09-13T02:50:34.509 INFO:tasks.workunit.client.0.smithi100.stdout:4/642: dread d3/d63/fa0 [0,4194304] 0 2024-09-13T02:50:34.511 INFO:tasks.workunit.client.0.smithi100.stdout:6/681: unlink d12/d43/d4b/d4c/l4f 0 2024-09-13T02:50:34.512 INFO:tasks.workunit.client.0.smithi100.stdout:1/751: mknod de/d14/d22/d52/d7a/cf3 0 2024-09-13T02:50:34.512 INFO:tasks.workunit.client.0.smithi100.stdout:1/752: creat de/d14/d2e/d48/ff4 x:0 0 0 2024-09-13T02:50:34.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/667: dread db/de/d1f/f4b [0,4194304] 0 2024-09-13T02:50:34.514 INFO:tasks.workunit.client.0.smithi100.stdout:4/643: creat d3/dc/d4b/d52/dd1/fdc x:0 0 0 2024-09-13T02:50:34.515 INFO:tasks.workunit.client.0.smithi100.stdout:6/682: mkdir d12/d14/d2f/dca 0 2024-09-13T02:50:34.515 INFO:tasks.workunit.client.0.smithi100.stdout:6/683: creat d12/d14/d1c/d6e/d71/fcb x:0 0 0 2024-09-13T02:50:34.517 INFO:tasks.workunit.client.0.smithi100.stdout:1/753: mkdir de/d14/df5 0 2024-09-13T02:50:34.517 INFO:tasks.workunit.client.0.smithi100.stdout:7/792: dread d3/d16/d55/d56/f61 [0,4194304] 0 2024-09-13T02:50:34.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/668: mknod db/ce7 0 2024-09-13T02:50:34.520 INFO:tasks.workunit.client.0.smithi100.stdout:6/684: link d12/d43/d4b/d4c/f5b d12/d2e/d90/fcc 0 2024-09-13T02:50:34.521 INFO:tasks.workunit.client.0.smithi100.stdout:1/754: link de/d14/d44/d61/da9/db7/fd4 de/d14/d22/d29/d68/d6d/dd3/ff6 0 2024-09-13T02:50:34.522 INFO:tasks.workunit.client.0.smithi100.stdout:1/755: write de/d14/d22/d52/d7a/feb [852640,111287] 0 2024-09-13T02:50:34.523 INFO:tasks.workunit.client.0.smithi100.stdout:5/669: link db/c75 db/de/d3e/d7e/d81/ce8 0 2024-09-13T02:50:34.523 INFO:tasks.workunit.client.0.smithi100.stdout:5/670: fdatasync db/de/d1f/d2b/fd3 0 2024-09-13T02:50:34.525 INFO:tasks.workunit.client.0.smithi100.stdout:6/685: mkdir d12/dcd 0 2024-09-13T02:50:34.528 INFO:tasks.workunit.client.0.smithi100.stdout:6/686: mkdir d12/d2e/d90/da2/dbc/dce 0 2024-09-13T02:50:34.528 INFO:tasks.workunit.client.0.smithi100.stdout:6/687: chown d12/d2e/d90/fcc 113 1 2024-09-13T02:50:34.528 INFO:tasks.workunit.client.0.smithi100.stdout:6/688: write d12/d14/d2f/d45/f49 [3616504,56214] 0 2024-09-13T02:50:34.530 INFO:tasks.workunit.client.0.smithi100.stdout:6/689: truncate d12/d14/f1a 324906 0 2024-09-13T02:50:34.532 INFO:tasks.workunit.client.0.smithi100.stdout:2/651: dwrite d0/db/d79/f8b [0,4194304] 0 2024-09-13T02:50:34.535 INFO:tasks.workunit.client.0.smithi100.stdout:6/690: dread d12/d14/d2f/d45/f51 [0,4194304] 0 2024-09-13T02:50:34.535 INFO:tasks.workunit.client.0.smithi100.stdout:6/691: fdatasync d12/f16 0 2024-09-13T02:50:34.535 INFO:tasks.workunit.client.0.smithi100.stdout:6/692: write d12/d14/d1c/d6e/d71/f97 [1560917,114278] 0 2024-09-13T02:50:34.535 INFO:tasks.workunit.client.0.smithi100.stdout:6/693: chown d12/d43/d4b/d4c/f87 4 1 2024-09-13T02:50:34.535 INFO:tasks.workunit.client.0.smithi100.stdout:4/644: write d3/d6/f10 [707589,57682] 0 2024-09-13T02:50:34.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/645: getdents d3/d3a 0 2024-09-13T02:50:34.537 INFO:tasks.workunit.client.0.smithi100.stdout:4/646: dread - d3/d6/d21/d46/fb7 zero size 2024-09-13T02:50:34.543 INFO:tasks.workunit.client.0.smithi100.stdout:3/804: dwrite d10/f54 [0,4194304] 0 2024-09-13T02:50:34.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/640: dwrite df/d85/faf [0,4194304] 0 2024-09-13T02:50:34.544 INFO:tasks.workunit.client.0.smithi100.stdout:8/641: truncate df/d13/d21/f57 5215139 0 2024-09-13T02:50:34.545 INFO:tasks.workunit.client.0.smithi100.stdout:0/696: dwrite d2/dd/db0/fc2 [0,4194304] 0 2024-09-13T02:50:34.545 INFO:tasks.workunit.client.0.smithi100.stdout:7/793: dwrite d3/d16/d55/d92/da9/fbe [0,4194304] 0 2024-09-13T02:50:34.545 INFO:tasks.workunit.client.0.smithi100.stdout:7/794: chown d3/d9b 48 1 2024-09-13T02:50:34.550 INFO:tasks.workunit.client.0.smithi100.stdout:1/756: dwrite de/d14/d22/d52/db8/f84 [0,4194304] 0 2024-09-13T02:50:34.565 INFO:tasks.workunit.client.0.smithi100.stdout:8/642: read df/dac/fb2 [3472785,107301] 0 2024-09-13T02:50:34.565 INFO:tasks.workunit.client.0.smithi100.stdout:8/643: chown df/d13/d21/c9b 0 1 2024-09-13T02:50:34.571 INFO:tasks.workunit.client.0.smithi100.stdout:0/697: mkdir d2/dd/d93/da2/da9/de3 0 2024-09-13T02:50:34.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/671: dwrite db/de/d1f/fb2 [0,4194304] 0 2024-09-13T02:50:34.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/672: truncate db/de/d1f/d2b/f79 1667188 0 2024-09-13T02:50:34.573 INFO:tasks.workunit.client.0.smithi100.stdout:5/673: write db/de/d3e/f51 [3928706,6905] 0 2024-09-13T02:50:34.574 INFO:tasks.workunit.client.0.smithi100.stdout:1/757: mkdir de/d14/d44/d61/ded/df7 0 2024-09-13T02:50:34.574 INFO:tasks.workunit.client.0.smithi100.stdout:0/698: rmdir d2/dd/db0/d43/d97 39 2024-09-13T02:50:34.577 INFO:tasks.workunit.client.0.smithi100.stdout:5/674: rename db/de/d1f/fb2 to db/de/d3e/fe9 0 2024-09-13T02:50:34.578 INFO:tasks.workunit.client.0.smithi100.stdout:1/758: mkdir de/d14/d44/d61/ded/df7/df8 0 2024-09-13T02:50:34.578 INFO:tasks.workunit.client.0.smithi100.stdout:1/759: creat de/d14/d22/d52/db8/ff9 x:0 0 0 2024-09-13T02:50:34.578 INFO:tasks.workunit.client.0.smithi100.stdout:1/760: chown de/d14 14963 1 2024-09-13T02:50:34.582 INFO:tasks.workunit.client.0.smithi100.stdout:1/761: rename de/d14/d22/d29/d68/d6d to de/d14/d22/dfa 0 2024-09-13T02:50:34.583 INFO:tasks.workunit.client.0.smithi100.stdout:1/762: mkdir de/d14/d86/dd1/dfb 0 2024-09-13T02:50:34.584 INFO:tasks.workunit.client.0.smithi100.stdout:0/699: dread d2/dd/d54/d28/f65 [0,4194304] 0 2024-09-13T02:50:34.584 INFO:tasks.workunit.client.0.smithi100.stdout:0/700: fdatasync d2/d1a/f7e 0 2024-09-13T02:50:34.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/701: creat d2/d1a/d51/fe4 x:0 0 0 2024-09-13T02:50:34.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/702: fsync d2/dd/d54/d28/fa1 0 2024-09-13T02:50:34.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/703: fdatasync d2/dd/d54/d28/fc7 0 2024-09-13T02:50:34.586 INFO:tasks.workunit.client.0.smithi100.stdout:5/675: dread db/de/d3e/fe9 [0,4194304] 0 2024-09-13T02:50:34.588 INFO:tasks.workunit.client.0.smithi100.stdout:5/676: getdents db 0 2024-09-13T02:50:34.588 INFO:tasks.workunit.client.0.smithi100.stdout:5/677: write db/de/d1f/d2b/f4a [235112,63158] 0 2024-09-13T02:50:34.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/652: dwrite d0/db/d23/f3a [0,4194304] 0 2024-09-13T02:50:34.593 INFO:tasks.workunit.client.0.smithi100.stdout:7/795: dwrite d3/d16/d55/f8e [0,4194304] 0 2024-09-13T02:50:34.593 INFO:tasks.workunit.client.0.smithi100.stdout:4/647: dwrite d3/d6/d21/d46/d2d/d58/f84 [0,4194304] 0 2024-09-13T02:50:34.596 INFO:tasks.workunit.client.0.smithi100.stdout:8/644: dwrite df/d5d/d70/d2c/d38/f71 [0,4194304] 0 2024-09-13T02:50:34.596 INFO:tasks.workunit.client.0.smithi100.stdout:8/645: write df/d13/d20/da2/fae [1513389,71017] 0 2024-09-13T02:50:34.597 INFO:tasks.workunit.client.0.smithi100.stdout:1/763: dread de/fa8 [0,4194304] 0 2024-09-13T02:50:34.597 INFO:tasks.workunit.client.0.smithi100.stdout:1/764: chown de/d14/d22/d52/d65/fd6 642325684 1 2024-09-13T02:50:34.597 INFO:tasks.workunit.client.0.smithi100.stdout:1/765: fdatasync de/d12/f33 0 2024-09-13T02:50:34.597 INFO:tasks.workunit.client.0.smithi100.stdout:1/766: write de/d12/f2a [724358,47551] 0 2024-09-13T02:50:34.597 INFO:tasks.workunit.client.0.smithi100.stdout:6/694: dread d12/d14/d1c/d6e/d71/f86 [0,4194304] 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:6/695: dread - d12/d43/d4b/f74 zero size 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:6/696: fdatasync d12/d14/f9c 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:6/697: truncate d12/fc5 1003613 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:6/698: write d12/d14/d1c/f3a [864600,28123] 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:5/678: dread db/de/d3e/d71/f97 [0,4194304] 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:3/805: dwrite fc [0,4194304] 0 2024-09-13T02:50:34.598 INFO:tasks.workunit.client.0.smithi100.stdout:2/653: symlink d0/db/d3f/d6a/d7f/dbb/lbc 0 2024-09-13T02:50:34.599 INFO:tasks.workunit.client.0.smithi100.stdout:4/648: dread d3/d6/f38 [0,4194304] 0 2024-09-13T02:50:34.599 INFO:tasks.workunit.client.0.smithi100.stdout:6/699: dread d12/fc5 [0,4194304] 0 2024-09-13T02:50:34.599 INFO:tasks.workunit.client.0.smithi100.stdout:7/796: symlink d3/d16/d89/l107 0 2024-09-13T02:50:34.602 INFO:tasks.workunit.client.0.smithi100.stdout:5/679: creat db/de/d3e/da2/fea x:0 0 0 2024-09-13T02:50:34.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/654: link d0/db/d68/l78 d0/db/d3f/d6a/lbd 0 2024-09-13T02:50:34.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/655: dread - d0/db/d21/d88/faa zero size 2024-09-13T02:50:34.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/656: write d0/d36/f9d [688735,36153] 0 2024-09-13T02:50:34.604 INFO:tasks.workunit.client.0.smithi100.stdout:4/649: symlink d3/d3a/d5c/ldd 0 2024-09-13T02:50:34.607 INFO:tasks.workunit.client.0.smithi100.stdout:7/797: rename d3/fcf to d3/d16/d55/d56/d9e/d9f/de9/df0/f108 0 2024-09-13T02:50:34.609 INFO:tasks.workunit.client.0.smithi100.stdout:4/650: truncate d3/d63/dae/fbe 5194372 0 2024-09-13T02:50:34.612 INFO:tasks.workunit.client.0.smithi100.stdout:6/700: link d12/d43/c83 d12/d14/d1c/d28/d88/da5/ccf 0 2024-09-13T02:50:34.612 INFO:tasks.workunit.client.0.smithi100.stdout:6/701: write d12/d14/d1c/d28/f78 [4541443,114466] 0 2024-09-13T02:50:34.614 INFO:tasks.workunit.client.0.smithi100.stdout:0/704: dwrite d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:34.614 INFO:tasks.workunit.client.0.smithi100.stdout:7/798: link d3/d5/d1b/f104 d3/d16/d55/f109 0 2024-09-13T02:50:34.617 INFO:tasks.workunit.client.0.smithi100.stdout:2/657: rmdir d0/db/d68/d6b 39 2024-09-13T02:50:34.618 INFO:tasks.workunit.client.0.smithi100.stdout:1/767: dread de/d14/d22/d52/db8/faa [0,4194304] 0 2024-09-13T02:50:34.618 INFO:tasks.workunit.client.0.smithi100.stdout:4/651: unlink d3/d6/d21/d67/fc1 0 2024-09-13T02:50:34.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/702: creat d12/d2e/d90/da2/fd0 x:0 0 0 2024-09-13T02:50:34.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/703: truncate d12/d43/fc2 199119 0 2024-09-13T02:50:34.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/704: write d12/d14/d1c/d6e/d71/f97 [2347354,125688] 0 2024-09-13T02:50:34.619 INFO:tasks.workunit.client.0.smithi100.stdout:6/705: creat d12/d2e/fd1 x:0 0 0 2024-09-13T02:50:34.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/705: mkdir d2/d9/d6d/d85/de5 0 2024-09-13T02:50:34.620 INFO:tasks.workunit.client.0.smithi100.stdout:0/706: readlink d2/dd/d93/la8 0 2024-09-13T02:50:34.620 INFO:tasks.workunit.client.0.smithi100.stdout:5/680: dread db/de/f52 [0,4194304] 0 2024-09-13T02:50:34.620 INFO:tasks.workunit.client.0.smithi100.stdout:5/681: creat db/de/d3e/feb x:0 0 0 2024-09-13T02:50:34.621 INFO:tasks.workunit.client.0.smithi100.stdout:7/799: rmdir d3/d16/d55/d92/da2 39 2024-09-13T02:50:34.621 INFO:tasks.workunit.client.0.smithi100.stdout:2/658: mkdir d0/db/dbe 0 2024-09-13T02:50:34.623 INFO:tasks.workunit.client.0.smithi100.stdout:9/664: sync 2024-09-13T02:50:34.625 INFO:tasks.workunit.client.0.smithi100.stdout:4/652: truncate d3/d6/fab 1781882 0 2024-09-13T02:50:34.625 INFO:tasks.workunit.client.0.smithi100.stdout:6/706: mkdir d12/d14/d1c/d28/d88/dd2 0 2024-09-13T02:50:34.626 INFO:tasks.workunit.client.0.smithi100.stdout:6/707: truncate d12/d14/fc3 431007 0 2024-09-13T02:50:34.626 INFO:tasks.workunit.client.0.smithi100.stdout:0/707: unlink d2/dd/d54/d47/d34/d3c/c6e 0 2024-09-13T02:50:34.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/806: dwrite d10/d21/d51/d5a/d5e/d71/fdc [0,4194304] 0 2024-09-13T02:50:34.628 INFO:tasks.workunit.client.0.smithi100.stdout:3/807: creat d10/d21/d51/d5a/d5e/d89/f10c x:0 0 0 2024-09-13T02:50:34.628 INFO:tasks.workunit.client.0.smithi100.stdout:8/646: dwrite df/f6c [0,4194304] 0 2024-09-13T02:50:34.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/800: truncate d3/d2d/f41 3905627 0 2024-09-13T02:50:34.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/801: dread - d3/d16/d3b/d8c/fe2 zero size 2024-09-13T02:50:34.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/802: fsync d3/d16/f32 0 2024-09-13T02:50:34.629 INFO:tasks.workunit.client.0.smithi100.stdout:7/803: write d3/d16/d55/d92/da9/dd3/ff7 [1098117,86168] 0 2024-09-13T02:50:34.630 INFO:tasks.workunit.client.0.smithi100.stdout:0/708: mknod d2/d9/d6d/d85/dcd/ce6 0 2024-09-13T02:50:34.636 INFO:tasks.workunit.client.0.smithi100.stdout:8/647: mknod df/d13/d21/ce7 0 2024-09-13T02:50:34.639 INFO:tasks.workunit.client.0.smithi100.stdout:7/804: unlink d3/d5/d1b/l35 0 2024-09-13T02:50:34.640 INFO:tasks.workunit.client.0.smithi100.stdout:8/648: mknod df/d13/d20/da2/ce8 0 2024-09-13T02:50:34.643 INFO:tasks.workunit.client.0.smithi100.stdout:0/709: read d2/fa [5091705,49139] 0 2024-09-13T02:50:34.643 INFO:tasks.workunit.client.0.smithi100.stdout:7/805: unlink d3/d16/d3b/da5/f4a 0 2024-09-13T02:50:34.644 INFO:tasks.workunit.client.0.smithi100.stdout:7/806: symlink d3/d16/d55/d92/da9/dd3/l10a 0 2024-09-13T02:50:34.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/649: dread df/d13/d21/f57 [0,4194304] 0 2024-09-13T02:50:34.646 INFO:tasks.workunit.client.0.smithi100.stdout:8/650: write df/d13/d21/f57 [1199429,45852] 0 2024-09-13T02:50:34.647 INFO:tasks.workunit.client.0.smithi100.stdout:0/710: dread d2/d9/f86 [0,4194304] 0 2024-09-13T02:50:34.650 INFO:tasks.workunit.client.0.smithi100.stdout:0/711: dread d2/d1a/d4c/d7f/fbe [0,4194304] 0 2024-09-13T02:50:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/712: fsync d2/d9/f81 0 2024-09-13T02:50:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:0/713: chown d2/dd/d54/d47/l79 1224520 1 2024-09-13T02:50:34.651 INFO:tasks.workunit.client.0.smithi100.stdout:1/768: dwrite de/d14/d22/d52/d65/fd6 [0,4194304] 0 2024-09-13T02:50:34.652 INFO:tasks.workunit.client.0.smithi100.stdout:0/714: rename d2/dd/db0/c20 to d2/dd/d93/da2/ce7 0 2024-09-13T02:50:34.658 INFO:tasks.workunit.client.0.smithi100.stdout:8/651: dread df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:34.659 INFO:tasks.workunit.client.0.smithi100.stdout:6/708: dread d12/d14/d1c/d28/f78 [0,4194304] 0 2024-09-13T02:50:34.659 INFO:tasks.workunit.client.0.smithi100.stdout:8/652: symlink df/d5d/dba/dcb/le9 0 2024-09-13T02:50:34.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/709: creat d12/d14/d1c/d28/d88/da5/fd3 x:0 0 0 2024-09-13T02:50:34.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/710: fdatasync d12/d14/d1c/d6e/d71/fcb 0 2024-09-13T02:50:34.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/682: dwrite db/f83 [0,4194304] 0 2024-09-13T02:50:34.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/683: write db/de/d3e/dc3/fe0 [227784,15845] 0 2024-09-13T02:50:34.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/684: chown db/de/d1f/c5a 45313 1 2024-09-13T02:50:34.664 INFO:tasks.workunit.client.0.smithi100.stdout:2/659: dwrite d0/db/d68/d6b/d71/d73/f7c [0,4194304] 0 2024-09-13T02:50:34.665 INFO:tasks.workunit.client.0.smithi100.stdout:3/808: dread d10/f92 [0,4194304] 0 2024-09-13T02:50:34.665 INFO:tasks.workunit.client.0.smithi100.stdout:4/653: dwrite d3/d6/d21/f76 [0,4194304] 0 2024-09-13T02:50:34.666 INFO:tasks.workunit.client.0.smithi100.stdout:5/685: mkdir db/de/d63/dec 0 2024-09-13T02:50:34.666 INFO:tasks.workunit.client.0.smithi100.stdout:5/686: creat db/de/ddc/fed x:0 0 0 2024-09-13T02:50:34.669 INFO:tasks.workunit.client.0.smithi100.stdout:0/715: dread d2/dd/db0/d43/d4b/f72 [0,4194304] 0 2024-09-13T02:50:34.670 INFO:tasks.workunit.client.0.smithi100.stdout:0/716: chown d2/dd/db0/l75 286 1 2024-09-13T02:50:34.670 INFO:tasks.workunit.client.0.smithi100.stdout:9/665: dwrite dd/d1b/d7d/f7e [0,4194304] 0 2024-09-13T02:50:34.670 INFO:tasks.workunit.client.0.smithi100.stdout:4/654: rename d3/d6/d9/l6c to d3/dc/d4b/d52/dd1/lde 0 2024-09-13T02:50:34.671 INFO:tasks.workunit.client.0.smithi100.stdout:0/717: symlink d2/d9/d6d/d85/de5/le8 0 2024-09-13T02:50:34.671 INFO:tasks.workunit.client.0.smithi100.stdout:0/718: stat d2/d9/c24 0 2024-09-13T02:50:34.672 INFO:tasks.workunit.client.0.smithi100.stdout:4/655: symlink d3/dc/d4b/d52/dd1/ldf 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:5/687: rename db/de/d3e/d7e/fa7 to db/de/d1f/d78/fee 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/711: dread d12/d2e/f3b [0,4194304] 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/712: write d12/d14/d9d/fb5 [735088,55895] 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/713: write d12/d14/d1c/d28/d88/da5/fd3 [184031,40879] 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/714: dread - d12/d2e/fd1 zero size 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:6/715: truncate d12/d14/d2f/d45/f51 891696 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/719: symlink d2/dd/db0/d3b/le9 0 2024-09-13T02:50:34.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/720: chown d2/dd/d54/d28/f65 0 1 2024-09-13T02:50:34.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/656: mkdir d3/d6/d21/d67/de0 0 2024-09-13T02:50:34.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/657: chown d3/dc/d4b/d7c/c61 3 1 2024-09-13T02:50:34.676 INFO:tasks.workunit.client.0.smithi100.stdout:4/658: truncate d3/d6/d21/d46/f5e 1370557 0 2024-09-13T02:50:34.676 INFO:tasks.workunit.client.0.smithi100.stdout:4/659: chown d3/d6/d21/d46/d2d/d42/fa5 57912880 1 2024-09-13T02:50:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:3/809: dread d10/d21/f29 [0,4194304] 0 2024-09-13T02:50:34.679 INFO:tasks.workunit.client.0.smithi100.stdout:1/769: dwrite de/d14/d44/f47 [0,4194304] 0 2024-09-13T02:50:34.681 INFO:tasks.workunit.client.0.smithi100.stdout:1/770: mknod de/d14/d86/cfc 0 2024-09-13T02:50:34.681 INFO:tasks.workunit.client.0.smithi100.stdout:7/807: dread d3/d5/f53 [0,4194304] 0 2024-09-13T02:50:34.681 INFO:tasks.workunit.client.0.smithi100.stdout:7/808: dread - d3/d16/d55/d92/db3/fca zero size 2024-09-13T02:50:34.681 INFO:tasks.workunit.client.0.smithi100.stdout:7/809: stat d3/d16/d55/d56/f61 0 2024-09-13T02:50:34.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/771: truncate de/d14/d2e/d48/f50 6775231 0 2024-09-13T02:50:34.683 INFO:tasks.workunit.client.0.smithi100.stdout:1/772: stat de/d14/d22/d29/d64/f5e 0 2024-09-13T02:50:34.684 INFO:tasks.workunit.client.0.smithi100.stdout:1/773: dread - de/d14/d22/d29/d68/fea zero size 2024-09-13T02:50:34.684 INFO:tasks.workunit.client.0.smithi100.stdout:3/810: dread d10/d21/d51/d5a/d73/fad [0,4194304] 0 2024-09-13T02:50:34.684 INFO:tasks.workunit.client.0.smithi100.stdout:3/811: dread - d10/ded/ffd zero size 2024-09-13T02:50:34.686 INFO:tasks.workunit.client.0.smithi100.stdout:2/660: read d0/db/d21/f94 [2607493,87520] 0 2024-09-13T02:50:34.688 INFO:tasks.workunit.client.0.smithi100.stdout:3/812: rename d10/d21/d51/d6c/dee/fe6 to d10/d21/d51/d6c/db7/f10d 0 2024-09-13T02:50:34.690 INFO:tasks.workunit.client.0.smithi100.stdout:0/721: write d2/dd/db0/d43/d4b/f4d [4151205,21020] 0 2024-09-13T02:50:34.690 INFO:tasks.workunit.client.0.smithi100.stdout:9/666: dwrite dd/d1b/fb0 [0,4194304] 0 2024-09-13T02:50:34.691 INFO:tasks.workunit.client.0.smithi100.stdout:1/774: getdents de/d14/d22/d52 0 2024-09-13T02:50:34.692 INFO:tasks.workunit.client.0.smithi100.stdout:6/716: read d12/d14/d1c/f30 [616128,21884] 0 2024-09-13T02:50:34.692 INFO:tasks.workunit.client.0.smithi100.stdout:4/660: dwrite d3/dc/d88/db4/fcd [0,4194304] 0 2024-09-13T02:50:34.695 INFO:tasks.workunit.client.0.smithi100.stdout:2/661: creat d0/db/d68/d6b/d85/fbf x:0 0 0 2024-09-13T02:50:34.695 INFO:tasks.workunit.client.0.smithi100.stdout:2/662: readlink d0/db/d3f/d6a/l72 0 2024-09-13T02:50:34.697 INFO:tasks.workunit.client.0.smithi100.stdout:3/813: symlink d10/d21/d51/d5a/d5e/d71/d93/l10e 0 2024-09-13T02:50:34.700 INFO:tasks.workunit.client.0.smithi100.stdout:1/775: read de/d14/d22/f35 [1485041,4424] 0 2024-09-13T02:50:34.702 INFO:tasks.workunit.client.0.smithi100.stdout:2/663: write d0/db/d21/d88/f49 [3925079,123649] 0 2024-09-13T02:50:34.702 INFO:tasks.workunit.client.0.smithi100.stdout:2/664: write d0/db/d21/fa6 [663772,25102] 0 2024-09-13T02:50:34.708 INFO:tasks.workunit.client.0.smithi100.stdout:1/776: read de/d14/d44/f47 [612906,37632] 0 2024-09-13T02:50:34.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/717: getdents d12/d14/d1c/d28 0 2024-09-13T02:50:34.712 INFO:tasks.workunit.client.0.smithi100.stdout:6/718: write d12/f16 [8482274,101002] 0 2024-09-13T02:50:34.713 INFO:tasks.workunit.client.0.smithi100.stdout:6/719: write d12/d14/d1c/d6e/d71/fb6 [1438593,45613] 0 2024-09-13T02:50:34.715 INFO:tasks.workunit.client.0.smithi100.stdout:4/661: symlink d3/d63/le1 0 2024-09-13T02:50:34.720 INFO:tasks.workunit.client.0.smithi100.stdout:3/814: mknod d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/c10f 0 2024-09-13T02:50:34.720 INFO:tasks.workunit.client.0.smithi100.stdout:3/815: chown d10/d21/d51/d5a/d5e/d89/dc0/fe8 55107 1 2024-09-13T02:50:34.720 INFO:tasks.workunit.client.0.smithi100.stdout:3/816: chown d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/c10f 925267 1 2024-09-13T02:50:34.720 INFO:tasks.workunit.client.0.smithi100.stdout:3/817: write d10/d21/f29 [1156642,117193] 0 2024-09-13T02:50:34.720 INFO:tasks.workunit.client.0.smithi100.stdout:3/818: readlink d10/d21/d51/d5a/d5e/d71/d93/lc5 0 2024-09-13T02:50:34.722 INFO:tasks.workunit.client.0.smithi100.stdout:2/665: mknod d0/db/d68/d6b/d85/cc0 0 2024-09-13T02:50:34.724 INFO:tasks.workunit.client.0.smithi100.stdout:6/720: unlink d12/c1b 0 2024-09-13T02:50:34.724 INFO:tasks.workunit.client.0.smithi100.stdout:6/721: dread - d12/d2e/d90/da2/f8c zero size 2024-09-13T02:50:34.724 INFO:tasks.workunit.client.0.smithi100.stdout:4/662: creat d3/d3a/d56/fe2 x:0 0 0 2024-09-13T02:50:34.726 INFO:tasks.workunit.client.0.smithi100.stdout:3/819: mknod d10/d21/d51/d5a/d5e/c110 0 2024-09-13T02:50:34.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/777: dwrite de/d14/d22/d52/f55 [0,4194304] 0 2024-09-13T02:50:34.727 INFO:tasks.workunit.client.0.smithi100.stdout:1/778: write de/d14/d22/fc9 [605513,68197] 0 2024-09-13T02:50:34.728 INFO:tasks.workunit.client.0.smithi100.stdout:2/666: creat d0/db/d3f/d6a/d7f/dbb/fc1 x:0 0 0 2024-09-13T02:50:34.728 INFO:tasks.workunit.client.0.smithi100.stdout:2/667: chown d0/db/d21/d5a/lb5 1 1 2024-09-13T02:50:34.729 INFO:tasks.workunit.client.0.smithi100.stdout:6/722: rename d12/d2e/f3b to d12/d14/d9d/fd4 0 2024-09-13T02:50:34.730 INFO:tasks.workunit.client.0.smithi100.stdout:4/663: creat d3/daf/fe3 x:0 0 0 2024-09-13T02:50:34.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/820: read - d10/f52 zero size 2024-09-13T02:50:34.730 INFO:tasks.workunit.client.0.smithi100.stdout:3/821: getdents d10/d21/d51/d107 0 2024-09-13T02:50:34.733 INFO:tasks.workunit.client.0.smithi100.stdout:2/668: rmdir d0/db/d23 39 2024-09-13T02:50:34.734 INFO:tasks.workunit.client.0.smithi100.stdout:6/723: mkdir d12/d2e/dd5 0 2024-09-13T02:50:34.735 INFO:tasks.workunit.client.0.smithi100.stdout:4/664: creat d3/dc/d4b/d8a/fe4 x:0 0 0 2024-09-13T02:50:34.736 INFO:tasks.workunit.client.0.smithi100.stdout:2/669: rmdir d0/db 39 2024-09-13T02:50:34.738 INFO:tasks.workunit.client.0.smithi100.stdout:6/724: mkdir d12/d2e/d90/da2/dbc/dce/dd6 0 2024-09-13T02:50:34.738 INFO:tasks.workunit.client.0.smithi100.stdout:6/725: chown d12/d43/d4b/d4c/l5f 1 1 2024-09-13T02:50:34.738 INFO:tasks.workunit.client.0.smithi100.stdout:4/665: mknod d3/d63/dae/ce5 0 2024-09-13T02:50:34.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/670: mknod d0/d36/cc2 0 2024-09-13T02:50:34.740 INFO:tasks.workunit.client.0.smithi100.stdout:6/726: unlink d12/f5c 0 2024-09-13T02:50:34.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/666: link d3/dc/d4b/d9b/db2/ld9 d3/d6/d21/d46/le6 0 2024-09-13T02:50:34.744 INFO:tasks.workunit.client.0.smithi100.stdout:6/727: mknod d12/d2e/d90/da2/dbc/cd7 0 2024-09-13T02:50:34.745 INFO:tasks.workunit.client.0.smithi100.stdout:4/667: link d3/dc/d88/db4/fcd d3/dc/d4b/d52/dda/d99/fe7 0 2024-09-13T02:50:34.746 INFO:tasks.workunit.client.0.smithi100.stdout:4/668: mkdir d3/dc/d4b/d52/dda/de8 0 2024-09-13T02:50:34.751 INFO:tasks.workunit.client.0.smithi100.stdout:4/669: read d3/d6/d21/d46/f5e [157190,10866] 0 2024-09-13T02:50:34.753 INFO:tasks.workunit.client.0.smithi100.stdout:3/822: dread d10/d21/f56 [0,4194304] 0 2024-09-13T02:50:34.753 INFO:tasks.workunit.client.0.smithi100.stdout:3/823: dread - d10/d21/d51/d5a/d5e/d71/d94/fd4 zero size 2024-09-13T02:50:34.754 INFO:tasks.workunit.client.0.smithi100.stdout:3/824: mknod d10/d21/d51/d5a/d5e/d71/d94/c111 0 2024-09-13T02:50:34.755 INFO:tasks.workunit.client.0.smithi100.stdout:2/671: rmdir d0/db/d3f/d6a/d7f/dbb 39 2024-09-13T02:50:34.756 INFO:tasks.workunit.client.0.smithi100.stdout:4/670: dread d3/d6/d9/f11 [0,4194304] 0 2024-09-13T02:50:34.756 INFO:tasks.workunit.client.0.smithi100.stdout:4/671: chown d3/d6/d21/f43 177 1 2024-09-13T02:50:34.758 INFO:tasks.workunit.client.0.smithi100.stdout:4/672: link d3/d6/d2f/d60/fbc d3/dc/d4b/d9b/fe9 0 2024-09-13T02:50:34.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/673: mknod d3/d3a/d56/cea 0 2024-09-13T02:50:34.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/674: chown d3/d6/d21/d46/d2d/f82 185738971 1 2024-09-13T02:50:34.759 INFO:tasks.workunit.client.0.smithi100.stdout:4/675: fdatasync d3/dc/d88/fba 0 2024-09-13T02:50:34.760 INFO:tasks.workunit.client.0.smithi100.stdout:4/676: rmdir d3/d6/d21/d46/d2d 39 2024-09-13T02:50:34.760 INFO:tasks.workunit.client.0.smithi100.stdout:4/677: fsync d3/dc/d4b/f91 0 2024-09-13T02:50:34.760 INFO:tasks.workunit.client.0.smithi100.stdout:4/678: creat d3/dc/d4b/d52/feb x:0 0 0 2024-09-13T02:50:34.760 INFO:tasks.workunit.client.0.smithi100.stdout:4/679: stat d3/d63 0 2024-09-13T02:50:34.761 INFO:tasks.workunit.client.0.smithi100.stdout:1/779: dwrite de/d14/d2e/d48/fe3 [0,4194304] 0 2024-09-13T02:50:34.764 INFO:tasks.workunit.client.0.smithi100.stdout:4/680: rename d3/d6/d21/d46/d34/l89 to d3/d6/d21/d67/lec 0 2024-09-13T02:50:34.764 INFO:tasks.workunit.client.0.smithi100.stdout:4/681: write d3/d6/d21/d67/f90 [1349751,63499] 0 2024-09-13T02:50:34.768 INFO:tasks.workunit.client.0.smithi100.stdout:6/728: dwrite d12/d43/d4b/d4c/fb3 [0,4194304] 0 2024-09-13T02:50:34.768 INFO:tasks.workunit.client.0.smithi100.stdout:6/729: readlink d12/d14/d4d/l94 0 2024-09-13T02:50:34.768 INFO:tasks.workunit.client.0.smithi100.stdout:6/730: chown d12/d14/c17 6917884 1 2024-09-13T02:50:34.772 INFO:tasks.workunit.client.0.smithi100.stdout:6/731: mkdir d12/d14/d2f/dca/dd8 0 2024-09-13T02:50:34.775 INFO:tasks.workunit.client.0.smithi100.stdout:3/825: dwrite d10/d21/f2f [0,4194304] 0 2024-09-13T02:50:34.775 INFO:tasks.workunit.client.0.smithi100.stdout:3/826: fdatasync d10/d21/d51/d5a/d5e/d89/f8d 0 2024-09-13T02:50:34.775 INFO:tasks.workunit.client.0.smithi100.stdout:3/827: chown d10/d21/d51/d6c/ffc 8 1 2024-09-13T02:50:34.776 INFO:tasks.workunit.client.0.smithi100.stdout:3/828: creat d10/ded/f112 x:0 0 0 2024-09-13T02:50:34.776 INFO:tasks.workunit.client.0.smithi100.stdout:1/780: dwrite de/d14/d44/d61/da9/db7/fd4 [0,4194304] 0 2024-09-13T02:50:34.777 INFO:tasks.workunit.client.0.smithi100.stdout:3/829: symlink d10/d21/d51/d5a/d5e/da1/l113 0 2024-09-13T02:50:34.786 INFO:tasks.workunit.client.0.smithi100.stdout:4/682: dwrite d3/d6/f10 [4194304,4194304] 0 2024-09-13T02:50:34.787 INFO:tasks.workunit.client.0.smithi100.stdout:4/683: creat d3/dc/d88/fed x:0 0 0 2024-09-13T02:50:34.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/684: symlink d3/d6/d21/d46/lee 0 2024-09-13T02:50:34.788 INFO:tasks.workunit.client.0.smithi100.stdout:4/685: stat d3/d6/d21/d67/f78 0 2024-09-13T02:50:34.789 INFO:tasks.workunit.client.0.smithi100.stdout:4/686: rmdir d3/d6/d21/d46/d2d/d3f 39 2024-09-13T02:50:34.792 INFO:tasks.workunit.client.0.smithi100.stdout:4/687: rmdir d3/d63 39 2024-09-13T02:50:34.792 INFO:tasks.workunit.client.0.smithi100.stdout:4/688: fsync d3/d6/d2f/f9c 0 2024-09-13T02:50:34.792 INFO:tasks.workunit.client.0.smithi100.stdout:4/689: dread - d3/daf/fe3 zero size 2024-09-13T02:50:34.795 INFO:tasks.workunit.client.0.smithi100.stdout:6/732: dwrite d12/d2e/d90/da2/f6d [4194304,4194304] 0 2024-09-13T02:50:34.795 INFO:tasks.workunit.client.0.smithi100.stdout:6/733: fdatasync d12/d14/d2f/f33 0 2024-09-13T02:50:34.795 INFO:tasks.workunit.client.0.smithi100.stdout:6/734: write d12/d43/d4b/d4c/d36/f63 [1892592,73718] 0 2024-09-13T02:50:34.797 INFO:tasks.workunit.client.0.smithi100.stdout:6/735: getdents d12/d14 0 2024-09-13T02:50:34.798 INFO:tasks.workunit.client.0.smithi100.stdout:6/736: mknod d12/d2e/d90/cd9 0 2024-09-13T02:50:34.799 INFO:tasks.workunit.client.0.smithi100.stdout:3/830: dwrite d10/f15 [0,4194304] 0 2024-09-13T02:50:34.799 INFO:tasks.workunit.client.0.smithi100.stdout:6/737: mknod d12/d14/d1c/d28/cda 0 2024-09-13T02:50:34.800 INFO:tasks.workunit.client.0.smithi100.stdout:6/738: mknod d12/d2e/d90/da2/dbc/dce/cdb 0 2024-09-13T02:50:34.800 INFO:tasks.workunit.client.0.smithi100.stdout:6/739: read - d12/d43/d4b/f96 zero size 2024-09-13T02:50:34.800 INFO:tasks.workunit.client.0.smithi100.stdout:6/740: write d12/d2e/d90/da2/fd0 [128439,98683] 0 2024-09-13T02:50:34.801 INFO:tasks.workunit.client.0.smithi100.stdout:6/741: write d12/d2e/d90/da2/dbc/fc0 [504373,119450] 0 2024-09-13T02:50:34.801 INFO:tasks.workunit.client.0.smithi100.stdout:6/742: chown d12/d43/d4b/lbe 40587 1 2024-09-13T02:50:34.802 INFO:tasks.workunit.client.0.smithi100.stdout:6/743: dread d12/d14/f75 [0,4194304] 0 2024-09-13T02:50:34.802 INFO:tasks.workunit.client.0.smithi100.stdout:6/744: stat c6 0 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/745: symlink d12/d14/d9d/db8/ldc 0 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/746: chown d12/d14 11562990 1 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/747: write d12/d14/f57 [1290463,6103] 0 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/748: chown d12/d43/d4b/d4c/d36/f46 1284432 1 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/749: chown d12/d2e/d90/da2/dbc/dce/dd6 234 1 2024-09-13T02:50:34.804 INFO:tasks.workunit.client.0.smithi100.stdout:6/750: chown d12/d2e/d90/da2/f6d 115 1 2024-09-13T02:50:34.805 INFO:tasks.workunit.client.0.smithi100.stdout:6/751: truncate d12/d43/d4b/d4c/fb3 2859587 0 2024-09-13T02:50:34.806 INFO:tasks.workunit.client.0.smithi100.stdout:6/752: mknod d12/d14/d2f/d45/cdd 0 2024-09-13T02:50:34.806 INFO:tasks.workunit.client.0.smithi100.stdout:6/753: write d12/d43/d4b/d4c/f9e [1006261,103806] 0 2024-09-13T02:50:34.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/754: symlink d12/d2e/d90/d92/lde 0 2024-09-13T02:50:34.807 INFO:tasks.workunit.client.0.smithi100.stdout:4/690: write d3/d6/d21/d46/f47 [1952314,61716] 0 2024-09-13T02:50:34.810 INFO:tasks.workunit.client.0.smithi100.stdout:6/755: rmdir d12/d2e/d90/da2/dbc 39 2024-09-13T02:50:34.814 INFO:tasks.workunit.client.0.smithi100.stdout:4/691: write f0 [5956987,49659] 0 2024-09-13T02:50:34.816 INFO:tasks.workunit.client.0.smithi100.stdout:5/688: sync 2024-09-13T02:50:34.816 INFO:tasks.workunit.client.0.smithi100.stdout:7/810: sync 2024-09-13T02:50:34.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/653: sync 2024-09-13T02:50:34.816 INFO:tasks.workunit.client.0.smithi100.stdout:3/831: dwrite d10/d21/d51/d6c/db7/f10d [0,4194304] 0 2024-09-13T02:50:34.817 INFO:tasks.workunit.client.0.smithi100.stdout:3/832: write d10/d21/d51/d5a/d5e/d90/fa0 [8987735,15148] 0 2024-09-13T02:50:34.818 INFO:tasks.workunit.client.0.smithi100.stdout:7/811: mknod d3/d16/d3b/da5/d87/c10b 0 2024-09-13T02:50:34.819 INFO:tasks.workunit.client.0.smithi100.stdout:8/654: mkdir df/d13/db5/dea 0 2024-09-13T02:50:34.821 INFO:tasks.workunit.client.0.smithi100.stdout:3/833: mknod d10/d21/d51/d5a/d5e/d99/dc7/c114 0 2024-09-13T02:50:34.822 INFO:tasks.workunit.client.0.smithi100.stdout:7/812: mkdir d3/d5/d1b/d1c/d36/d10c 0 2024-09-13T02:50:34.822 INFO:tasks.workunit.client.0.smithi100.stdout:7/813: fsync d3/d16/d55/d92/da9/fee 0 2024-09-13T02:50:34.823 INFO:tasks.workunit.client.0.smithi100.stdout:3/834: mknod d10/d21/d51/d5a/d5e/d99/dc7/c115 0 2024-09-13T02:50:34.824 INFO:tasks.workunit.client.0.smithi100.stdout:3/835: dread d10/f44 [0,4194304] 0 2024-09-13T02:50:34.824 INFO:tasks.workunit.client.0.smithi100.stdout:7/814: mkdir d3/d16/d55/d92/da9/d10d 0 2024-09-13T02:50:34.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/815: readlink d3/d5/d1b/l83 0 2024-09-13T02:50:34.825 INFO:tasks.workunit.client.0.smithi100.stdout:7/816: fsync d3/d16/d55/d56/fc4 0 2024-09-13T02:50:34.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/655: dread df/d5d/d70/d2c/d38/f5b [0,4194304] 0 2024-09-13T02:50:34.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/656: fsync df/f64 0 2024-09-13T02:50:34.826 INFO:tasks.workunit.client.0.smithi100.stdout:3/836: symlink d10/d21/d51/d6c/dee/l116 0 2024-09-13T02:50:34.828 INFO:tasks.workunit.client.0.smithi100.stdout:8/657: unlink df/d13/d20/f7a 0 2024-09-13T02:50:34.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/658: getdents df/d13/d21/d81 0 2024-09-13T02:50:34.830 INFO:tasks.workunit.client.0.smithi100.stdout:8/659: chown df/d85/ccc 9185 1 2024-09-13T02:50:34.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/660: link df/d13/d21/l3d df/d6f/leb 0 2024-09-13T02:50:34.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/661: dread df/d13/f44 [0,4194304] 0 2024-09-13T02:50:34.838 INFO:tasks.workunit.client.0.smithi100.stdout:8/662: chown df/l80 3844 1 2024-09-13T02:50:34.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/663: read df/d13/d21/d81/f82 [171307,59895] 0 2024-09-13T02:50:34.839 INFO:tasks.workunit.client.0.smithi100.stdout:8/664: stat df/d5d/dba/cbe 0 2024-09-13T02:50:34.839 INFO:tasks.workunit.client.0.smithi100.stdout:3/837: dread fc [0,4194304] 0 2024-09-13T02:50:34.839 INFO:tasks.workunit.client.0.smithi100.stdout:3/838: fsync d10/d21/f3b 0 2024-09-13T02:50:34.846 INFO:tasks.workunit.client.0.smithi100.stdout:6/756: dwrite d12/d14/d2f/f33 [0,4194304] 0 2024-09-13T02:50:34.846 INFO:tasks.workunit.client.0.smithi100.stdout:6/757: truncate d12/d43/d4b/d4c/f5b 1043640 0 2024-09-13T02:50:34.846 INFO:tasks.workunit.client.0.smithi100.stdout:6/758: stat d12/d2e/d90/cd9 0 2024-09-13T02:50:34.846 INFO:tasks.workunit.client.0.smithi100.stdout:3/839: dread d10/d21/d57/f5b [0,4194304] 0 2024-09-13T02:50:34.847 INFO:tasks.workunit.client.0.smithi100.stdout:4/692: dwrite d3/dc/d4b/f87 [0,4194304] 0 2024-09-13T02:50:34.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/689: dwrite db/de/d3e/fe9 [0,4194304] 0 2024-09-13T02:50:34.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/759: truncate d12/f16 1401590 0 2024-09-13T02:50:34.847 INFO:tasks.workunit.client.0.smithi100.stdout:6/760: creat d12/d43/d4b/d4c/fdf x:0 0 0 2024-09-13T02:50:34.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/761: read - d12/d14/d68/f8d zero size 2024-09-13T02:50:34.848 INFO:tasks.workunit.client.0.smithi100.stdout:6/762: truncate d12/d14/f75 1090813 0 2024-09-13T02:50:34.848 INFO:tasks.workunit.client.0.smithi100.stdout:3/840: creat d10/d8a/f117 x:0 0 0 2024-09-13T02:50:34.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/693: getdents d3/d6/d21/d46/d2d/d3f 0 2024-09-13T02:50:34.853 INFO:tasks.workunit.client.0.smithi100.stdout:4/694: chown d3/d3a/d5c/lb3 3777 1 2024-09-13T02:50:34.854 INFO:tasks.workunit.client.0.smithi100.stdout:4/695: rename d3/dc to d3/dc/d88/db4/def 22 2024-09-13T02:50:34.855 INFO:tasks.workunit.client.0.smithi100.stdout:4/696: mkdir d3/d6/d21/d67/de0/df0 0 2024-09-13T02:50:34.855 INFO:tasks.workunit.client.0.smithi100.stdout:8/665: dwrite df/d13/d21/d81/db0/fdc [0,4194304] 0 2024-09-13T02:50:34.856 INFO:tasks.workunit.client.0.smithi100.stdout:3/841: write d10/f49 [22642,76308] 0 2024-09-13T02:50:34.867 INFO:tasks.workunit.client.0.smithi100.stdout:8/666: dread df/d5d/d70/f63 [0,4194304] 0 2024-09-13T02:50:34.869 INFO:tasks.workunit.client.0.smithi100.stdout:5/690: dwrite db/f83 [0,4194304] 0 2024-09-13T02:50:34.869 INFO:tasks.workunit.client.0.smithi100.stdout:5/691: write db/de/d1f/d78/fc4 [787592,59748] 0 2024-09-13T02:50:34.870 INFO:tasks.workunit.client.0.smithi100.stdout:8/667: creat df/d5d/d70/d41/fec x:0 0 0 2024-09-13T02:50:34.870 INFO:tasks.workunit.client.0.smithi100.stdout:8/668: creat df/d5d/d88/fed x:0 0 0 2024-09-13T02:50:34.870 INFO:tasks.workunit.client.0.smithi100.stdout:8/669: write df/d6f/fd7 [974769,32098] 0 2024-09-13T02:50:34.887 INFO:tasks.workunit.client.0.smithi100.stdout:6/763: dwrite d12/d14/d1c/d28/d88/da5/fd3 [0,4194304] 0 2024-09-13T02:50:34.888 INFO:tasks.workunit.client.0.smithi100.stdout:4/697: dwrite d3/d6/d2f/d7a/fa1 [0,4194304] 0 2024-09-13T02:50:34.888 INFO:tasks.workunit.client.0.smithi100.stdout:3/842: dwrite d10/f33 [0,4194304] 0 2024-09-13T02:50:34.888 INFO:tasks.workunit.client.0.smithi100.stdout:5/692: dwrite db/de/d1f/f4b [0,4194304] 0 2024-09-13T02:50:34.888 INFO:tasks.workunit.client.0.smithi100.stdout:6/764: dread d12/d2e/d90/fcc [0,4194304] 0 2024-09-13T02:50:34.893 INFO:tasks.workunit.client.0.smithi100.stdout:4/698: link d3/d3a/d5c/ldd d3/d6/lf1 0 2024-09-13T02:50:34.896 INFO:tasks.workunit.client.0.smithi100.stdout:6/765: rename d12/d14/d21/l85 to d12/d2e/d90/da2/dbc/dce/dd6/le0 0 2024-09-13T02:50:34.899 INFO:tasks.workunit.client.0.smithi100.stdout:6/766: mkdir d12/d14/d4d/de1 0 2024-09-13T02:50:34.899 INFO:tasks.workunit.client.0.smithi100.stdout:4/699: getdents d3/d6/d2f/d7a 0 2024-09-13T02:50:34.902 INFO:tasks.workunit.client.0.smithi100.stdout:3/843: write d10/d21/d51/d5a/d5e/d71/d97/db1/fcb [2180042,13327] 0 2024-09-13T02:50:34.902 INFO:tasks.workunit.client.0.smithi100.stdout:3/844: write d10/d21/d51/d5a/d5e/fca [4312076,13116] 0 2024-09-13T02:50:34.902 INFO:tasks.workunit.client.0.smithi100.stdout:3/845: chown d10/d21/d51/d6c/fd8 1767939 1 2024-09-13T02:50:34.902 INFO:tasks.workunit.client.0.smithi100.stdout:4/700: rename d3/dc/d4b/d52/dda/d99/cc0 to d3/dc/d4b/d7c/cf2 0 2024-09-13T02:50:34.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/722: sync 2024-09-13T02:50:34.903 INFO:tasks.workunit.client.0.smithi100.stdout:0/723: write d2/d1a/f7e [189426,48762] 0 2024-09-13T02:50:34.903 INFO:tasks.workunit.client.0.smithi100.stdout:5/693: dwrite db/de/d1f/d2b/f4a [0,4194304] 0 2024-09-13T02:50:34.903 INFO:tasks.workunit.client.0.smithi100.stdout:6/767: rmdir d12/d14/d1c/d7b 39 2024-09-13T02:50:34.905 INFO:tasks.workunit.client.0.smithi100.stdout:3/846: rename d10/d21/d51/l7a to d10/d21/d51/l118 0 2024-09-13T02:50:34.905 INFO:tasks.workunit.client.0.smithi100.stdout:3/847: write d10/f2a [273279,12794] 0 2024-09-13T02:50:34.908 INFO:tasks.workunit.client.0.smithi100.stdout:0/724: unlink d2/dd/d54/d3e/d5d/l5e 0 2024-09-13T02:50:34.910 INFO:tasks.workunit.client.0.smithi100.stdout:5/694: symlink db/de/d63/dec/lef 0 2024-09-13T02:50:34.911 INFO:tasks.workunit.client.0.smithi100.stdout:6/768: symlink d12/d43/d4b/d4c/le2 0 2024-09-13T02:50:34.911 INFO:tasks.workunit.client.0.smithi100.stdout:6/769: chown d12/d14/d1c/c56 1954 1 2024-09-13T02:50:34.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/701: dread d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:34.914 INFO:tasks.workunit.client.0.smithi100.stdout:6/770: rename d12/d14/d21/c65 to d12/d14/d2f/d45/ce3 0 2024-09-13T02:50:34.915 INFO:tasks.workunit.client.0.smithi100.stdout:4/702: symlink d3/d6/d21/d46/d34/lf3 0 2024-09-13T02:50:34.918 INFO:tasks.workunit.client.0.smithi100.stdout:6/771: dread d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:34.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/772: link d12/d14/l99 d12/d14/d1c/d28/d88/da5/le4 0 2024-09-13T02:50:34.920 INFO:tasks.workunit.client.0.smithi100.stdout:6/773: write d12/d43/d4b/f74 [352025,6346] 0 2024-09-13T02:50:34.922 INFO:tasks.workunit.client.0.smithi100.stdout:6/774: symlink d12/d14/d2f/d45/d73/le5 0 2024-09-13T02:50:34.922 INFO:tasks.workunit.client.0.smithi100.stdout:6/775: rmdir d12/d14/d2f/dca 39 2024-09-13T02:50:34.924 INFO:tasks.workunit.client.0.smithi100.stdout:6/776: creat d12/d14/d2f/dca/dd8/fe6 x:0 0 0 2024-09-13T02:50:34.924 INFO:tasks.workunit.client.0.smithi100.stdout:5/695: write db/de/d1f/f31 [4585570,102805] 0 2024-09-13T02:50:34.924 INFO:tasks.workunit.client.0.smithi100.stdout:3/848: dwrite d10/d21/d51/d5a/d5e/d89/fdb [0,4194304] 0 2024-09-13T02:50:34.924 INFO:tasks.workunit.client.0.smithi100.stdout:3/849: stat d10/d21/f3b 0 2024-09-13T02:50:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:34 smithi100 ceph-mon[27894]: pgmap v248: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 110 MiB/s rd, 146 MiB/s wr, 665 op/s 2024-09-13T02:50:34.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/777: rename d12/d14/d1c/d28/d88/da5/fd3 to d12/d14/d2f/d45/fe7 0 2024-09-13T02:50:34.928 INFO:tasks.workunit.client.0.smithi100.stdout:6/778: mknod d12/d14/d21/ce8 0 2024-09-13T02:50:34.928 INFO:tasks.workunit.client.0.smithi100.stdout:6/779: chown d12/d14/d2f/d45 58540647 1 2024-09-13T02:50:34.932 INFO:tasks.workunit.client.0.smithi100.stdout:6/780: dread d12/d14/d2f/d45/d73/f80 [0,4194304] 0 2024-09-13T02:50:34.936 INFO:tasks.workunit.client.0.smithi100.stdout:0/725: dwrite d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:34.938 INFO:tasks.workunit.client.0.smithi100.stdout:4/703: dwrite d3/d6/d2f/d7a/fca [0,4194304] 0 2024-09-13T02:50:34.938 INFO:tasks.workunit.client.0.smithi100.stdout:0/726: creat d2/dd/d93/fea x:0 0 0 2024-09-13T02:50:34.943 INFO:tasks.workunit.client.0.smithi100.stdout:2/672: sync 2024-09-13T02:50:34.943 INFO:tasks.workunit.client.0.smithi100.stdout:1/781: sync 2024-09-13T02:50:34.943 INFO:tasks.workunit.client.0.smithi100.stdout:9/667: sync 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:1/782: fdatasync f7 0 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/668: creat dd/d1b/d1d/d43/d4f/da5/fe2 x:0 0 0 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:1/783: write f7 [4811265,123808] 0 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/669: dread - dd/d1b/d1d/d43/d4f/da5/f91 zero size 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/670: write dd/d1b/d1d/d43/d5d/f7b [4384091,65074] 0 2024-09-13T02:50:34.944 INFO:tasks.workunit.client.0.smithi100.stdout:9/671: creat dd/d1b/d1d/d43/d4f/da5/fe3 x:0 0 0 2024-09-13T02:50:34.947 INFO:tasks.workunit.client.0.smithi100.stdout:1/784: symlink de/d14/d22/d52/d7a/d81/lfd 0 2024-09-13T02:50:34.947 INFO:tasks.workunit.client.0.smithi100.stdout:1/785: creat de/d14/d86/ffe x:0 0 0 2024-09-13T02:50:34.948 INFO:tasks.workunit.client.0.smithi100.stdout:6/781: dwrite d12/d43/d4b/f96 [0,4194304] 0 2024-09-13T02:50:34.950 INFO:tasks.workunit.client.0.smithi100.stdout:1/786: mkdir de/d14/df5/dff 0 2024-09-13T02:50:34.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/704: write d3/dc/d88/db4/fcd [4112813,91784] 0 2024-09-13T02:50:34.955 INFO:tasks.workunit.client.0.smithi100.stdout:4/705: symlink d3/d3a/d5c/lf4 0 2024-09-13T02:50:34.956 INFO:tasks.workunit.client.0.smithi100.stdout:1/787: rmdir de/d14/d2e/d48 39 2024-09-13T02:50:34.958 INFO:tasks.workunit.client.0.smithi100.stdout:1/788: creat de/d14/d44/d61/ded/df7/f100 x:0 0 0 2024-09-13T02:50:34.958 INFO:tasks.workunit.client.0.smithi100.stdout:0/727: dwrite d2/dd/db0/d43/fd8 [0,4194304] 0 2024-09-13T02:50:34.960 INFO:tasks.workunit.client.0.smithi100.stdout:1/789: mkdir de/d14/df5/dff/d101 0 2024-09-13T02:50:34.960 INFO:tasks.workunit.client.0.smithi100.stdout:1/790: truncate de/d14/d2e/d48/fc7 8766690 0 2024-09-13T02:50:34.961 INFO:tasks.workunit.client.0.smithi100.stdout:1/791: mkdir de/d14/d22/d52/db8/d102 0 2024-09-13T02:50:34.961 INFO:tasks.workunit.client.0.smithi100.stdout:1/792: fdatasync de/f46 0 2024-09-13T02:50:34.961 INFO:tasks.workunit.client.0.smithi100.stdout:1/793: write de/d14/d2e/d60/fe4 [1744266,66653] 0 2024-09-13T02:50:34.979 INFO:tasks.workunit.client.0.smithi100.stdout:0/728: write d2/dd/db0/d43/d4b/db4/fbf [355251,11509] 0 2024-09-13T02:50:34.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/729: mkdir d2/d9/d6d/d85/de5/deb 0 2024-09-13T02:50:34.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/730: fdatasync d2/dd/d54/d47/d34/f2b 0 2024-09-13T02:50:34.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/731: write d2/dd/d54/d28/dac/fc5 [7254169,45352] 0 2024-09-13T02:50:34.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/732: truncate d2/dd/d54/d47/f2d 255213 0 2024-09-13T02:50:34.981 INFO:tasks.workunit.client.0.smithi100.stdout:0/733: read - d2/dd/db0/d3b/f6f zero size 2024-09-13T02:50:34.984 INFO:tasks.workunit.client.0.smithi100.stdout:6/782: dwrite d12/d14/d1c/f77 [0,4194304] 0 2024-09-13T02:50:34.986 INFO:tasks.workunit.client.0.smithi100.stdout:9/672: dwrite dd/d1b/d1d/d43/d5e/f9b [0,4194304] 0 2024-09-13T02:50:34.988 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:34 smithi122 ceph-mon[34559]: pgmap v248: 65 pgs: 65 active+clean; 1.2 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 110 MiB/s rd, 146 MiB/s wr, 665 op/s 2024-09-13T02:50:34.989 INFO:tasks.workunit.client.0.smithi100.stdout:6/783: getdents d12/d14/d2f/dca/dd8 0 2024-09-13T02:50:34.989 INFO:tasks.workunit.client.0.smithi100.stdout:9/673: truncate dd/d1b/d21/d86/f4c 2207928 0 2024-09-13T02:50:34.989 INFO:tasks.workunit.client.0.smithi100.stdout:6/784: dread - d12/d14/d1c/fa1 zero size 2024-09-13T02:50:34.991 INFO:tasks.workunit.client.0.smithi100.stdout:6/785: link d12/d14/d1c/f62 d12/dcd/fe9 0 2024-09-13T02:50:34.992 INFO:tasks.workunit.client.0.smithi100.stdout:2/673: dwrite d0/db/f12 [0,4194304] 0 2024-09-13T02:50:34.992 INFO:tasks.workunit.client.0.smithi100.stdout:4/706: dwrite d3/d6/d21/d46/f5e [0,4194304] 0 2024-09-13T02:50:34.992 INFO:tasks.workunit.client.0.smithi100.stdout:2/674: chown d0/d36/d8a/l97 169734809 1 2024-09-13T02:50:34.992 INFO:tasks.workunit.client.0.smithi100.stdout:2/675: readlink d0/db/d21/d57/l70 0 2024-09-13T02:50:34.993 INFO:tasks.workunit.client.0.smithi100.stdout:9/674: symlink dd/d1b/le4 0 2024-09-13T02:50:34.993 INFO:tasks.workunit.client.0.smithi100.stdout:4/707: write d3/d6/d9/d9e/fb0 [390297,51569] 0 2024-09-13T02:50:34.993 INFO:tasks.workunit.client.0.smithi100.stdout:4/708: chown d3/dc/c22 28311640 1 2024-09-13T02:50:34.993 INFO:tasks.workunit.client.0.smithi100.stdout:2/676: dread d0/db/d3f/fa4 [0,4194304] 0 2024-09-13T02:50:34.993 INFO:tasks.workunit.client.0.smithi100.stdout:6/786: creat d12/d14/d2f/d45/d73/fea x:0 0 0 2024-09-13T02:50:34.994 INFO:tasks.workunit.client.0.smithi100.stdout:9/675: creat dd/d1b/d24/da8/fe5 x:0 0 0 2024-09-13T02:50:34.994 INFO:tasks.workunit.client.0.smithi100.stdout:2/677: mkdir d0/db/dbe/dc3 0 2024-09-13T02:50:34.994 INFO:tasks.workunit.client.0.smithi100.stdout:2/678: creat d0/db/d68/d6b/d85/fc4 x:0 0 0 2024-09-13T02:50:34.995 INFO:tasks.workunit.client.0.smithi100.stdout:2/679: creat d0/db/d68/d6b/da5/fc5 x:0 0 0 2024-09-13T02:50:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:2/680: write d0/db/d21/f54 [681368,74143] 0 2024-09-13T02:50:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:2/681: creat d0/db/d21/d57/d81/fc6 x:0 0 0 2024-09-13T02:50:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:2/682: fdatasync d0/db/d3f/f9e 0 2024-09-13T02:50:34.996 INFO:tasks.workunit.client.0.smithi100.stdout:2/683: fsync d0/db/d21/f94 0 2024-09-13T02:50:34.998 INFO:tasks.workunit.client.0.smithi100.stdout:1/794: dwrite de/fa8 [0,4194304] 0 2024-09-13T02:50:34.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/684: rename d0/db/f52 to d0/db/d68/d6b/da5/d8f/fc7 0 2024-09-13T02:50:34.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/685: fdatasync d0/db/d3f/fa4 0 2024-09-13T02:50:34.998 INFO:tasks.workunit.client.0.smithi100.stdout:2/686: creat d0/db/d68/d9a/fc8 x:0 0 0 2024-09-13T02:50:35.001 INFO:tasks.workunit.client.0.smithi100.stdout:1/795: truncate de/d14/d22/fc9 546772 0 2024-09-13T02:50:35.002 INFO:tasks.workunit.client.0.smithi100.stdout:0/734: dwrite d2/dd/db0/fc2 [0,4194304] 0 2024-09-13T02:50:35.002 INFO:tasks.workunit.client.0.smithi100.stdout:0/735: creat d2/dd/db0/d43/d4b/db4/fec x:0 0 0 2024-09-13T02:50:35.002 INFO:tasks.workunit.client.0.smithi100.stdout:0/736: stat d2/dd/d54/d47/d34/da3 0 2024-09-13T02:50:35.005 INFO:tasks.workunit.client.0.smithi100.stdout:4/709: write d3/d6/d2f/d7a/fca [3584162,94187] 0 2024-09-13T02:50:35.011 INFO:tasks.workunit.client.0.smithi100.stdout:2/687: rename d0/l53 to d0/db/d3f/d6a/d7f/dbb/lc9 0 2024-09-13T02:50:35.012 INFO:tasks.workunit.client.0.smithi100.stdout:1/796: symlink de/d14/d86/dd0/l103 0 2024-09-13T02:50:35.014 INFO:tasks.workunit.client.0.smithi100.stdout:2/688: read d0/db/f45 [373418,105812] 0 2024-09-13T02:50:35.014 INFO:tasks.workunit.client.0.smithi100.stdout:2/689: chown d0/db/d3f/d6a/lbd 3142376 1 2024-09-13T02:50:35.017 INFO:tasks.workunit.client.0.smithi100.stdout:0/737: rename d2/d1a/d51/l5b to d2/dd/d54/d47/d34/d91/led 0 2024-09-13T02:50:35.018 INFO:tasks.workunit.client.0.smithi100.stdout:6/787: dwrite d12/d14/f1a [0,4194304] 0 2024-09-13T02:50:35.019 INFO:tasks.workunit.client.0.smithi100.stdout:1/797: creat de/d14/d44/d61/da9/dc4/f104 x:0 0 0 2024-09-13T02:50:35.019 INFO:tasks.workunit.client.0.smithi100.stdout:1/798: fsync de/d14/d2e/f37 0 2024-09-13T02:50:35.020 INFO:tasks.workunit.client.0.smithi100.stdout:2/690: truncate d0/d36/f4f 1994930 0 2024-09-13T02:50:35.020 INFO:tasks.workunit.client.0.smithi100.stdout:0/738: dread d2/dd/fc1 [0,4194304] 0 2024-09-13T02:50:35.020 INFO:tasks.workunit.client.0.smithi100.stdout:0/739: chown d2/dd/d54/d47/d34/d91/led 2100 1 2024-09-13T02:50:35.020 INFO:tasks.workunit.client.0.smithi100.stdout:0/740: write d2/d1a/f4f [179366,37700] 0 2024-09-13T02:50:35.020 INFO:tasks.workunit.client.0.smithi100.stdout:0/741: write d2/dd/d54/d3e/d5d/f62 [735183,34] 0 2024-09-13T02:50:35.021 INFO:tasks.workunit.client.0.smithi100.stdout:6/788: mknod d12/d14/d4d/de1/ceb 0 2024-09-13T02:50:35.021 INFO:tasks.workunit.client.0.smithi100.stdout:9/676: dwrite dd/d1b/d1d/d28/f8c [0,4194304] 0 2024-09-13T02:50:35.022 INFO:tasks.workunit.client.0.smithi100.stdout:9/677: fdatasync dd/d1b/d1d/faf 0 2024-09-13T02:50:35.022 INFO:tasks.workunit.client.0.smithi100.stdout:9/678: stat dd/d1b/d24/d74/f65 0 2024-09-13T02:50:35.023 INFO:tasks.workunit.client.0.smithi100.stdout:6/789: rename d12/d14/d2f/d45/d73/f80 to d12/d14/d2f/fec 0 2024-09-13T02:50:35.024 INFO:tasks.workunit.client.0.smithi100.stdout:0/742: link d2/dd/d54/d3e/d5d/f6b d2/d1a/fee 0 2024-09-13T02:50:35.024 INFO:tasks.workunit.client.0.smithi100.stdout:2/691: write d0/db/d3f/fa4 [930755,73011] 0 2024-09-13T02:50:35.025 INFO:tasks.workunit.client.0.smithi100.stdout:2/692: write d0/db/d21/d57/f98 [263215,15371] 0 2024-09-13T02:50:35.027 INFO:tasks.workunit.client.0.smithi100.stdout:9/679: mknod dd/d1b/ce6 0 2024-09-13T02:50:35.029 INFO:tasks.workunit.client.0.smithi100.stdout:6/790: mkdir d12/d14/d4d/ded 0 2024-09-13T02:50:35.029 INFO:tasks.workunit.client.0.smithi100.stdout:2/693: dread d0/fa1 [0,4194304] 0 2024-09-13T02:50:35.031 INFO:tasks.workunit.client.0.smithi100.stdout:9/680: mkdir dd/d1b/d24/d74/d4e/de7 0 2024-09-13T02:50:35.031 INFO:tasks.workunit.client.0.smithi100.stdout:9/681: creat dd/d1b/d1d/d43/d5e/dc0/fe8 x:0 0 0 2024-09-13T02:50:35.031 INFO:tasks.workunit.client.0.smithi100.stdout:9/682: fsync dd/d1b/d21/fde 0 2024-09-13T02:50:35.031 INFO:tasks.workunit.client.0.smithi100.stdout:4/710: dwrite d3/d6/d2f/d7a/fc7 [0,4194304] 0 2024-09-13T02:50:35.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/791: link d12/d2e/d90/fc8 d12/d14/d1c/fee 0 2024-09-13T02:50:35.032 INFO:tasks.workunit.client.0.smithi100.stdout:6/792: readlink d12/d14/d1c/l1d 0 2024-09-13T02:50:35.034 INFO:tasks.workunit.client.0.smithi100.stdout:9/683: mkdir dd/d1b/d27/d51/de9 0 2024-09-13T02:50:35.039 INFO:tasks.workunit.client.0.smithi100.stdout:1/799: dwrite de/d14/d22/d52/d7a/d81/fd2 [0,4194304] 0 2024-09-13T02:50:35.049 INFO:tasks.workunit.client.0.smithi100.stdout:2/694: dread d0/db/d3f/fa4 [0,4194304] 0 2024-09-13T02:50:35.050 INFO:tasks.workunit.client.0.smithi100.stdout:7/817: sync 2024-09-13T02:50:35.050 INFO:tasks.workunit.client.0.smithi100.stdout:8/670: sync 2024-09-13T02:50:35.050 INFO:tasks.workunit.client.0.smithi100.stdout:8/671: write df/d13/d20/da2/fd1 [187878,64647] 0 2024-09-13T02:50:35.052 INFO:tasks.workunit.client.0.smithi100.stdout:0/743: dread d2/dd/db0/d43/d4b/db4/fbf [4194304,4194304] 0 2024-09-13T02:50:35.053 INFO:tasks.workunit.client.0.smithi100.stdout:1/800: creat de/d12/f105 x:0 0 0 2024-09-13T02:50:35.053 INFO:tasks.workunit.client.0.smithi100.stdout:1/801: write de/d14/d44/d61/da9/db7/fcd [985807,62788] 0 2024-09-13T02:50:35.054 INFO:tasks.workunit.client.0.smithi100.stdout:2/695: mkdir d0/db/d68/d6b/da5/d8f/dca 0 2024-09-13T02:50:35.054 INFO:tasks.workunit.client.0.smithi100.stdout:2/696: read - d0/db/d79/fb1 zero size 2024-09-13T02:50:35.055 INFO:tasks.workunit.client.0.smithi100.stdout:7/818: creat d3/d16/d55/d92/da9/dde/f10e x:0 0 0 2024-09-13T02:50:35.056 INFO:tasks.workunit.client.0.smithi100.stdout:2/697: write d0/db/d21/f93 [724131,58361] 0 2024-09-13T02:50:35.057 INFO:tasks.workunit.client.0.smithi100.stdout:8/672: creat df/d13/d20/d98/fee x:0 0 0 2024-09-13T02:50:35.057 INFO:tasks.workunit.client.0.smithi100.stdout:8/673: fdatasync df/d5d/f69 0 2024-09-13T02:50:35.058 INFO:tasks.workunit.client.0.smithi100.stdout:7/819: truncate d3/d5/f82 90188 0 2024-09-13T02:50:35.060 INFO:tasks.workunit.client.0.smithi100.stdout:7/820: unlink d3/d16/d3b/d8c/la4 0 2024-09-13T02:50:35.062 INFO:tasks.workunit.client.0.smithi100.stdout:7/821: rename d3/d16/l57 to d3/d16/d55/d92/da9/l10f 0 2024-09-13T02:50:35.062 INFO:tasks.workunit.client.0.smithi100.stdout:1/802: read de/f2c [2735622,23970] 0 2024-09-13T02:50:35.064 INFO:tasks.workunit.client.0.smithi100.stdout:1/803: truncate de/d14/d22/f3c 36156 0 2024-09-13T02:50:35.066 INFO:tasks.workunit.client.0.smithi100.stdout:7/822: truncate d3/d5/f1e 510650 0 2024-09-13T02:50:35.066 INFO:tasks.workunit.client.0.smithi100.stdout:7/823: truncate d3/d16/d55/d92/da9/dde/f10e 667036 0 2024-09-13T02:50:35.068 INFO:tasks.workunit.client.0.smithi100.stdout:7/824: mkdir d3/d16/d55/d56/d9e/d9f/de9/d110 0 2024-09-13T02:50:35.068 INFO:tasks.workunit.client.0.smithi100.stdout:7/825: fdatasync d3/d5/f82 0 2024-09-13T02:50:35.068 INFO:tasks.workunit.client.0.smithi100.stdout:7/826: fdatasync d3/d5/d1b/d1c/f7f 0 2024-09-13T02:50:35.069 INFO:tasks.workunit.client.0.smithi100.stdout:7/827: mknod d3/d16/d55/d92/c111 0 2024-09-13T02:50:35.069 INFO:tasks.workunit.client.0.smithi100.stdout:7/828: write d3/d5/d4f/fbb [771476,108038] 0 2024-09-13T02:50:35.070 INFO:tasks.workunit.client.0.smithi100.stdout:7/829: readlink d3/d16/d55/lf2 0 2024-09-13T02:50:35.070 INFO:tasks.workunit.client.0.smithi100.stdout:7/830: read - d3/d16/d55/d56/d9e/d9f/fbf zero size 2024-09-13T02:50:35.073 INFO:tasks.workunit.client.0.smithi100.stdout:0/744: dread d2/dd/d54/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:35.075 INFO:tasks.workunit.client.0.smithi100.stdout:0/745: rmdir d2/dd/db0/d43/d4b 39 2024-09-13T02:50:35.076 INFO:tasks.workunit.client.0.smithi100.stdout:0/746: creat d2/dd/d54/d68/dae/fef x:0 0 0 2024-09-13T02:50:35.077 INFO:tasks.workunit.client.0.smithi100.stdout:0/747: mknod d2/dd/db0/cf0 0 2024-09-13T02:50:35.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/698: dread d0/db/d68/d6b/d71/d73/f7c [0,4194304] 0 2024-09-13T02:50:35.077 INFO:tasks.workunit.client.0.smithi100.stdout:2/699: chown d0/db/d21/l31 30594223 1 2024-09-13T02:50:35.078 INFO:tasks.workunit.client.0.smithi100.stdout:0/748: symlink d2/dd/db0/de0/lf1 0 2024-09-13T02:50:35.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/793: dwrite d12/d43/d4b/f74 [0,4194304] 0 2024-09-13T02:50:35.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/794: truncate d12/d14/d1c/f62 966885 0 2024-09-13T02:50:35.078 INFO:tasks.workunit.client.0.smithi100.stdout:6/795: creat d12/d2e/fef x:0 0 0 2024-09-13T02:50:35.079 INFO:tasks.workunit.client.0.smithi100.stdout:4/711: dwrite d3/d6/f10 [0,4194304] 0 2024-09-13T02:50:35.079 INFO:tasks.workunit.client.0.smithi100.stdout:4/712: getdents d3/d6/da6 0 2024-09-13T02:50:35.079 INFO:tasks.workunit.client.0.smithi100.stdout:9/684: dwrite dd/d1b/d1d/d43/d5d/fd8 [0,4194304] 0 2024-09-13T02:50:35.079 INFO:tasks.workunit.client.0.smithi100.stdout:9/685: write dd/d1b/d24/d74/d4e/f96 [378213,80509] 0 2024-09-13T02:50:35.080 INFO:tasks.workunit.client.0.smithi100.stdout:0/749: mknod d2/d9/d6d/d85/db3/cf2 0 2024-09-13T02:50:35.084 INFO:tasks.workunit.client.0.smithi100.stdout:1/804: dwrite de/d14/d22/dfa/dd3/fdd [0,4194304] 0 2024-09-13T02:50:35.085 INFO:tasks.workunit.client.0.smithi100.stdout:6/796: rename d12/d43/d4b/d4c/d36 to d12/d14/d5a/df0 0 2024-09-13T02:50:35.085 INFO:tasks.workunit.client.0.smithi100.stdout:8/674: dwrite df/d13/d5c/f83 [4194304,4194304] 0 2024-09-13T02:50:35.089 INFO:tasks.workunit.client.0.smithi100.stdout:8/675: dread df/d13/d5c/f83 [0,4194304] 0 2024-09-13T02:50:35.090 INFO:tasks.workunit.client.0.smithi100.stdout:5/696: sync 2024-09-13T02:50:35.100 INFO:tasks.workunit.client.0.smithi100.stdout:9/686: creat dd/d1b/d24/d74/d4e/d58/fea x:0 0 0 2024-09-13T02:50:35.104 INFO:tasks.workunit.client.0.smithi100.stdout:1/805: rename de/d14/d22/d52/d7a/l7c to de/d14/d22/l106 0 2024-09-13T02:50:35.105 INFO:tasks.workunit.client.0.smithi100.stdout:6/797: symlink d12/d14/d1c/d28/d88/lf1 0 2024-09-13T02:50:35.107 INFO:tasks.workunit.client.0.smithi100.stdout:8/676: mknod df/d5d/d70/d41/cef 0 2024-09-13T02:50:35.107 INFO:tasks.workunit.client.0.smithi100.stdout:8/677: dread - df/d5d/d70/f91 zero size 2024-09-13T02:50:35.108 INFO:tasks.workunit.client.0.smithi100.stdout:1/806: creat de/d14/d22/d52/d7a/d81/de0/f107 x:0 0 0 2024-09-13T02:50:35.109 INFO:tasks.workunit.client.0.smithi100.stdout:6/798: unlink d12/d14/l99 0 2024-09-13T02:50:35.110 INFO:tasks.workunit.client.0.smithi100.stdout:6/799: mkdir d12/d14/df2 0 2024-09-13T02:50:35.112 INFO:tasks.workunit.client.0.smithi100.stdout:6/800: link d12/d14/d1c/c1e d12/d2e/d90/cf3 0 2024-09-13T02:50:35.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/700: dwrite d0/db/d21/d57/f61 [0,4194304] 0 2024-09-13T02:50:35.116 INFO:tasks.workunit.client.0.smithi100.stdout:2/701: creat d0/d36/fcb x:0 0 0 2024-09-13T02:50:35.117 INFO:tasks.workunit.client.0.smithi100.stdout:0/750: dwrite d2/dd/f9e [0,4194304] 0 2024-09-13T02:50:35.117 INFO:tasks.workunit.client.0.smithi100.stdout:4/713: dwrite d3/dc/d4b/d52/dda/d99/fad [0,4194304] 0 2024-09-13T02:50:35.117 INFO:tasks.workunit.client.0.smithi100.stdout:7/831: dread d3/d5/f1e [0,4194304] 0 2024-09-13T02:50:35.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/714: dread d3/d6/f38 [0,4194304] 0 2024-09-13T02:50:35.121 INFO:tasks.workunit.client.0.smithi100.stdout:2/702: mkdir d0/db/d3f/d6a/d7f/dcc 0 2024-09-13T02:50:35.121 INFO:tasks.workunit.client.0.smithi100.stdout:9/687: write dd/d1b/d1d/d43/d5d/f9e [1562460,111985] 0 2024-09-13T02:50:35.122 INFO:tasks.workunit.client.0.smithi100.stdout:9/688: stat dd/d1b/d21/d86/c71 0 2024-09-13T02:50:35.124 INFO:tasks.workunit.client.0.smithi100.stdout:0/751: unlink d2/d1a/fee 0 2024-09-13T02:50:35.124 INFO:tasks.workunit.client.0.smithi100.stdout:0/752: dread - d2/dd/db0/d43/d4b/db4/fec zero size 2024-09-13T02:50:35.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/832: mkdir d3/d16/d3b/d112 0 2024-09-13T02:50:35.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/833: chown d3/d16/d55/caa 0 1 2024-09-13T02:50:35.127 INFO:tasks.workunit.client.0.smithi100.stdout:7/834: chown d3/d16/d55/d92/da9/cb6 28 1 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/801: rmdir d12/d14/d5a/df0 39 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/802: chown d12/d14/c24 1 1 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/803: fdatasync d12/d14/d9d/fb5 0 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/804: write d12/d2e/d90/da2/fd0 [553924,20348] 0 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/805: stat d12/d14/d1c/lad 0 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:6/806: chown d12/d2e/d90/da2 11751 1 2024-09-13T02:50:35.128 INFO:tasks.workunit.client.0.smithi100.stdout:4/715: truncate d3/dc/d4b/d9b/fe9 2767980 0 2024-09-13T02:50:35.129 INFO:tasks.workunit.client.0.smithi100.stdout:2/703: link d0/db/d23/l29 d0/db/d68/d9a/lcd 0 2024-09-13T02:50:35.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/835: mknod d3/d16/d55/d56/d9e/d9f/c113 0 2024-09-13T02:50:35.132 INFO:tasks.workunit.client.0.smithi100.stdout:6/807: mknod d12/d14/d1c/d6e/d71/cf4 0 2024-09-13T02:50:35.133 INFO:tasks.workunit.client.0.smithi100.stdout:6/808: creat d12/d14/d9d/ff5 x:0 0 0 2024-09-13T02:50:35.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/716: symlink d3/d6/d2f/d60/lf5 0 2024-09-13T02:50:35.133 INFO:tasks.workunit.client.0.smithi100.stdout:4/717: stat d3/d6/d21/d46/fa3 0 2024-09-13T02:50:35.134 INFO:tasks.workunit.client.0.smithi100.stdout:2/704: truncate d0/db/d68/d6b/f76 330850 0 2024-09-13T02:50:35.135 INFO:tasks.workunit.client.0.smithi100.stdout:6/809: dread d12/d14/d1c/f3a [0,4194304] 0 2024-09-13T02:50:35.136 INFO:tasks.workunit.client.0.smithi100.stdout:9/689: mknod dd/ceb 0 2024-09-13T02:50:35.137 INFO:tasks.workunit.client.0.smithi100.stdout:0/753: getdents d2/d9/d6d/d85/dcd 0 2024-09-13T02:50:35.137 INFO:tasks.workunit.client.0.smithi100.stdout:3/850: sync 2024-09-13T02:50:35.139 INFO:tasks.workunit.client.0.smithi100.stdout:7/836: link d3/d16/d55/f9d d3/d16/d3b/da5/f114 0 2024-09-13T02:50:35.139 INFO:tasks.workunit.client.0.smithi100.stdout:7/837: stat d3/d2d/cf8 0 2024-09-13T02:50:35.143 INFO:tasks.workunit.client.0.smithi100.stdout:6/810: rename d12/d14/d1c/d6e/d71/cb4 to d12/d14/d9d/db8/cf6 0 2024-09-13T02:50:35.144 INFO:tasks.workunit.client.0.smithi100.stdout:9/690: symlink dd/d1b/d1d/d43/d5e/dc0/lec 0 2024-09-13T02:50:35.144 INFO:tasks.workunit.client.0.smithi100.stdout:9/691: chown dd 94 1 2024-09-13T02:50:35.144 INFO:tasks.workunit.client.0.smithi100.stdout:9/692: creat dd/d1b/d1d/d43/d5e/fed x:0 0 0 2024-09-13T02:50:35.145 INFO:tasks.workunit.client.0.smithi100.stdout:0/754: truncate d2/dd/db0/fc2 3118602 0 2024-09-13T02:50:35.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/838: stat c2 0 2024-09-13T02:50:35.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/839: chown d3/d5/d1b/d1c/d36/d9c/lbd 0 1 2024-09-13T02:50:35.147 INFO:tasks.workunit.client.0.smithi100.stdout:2/705: getdents d0/db/d21 0 2024-09-13T02:50:35.147 INFO:tasks.workunit.client.0.smithi100.stdout:2/706: getdents d0/db/d21 0 2024-09-13T02:50:35.149 INFO:tasks.workunit.client.0.smithi100.stdout:9/693: symlink dd/d1b/d24/d74/d4e/d58/lee 0 2024-09-13T02:50:35.150 INFO:tasks.workunit.client.0.smithi100.stdout:0/755: symlink d2/d9/d6d/lf3 0 2024-09-13T02:50:35.150 INFO:tasks.workunit.client.0.smithi100.stdout:0/756: read d2/dd/d54/d28/fc7 [2961,96903] 0 2024-09-13T02:50:35.151 INFO:tasks.workunit.client.0.smithi100.stdout:7/840: mkdir d3/d9b/d115 0 2024-09-13T02:50:35.152 INFO:tasks.workunit.client.0.smithi100.stdout:7/841: read d3/d16/d55/d92/da9/dde/fe4 [2166392,83938] 0 2024-09-13T02:50:35.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/707: symlink d0/db/d68/d9a/lce 0 2024-09-13T02:50:35.153 INFO:tasks.workunit.client.0.smithi100.stdout:9/694: rename dd/fc8 to dd/db5/fef 0 2024-09-13T02:50:35.153 INFO:tasks.workunit.client.0.smithi100.stdout:9/695: readlink dd/d1b/d1d/d43/d4f/da5/ld5 0 2024-09-13T02:50:35.154 INFO:tasks.workunit.client.0.smithi100.stdout:0/757: chown d2/dd/db0/d43/d4b/c99 33281 1 2024-09-13T02:50:35.155 INFO:tasks.workunit.client.0.smithi100.stdout:2/708: mkdir d0/db/d68/d6b/da5/dcf 0 2024-09-13T02:50:35.157 INFO:tasks.workunit.client.0.smithi100.stdout:9/696: rename dd/fdf to dd/d1b/d24/da8/da9/ff0 0 2024-09-13T02:50:35.158 INFO:tasks.workunit.client.0.smithi100.stdout:2/709: symlink d0/db/d21/d5a/ld0 0 2024-09-13T02:50:35.158 INFO:tasks.workunit.client.0.smithi100.stdout:2/710: getdents d0/db/dbe/dc3 0 2024-09-13T02:50:35.158 INFO:tasks.workunit.client.0.smithi100.stdout:2/711: fsync d0/db/d79/f8b 0 2024-09-13T02:50:35.158 INFO:tasks.workunit.client.0.smithi100.stdout:2/712: write d0/db/d68/d9a/fc8 [302818,111661] 0 2024-09-13T02:50:35.159 INFO:tasks.workunit.client.0.smithi100.stdout:9/697: symlink dd/d1b/d24/da8/lf1 0 2024-09-13T02:50:35.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/713: creat d0/db/dbe/fd1 x:0 0 0 2024-09-13T02:50:35.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/714: creat d0/db/d68/d6b/d85/fd2 x:0 0 0 2024-09-13T02:50:35.161 INFO:tasks.workunit.client.0.smithi100.stdout:2/715: write d0/db/d21/d57/f59 [1713241,27667] 0 2024-09-13T02:50:35.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/716: mknod d0/db/d3f/cd3 0 2024-09-13T02:50:35.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/717: creat d0/db/d21/d88/fd4 x:0 0 0 2024-09-13T02:50:35.165 INFO:tasks.workunit.client.0.smithi100.stdout:0/758: dread d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:35.167 INFO:tasks.workunit.client.0.smithi100.stdout:7/842: dread d3/d5/f17 [0,4194304] 0 2024-09-13T02:50:35.168 INFO:tasks.workunit.client.0.smithi100.stdout:0/759: mkdir d2/df4 0 2024-09-13T02:50:35.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/851: dwrite d10/d21/d51/f59 [0,4194304] 0 2024-09-13T02:50:35.168 INFO:tasks.workunit.client.0.smithi100.stdout:3/852: chown d10/d21/d51/d5a/d5e/d90/fa0 15593302 1 2024-09-13T02:50:35.168 INFO:tasks.workunit.client.0.smithi100.stdout:7/843: symlink d3/d16/d55/d56/d9e/d9f/de9/d110/l116 0 2024-09-13T02:50:35.172 INFO:tasks.workunit.client.0.smithi100.stdout:0/760: symlink d2/dd/d54/d47/d8a/lf5 0 2024-09-13T02:50:35.172 INFO:tasks.workunit.client.0.smithi100.stdout:0/761: chown d2/dd/d54/fd7 345 1 2024-09-13T02:50:35.173 INFO:tasks.workunit.client.0.smithi100.stdout:4/718: dwrite d3/daf/fe3 [0,4194304] 0 2024-09-13T02:50:35.173 INFO:tasks.workunit.client.0.smithi100.stdout:6/811: dwrite d12/d14/d1c/f77 [0,4194304] 0 2024-09-13T02:50:35.173 INFO:tasks.workunit.client.0.smithi100.stdout:6/812: dread d12/d43/d4b/d4c/f5b [0,4194304] 0 2024-09-13T02:50:35.173 INFO:tasks.workunit.client.0.smithi100.stdout:7/844: getdents d3/d16/db0/dd4 0 2024-09-13T02:50:35.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/845: write d3/d16/d3b/f5d [637935,23197] 0 2024-09-13T02:50:35.174 INFO:tasks.workunit.client.0.smithi100.stdout:7/846: chown d3/d16/d55/d56/d9e/d9f/de9/df0/f108 1063 1 2024-09-13T02:50:35.175 INFO:tasks.workunit.client.0.smithi100.stdout:0/762: mknod d2/dd/d93/da2/da9/de3/cf6 0 2024-09-13T02:50:35.175 INFO:tasks.workunit.client.0.smithi100.stdout:0/763: stat d2/dd/d54/d47 0 2024-09-13T02:50:35.176 INFO:tasks.workunit.client.0.smithi100.stdout:3/853: rmdir d10/d8a 39 2024-09-13T02:50:35.176 INFO:tasks.workunit.client.0.smithi100.stdout:3/854: write f8 [3171132,119476] 0 2024-09-13T02:50:35.176 INFO:tasks.workunit.client.0.smithi100.stdout:3/855: read - d10/fdf zero size 2024-09-13T02:50:35.179 INFO:tasks.workunit.client.0.smithi100.stdout:4/719: mkdir d3/dc/d4b/d9b/db2/df6 0 2024-09-13T02:50:35.179 INFO:tasks.workunit.client.0.smithi100.stdout:2/718: dread d0/db/f12 [0,4194304] 0 2024-09-13T02:50:35.179 INFO:tasks.workunit.client.0.smithi100.stdout:6/813: rmdir d12/d14/d5a 39 2024-09-13T02:50:35.181 INFO:tasks.workunit.client.0.smithi100.stdout:7/847: unlink d3/d2d/c68 0 2024-09-13T02:50:35.181 INFO:tasks.workunit.client.0.smithi100.stdout:7/848: dread - d3/feb zero size 2024-09-13T02:50:35.185 INFO:tasks.workunit.client.0.smithi100.stdout:3/856: creat d10/f119 x:0 0 0 2024-09-13T02:50:35.186 INFO:tasks.workunit.client.0.smithi100.stdout:7/849: creat d3/d16/d55/d56/d9e/d9f/f117 x:0 0 0 2024-09-13T02:50:35.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/857: dread d10/d21/f3b [0,4194304] 0 2024-09-13T02:50:35.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/858: creat d10/dec/f11a x:0 0 0 2024-09-13T02:50:35.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/859: fsync d10/d21/d51/d5a/d5e/da1/fd6 0 2024-09-13T02:50:35.196 INFO:tasks.workunit.client.0.smithi100.stdout:3/860: stat d10/d21/d51/d5a/d5e/d89/fdd 0 2024-09-13T02:50:35.196 INFO:tasks.workunit.client.0.smithi100.stdout:0/764: rmdir d2/dd/d54 39 2024-09-13T02:50:35.198 INFO:tasks.workunit.client.0.smithi100.stdout:3/861: unlink d10/d21/d51/d5a/d5e/f78 0 2024-09-13T02:50:35.199 INFO:tasks.workunit.client.0.smithi100.stdout:0/765: creat d2/dd/d54/ff7 x:0 0 0 2024-09-13T02:50:35.199 INFO:tasks.workunit.client.0.smithi100.stdout:0/766: truncate d2/dd/d54/ff7 149082 0 2024-09-13T02:50:35.199 INFO:tasks.workunit.client.0.smithi100.stdout:0/767: truncate d2/f56 4792237 0 2024-09-13T02:50:35.199 INFO:tasks.workunit.client.0.smithi100.stdout:0/768: fsync d2/d1a/d51/f7d 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/862: mknod d10/d21/d51/c11b 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/863: chown d10/l47 17875 1 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:3/864: write d10/f49 [898484,38865] 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/698: dwrite dd/d1b/da3/fe1 [0,4194304] 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/699: creat dd/d1b/d1d/d43/d4f/da5/ff2 x:0 0 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/700: chown dd/d1b/d24/d74/d4e/d58/fea 15 1 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:9/701: write dd/db5/fef [811284,44629] 0 2024-09-13T02:50:35.200 INFO:tasks.workunit.client.0.smithi100.stdout:0/769: mkdir d2/d9/d6d/d85/dcd/df8 0 2024-09-13T02:50:35.205 INFO:tasks.workunit.client.0.smithi100.stdout:9/702: dread dd/d1b/d1d/f3b [0,4194304] 0 2024-09-13T02:50:35.208 INFO:tasks.workunit.client.0.smithi100.stdout:3/865: link d10/c4a d10/d21/d51/d5a/d5e/d89/dc0/c11c 0 2024-09-13T02:50:35.210 INFO:tasks.workunit.client.0.smithi100.stdout:3/866: symlink d10/d21/d51/d6c/db7/l11d 0 2024-09-13T02:50:35.210 INFO:tasks.workunit.client.0.smithi100.stdout:3/867: creat d10/d21/d51/d5a/d5e/d71/d97/db1/f11e x:0 0 0 2024-09-13T02:50:35.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/868: link d10/d8a/l96 d10/d21/d51/d5a/d73/l11f 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:6/814: dwrite d12/d14/d9d/fd4 [0,4194304] 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:4/720: dwrite d3/dc/d4b/d8a/fe4 [0,4194304] 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:7/850: dwrite d3/d5/d4f/f90 [0,4194304] 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:7/851: chown d3/d16/db0 207 1 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:3/869: unlink d10/f38 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:3/870: creat d10/d21/d51/d6c/db7/f120 x:0 0 0 2024-09-13T02:50:35.216 INFO:tasks.workunit.client.0.smithi100.stdout:3/871: chown d10/d21/d51/c11b 16544585 1 2024-09-13T02:50:35.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/815: creat d12/dcd/ff7 x:0 0 0 2024-09-13T02:50:35.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/816: chown d12/d14/d2f/l41 0 1 2024-09-13T02:50:35.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/817: chown d12/d14/d1c/d6e/d71/c93 1768442 1 2024-09-13T02:50:35.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/818: write d12/d14/d5a/df0/f63 [2028333,1066] 0 2024-09-13T02:50:35.219 INFO:tasks.workunit.client.0.smithi100.stdout:2/719: dwrite d0/db/d21/d88/f49 [4194304,4194304] 0 2024-09-13T02:50:35.219 INFO:tasks.workunit.client.0.smithi100.stdout:2/720: readlink d0/d36/l66 0 2024-09-13T02:50:35.220 INFO:tasks.workunit.client.0.smithi100.stdout:6/819: write d12/d43/d4b/d4c/f9e [348357,24840] 0 2024-09-13T02:50:35.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/721: mkdir d0/dd5 0 2024-09-13T02:50:35.225 INFO:tasks.workunit.client.0.smithi100.stdout:7/852: getdents d3/d16/d55/d56/d9e/d9f 0 2024-09-13T02:50:35.227 INFO:tasks.workunit.client.0.smithi100.stdout:7/853: creat d3/d5/d4f/f118 x:0 0 0 2024-09-13T02:50:35.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/703: dwrite dd/d1b/d21/d86/fda [0,4194304] 0 2024-09-13T02:50:35.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/704: creat dd/d1b/d24/d74/d4e/d58/ff3 x:0 0 0 2024-09-13T02:50:35.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/678: sync 2024-09-13T02:50:35.230 INFO:tasks.workunit.client.0.smithi100.stdout:5/697: sync 2024-09-13T02:50:35.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/807: sync 2024-09-13T02:50:35.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/808: write de/f45 [257983,41554] 0 2024-09-13T02:50:35.230 INFO:tasks.workunit.client.0.smithi100.stdout:1/809: write de/d14/d86/ffe [646717,118567] 0 2024-09-13T02:50:35.230 INFO:tasks.workunit.client.0.smithi100.stdout:7/854: rename d3/d5/d1b/d1c/f7e to d3/d9b/d115/f119 0 2024-09-13T02:50:35.232 INFO:tasks.workunit.client.0.smithi100.stdout:0/770: dwrite d2/dd/d54/d47/d34/d3c/f89 [0,4194304] 0 2024-09-13T02:50:35.232 INFO:tasks.workunit.client.0.smithi100.stdout:2/722: dread d0/db/f12 [0,4194304] 0 2024-09-13T02:50:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:5/698: creat db/de/d3e/d7e/dd8/ff0 x:0 0 0 2024-09-13T02:50:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:5/699: dread - db/de/d3e/fe1 zero size 2024-09-13T02:50:35.234 INFO:tasks.workunit.client.0.smithi100.stdout:5/700: fsync db/de/d1f/d2b/f34 0 2024-09-13T02:50:35.235 INFO:tasks.workunit.client.0.smithi100.stdout:8/679: mkdir df/d13/db5/dc3/df0 0 2024-09-13T02:50:35.241 INFO:tasks.workunit.client.0.smithi100.stdout:4/721: dwrite d3/d6/d9/d9e/fb0 [0,4194304] 0 2024-09-13T02:50:35.243 INFO:tasks.workunit.client.0.smithi100.stdout:5/701: rmdir db/de/d1f/d2b/d9b 39 2024-09-13T02:50:35.245 INFO:tasks.workunit.client.0.smithi100.stdout:8/680: truncate df/d13/d5c/f83 8203590 0 2024-09-13T02:50:35.248 INFO:tasks.workunit.client.0.smithi100.stdout:3/872: dwrite d10/d21/d57/f5b [4194304,4194304] 0 2024-09-13T02:50:35.250 INFO:tasks.workunit.client.0.smithi100.stdout:4/722: mknod d3/d3a/d56/cf7 0 2024-09-13T02:50:35.251 INFO:tasks.workunit.client.0.smithi100.stdout:7/855: dread d3/d16/d3b/f5d [0,4194304] 0 2024-09-13T02:50:35.252 INFO:tasks.workunit.client.0.smithi100.stdout:5/702: rename db/c19 to db/de/d1f/d2b/dbe/cf1 0 2024-09-13T02:50:35.254 INFO:tasks.workunit.client.0.smithi100.stdout:8/681: mkdir df/d13/d21/df1 0 2024-09-13T02:50:35.258 INFO:tasks.workunit.client.0.smithi100.stdout:3/873: mkdir d10/d21/d51/d5a/d5e/d99/d121 0 2024-09-13T02:50:35.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/723: creat d3/d6/d21/d67/ff8 x:0 0 0 2024-09-13T02:50:35.260 INFO:tasks.workunit.client.0.smithi100.stdout:7/856: truncate d3/d16/d55/d92/da9/dd3/ff7 394228 0 2024-09-13T02:50:35.261 INFO:tasks.workunit.client.0.smithi100.stdout:5/703: symlink db/de/d1f/d2b/d9b/lf2 0 2024-09-13T02:50:35.262 INFO:tasks.workunit.client.0.smithi100.stdout:8/682: unlink df/d13/d68/fab 0 2024-09-13T02:50:35.262 INFO:tasks.workunit.client.0.smithi100.stdout:8/683: chown ce 309876675 1 2024-09-13T02:50:35.264 INFO:tasks.workunit.client.0.smithi100.stdout:4/724: link d3/d6/d2f/d7a/cd7 d3/dc/d4b/d52/cf9 0 2024-09-13T02:50:35.264 INFO:tasks.workunit.client.0.smithi100.stdout:4/725: readlink d3/d3a/l97 0 2024-09-13T02:50:35.265 INFO:tasks.workunit.client.0.smithi100.stdout:7/857: mkdir d3/d16/d3b/da5/d11a 0 2024-09-13T02:50:35.266 INFO:tasks.workunit.client.0.smithi100.stdout:8/684: mknod df/d13/d21/d81/cf2 0 2024-09-13T02:50:35.266 INFO:tasks.workunit.client.0.smithi100.stdout:8/685: read - df/d5d/d88/fed zero size 2024-09-13T02:50:35.266 INFO:tasks.workunit.client.0.smithi100.stdout:9/705: dwrite dd/d1b/d1d/d43/f44 [4194304,4194304] 0 2024-09-13T02:50:35.266 INFO:tasks.workunit.client.0.smithi100.stdout:7/858: mkdir d3/d16/db0/d11b 0 2024-09-13T02:50:35.267 INFO:tasks.workunit.client.0.smithi100.stdout:7/859: truncate d3/d16/d55/f109 136986 0 2024-09-13T02:50:35.267 INFO:tasks.workunit.client.0.smithi100.stdout:8/686: mknod df/dbb/cf3 0 2024-09-13T02:50:35.268 INFO:tasks.workunit.client.0.smithi100.stdout:8/687: getdents df/d13/db5/dc3/df0 0 2024-09-13T02:50:35.269 INFO:tasks.workunit.client.0.smithi100.stdout:9/706: mknod dd/d1b/d1d/d43/d5d/cf4 0 2024-09-13T02:50:35.269 INFO:tasks.workunit.client.0.smithi100.stdout:1/810: dwrite de/d14/d44/d7f/f8b [0,4194304] 0 2024-09-13T02:50:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/723: dwrite d0/f19 [0,4194304] 0 2024-09-13T02:50:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/724: chown d0/db/d21/d69 4 1 2024-09-13T02:50:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:1/811: chown de/d14/d44/f47 705 1 2024-09-13T02:50:35.270 INFO:tasks.workunit.client.0.smithi100.stdout:1/812: readlink de/d14/d22/d29/d64/l80 0 2024-09-13T02:50:35.271 INFO:tasks.workunit.client.0.smithi100.stdout:8/688: creat df/d13/db5/dc3/de0/ff4 x:0 0 0 2024-09-13T02:50:35.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/707: link c4 dd/d1b/d27/cf5 0 2024-09-13T02:50:35.272 INFO:tasks.workunit.client.0.smithi100.stdout:9/708: dread dd/d1b/f9d [0,4194304] 0 2024-09-13T02:50:35.273 INFO:tasks.workunit.client.0.smithi100.stdout:2/725: mknod d0/db/d21/d5a/cd6 0 2024-09-13T02:50:35.274 INFO:tasks.workunit.client.0.smithi100.stdout:1/813: mkdir de/d14/d22/d29/d108 0 2024-09-13T02:50:35.276 INFO:tasks.workunit.client.0.smithi100.stdout:8/689: mknod df/d5d/dba/cf5 0 2024-09-13T02:50:35.277 INFO:tasks.workunit.client.0.smithi100.stdout:9/709: mknod dd/d1b/d24/d74/d4e/dc4/cf6 0 2024-09-13T02:50:35.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/690: mknod df/d85/cf6 0 2024-09-13T02:50:35.280 INFO:tasks.workunit.client.0.smithi100.stdout:9/710: symlink dd/d1b/d1d/d28/lf7 0 2024-09-13T02:50:35.280 INFO:tasks.workunit.client.0.smithi100.stdout:3/874: dwrite d10/d21/d57/faa [0,4194304] 0 2024-09-13T02:50:35.281 INFO:tasks.workunit.client.0.smithi100.stdout:4/726: dwrite d3/d6/d21/d46/d2d/d42/fa5 [0,4194304] 0 2024-09-13T02:50:35.281 INFO:tasks.workunit.client.0.smithi100.stdout:8/691: truncate df/d5d/fa8 689606 0 2024-09-13T02:50:35.286 INFO:tasks.workunit.client.0.smithi100.stdout:3/875: link d10/d21/c3f d10/d21/d51/d5a/d5e/d71/d94/c122 0 2024-09-13T02:50:35.287 INFO:tasks.workunit.client.0.smithi100.stdout:3/876: dread - d10/ded/f112 zero size 2024-09-13T02:50:35.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/692: symlink df/dac/lf7 0 2024-09-13T02:50:35.288 INFO:tasks.workunit.client.0.smithi100.stdout:8/693: rename df/d5d to df/d5d/df8 22 2024-09-13T02:50:35.288 INFO:tasks.workunit.client.0.smithi100.stdout:4/727: dread d3/dc/d4b/d52/dda/d99/fe7 [0,4194304] 0 2024-09-13T02:50:35.290 INFO:tasks.workunit.client.0.smithi100.stdout:8/694: creat df/d13/d21/d81/db0/da3/ff9 x:0 0 0 2024-09-13T02:50:35.291 INFO:tasks.workunit.client.0.smithi100.stdout:8/695: write df/d13/d20/d98/fdf [355816,63209] 0 2024-09-13T02:50:35.291 INFO:tasks.workunit.client.0.smithi100.stdout:8/696: truncate df/d13/d21/d81/db0/fd5 748233 0 2024-09-13T02:50:35.293 INFO:tasks.workunit.client.0.smithi100.stdout:3/877: unlink d10/d21/d51/d5a/l5c 0 2024-09-13T02:50:35.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/860: truncate d3/d16/d55/d92/da9/dd3/ff7 781250 0 2024-09-13T02:50:35.297 INFO:tasks.workunit.client.0.smithi100.stdout:7/861: creat d3/d16/d55/d92/da9/dd3/f11c x:0 0 0 2024-09-13T02:50:35.298 INFO:tasks.workunit.client.0.smithi100.stdout:7/862: write d3/d16/d55/d56/d9e/d9f/fef [218450,33176] 0 2024-09-13T02:50:35.299 INFO:tasks.workunit.client.0.smithi100.stdout:8/697: creat df/d5d/d70/ffa x:0 0 0 2024-09-13T02:50:35.299 INFO:tasks.workunit.client.0.smithi100.stdout:9/711: dwrite dd/d1b/d24/da8/da9/ff0 [0,4194304] 0 2024-09-13T02:50:35.300 INFO:tasks.workunit.client.0.smithi100.stdout:9/712: creat dd/d1b/d21/ff8 x:0 0 0 2024-09-13T02:50:35.300 INFO:tasks.workunit.client.0.smithi100.stdout:4/728: getdents d3/dc/d4b/d8a 0 2024-09-13T02:50:35.301 INFO:tasks.workunit.client.0.smithi100.stdout:8/698: dread df/d5d/d88/f90 [0,4194304] 0 2024-09-13T02:50:35.301 INFO:tasks.workunit.client.0.smithi100.stdout:8/699: dread - df/d5d/d70/f91 zero size 2024-09-13T02:50:35.303 INFO:tasks.workunit.client.0.smithi100.stdout:7/863: unlink d3/d16/c19 0 2024-09-13T02:50:35.305 INFO:tasks.workunit.client.0.smithi100.stdout:3/878: dread d10/d21/d51/f55 [0,4194304] 0 2024-09-13T02:50:35.306 INFO:tasks.workunit.client.0.smithi100.stdout:3/879: dread - d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fe4 zero size 2024-09-13T02:50:35.306 INFO:tasks.workunit.client.0.smithi100.stdout:3/880: write d10/d21/d51/d5a/d5e/d89/dc0/fe8 [5150313,118636] 0 2024-09-13T02:50:35.307 INFO:tasks.workunit.client.0.smithi100.stdout:4/729: creat d3/dc/d4b/d7c/ffa x:0 0 0 2024-09-13T02:50:35.308 INFO:tasks.workunit.client.0.smithi100.stdout:4/730: dread - d3/dc/d88/fed zero size 2024-09-13T02:50:35.308 INFO:tasks.workunit.client.0.smithi100.stdout:9/713: dread dd/d1b/d1d/d43/d5e/dc0/fdd [0,4194304] 0 2024-09-13T02:50:35.308 INFO:tasks.workunit.client.0.smithi100.stdout:7/864: creat d3/d16/d3b/da5/d87/f11d x:0 0 0 2024-09-13T02:50:35.310 INFO:tasks.workunit.client.0.smithi100.stdout:3/881: creat d10/d21/d51/d5a/d5e/f123 x:0 0 0 2024-09-13T02:50:35.310 INFO:tasks.workunit.client.0.smithi100.stdout:3/882: write d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/fe4 [528017,111235] 0 2024-09-13T02:50:35.311 INFO:tasks.workunit.client.0.smithi100.stdout:4/731: mkdir d3/daf/dfb 0 2024-09-13T02:50:35.311 INFO:tasks.workunit.client.0.smithi100.stdout:4/732: readlink d3/dc/d4b/d52/dd1/lde 0 2024-09-13T02:50:35.312 INFO:tasks.workunit.client.0.smithi100.stdout:9/714: symlink dd/db5/lf9 0 2024-09-13T02:50:35.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/883: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/d104/f124 x:0 0 0 2024-09-13T02:50:35.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/884: write d10/d21/d51/d6c/f83 [51964,80928] 0 2024-09-13T02:50:35.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/885: truncate d10/d21/d51/d5a/d5e/d89/f10c 425662 0 2024-09-13T02:50:35.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/886: truncate d10/d21/f5d 681544 0 2024-09-13T02:50:35.315 INFO:tasks.workunit.client.0.smithi100.stdout:3/887: chown d10/f2b 334 1 2024-09-13T02:50:35.316 INFO:tasks.workunit.client.0.smithi100.stdout:4/733: creat d3/d63/dae/ffc x:0 0 0 2024-09-13T02:50:35.316 INFO:tasks.workunit.client.0.smithi100.stdout:4/734: creat d3/dc/d88/ffd x:0 0 0 2024-09-13T02:50:35.318 INFO:tasks.workunit.client.0.smithi100.stdout:4/735: mkdir d3/d6/d2f/d60/dfe 0 2024-09-13T02:50:35.320 INFO:tasks.workunit.client.0.smithi100.stdout:4/736: getdents d3/d6/d9/d9e 0 2024-09-13T02:50:35.320 INFO:tasks.workunit.client.0.smithi100.stdout:4/737: fsync d3/dc/d4b/d52/dd1/fdc 0 2024-09-13T02:50:35.321 INFO:tasks.workunit.client.0.smithi100.stdout:7/865: dread d3/d5/d1b/d1c/f39 [0,4194304] 0 2024-09-13T02:50:35.321 INFO:tasks.workunit.client.0.smithi100.stdout:7/866: creat d3/d16/d55/d92/da9/dde/f11e x:0 0 0 2024-09-13T02:50:35.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/726: dwrite d0/db/d3f/d6a/d7f/dbb/fc1 [0,4194304] 0 2024-09-13T02:50:35.322 INFO:tasks.workunit.client.0.smithi100.stdout:1/814: dwrite de/d14/d22/d29/d64/f7e [0,4194304] 0 2024-09-13T02:50:35.323 INFO:tasks.workunit.client.0.smithi100.stdout:4/738: unlink d3/dc/f48 0 2024-09-13T02:50:35.324 INFO:tasks.workunit.client.0.smithi100.stdout:4/739: write d3/d6/d21/d46/f83 [4735302,17634] 0 2024-09-13T02:50:35.325 INFO:tasks.workunit.client.0.smithi100.stdout:7/867: write d3/d5/fe0 [811629,123892] 0 2024-09-13T02:50:35.325 INFO:tasks.workunit.client.0.smithi100.stdout:9/715: dread dd/f76 [0,4194304] 0 2024-09-13T02:50:35.325 INFO:tasks.workunit.client.0.smithi100.stdout:8/700: dwrite df/f6c [0,4194304] 0 2024-09-13T02:50:35.326 INFO:tasks.workunit.client.0.smithi100.stdout:9/716: creat dd/d1b/d27/ffa x:0 0 0 2024-09-13T02:50:35.328 INFO:tasks.workunit.client.0.smithi100.stdout:4/740: write d3/dc/d4b/d9b/fe9 [1165247,60244] 0 2024-09-13T02:50:35.329 INFO:tasks.workunit.client.0.smithi100.stdout:2/727: rename d0/d36/d8a/l97 to d0/db/d3f/d6a/ld7 0 2024-09-13T02:50:35.330 INFO:tasks.workunit.client.0.smithi100.stdout:7/868: rmdir d3/d16/d89/d94 39 2024-09-13T02:50:35.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/701: unlink df/d13/d20/da2/ce8 0 2024-09-13T02:50:35.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/702: write df/d13/f14 [311233,74486] 0 2024-09-13T02:50:35.333 INFO:tasks.workunit.client.0.smithi100.stdout:9/717: symlink dd/d1b/d1d/d28/lfb 0 2024-09-13T02:50:35.336 INFO:tasks.workunit.client.0.smithi100.stdout:3/888: dwrite d10/d21/d57/f5b [4194304,4194304] 0 2024-09-13T02:50:35.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/815: rename de/d14/d22/dfa/dd3/f6c to de/d14/d2e/d60/f109 0 2024-09-13T02:50:35.338 INFO:tasks.workunit.client.0.smithi100.stdout:7/869: mknod d3/d16/d3b/d8c/c11f 0 2024-09-13T02:50:35.338 INFO:tasks.workunit.client.0.smithi100.stdout:7/870: read d3/d16/d3b/f5d [2609518,113090] 0 2024-09-13T02:50:35.340 INFO:tasks.workunit.client.0.smithi100.stdout:4/741: dread d3/d6/d2f/d7a/fca [0,4194304] 0 2024-09-13T02:50:35.340 INFO:tasks.workunit.client.0.smithi100.stdout:4/742: chown d3/d6/d21/d46/lee 50 1 2024-09-13T02:50:35.340 INFO:tasks.workunit.client.0.smithi100.stdout:4/743: truncate d3/d63/f6a 6197496 0 2024-09-13T02:50:35.341 INFO:tasks.workunit.client.0.smithi100.stdout:4/744: readlink d3/dc/d88/lb1 0 2024-09-13T02:50:35.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/703: link df/d5d/d88/f8a df/d13/d21/d81/d93/ffb 0 2024-09-13T02:50:35.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/704: getdents df/d5d/d70/d2c/de3 0 2024-09-13T02:50:35.342 INFO:tasks.workunit.client.0.smithi100.stdout:8/705: fsync df/d5d/d70/f91 0 2024-09-13T02:50:35.351 INFO:tasks.workunit.client.0.smithi100.stdout:3/889: write d10/d21/d51/d5a/d5e/d99/fe5 [25401,90747] 0 2024-09-13T02:50:35.351 INFO:tasks.workunit.client.0.smithi100.stdout:3/890: truncate d10/d8a/f117 119822 0 2024-09-13T02:50:35.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/728: rename d0/db/l51 to d0/db/d21/d88/ld8 0 2024-09-13T02:50:35.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/729: chown d0/db/d68/d6b/d85/fc4 765867 1 2024-09-13T02:50:35.353 INFO:tasks.workunit.client.0.smithi100.stdout:2/730: creat d0/db/d21/d88/fd9 x:0 0 0 2024-09-13T02:50:35.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/706: getdents df/d6f 0 2024-09-13T02:50:35.354 INFO:tasks.workunit.client.0.smithi100.stdout:8/707: write f2 [9436710,99549] 0 2024-09-13T02:50:35.355 INFO:tasks.workunit.client.0.smithi100.stdout:3/891: stat d10/c14 0 2024-09-13T02:50:35.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/708: unlink df/d5d/d88/ld6 0 2024-09-13T02:50:35.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/816: dwrite de/d14/d22/d29/d64/f89 [0,4194304] 0 2024-09-13T02:50:35.361 INFO:tasks.workunit.client.0.smithi100.stdout:9/718: dwrite dd/d1b/d24/da8/fe5 [0,4194304] 0 2024-09-13T02:50:35.361 INFO:tasks.workunit.client.0.smithi100.stdout:4/745: dwrite d3/d6/d2f/f9c [0,4194304] 0 2024-09-13T02:50:35.361 INFO:tasks.workunit.client.0.smithi100.stdout:8/709: mkdir df/d13/d20/d98/dfc 0 2024-09-13T02:50:35.369 INFO:tasks.workunit.client.0.smithi100.stdout:4/746: getdents d3/d6/d21/d46/d2d 0 2024-09-13T02:50:35.371 INFO:tasks.workunit.client.0.smithi100.stdout:8/710: symlink df/d13/d20/da2/lfd 0 2024-09-13T02:50:35.371 INFO:tasks.workunit.client.0.smithi100.stdout:8/711: write df/d13/d21/d81/d93/ffb [623844,30] 0 2024-09-13T02:50:35.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/892: rmdir d10/d21/d51/d107 0 2024-09-13T02:50:35.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/893: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/d104/f125 x:0 0 0 2024-09-13T02:50:35.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/894: read - d10/dec/f11a zero size 2024-09-13T02:50:35.373 INFO:tasks.workunit.client.0.smithi100.stdout:3/895: stat d10/d21/f56 0 2024-09-13T02:50:35.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/731: dwrite d0/db/f16 [0,4194304] 0 2024-09-13T02:50:35.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/732: write d0/d36/f75 [1286896,46083] 0 2024-09-13T02:50:35.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/733: getdents d0/db/d21 0 2024-09-13T02:50:35.377 INFO:tasks.workunit.client.0.smithi100.stdout:2/734: creat d0/d36/fda x:0 0 0 2024-09-13T02:50:35.378 INFO:tasks.workunit.client.0.smithi100.stdout:3/896: mkdir d10/d21/d51/d126 0 2024-09-13T02:50:35.379 INFO:tasks.workunit.client.0.smithi100.stdout:7/871: dwrite d3/d5/fd5 [0,4194304] 0 2024-09-13T02:50:35.385 INFO:tasks.workunit.client.0.smithi100.stdout:7/872: symlink d3/d5/l120 0 2024-09-13T02:50:35.387 INFO:tasks.workunit.client.0.smithi100.stdout:0/771: sync 2024-09-13T02:50:35.387 INFO:tasks.workunit.client.0.smithi100.stdout:6/820: sync 2024-09-13T02:50:35.388 INFO:tasks.workunit.client.0.smithi100.stdout:7/873: rename d3/d5/d1b/l2b to d3/d5/d1b/d1c/d36/d9c/l121 0 2024-09-13T02:50:35.390 INFO:tasks.workunit.client.0.smithi100.stdout:0/772: mkdir d2/dd/d54/d47/d34/d91/df9 0 2024-09-13T02:50:35.392 INFO:tasks.workunit.client.0.smithi100.stdout:7/874: rename d3/d16/d55/d56/d9e/d9f/c113 to d3/d5/d4f/c122 0 2024-09-13T02:50:35.392 INFO:tasks.workunit.client.0.smithi100.stdout:0/773: truncate d2/dd/d54/d3e/d5d/f6b 280821 0 2024-09-13T02:50:35.393 INFO:tasks.workunit.client.0.smithi100.stdout:4/747: write d3/d6/d21/d46/f5e [2990677,63035] 0 2024-09-13T02:50:35.393 INFO:tasks.workunit.client.0.smithi100.stdout:0/774: dread d2/dd/d54/d28/fc7 [0,4194304] 0 2024-09-13T02:50:35.394 INFO:tasks.workunit.client.0.smithi100.stdout:0/775: write d2/dd/db0/d3b/f40 [1403823,2050] 0 2024-09-13T02:50:35.395 INFO:tasks.workunit.client.0.smithi100.stdout:4/748: rename d3/d3a/lc5 to d3/d6/d21/lff 0 2024-09-13T02:50:35.398 INFO:tasks.workunit.client.0.smithi100.stdout:4/749: symlink d3/d6/d21/d46/d2d/d58/l100 0 2024-09-13T02:50:35.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/897: dread fc [0,4194304] 0 2024-09-13T02:50:35.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/898: chown d10/d21/c3f 3844984 1 2024-09-13T02:50:35.399 INFO:tasks.workunit.client.0.smithi100.stdout:3/899: write d10/d21/d51/d5a/d5e/d71/d97/db1/f11e [696991,6062] 0 2024-09-13T02:50:35.400 INFO:tasks.workunit.client.0.smithi100.stdout:3/900: creat d10/d21/d51/d5a/d5e/d71/d97/f127 x:0 0 0 2024-09-13T02:50:35.401 INFO:tasks.workunit.client.0.smithi100.stdout:0/776: rename d2/dd/db0/d43 to d2/dd/d54/d47/d8a/dfa 0 2024-09-13T02:50:35.401 INFO:tasks.workunit.client.0.smithi100.stdout:0/777: truncate d2/d1a/f88 1702795 0 2024-09-13T02:50:35.402 INFO:tasks.workunit.client.0.smithi100.stdout:1/817: dwrite de/d14/d2e/d48/f50 [0,4194304] 0 2024-09-13T02:50:35.402 INFO:tasks.workunit.client.0.smithi100.stdout:3/901: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/d128 0 2024-09-13T02:50:35.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/818: rename de/d14/d22/d52/d65/cb6 to de/d14/df5/c10a 0 2024-09-13T02:50:35.404 INFO:tasks.workunit.client.0.smithi100.stdout:1/819: read de/d14/d22/d29/d64/f99 [837316,32881] 0 2024-09-13T02:50:35.405 INFO:tasks.workunit.client.0.smithi100.stdout:0/778: symlink d2/dd/d54/d47/d8a/dfa/d4b/lfb 0 2024-09-13T02:50:35.405 INFO:tasks.workunit.client.0.smithi100.stdout:0/779: write d2/d9/f86 [1352103,38147] 0 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/820: mkdir de/d14/d2e/d48/d10b 0 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/821: chown de/d14/d22/dfa/dd3/l3f 2908420 1 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/822: write de/d14/d22/d52/d65/f6f [1217726,76731] 0 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/823: fdatasync de/d14/d2e/d48/fe3 0 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:1/824: readlink de/d14/d22/d52/lbe 0 2024-09-13T02:50:35.406 INFO:tasks.workunit.client.0.smithi100.stdout:0/780: stat d2/dd/d54/d47/d34/cd4 0 2024-09-13T02:50:35.408 INFO:tasks.workunit.client.0.smithi100.stdout:1/825: rename de/d12/f33 to de/d14/d44/d7f/f10c 0 2024-09-13T02:50:35.408 INFO:tasks.workunit.client.0.smithi100.stdout:1/826: write de/d14/d2e/d48/fc7 [7525116,58055] 0 2024-09-13T02:50:35.408 INFO:tasks.workunit.client.0.smithi100.stdout:1/827: chown de/d14/d22/dfa/dd3 0 1 2024-09-13T02:50:35.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/828: mkdir de/d14/d22/d29/d68/d10d 0 2024-09-13T02:50:35.409 INFO:tasks.workunit.client.0.smithi100.stdout:9/719: dwrite dd/d1b/d1d/d28/f54 [0,4194304] 0 2024-09-13T02:50:35.409 INFO:tasks.workunit.client.0.smithi100.stdout:2/735: dwrite d0/db/d21/f47 [0,4194304] 0 2024-09-13T02:50:35.410 INFO:tasks.workunit.client.0.smithi100.stdout:0/781: mknod d2/dd/d54/cfc 0 2024-09-13T02:50:35.410 INFO:tasks.workunit.client.0.smithi100.stdout:0/782: write d2/dd/db0/d3b/f67 [1236650,67052] 0 2024-09-13T02:50:35.412 INFO:tasks.workunit.client.0.smithi100.stdout:1/829: mkdir de/d14/d2e/d75/d10e 0 2024-09-13T02:50:35.412 INFO:tasks.workunit.client.0.smithi100.stdout:1/830: write de/d14/d2e/d48/fc7 [7111019,86447] 0 2024-09-13T02:50:35.413 INFO:tasks.workunit.client.0.smithi100.stdout:2/736: getdents d0/db/d68/d6b/da5/d8f 0 2024-09-13T02:50:35.414 INFO:tasks.workunit.client.0.smithi100.stdout:8/712: dwrite df/d13/d21/d81/f8d [0,4194304] 0 2024-09-13T02:50:35.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/704: sync 2024-09-13T02:50:35.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/705: chown db/de/d3e/dc3 2910487 1 2024-09-13T02:50:35.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/706: dread - db/de/d3e/da2/fea zero size 2024-09-13T02:50:35.415 INFO:tasks.workunit.client.0.smithi100.stdout:5/707: fdatasync db/de/ddc/fed 0 2024-09-13T02:50:35.416 INFO:tasks.workunit.client.0.smithi100.stdout:3/902: write d10/d21/d51/d6c/f6d [1796839,50793] 0 2024-09-13T02:50:35.418 INFO:tasks.workunit.client.0.smithi100.stdout:7/875: dread d3/fc [0,4194304] 0 2024-09-13T02:50:35.418 INFO:tasks.workunit.client.0.smithi100.stdout:8/713: mknod df/d13/d21/d81/d93/cfe 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:5/708: truncate db/de/d3e/dc3/fd0 621308 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/821: dwrite d12/d14/f57 [0,4194304] 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/822: truncate d12/d14/d1c/d7b/da6/fc9 294938 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/823: fsync d12/d2e/d90/da2/dbc/fc0 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:1/831: dread de/d14/d22/f9a [0,4194304] 0 2024-09-13T02:50:35.420 INFO:tasks.workunit.client.0.smithi100.stdout:0/783: dread d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:35.422 INFO:tasks.workunit.client.0.smithi100.stdout:2/737: getdents d0/d36/d8a 0 2024-09-13T02:50:35.429 INFO:tasks.workunit.client.0.smithi100.stdout:3/903: mkdir d10/d21/d129 0 2024-09-13T02:50:35.433 INFO:tasks.workunit.client.0.smithi100.stdout:5/709: rename db/de/d1f/d78/c82 to db/de/d1f/d78/cf3 0 2024-09-13T02:50:35.433 INFO:tasks.workunit.client.0.smithi100.stdout:5/710: stat db/de/d1f/d2b/f2d 0 2024-09-13T02:50:35.433 INFO:tasks.workunit.client.0.smithi100.stdout:5/711: creat db/de/d3e/d7e/dd8/ff4 x:0 0 0 2024-09-13T02:50:35.433 INFO:tasks.workunit.client.0.smithi100.stdout:5/712: dread - db/de/d63/fb0 zero size 2024-09-13T02:50:35.434 INFO:tasks.workunit.client.0.smithi100.stdout:9/720: dwrite dd/d1b/d27/fc7 [0,4194304] 0 2024-09-13T02:50:35.437 INFO:tasks.workunit.client.0.smithi100.stdout:4/750: dwrite f0 [4194304,4194304] 0 2024-09-13T02:50:35.437 INFO:tasks.workunit.client.0.smithi100.stdout:4/751: creat d3/d6/d21/d67/f101 x:0 0 0 2024-09-13T02:50:35.437 INFO:tasks.workunit.client.0.smithi100.stdout:1/832: truncate de/d14/f41 2826353 0 2024-09-13T02:50:35.438 INFO:tasks.workunit.client.0.smithi100.stdout:2/738: mkdir d0/db/d68/d6b/d85/ddb 0 2024-09-13T02:50:35.445 INFO:tasks.workunit.client.0.smithi100.stdout:7/876: link d3/d5/f53 d3/d16/d3b/da5/df5/f123 0 2024-09-13T02:50:35.447 INFO:tasks.workunit.client.0.smithi100.stdout:5/713: rename db/de/d1f/l9f to db/de/d3e/da2/lf5 0 2024-09-13T02:50:35.448 INFO:tasks.workunit.client.0.smithi100.stdout:5/714: fsync db/de/fbd 0 2024-09-13T02:50:35.449 INFO:tasks.workunit.client.0.smithi100.stdout:1/833: truncate de/f4f 15117 0 2024-09-13T02:50:35.449 INFO:tasks.workunit.client.0.smithi100.stdout:2/739: truncate d0/d36/f9d 67603 0 2024-09-13T02:50:35.452 INFO:tasks.workunit.client.0.smithi100.stdout:0/784: dwrite d2/dd/d54/d47/d34/f39 [0,4194304] 0 2024-09-13T02:50:35.452 INFO:tasks.workunit.client.0.smithi100.stdout:6/824: dwrite d12/d14/d1c/d6e/f8b [0,4194304] 0 2024-09-13T02:50:35.455 INFO:tasks.workunit.client.0.smithi100.stdout:4/752: dwrite d3/d6/fab [0,4194304] 0 2024-09-13T02:50:35.455 INFO:tasks.workunit.client.0.smithi100.stdout:3/904: link d10/c14 d10/d8a/c12a 0 2024-09-13T02:50:35.458 INFO:tasks.workunit.client.0.smithi100.stdout:7/877: creat d3/d16/db0/f124 x:0 0 0 2024-09-13T02:50:35.459 INFO:tasks.workunit.client.0.smithi100.stdout:9/721: rename dd/d1b/d1d/d43/d5d/cf4 to dd/d1b/d27/d51/de9/cfc 0 2024-09-13T02:50:35.459 INFO:tasks.workunit.client.0.smithi100.stdout:9/722: creat dd/d1b/d1d/d43/d4f/da5/ffd x:0 0 0 2024-09-13T02:50:35.459 INFO:tasks.workunit.client.0.smithi100.stdout:9/723: creat dd/d1b/d24/da8/ffe x:0 0 0 2024-09-13T02:50:35.460 INFO:tasks.workunit.client.0.smithi100.stdout:9/724: chown dd/d1b/d27/f63 124314088 1 2024-09-13T02:50:35.460 INFO:tasks.workunit.client.0.smithi100.stdout:5/715: mknod db/de/d3e/da2/cf6 0 2024-09-13T02:50:35.461 INFO:tasks.workunit.client.0.smithi100.stdout:2/740: mknod d0/d36/d8a/cdc 0 2024-09-13T02:50:35.463 INFO:tasks.workunit.client.0.smithi100.stdout:5/716: dread db/de/d3e/da2/dac/fc8 [0,4194304] 0 2024-09-13T02:50:35.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/785: rename d2/d1a/l2c to d2/dd/d54/d47/d34/d91/lfd 0 2024-09-13T02:50:35.469 INFO:tasks.workunit.client.0.smithi100.stdout:4/753: rename d3/dc/d4b to d3/dc/d4b/d52/dda/d99/d102 22 2024-09-13T02:50:35.472 INFO:tasks.workunit.client.0.smithi100.stdout:9/725: mknod dd/d1b/d1d/d43/d4f/cff 0 2024-09-13T02:50:35.472 INFO:tasks.workunit.client.0.smithi100.stdout:2/741: dread d0/db/f16 [0,4194304] 0 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/834: dwrite de/d14/d2e/d48/ff4 [0,4194304] 0 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/835: stat de/d14/d44/d7f/dc2 0 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:1/836: fdatasync de/d14/d22/d52/db8/faa 0 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/717: write db/de/f7b [4877549,120276] 0 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/718: chown db/de/d63/d9c 23012544 1 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/719: chown db/c2e 1238415 1 2024-09-13T02:50:35.475 INFO:tasks.workunit.client.0.smithi100.stdout:2/742: symlink d0/db/d79/ldd 0 2024-09-13T02:50:35.476 INFO:tasks.workunit.client.0.smithi100.stdout:0/786: symlink d2/dd/d54/d47/d8a/dfa/d4b/lfe 0 2024-09-13T02:50:35.477 INFO:tasks.workunit.client.0.smithi100.stdout:9/726: mkdir dd/d100 0 2024-09-13T02:50:35.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/825: dwrite d12/d43/d4b/d4c/fb3 [0,4194304] 0 2024-09-13T02:50:35.479 INFO:tasks.workunit.client.0.smithi100.stdout:6/826: chown d12/d14/d5a/df0/f38 0 1 2024-09-13T02:50:35.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/837: mknod de/d14/d44/d61/ded/df7/c10f 0 2024-09-13T02:50:35.480 INFO:tasks.workunit.client.0.smithi100.stdout:1/838: dread - de/d14/d22/d52/d65/dc6/fee zero size 2024-09-13T02:50:35.482 INFO:tasks.workunit.client.0.smithi100.stdout:5/720: mknod db/de/d3e/da2/dac/cf7 0 2024-09-13T02:50:35.484 INFO:tasks.workunit.client.0.smithi100.stdout:2/743: symlink d0/db/d3f/d6a/lde 0 2024-09-13T02:50:35.484 INFO:tasks.workunit.client.0.smithi100.stdout:3/905: dwrite d10/d21/d51/d5a/d5e/d71/d97/ff2 [0,4194304] 0 2024-09-13T02:50:35.485 INFO:tasks.workunit.client.0.smithi100.stdout:3/906: readlink d10/d21/ld9 0 2024-09-13T02:50:35.485 INFO:tasks.workunit.client.0.smithi100.stdout:0/787: mkdir d2/dd/d93/da2/dff 0 2024-09-13T02:50:35.486 INFO:tasks.workunit.client.0.smithi100.stdout:9/727: creat dd/d1b/d24/da8/da9/f101 x:0 0 0 2024-09-13T02:50:35.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/827: mknod d12/d14/d1c/d6e/d71/cf8 0 2024-09-13T02:50:35.487 INFO:tasks.workunit.client.0.smithi100.stdout:6/828: chown d12/d14/d5a/df0 0 1 2024-09-13T02:50:35.489 INFO:tasks.workunit.client.0.smithi100.stdout:3/907: symlink d10/d21/d51/d5a/d5e/d99/l12b 0 2024-09-13T02:50:35.491 INFO:tasks.workunit.client.0.smithi100.stdout:4/754: dwrite d3/d6/d21/d46/d2d/d42/fa5 [4194304,4194304] 0 2024-09-13T02:50:35.492 INFO:tasks.workunit.client.0.smithi100.stdout:4/755: write d3/d63/dae/ffc [507026,25185] 0 2024-09-13T02:50:35.492 INFO:tasks.workunit.client.0.smithi100.stdout:0/788: rename d2/dd/fc1 to d2/dd/d54/d47/f100 0 2024-09-13T02:50:35.492 INFO:tasks.workunit.client.0.smithi100.stdout:9/728: symlink dd/d1b/d1d/l102 0 2024-09-13T02:50:35.493 INFO:tasks.workunit.client.0.smithi100.stdout:9/729: truncate dd/d1b/d24/f67 2386733 0 2024-09-13T02:50:35.493 INFO:tasks.workunit.client.0.smithi100.stdout:6/829: symlink d12/d2e/d90/d92/lf9 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/839: getdents de/d14 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/840: write de/d14/d44/d61/ded/df7/f100 [311691,128044] 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/841: write de/d14/f41 [3255933,35678] 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/842: stat de/d14/d22/d29/d64 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/843: readlink de/d14/d22/d52/d65/lde 0 2024-09-13T02:50:35.495 INFO:tasks.workunit.client.0.smithi100.stdout:1/844: chown de/d14/d22/d29/d64/f7e 3273001 1 2024-09-13T02:50:35.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/845: write de/d14/d22/d52/d7a/d81/de0/ff1 [1302853,119980] 0 2024-09-13T02:50:35.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/846: readlink de/d12/l1d 0 2024-09-13T02:50:35.496 INFO:tasks.workunit.client.0.smithi100.stdout:1/847: dread de/d14/d22/dfa/dd3/f78 [0,4194304] 0 2024-09-13T02:50:35.496 INFO:tasks.workunit.client.0.smithi100.stdout:3/908: mkdir d10/d21/d51/d126/d12c 0 2024-09-13T02:50:35.498 INFO:tasks.workunit.client.0.smithi100.stdout:4/756: truncate d3/dc/d88/db4/fcd 3770753 0 2024-09-13T02:50:35.499 INFO:tasks.workunit.client.0.smithi100.stdout:9/730: truncate dd/d1b/d1d/d28/f54 3088023 0 2024-09-13T02:50:35.501 INFO:tasks.workunit.client.0.smithi100.stdout:6/830: mknod d12/d2e/d90/da2/dbc/dce/dd6/cfa 0 2024-09-13T02:50:35.501 INFO:tasks.workunit.client.0.smithi100.stdout:3/909: truncate fc 374044 0 2024-09-13T02:50:35.501 INFO:tasks.workunit.client.0.smithi100.stdout:3/910: write d10/ded/f101 [553305,62256] 0 2024-09-13T02:50:35.503 INFO:tasks.workunit.client.0.smithi100.stdout:1/848: link de/d14/d44/d61/da9/db7/fcd de/d14/d86/dd1/f110 0 2024-09-13T02:50:35.505 INFO:tasks.workunit.client.0.smithi100.stdout:9/731: mknod dd/db5/c103 0 2024-09-13T02:50:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:4/757: dread d3/d6/d2f/f9c [0,4194304] 0 2024-09-13T02:50:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:4/758: write d3/dc/d4b/f86 [363315,53782] 0 2024-09-13T02:50:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/911: creat d10/d21/d51/d6c/dd3/f12d x:0 0 0 2024-09-13T02:50:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/912: creat d10/d21/d51/d5a/d5e/d89/dc0/f12e x:0 0 0 2024-09-13T02:50:35.506 INFO:tasks.workunit.client.0.smithi100.stdout:3/913: readlink d10/d21/d51/d5a/d5e/d71/d94/d9c/la9 0 2024-09-13T02:50:35.509 INFO:tasks.workunit.client.0.smithi100.stdout:9/732: creat dd/d1b/d1d/dad/f104 x:0 0 0 2024-09-13T02:50:35.509 INFO:tasks.workunit.client.0.smithi100.stdout:9/733: fdatasync dd/d1b/d24/d74/f38 0 2024-09-13T02:50:35.509 INFO:tasks.workunit.client.0.smithi100.stdout:9/734: creat dd/d1b/d1d/d43/d5e/f105 x:0 0 0 2024-09-13T02:50:35.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/759: unlink d3/d6/d21/d46/f39 0 2024-09-13T02:50:35.511 INFO:tasks.workunit.client.0.smithi100.stdout:4/760: read - d3/dc/d4b/d52/f8c zero size 2024-09-13T02:50:35.514 INFO:tasks.workunit.client.0.smithi100.stdout:3/914: link d10/d8a/c12a d10/d21/d51/c12f 0 2024-09-13T02:50:35.519 INFO:tasks.workunit.client.0.smithi100.stdout:3/915: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/d130 0 2024-09-13T02:50:35.519 INFO:tasks.workunit.client.0.smithi100.stdout:3/916: chown d10/d21/d51/d5a/d5e/d71/d97/db1/cde 118 1 2024-09-13T02:50:35.520 INFO:tasks.workunit.client.0.smithi100.stdout:0/789: dwrite d2/dd/d54/d47/d34/f2b [0,4194304] 0 2024-09-13T02:50:35.521 INFO:tasks.workunit.client.0.smithi100.stdout:3/917: creat d10/d21/d51/d5a/d5e/d99/f131 x:0 0 0 2024-09-13T02:50:35.521 INFO:tasks.workunit.client.0.smithi100.stdout:3/918: chown d10/d21/d51/d5a/d5e/d71/d93/l10e 5676 1 2024-09-13T02:50:35.523 INFO:tasks.workunit.client.0.smithi100.stdout:0/790: truncate d2/f11 48928 0 2024-09-13T02:50:35.524 INFO:tasks.workunit.client.0.smithi100.stdout:3/919: mknod d10/d8a/c132 0 2024-09-13T02:50:35.526 INFO:tasks.workunit.client.0.smithi100.stdout:3/920: link d10/d21/d51/d6c/db7/fbf d10/d21/d51/d5a/d5e/d71/d94/d9c/d128/f133 0 2024-09-13T02:50:35.526 INFO:tasks.workunit.client.0.smithi100.stdout:3/921: fsync d10/f49 0 2024-09-13T02:50:35.528 INFO:tasks.workunit.client.0.smithi100.stdout:3/922: mkdir d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/d134 0 2024-09-13T02:50:35.528 INFO:tasks.workunit.client.0.smithi100.stdout:4/761: dwrite d3/d63/fd3 [0,4194304] 0 2024-09-13T02:50:35.529 INFO:tasks.workunit.client.0.smithi100.stdout:6/831: dwrite d12/d14/d1c/fee [0,4194304] 0 2024-09-13T02:50:35.529 INFO:tasks.workunit.client.0.smithi100.stdout:3/923: creat d10/d8a/f135 x:0 0 0 2024-09-13T02:50:35.537 INFO:tasks.workunit.client.0.smithi100.stdout:0/791: dwrite d2/dd/d54/d47/f77 [0,4194304] 0 2024-09-13T02:50:35.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/762: write d3/d6/d21/d46/d2d/d58/f84 [6497682,74920] 0 2024-09-13T02:50:35.538 INFO:tasks.workunit.client.0.smithi100.stdout:4/763: chown d3/dc/d4b/d8a/l8d 0 1 2024-09-13T02:50:35.538 INFO:tasks.workunit.client.0.smithi100.stdout:6/832: creat d12/d14/d1c/d7b/ffb x:0 0 0 2024-09-13T02:50:35.540 INFO:tasks.workunit.client.0.smithi100.stdout:3/924: creat d10/d8a/f136 x:0 0 0 2024-09-13T02:50:35.541 INFO:tasks.workunit.client.0.smithi100.stdout:0/792: symlink d2/dd/d54/d47/l101 0 2024-09-13T02:50:35.542 INFO:tasks.workunit.client.0.smithi100.stdout:4/764: mkdir d3/d6/d21/d103 0 2024-09-13T02:50:35.544 INFO:tasks.workunit.client.0.smithi100.stdout:3/925: getdents d10/d21/d51/d5a/d5e/d71/d94/d9c 0 2024-09-13T02:50:35.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/765: unlink d3/d6/fab 0 2024-09-13T02:50:35.546 INFO:tasks.workunit.client.0.smithi100.stdout:4/766: stat d3/d6/d2f/d60/ldb 0 2024-09-13T02:50:35.546 INFO:tasks.workunit.client.0.smithi100.stdout:9/735: read dd/d1b/d1d/d28/f54 [376607,63689] 0 2024-09-13T02:50:35.546 INFO:tasks.workunit.client.0.smithi100.stdout:9/736: write dd/d1b/d27/ffa [578499,79060] 0 2024-09-13T02:50:35.547 INFO:tasks.workunit.client.0.smithi100.stdout:6/833: symlink d12/d43/lfc 0 2024-09-13T02:50:35.549 INFO:tasks.workunit.client.0.smithi100.stdout:3/926: rename d10/d21/d51/d5a/d5e/d99/f131 to d10/d21/d51/d5a/d5e/d71/d94/f137 0 2024-09-13T02:50:35.549 INFO:tasks.workunit.client.0.smithi100.stdout:3/927: creat d10/d21/d51/d6c/f138 x:0 0 0 2024-09-13T02:50:35.550 INFO:tasks.workunit.client.0.smithi100.stdout:6/834: write d12/d14/d2f/d45/f49 [3234248,73294] 0 2024-09-13T02:50:35.550 INFO:tasks.workunit.client.0.smithi100.stdout:4/767: mknod d3/c104 0 2024-09-13T02:50:35.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/737: mkdir dd/d1b/d1d/dad/d106 0 2024-09-13T02:50:35.551 INFO:tasks.workunit.client.0.smithi100.stdout:0/793: read d2/dd/d54/d47/d34/f2b [205718,4151] 0 2024-09-13T02:50:35.552 INFO:tasks.workunit.client.0.smithi100.stdout:3/928: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/db4/d130/f139 x:0 0 0 2024-09-13T02:50:35.552 INFO:tasks.workunit.client.0.smithi100.stdout:6/835: dread d12/d14/d2f/d45/f51 [0,4194304] 0 2024-09-13T02:50:35.553 INFO:tasks.workunit.client.0.smithi100.stdout:4/768: creat d3/d6/d21/d46/d2d/d42/f105 x:0 0 0 2024-09-13T02:50:35.553 INFO:tasks.workunit.client.0.smithi100.stdout:0/794: mknod d2/dd/db0/d3b/c102 0 2024-09-13T02:50:35.556 INFO:tasks.workunit.client.0.smithi100.stdout:4/769: creat d3/d63/f106 x:0 0 0 2024-09-13T02:50:35.557 INFO:tasks.workunit.client.0.smithi100.stdout:9/738: dread dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:35.558 INFO:tasks.workunit.client.0.smithi100.stdout:3/929: rename d10/d21/d51/d5a/la6 to d10/d21/d51/d5a/d5e/d89/l13a 0 2024-09-13T02:50:35.560 INFO:tasks.workunit.client.0.smithi100.stdout:4/770: rename d3/d6/d21/d46/d2d/d3f/lbf to d3/d63/dae/l107 0 2024-09-13T02:50:35.566 INFO:tasks.workunit.client.0.smithi100.stdout:0/795: dread d2/dd/d54/d47/d8a/dfa/d4b/f4d [0,4194304] 0 2024-09-13T02:50:35.566 INFO:tasks.workunit.client.0.smithi100.stdout:8/714: sync 2024-09-13T02:50:35.569 INFO:tasks.workunit.client.0.smithi100.stdout:9/739: write dd/d1b/d24/d74/f37 [1153244,55087] 0 2024-09-13T02:50:35.569 INFO:tasks.workunit.client.0.smithi100.stdout:0/796: creat d2/dd/d54/d47/d8a/dfa/d97/f103 x:0 0 0 2024-09-13T02:50:35.570 INFO:tasks.workunit.client.0.smithi100.stdout:8/715: truncate f8 861306 0 2024-09-13T02:50:35.572 INFO:tasks.workunit.client.0.smithi100.stdout:6/836: dwrite d12/dcd/fe9 [0,4194304] 0 2024-09-13T02:50:35.572 INFO:tasks.workunit.client.0.smithi100.stdout:6/837: stat d12/d43/d4b/d4c 0 2024-09-13T02:50:35.573 INFO:tasks.workunit.client.0.smithi100.stdout:6/838: dread d12/d43/fc2 [0,4194304] 0 2024-09-13T02:50:35.574 INFO:tasks.workunit.client.0.smithi100.stdout:0/797: unlink d2/d1a/d4c/f63 0 2024-09-13T02:50:35.585 INFO:tasks.workunit.client.0.smithi100.stdout:4/771: dwrite d3/dc/d4b/f91 [0,4194304] 0 2024-09-13T02:50:35.585 INFO:tasks.workunit.client.0.smithi100.stdout:4/772: stat d3/d6/d2f/d60/dfe 0 2024-09-13T02:50:35.585 INFO:tasks.workunit.client.0.smithi100.stdout:4/773: dread - d3/d63/f106 zero size 2024-09-13T02:50:35.586 INFO:tasks.workunit.client.0.smithi100.stdout:0/798: rename d2/dd/d54/c60 to d2/dd/d54/d47/d34/d91/df9/c104 0 2024-09-13T02:50:35.588 INFO:tasks.workunit.client.0.smithi100.stdout:0/799: mkdir d2/dd/d54/d47/d8a/dfa/d97/d105 0 2024-09-13T02:50:35.589 INFO:tasks.workunit.client.0.smithi100.stdout:0/800: getdents d2/dd/d54/d47 0 2024-09-13T02:50:35.590 INFO:tasks.workunit.client.0.smithi100.stdout:0/801: write d2/dd/db0/f7c [4554762,105082] 0 2024-09-13T02:50:35.593 INFO:tasks.workunit.client.0.smithi100.stdout:0/802: rmdir d2/d1a/d4c 39 2024-09-13T02:50:35.594 INFO:tasks.workunit.client.0.smithi100.stdout:0/803: symlink d2/d9/d6d/d85/l106 0 2024-09-13T02:50:35.594 INFO:tasks.workunit.client.0.smithi100.stdout:0/804: dread - d2/dd/d54/fd7 zero size 2024-09-13T02:50:35.594 INFO:tasks.workunit.client.0.smithi100.stdout:0/805: write d2/d1a/d51/f87 [1284747,118967] 0 2024-09-13T02:50:35.595 INFO:tasks.workunit.client.0.smithi100.stdout:0/806: unlink d2/dd/db0/f7c 0 2024-09-13T02:50:35.596 INFO:tasks.workunit.client.0.smithi100.stdout:0/807: read d2/dd/d54/d47/d8a/dfa/d4b/db4/fbf [711571,48261] 0 2024-09-13T02:50:35.597 INFO:tasks.workunit.client.0.smithi100.stdout:9/740: dwrite dd/d1b/d1d/f1f [0,4194304] 0 2024-09-13T02:50:35.597 INFO:tasks.workunit.client.0.smithi100.stdout:0/808: symlink d2/dd/d54/d28/dac/l107 0 2024-09-13T02:50:35.597 INFO:tasks.workunit.client.0.smithi100.stdout:0/809: write d2/dd/d54/fd7 [83180,89644] 0 2024-09-13T02:50:35.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/741: unlink dd/d1b/d1d/d43/d4f/f50 0 2024-09-13T02:50:35.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/742: fsync dd/d1b/d31/f8a 0 2024-09-13T02:50:35.598 INFO:tasks.workunit.client.0.smithi100.stdout:9/743: dread - dd/d1b/d1d/d43/d4f/da5/ffd zero size 2024-09-13T02:50:35.599 INFO:tasks.workunit.client.0.smithi100.stdout:0/810: truncate d2/dd/d54/d28/dac/fc5 3264611 0 2024-09-13T02:50:35.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/744: link dd/d1b/d27/f59 dd/d1b/da3/dc9/f107 0 2024-09-13T02:50:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:0/811: mknod d2/dd/d54/d47/c108 0 2024-09-13T02:50:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/745: creat dd/d1b/d24/d74/d4e/d58/db8/f108 x:0 0 0 2024-09-13T02:50:35.601 INFO:tasks.workunit.client.0.smithi100.stdout:9/746: chown dd/d1b/d27/d51/de9/cfc 6968848 1 2024-09-13T02:50:35.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/747: creat dd/d1b/d21/f109 x:0 0 0 2024-09-13T02:50:35.602 INFO:tasks.workunit.client.0.smithi100.stdout:9/748: mknod dd/d100/c10a 0 2024-09-13T02:50:35.604 INFO:tasks.workunit.client.0.smithi100.stdout:8/716: dwrite df/f6c [0,4194304] 0 2024-09-13T02:50:35.605 INFO:tasks.workunit.client.0.smithi100.stdout:6/839: dwrite d12/d14/d5a/df0/f38 [4194304,4194304] 0 2024-09-13T02:50:35.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/840: mknod d12/d14/d1c/d28/d88/d9f/cfd 0 2024-09-13T02:50:35.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/841: read d12/d14/d1c/f30 [2671502,101995] 0 2024-09-13T02:50:35.616 INFO:tasks.workunit.client.0.smithi100.stdout:8/717: dread df/d13/d21/d81/db0/fdc [0,4194304] 0 2024-09-13T02:50:35.618 INFO:tasks.workunit.client.0.smithi100.stdout:8/718: link df/d5d/dba/le2 df/d13/db5/dc3/de0/lff 0 2024-09-13T02:50:35.620 INFO:tasks.workunit.client.0.smithi100.stdout:8/719: creat df/d13/db5/dea/f100 x:0 0 0 2024-09-13T02:50:35.621 INFO:tasks.workunit.client.0.smithi100.stdout:8/720: dread - df/d5d/d88/fed zero size 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/812: dwrite d2/d1a/da5/fd2 [0,4194304] 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:9/749: dwrite dd/d1b/d1d/d43/d4f/fd9 [0,4194304] 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:9/750: fsync dd/d1b/d21/d86/f52 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/813: chown d2/dd/d54/d28/f35 0 1 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/814: write d2/dd/d54/d28/fc9 [3385409,37868] 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/815: stat d2/d9/d6d/d85/de5/deb 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:0/816: fdatasync d2/d1a/f7e 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:6/842: dwrite d12/d14/d1c/f77 [4194304,4194304] 0 2024-09-13T02:50:35.636 INFO:tasks.workunit.client.0.smithi100.stdout:6/843: truncate d12/d14/d9d/ff5 844409 0 2024-09-13T02:50:35.637 INFO:tasks.workunit.client.0.smithi100.stdout:6/844: chown d12/d14/d2f/cc1 272663 1 2024-09-13T02:50:35.637 INFO:tasks.workunit.client.0.smithi100.stdout:6/845: dread - d12/d2e/d90/fa9 zero size 2024-09-13T02:50:35.646 INFO:tasks.workunit.client.0.smithi100.stdout:6/846: rmdir d12/d14/d5a 39 2024-09-13T02:50:35.647 INFO:tasks.workunit.client.0.smithi100.stdout:0/817: rename d2/dd/db0/d3b/f40 to d2/d1a/f109 0 2024-09-13T02:50:35.648 INFO:tasks.workunit.client.0.smithi100.stdout:6/847: mkdir d12/d14/d2f/dca/dfe 0 2024-09-13T02:50:35.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/848: write d12/d14/d9d/fb5 [523621,47656] 0 2024-09-13T02:50:35.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/849: dread - d12/d2e/d90/da2/f8c zero size 2024-09-13T02:50:35.649 INFO:tasks.workunit.client.0.smithi100.stdout:6/850: creat d12/d14/d9d/fff x:0 0 0 2024-09-13T02:50:35.652 INFO:tasks.workunit.client.0.smithi100.stdout:6/851: rename d12/d14/d2f/d45 to d12/d14/d1c/d6e/d71/d100 0 2024-09-13T02:50:35.652 INFO:tasks.workunit.client.0.smithi100.stdout:6/852: chown d12/d14/d1c/f77 1562602721 1 2024-09-13T02:50:35.653 INFO:tasks.workunit.client.0.smithi100.stdout:6/853: mkdir d12/d14/d4d/de1/d101 0 2024-09-13T02:50:35.653 INFO:tasks.workunit.client.0.smithi100.stdout:9/751: dwrite dd/d1b/d24/d74/d4e/f96 [0,4194304] 0 2024-09-13T02:50:35.654 INFO:tasks.workunit.client.0.smithi100.stdout:9/752: creat dd/d1b/d24/d74/d4e/d58/f10b x:0 0 0 2024-09-13T02:50:35.654 INFO:tasks.workunit.client.0.smithi100.stdout:6/854: truncate d12/d2e/d90/da2/f6d 3564969 0 2024-09-13T02:50:35.657 INFO:tasks.workunit.client.0.smithi100.stdout:9/753: link dd/d1b/d1d/d43/d5d/c60 dd/d1b/d24/da8/da9/c10c 0 2024-09-13T02:50:35.657 INFO:tasks.workunit.client.0.smithi100.stdout:1/849: sync 2024-09-13T02:50:35.657 INFO:tasks.workunit.client.0.smithi100.stdout:5/721: sync 2024-09-13T02:50:35.657 INFO:tasks.workunit.client.0.smithi100.stdout:7/878: sync 2024-09-13T02:50:35.657 INFO:tasks.workunit.client.0.smithi100.stdout:2/744: sync 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/818: dread d2/dd/f9e [0,4194304] 0 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/819: fdatasync d2/dd/d54/d28/f35 0 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/820: chown d2/dd/d54/d47/d34/cd4 328847 1 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/821: write d2/dd/d54/d28/fc7 [617113,23516] 0 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/822: readlink d2/dd/d54/d28/dac/l107 0 2024-09-13T02:50:35.659 INFO:tasks.workunit.client.0.smithi100.stdout:0/823: fdatasync d2/dd/d54/d47/f100 0 2024-09-13T02:50:35.660 INFO:tasks.workunit.client.0.smithi100.stdout:0/824: creat d2/d1a/d51/f10a x:0 0 0 2024-09-13T02:50:35.660 INFO:tasks.workunit.client.0.smithi100.stdout:9/754: mknod dd/d1b/d24/d74/d4e/dc4/c10d 0 2024-09-13T02:50:35.660 INFO:tasks.workunit.client.0.smithi100.stdout:7/879: rename d3/d16/d55/d92/da2/cf6 to d3/d16/d3b/da5/d11a/c125 0 2024-09-13T02:50:35.660 INFO:tasks.workunit.client.0.smithi100.stdout:7/880: truncate d3/feb 331047 0 2024-09-13T02:50:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:1/850: mkdir de/d14/d22/d52/d7a/d111 0 2024-09-13T02:50:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:2/745: getdents d0/db/d21/d5a 0 2024-09-13T02:50:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/855: read d12/d14/d5a/df0/f98 [2077708,128401] 0 2024-09-13T02:50:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/856: creat d12/d14/d1c/d6e/d71/f102 x:0 0 0 2024-09-13T02:50:35.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/722: symlink db/de/ddc/lf8 0 2024-09-13T02:50:35.664 INFO:tasks.workunit.client.0.smithi100.stdout:0/825: symlink d2/d1a/d4c/l10b 0 2024-09-13T02:50:35.665 INFO:tasks.workunit.client.0.smithi100.stdout:0/826: creat d2/d1a/d51/f10c x:0 0 0 2024-09-13T02:50:35.665 INFO:tasks.workunit.client.0.smithi100.stdout:0/827: rename d2/d9/d6d/d85 to d2/d9/d6d/d85/db3/d10d 22 2024-09-13T02:50:35.665 INFO:tasks.workunit.client.0.smithi100.stdout:9/755: symlink dd/d1b/d1d/d43/l10e 0 2024-09-13T02:50:35.666 INFO:tasks.workunit.client.0.smithi100.stdout:9/756: read dd/d1b/d24/d74/f65 [104950,128537] 0 2024-09-13T02:50:35.667 INFO:tasks.workunit.client.0.smithi100.stdout:7/881: mknod d3/d16/d3b/da5/df5/c126 0 2024-09-13T02:50:35.668 INFO:tasks.workunit.client.0.smithi100.stdout:1/851: truncate de/d14/d22/f35 114580 0 2024-09-13T02:50:35.669 INFO:tasks.workunit.client.0.smithi100.stdout:2/746: creat d0/db/d21/d5a/fdf x:0 0 0 2024-09-13T02:50:35.671 INFO:tasks.workunit.client.0.smithi100.stdout:6/857: creat d12/d14/d1c/d28/d88/d9f/f103 x:0 0 0 2024-09-13T02:50:35.672 INFO:tasks.workunit.client.0.smithi100.stdout:5/723: symlink db/de/d1f/d2b/d9b/lf9 0 2024-09-13T02:50:35.675 INFO:tasks.workunit.client.0.smithi100.stdout:9/757: write f5 [2105835,11049] 0 2024-09-13T02:50:35.679 INFO:tasks.workunit.client.0.smithi100.stdout:0/828: mknod d2/dd/d54/d47/d34/c10e 0 2024-09-13T02:50:35.680 INFO:tasks.workunit.client.0.smithi100.stdout:7/882: getdents d3/d16/d3b/da5/d11a 0 2024-09-13T02:50:35.684 INFO:tasks.workunit.client.0.smithi100.stdout:0/829: mknod d2/dd/c10f 0 2024-09-13T02:50:35.685 INFO:tasks.workunit.client.0.smithi100.stdout:6/858: dread d12/d2e/d90/da2/f7c [0,4194304] 0 2024-09-13T02:50:35.685 INFO:tasks.workunit.client.0.smithi100.stdout:6/859: read d12/d14/d2f/fec [939829,54695] 0 2024-09-13T02:50:35.685 INFO:tasks.workunit.client.0.smithi100.stdout:1/852: getdents de/d14/d22/d29 0 2024-09-13T02:50:35.687 INFO:tasks.workunit.client.0.smithi100.stdout:0/830: creat d2/dd/d54/d68/f110 x:0 0 0 2024-09-13T02:50:35.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/853: dread de/f45 [0,4194304] 0 2024-09-13T02:50:35.688 INFO:tasks.workunit.client.0.smithi100.stdout:1/854: fsync de/d14/d22/f3c 0 2024-09-13T02:50:35.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/855: chown de/d14/dbb 86368295 1 2024-09-13T02:50:35.689 INFO:tasks.workunit.client.0.smithi100.stdout:1/856: write de/d12/f3e [1063118,63491] 0 2024-09-13T02:50:35.689 INFO:tasks.workunit.client.0.smithi100.stdout:0/831: link d2/dd/d54/d47/c9f d2/dd/d54/d47/d8a/dfa/d97/d105/c111 0 2024-09-13T02:50:35.691 INFO:tasks.workunit.client.0.smithi100.stdout:7/883: rename d3/d5/d1b to d3/d16/d55/d92/da9/dde/d127 0 2024-09-13T02:50:35.691 INFO:tasks.workunit.client.0.smithi100.stdout:7/884: write d3/d5/f82 [1113501,34578] 0 2024-09-13T02:50:35.693 INFO:tasks.workunit.client.0.smithi100.stdout:0/832: creat d2/dd/d54/d47/d34/d91/df9/f112 x:0 0 0 2024-09-13T02:50:35.694 INFO:tasks.workunit.client.0.smithi100.stdout:5/724: dwrite db/de/d63/f65 [0,4194304] 0 2024-09-13T02:50:35.695 INFO:tasks.workunit.client.0.smithi100.stdout:7/885: mknod d3/d16/d89/d94/c128 0 2024-09-13T02:50:35.696 INFO:tasks.workunit.client.0.smithi100.stdout:7/886: chown d3/d16/d55/d92/da9 0 1 2024-09-13T02:50:35.696 INFO:tasks.workunit.client.0.smithi100.stdout:7/887: stat d3/d16/d55/d92/da9/dde/d127/d1c/l51 0 2024-09-13T02:50:35.696 INFO:tasks.workunit.client.0.smithi100.stdout:7/888: fdatasync d3/d5/fe0 0 2024-09-13T02:50:35.696 INFO:tasks.workunit.client.0.smithi100.stdout:2/747: dwrite d0/db/d68/d6b/f76 [0,4194304] 0 2024-09-13T02:50:35.697 INFO:tasks.workunit.client.0.smithi100.stdout:6/860: write d12/d43/d4b/f74 [915214,92852] 0 2024-09-13T02:50:35.697 INFO:tasks.workunit.client.0.smithi100.stdout:0/833: mkdir d2/dd/db0/de0/d113 0 2024-09-13T02:50:35.697 INFO:tasks.workunit.client.0.smithi100.stdout:7/889: unlink d3/d16/d3b/d8c/fe2 0 2024-09-13T02:50:35.698 INFO:tasks.workunit.client.0.smithi100.stdout:7/890: fsync d3/d16/d55/d92/da2/fb7 0 2024-09-13T02:50:35.698 INFO:tasks.workunit.client.0.smithi100.stdout:7/891: creat d3/d16/d55/d92/da9/dd3/f129 x:0 0 0 2024-09-13T02:50:35.699 INFO:tasks.workunit.client.0.smithi100.stdout:7/892: chown d3/d16/db0/f124 6257345 1 2024-09-13T02:50:35.700 INFO:tasks.workunit.client.0.smithi100.stdout:0/834: mknod d2/dd/d54/d3e/d5d/c114 0 2024-09-13T02:50:35.701 INFO:tasks.workunit.client.0.smithi100.stdout:0/835: truncate d2/d1a/d51/fe4 459569 0 2024-09-13T02:50:35.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/893: rename d3/d16/d55/d92/da9/dde/d127/l97 to d3/d2d/l12a 0 2024-09-13T02:50:35.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/894: chown d3/d16/d3b/da5/d11a/c125 999 1 2024-09-13T02:50:35.705 INFO:tasks.workunit.client.0.smithi100.stdout:7/895: stat d3/d16/d55/d92/da9/dd3/ff7 0 2024-09-13T02:50:35.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/836: getdents d2/dd/d54/d47/d34/d91 0 2024-09-13T02:50:35.706 INFO:tasks.workunit.client.0.smithi100.stdout:0/837: write d2/d1a/d51/f10a [875846,48360] 0 2024-09-13T02:50:35.708 INFO:tasks.workunit.client.0.smithi100.stdout:7/896: creat d3/d16/d55/d92/f12b x:0 0 0 2024-09-13T02:50:35.708 INFO:tasks.workunit.client.0.smithi100.stdout:7/897: readlink d3/d16/d55/d56/d9e/d9f/de9/d110/l116 0 2024-09-13T02:50:35.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/838: truncate d2/d1a/f1e 4431618 0 2024-09-13T02:50:35.710 INFO:tasks.workunit.client.0.smithi100.stdout:2/748: dread d0/db/d68/d6b/d71/d73/f7e [0,4194304] 0 2024-09-13T02:50:35.710 INFO:tasks.workunit.client.0.smithi100.stdout:7/898: unlink d3/d16/l46 0 2024-09-13T02:50:35.712 INFO:tasks.workunit.client.0.smithi100.stdout:2/749: mknod d0/db/d3f/d6a/d7f/ce0 0 2024-09-13T02:50:35.712 INFO:tasks.workunit.client.0.smithi100.stdout:2/750: fdatasync d0/db/d21/d57/f59 0 2024-09-13T02:50:35.713 INFO:tasks.workunit.client.0.smithi100.stdout:2/751: rmdir d0/db/d68/d6b/da5/d8f 39 2024-09-13T02:50:35.715 INFO:tasks.workunit.client.0.smithi100.stdout:2/752: rmdir d0/db/d68/d6b/da5/d8f/dca 0 2024-09-13T02:50:35.718 INFO:tasks.workunit.client.0.smithi100.stdout:1/857: dwrite de/d14/d22/d52/d7a/feb [0,4194304] 0 2024-09-13T02:50:35.722 INFO:tasks.workunit.client.0.smithi100.stdout:1/858: rename de/d14/d22/dfa/dd3/lbd to de/d14/d22/d29/d68/d10d/l112 0 2024-09-13T02:50:35.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/859: creat de/d14/d22/d29/d108/f113 x:0 0 0 2024-09-13T02:50:35.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/860: chown de/d12/c53 298445772 1 2024-09-13T02:50:35.723 INFO:tasks.workunit.client.0.smithi100.stdout:1/861: chown f1 3960008 1 2024-09-13T02:50:35.724 INFO:tasks.workunit.client.0.smithi100.stdout:1/862: mkdir de/d14/df5/dff/d101/d114 0 2024-09-13T02:50:35.724 INFO:tasks.workunit.client.0.smithi100.stdout:1/863: stat de/d14/d2e/d48/f50 0 2024-09-13T02:50:35.730 INFO:tasks.workunit.client.0.smithi100.stdout:5/725: dwrite db/de/ddc/fed [0,4194304] 0 2024-09-13T02:50:35.730 INFO:tasks.workunit.client.0.smithi100.stdout:5/726: dread - db/de/d3e/dc3/fd2 zero size 2024-09-13T02:50:35.737 INFO:tasks.workunit.client.0.smithi100.stdout:5/727: mkdir db/de/d3e/dfa 0 2024-09-13T02:50:35.737 INFO:tasks.workunit.client.0.smithi100.stdout:2/753: dread d0/db/d79/f8b [0,4194304] 0 2024-09-13T02:50:35.738 INFO:tasks.workunit.client.0.smithi100.stdout:5/728: mkdir db/de/d3e/d7e/dfb 0 2024-09-13T02:50:35.739 INFO:tasks.workunit.client.0.smithi100.stdout:2/754: mkdir d0/db/d68/d6b/de1 0 2024-09-13T02:50:35.740 INFO:tasks.workunit.client.0.smithi100.stdout:5/729: truncate db/de/d63/fa0 1078876 0 2024-09-13T02:50:35.740 INFO:tasks.workunit.client.0.smithi100.stdout:5/730: write db/de/d1f/f9e [3009728,17557] 0 2024-09-13T02:50:35.741 INFO:tasks.workunit.client.0.smithi100.stdout:2/755: symlink d0/db/d21/le2 0 2024-09-13T02:50:35.743 INFO:tasks.workunit.client.0.smithi100.stdout:5/731: mkdir db/de/d3e/dfa/dfc 0 2024-09-13T02:50:35.743 INFO:tasks.workunit.client.0.smithi100.stdout:5/732: write db/de/d3e/dc3/fd2 [352793,119777] 0 2024-09-13T02:50:35.743 INFO:tasks.workunit.client.0.smithi100.stdout:5/733: fdatasync db/de/fbd 0 2024-09-13T02:50:35.744 INFO:tasks.workunit.client.0.smithi100.stdout:2/756: mknod d0/db/d3f/ce3 0 2024-09-13T02:50:35.744 INFO:tasks.workunit.client.0.smithi100.stdout:5/734: rmdir db/de/d3e/da2/ddb 39 2024-09-13T02:50:35.744 INFO:tasks.workunit.client.0.smithi100.stdout:5/735: chown db/de/d3e/fe1 704651013 1 2024-09-13T02:50:35.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/861: dwrite d12/d14/d5a/df0/f46 [0,4194304] 0 2024-09-13T02:50:35.745 INFO:tasks.workunit.client.0.smithi100.stdout:6/862: read f7 [931666,7910] 0 2024-09-13T02:50:35.747 INFO:tasks.workunit.client.0.smithi100.stdout:7/899: dwrite d3/f4c [0,4194304] 0 2024-09-13T02:50:35.747 INFO:tasks.workunit.client.0.smithi100.stdout:0/839: dwrite d2/dd/d54/d28/f35 [0,4194304] 0 2024-09-13T02:50:35.748 INFO:tasks.workunit.client.0.smithi100.stdout:1/864: dwrite de/d14/d22/dfa/dd3/ff6 [4194304,4194304] 0 2024-09-13T02:50:35.748 INFO:tasks.workunit.client.0.smithi100.stdout:1/865: write de/d14/d22/d52/d65/dc6/fe9 [4583919,11199] 0 2024-09-13T02:50:35.748 INFO:tasks.workunit.client.0.smithi100.stdout:1/866: write de/d14/d86/fb9 [49684,67940] 0 2024-09-13T02:50:35.749 INFO:tasks.workunit.client.0.smithi100.stdout:0/840: dread d2/dd/d54/d28/f65 [0,4194304] 0 2024-09-13T02:50:35.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/863: rename d12/d14/f9c to d12/d14/d2f/dca/dd8/f104 0 2024-09-13T02:50:35.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/864: write d12/d43/d4b/d4c/fdf [552877,18152] 0 2024-09-13T02:50:35.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/865: fdatasync d12/d14/d2f/f33 0 2024-09-13T02:50:35.752 INFO:tasks.workunit.client.0.smithi100.stdout:6/866: chown d12/d2e/d90/da2/f7c 1003010304 1 2024-09-13T02:50:35.753 INFO:tasks.workunit.client.0.smithi100.stdout:6/867: write d12/d14/d1c/fa1 [993148,110482] 0 2024-09-13T02:50:35.755 INFO:tasks.workunit.client.0.smithi100.stdout:1/867: read de/d14/d22/dfa/dd3/ff6 [2769197,55353] 0 2024-09-13T02:50:35.756 INFO:tasks.workunit.client.0.smithi100.stdout:7/900: mknod d3/d9b/d115/c12c 0 2024-09-13T02:50:35.759 INFO:tasks.workunit.client.0.smithi100.stdout:0/841: creat d2/d9/d6d/d85/db3/f115 x:0 0 0 2024-09-13T02:50:35.761 INFO:tasks.workunit.client.0.smithi100.stdout:6/868: mkdir d12/d14/d68/d105 0 2024-09-13T02:50:35.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/868: creat de/d14/d2e/ddc/f115 x:0 0 0 2024-09-13T02:50:35.762 INFO:tasks.workunit.client.0.smithi100.stdout:1/869: fdatasync de/d14/d22/d52/d65/fc8 0 2024-09-13T02:50:35.764 INFO:tasks.workunit.client.0.smithi100.stdout:6/869: truncate d12/d43/d4b/d4c/f5b 1012459 0 2024-09-13T02:50:35.766 INFO:tasks.workunit.client.0.smithi100.stdout:1/870: rename de/d14/d22/fd5 to de/d14/d2e/d60/f116 0 2024-09-13T02:50:35.766 INFO:tasks.workunit.client.0.smithi100.stdout:0/842: write d2/d9/d6d/d85/f9b [2659247,30614] 0 2024-09-13T02:50:35.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/901: rmdir d3/d16/d55/d92/da9 39 2024-09-13T02:50:35.767 INFO:tasks.workunit.client.0.smithi100.stdout:7/902: creat d3/d16/d3b/da5/d87/f12d x:0 0 0 2024-09-13T02:50:35.769 INFO:tasks.workunit.client.0.smithi100.stdout:1/871: unlink de/d14/d22/d52/d65/fa3 0 2024-09-13T02:50:35.769 INFO:tasks.workunit.client.0.smithi100.stdout:1/872: write de/d14/d22/d52/d65/f6f [1995498,92492] 0 2024-09-13T02:50:35.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/843: mknod d2/dd/d54/d3e/d5d/c116 0 2024-09-13T02:50:35.770 INFO:tasks.workunit.client.0.smithi100.stdout:0/844: stat d2/dd/d54/d47 0 2024-09-13T02:50:35.772 INFO:tasks.workunit.client.0.smithi100.stdout:5/736: dwrite db/de/d3e/dc3/fe0 [0,4194304] 0 2024-09-13T02:50:35.772 INFO:tasks.workunit.client.0.smithi100.stdout:7/903: rename d3/d16/d55/d56/d9e/d9f/cdf to d3/d5/d4f/c12e 0 2024-09-13T02:50:35.773 INFO:tasks.workunit.client.0.smithi100.stdout:7/904: dread d3/d16/d55/f109 [0,4194304] 0 2024-09-13T02:50:35.774 INFO:tasks.workunit.client.0.smithi100.stdout:2/757: dwrite d0/db/d21/d88/faa [0,4194304] 0 2024-09-13T02:50:35.774 INFO:tasks.workunit.client.0.smithi100.stdout:2/758: creat d0/db/d68/d9a/fe4 x:0 0 0 2024-09-13T02:50:35.774 INFO:tasks.workunit.client.0.smithi100.stdout:2/759: fsync d0/db/d68/d6b/da5/d8f/faf 0 2024-09-13T02:50:35.775 INFO:tasks.workunit.client.0.smithi100.stdout:1/873: dread de/d14/d44/d7f/f96 [0,4194304] 0 2024-09-13T02:50:35.775 INFO:tasks.workunit.client.0.smithi100.stdout:1/874: write de/d14/d22/f4a [584276,51599] 0 2024-09-13T02:50:35.776 INFO:tasks.workunit.client.0.smithi100.stdout:2/760: dread d0/db/d21/d57/f59 [0,4194304] 0 2024-09-13T02:50:35.776 INFO:tasks.workunit.client.0.smithi100.stdout:5/737: creat db/de/d3e/da2/dac/db1/ffd x:0 0 0 2024-09-13T02:50:35.777 INFO:tasks.workunit.client.0.smithi100.stdout:7/905: truncate d3/fc 3710377 0 2024-09-13T02:50:35.778 INFO:tasks.workunit.client.0.smithi100.stdout:0/845: getdents d2/d9 0 2024-09-13T02:50:35.779 INFO:tasks.workunit.client.0.smithi100.stdout:6/870: write d12/d43/d4b/f96 [3118331,90102] 0 2024-09-13T02:50:35.780 INFO:tasks.workunit.client.0.smithi100.stdout:3/930: sync 2024-09-13T02:50:35.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/875: mknod de/d14/d22/d52/db8/c117 0 2024-09-13T02:50:35.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/876: chown de/d14/d44/d61/f90 35649 1 2024-09-13T02:50:35.793 INFO:tasks.workunit.client.0.smithi100.stdout:1/877: write de/d14/d44/d7f/fb3 [1193148,46654] 0 2024-09-13T02:50:35.794 INFO:tasks.workunit.client.0.smithi100.stdout:5/738: symlink db/de/d3e/d7e/lfe 0 2024-09-13T02:50:35.794 INFO:tasks.workunit.client.0.smithi100.stdout:5/739: chown db/de/d3e/f51 192087778 1 2024-09-13T02:50:35.795 INFO:tasks.workunit.client.0.smithi100.stdout:7/906: symlink d3/d16/d55/d92/da9/dde/l12f 0 2024-09-13T02:50:35.796 INFO:tasks.workunit.client.0.smithi100.stdout:0/846: link d2/dd/d54/d47/d34/d91/led d2/dd/d54/d47/d8a/dfa/d97/d105/l117 0 2024-09-13T02:50:35.796 INFO:tasks.workunit.client.0.smithi100.stdout:0/847: fsync d2/d1a/f7e 0 2024-09-13T02:50:35.796 INFO:tasks.workunit.client.0.smithi100.stdout:0/848: fsync d2/dd/d54/ff7 0 2024-09-13T02:50:35.798 INFO:tasks.workunit.client.0.smithi100.stdout:6/871: rename d12/d14/d2f/dca/dd8/f104 to d12/f106 0 2024-09-13T02:50:35.799 INFO:tasks.workunit.client.0.smithi100.stdout:1/878: truncate de/f3a 3767447 0 2024-09-13T02:50:35.800 INFO:tasks.workunit.client.0.smithi100.stdout:1/879: write de/d14/d2e/ddc/f115 [1038979,56916] 0 2024-09-13T02:50:35.802 INFO:tasks.workunit.client.0.smithi100.stdout:3/931: dwrite d10/d21/d51/d5a/d5e/d71/fdc [0,4194304] 0 2024-09-13T02:50:35.806 INFO:tasks.workunit.client.0.smithi100.stdout:2/761: dwrite d0/d36/d8a/fa2 [0,4194304] 0 2024-09-13T02:50:35.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/872: mknod d12/d2e/d90/da2/dbc/dce/c107 0 2024-09-13T02:50:35.807 INFO:tasks.workunit.client.0.smithi100.stdout:6/873: chown d12/d14/d21/l7f 48 1 2024-09-13T02:50:35.810 INFO:tasks.workunit.client.0.smithi100.stdout:5/740: unlink db/de/c32 0 2024-09-13T02:50:35.811 INFO:tasks.workunit.client.0.smithi100.stdout:4/774: sync 2024-09-13T02:50:35.811 INFO:tasks.workunit.client.0.smithi100.stdout:9/758: sync 2024-09-13T02:50:35.812 INFO:tasks.workunit.client.0.smithi100.stdout:8/721: sync 2024-09-13T02:50:35.812 INFO:tasks.workunit.client.0.smithi100.stdout:9/759: fdatasync dd/d1b/d1d/dad/f104 0 2024-09-13T02:50:35.815 INFO:tasks.workunit.client.0.smithi100.stdout:7/907: rename d3/d5/l31 to d3/d16/d3b/d112/l130 0 2024-09-13T02:50:35.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/775: unlink d3/d6/d21/d46/le6 0 2024-09-13T02:50:35.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/776: read d3/dc/d88/db4/fcd [848526,76728] 0 2024-09-13T02:50:35.819 INFO:tasks.workunit.client.0.smithi100.stdout:4/777: write d3/d6/d21/f43 [7154790,68497] 0 2024-09-13T02:50:35.821 INFO:tasks.workunit.client.0.smithi100.stdout:9/760: symlink dd/d1b/da3/l10f 0 2024-09-13T02:50:35.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/762: truncate d0/db/d21/d88/faa 3521074 0 2024-09-13T02:50:35.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/763: truncate d0/fe 9208642 0 2024-09-13T02:50:35.822 INFO:tasks.workunit.client.0.smithi100.stdout:2/764: chown d0/db/d68/d6b/da5/fae 300347 1 2024-09-13T02:50:35.822 INFO:tasks.workunit.client.0.smithi100.stdout:6/874: read d12/d43/f54 [4008192,91472] 0 2024-09-13T02:50:35.824 INFO:tasks.workunit.client.0.smithi100.stdout:8/722: rename df/d13/d20/d98/dfc to df/d5d/d70/d2c/d38/d9e/dad/d101 0 2024-09-13T02:50:35.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/723: creat df/d5d/d88/dc0/f102 x:0 0 0 2024-09-13T02:50:35.825 INFO:tasks.workunit.client.0.smithi100.stdout:8/724: chown df/d5d/d70 4842 1 2024-09-13T02:50:35.826 INFO:tasks.workunit.client.0.smithi100.stdout:7/908: mkdir d3/d16/db0/d131 0 2024-09-13T02:50:35.826 INFO:tasks.workunit.client.0.smithi100.stdout:9/761: mknod dd/d1b/d24/d74/d4e/c110 0 2024-09-13T02:50:35.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/765: truncate d0/f19 215822 0 2024-09-13T02:50:35.827 INFO:tasks.workunit.client.0.smithi100.stdout:2/766: dread - d0/db/d68/d6b/da5/fa0 zero size 2024-09-13T02:50:35.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/875: rename d12/d14/d2f/l41 to d12/d14/d1c/d7b/da6/l108 0 2024-09-13T02:50:35.829 INFO:tasks.workunit.client.0.smithi100.stdout:8/725: truncate df/d13/f59 333283 0 2024-09-13T02:50:35.830 INFO:tasks.workunit.client.0.smithi100.stdout:9/762: mkdir dd/d1b/d1d/d28/d111 0 2024-09-13T02:50:35.831 INFO:tasks.workunit.client.0.smithi100.stdout:2/767: symlink d0/db/d3f/d6a/d7f/dbb/le5 0 2024-09-13T02:50:35.831 INFO:tasks.workunit.client.0.smithi100.stdout:2/768: write d0/db/d21/f54 [1364781,8397] 0 2024-09-13T02:50:35.831 INFO:tasks.workunit.client.0.smithi100.stdout:2/769: truncate d0/d36/f75 4729740 0 2024-09-13T02:50:35.831 INFO:tasks.workunit.client.0.smithi100.stdout:6/876: creat d12/d14/d4d/de1/d101/f109 x:0 0 0 2024-09-13T02:50:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/849: dwrite d2/dd/db0/d3b/f6f [0,4194304] 0 2024-09-13T02:50:35.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/850: chown d2/dd/d54/d47/d34/d3c/l46 97 1 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/726: symlink df/d6f/l103 0 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/727: chown df/d6f/leb 1 1 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:8/728: fsync df/d13/db5/dea/f100 0 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:9/763: mknod dd/db5/c112 0 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/770: truncate d0/db/f40 3427217 0 2024-09-13T02:50:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:2/771: stat d0/db/d68/d6b 0 2024-09-13T02:50:35.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/877: mknod d12/d14/df2/c10a 0 2024-09-13T02:50:35.834 INFO:tasks.workunit.client.0.smithi100.stdout:6/878: write d12/d2e/d90/fa9 [327187,128479] 0 2024-09-13T02:50:35.835 INFO:tasks.workunit.client.0.smithi100.stdout:0/851: creat d2/dd/d54/d3e/f118 x:0 0 0 2024-09-13T02:50:35.835 INFO:tasks.workunit.client.0.smithi100.stdout:0/852: write d2/d9/f86 [2279252,57880] 0 2024-09-13T02:50:35.836 INFO:tasks.workunit.client.0.smithi100.stdout:9/764: symlink dd/d1b/d27/d51/de9/l113 0 2024-09-13T02:50:35.837 INFO:tasks.workunit.client.0.smithi100.stdout:2/772: symlink d0/db/d3f/d6a/d7f/dcc/le6 0 2024-09-13T02:50:35.838 INFO:tasks.workunit.client.0.smithi100.stdout:6/879: creat d12/d14/d1c/d6e/d71/d100/db9/f10b x:0 0 0 2024-09-13T02:50:35.839 INFO:tasks.workunit.client.0.smithi100.stdout:2/773: mkdir d0/db/d68/d6b/da5/de7 0 2024-09-13T02:50:35.840 INFO:tasks.workunit.client.0.smithi100.stdout:1/880: dwrite de/d14/d44/d7f/fec [0,4194304] 0 2024-09-13T02:50:35.843 INFO:tasks.workunit.client.0.smithi100.stdout:3/932: dwrite d10/d21/d51/d5a/d5e/d89/fdd [0,4194304] 0 2024-09-13T02:50:35.843 INFO:tasks.workunit.client.0.smithi100.stdout:3/933: dread - d10/d21/d51/d6c/f8c zero size 2024-09-13T02:50:35.843 INFO:tasks.workunit.client.0.smithi100.stdout:5/741: dwrite db/de/d3e/da2/dac/db1/ffd [0,4194304] 0 2024-09-13T02:50:35.843 INFO:tasks.workunit.client.0.smithi100.stdout:5/742: chown db/de/d1f/d78/fee 178002 1 2024-09-13T02:50:35.844 INFO:tasks.workunit.client.0.smithi100.stdout:2/774: link d0/d36/f4f d0/db/d68/d6b/d85/fe8 0 2024-09-13T02:50:35.844 INFO:tasks.workunit.client.0.smithi100.stdout:2/775: readlink d0/db/d79/ldd 0 2024-09-13T02:50:35.844 INFO:tasks.workunit.client.0.smithi100.stdout:4/778: dwrite d3/dc/d4b/d9b/fe9 [0,4194304] 0 2024-09-13T02:50:35.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/729: write f5 [1433980,101181] 0 2024-09-13T02:50:35.850 INFO:tasks.workunit.client.0.smithi100.stdout:8/730: fsync df/d13/d68/f8e 0 2024-09-13T02:50:35.851 INFO:tasks.workunit.client.0.smithi100.stdout:8/731: dread df/d13/d21/f57 [4194304,4194304] 0 2024-09-13T02:50:35.852 INFO:tasks.workunit.client.0.smithi100.stdout:7/909: getdents d3/d5 0 2024-09-13T02:50:35.855 INFO:tasks.workunit.client.0.smithi100.stdout:1/881: dread de/d14/d22/f9a [0,4194304] 0 2024-09-13T02:50:35.858 INFO:tasks.workunit.client.0.smithi100.stdout:0/853: dwrite d2/d1a/d4c/f98 [0,4194304] 0 2024-09-13T02:50:35.859 INFO:tasks.workunit.client.0.smithi100.stdout:5/743: creat db/de/d3e/d7e/d81/fff x:0 0 0 2024-09-13T02:50:35.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/776: rename d0/db/d23/c28 to d0/db/d21/ce9 0 2024-09-13T02:50:35.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/777: creat d0/db/d21/d57/fea x:0 0 0 2024-09-13T02:50:35.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/778: truncate d0/db/d21/d57/fea 72988 0 2024-09-13T02:50:35.862 INFO:tasks.workunit.client.0.smithi100.stdout:2/779: dread - d0/db/d21/d57/d81/fc6 zero size 2024-09-13T02:50:35.867 INFO:tasks.workunit.client.0.smithi100.stdout:1/882: write de/d14/d22/d52/d7a/d81/de0/f107 [110876,30852] 0 2024-09-13T02:50:35.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/854: unlink d2/dd/c10f 0 2024-09-13T02:50:35.870 INFO:tasks.workunit.client.0.smithi100.stdout:0/855: write d2/d1a/da5/db9/fd0 [444034,120471] 0 2024-09-13T02:50:35.882 INFO:tasks.workunit.client.0.smithi100.stdout:9/765: dwrite dd/d1b/d1d/d28/f8c [0,4194304] 0 2024-09-13T02:50:35.882 INFO:tasks.workunit.client.0.smithi100.stdout:9/766: write dd/d1b/f70 [727794,51958] 0 2024-09-13T02:50:35.882 INFO:tasks.workunit.client.0.smithi100.stdout:9/767: chown dd/d1b/d24/d74/d4e/d58/f68 0 1 2024-09-13T02:50:35.882 INFO:tasks.workunit.client.0.smithi100.stdout:9/768: chown dd/d1b/c80 688 1 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:6/880: dwrite d12/d14/d1c/f30 [0,4194304] 0 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:2/780: dread d0/db/d21/d88/f49 [4194304,4194304] 0 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:4/779: rmdir d3 39 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:7/910: dwrite d3/d16/d55/d56/d9e/d9f/fef [0,4194304] 0 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:6/881: chown d12/d14/d2f/c37 10 1 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:7/911: dread - d3/d16/d55/d92/da9/fee zero size 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:7/912: chown d3/d5/l120 1604 1 2024-09-13T02:50:35.884 INFO:tasks.workunit.client.0.smithi100.stdout:2/781: write d0/db/d68/d9a/fe4 [734789,83395] 0 2024-09-13T02:50:35.885 INFO:tasks.workunit.client.0.smithi100.stdout:2/782: read - d0/db/d68/d6b/d71/f84 zero size 2024-09-13T02:50:35.885 INFO:tasks.workunit.client.0.smithi100.stdout:2/783: chown d0/db/d68/d6b/d71 0 1 2024-09-13T02:50:35.885 INFO:tasks.workunit.client.0.smithi100.stdout:1/883: stat de/d14/d44/d61/ca4 0 2024-09-13T02:50:35.889 INFO:tasks.workunit.client.0.smithi100.stdout:0/856: link d2/d1a/f109 d2/dd/d54/d47/d34/da3/f119 0 2024-09-13T02:50:35.891 INFO:tasks.workunit.client.0.smithi100.stdout:9/769: dread dd/d1b/fb0 [0,4194304] 0 2024-09-13T02:50:35.891 INFO:tasks.workunit.client.0.smithi100.stdout:9/770: stat dd/d1b/d1d/c33 0 2024-09-13T02:50:35.897 INFO:tasks.workunit.client.0.smithi100.stdout:2/784: dread d0/db/d68/d6b/d71/d73/f7c [0,4194304] 0 2024-09-13T02:50:35.901 INFO:tasks.workunit.client.0.smithi100.stdout:7/913: dwrite d3/d16/d55/f5e [8388608,4194304] 0 2024-09-13T02:50:35.902 INFO:tasks.workunit.client.0.smithi100.stdout:4/780: truncate d3/d6/f10 2489841 0 2024-09-13T02:50:35.904 INFO:tasks.workunit.client.0.smithi100.stdout:6/882: getdents d12/d14/d1c/d6e 0 2024-09-13T02:50:35.904 INFO:tasks.workunit.client.0.smithi100.stdout:6/883: write d12/d2e/d90/da2/f8c [906084,33776] 0 2024-09-13T02:50:35.907 INFO:tasks.workunit.client.0.smithi100.stdout:0/857: mkdir d2/d1a/d51/d11a 0 2024-09-13T02:50:35.907 INFO:tasks.workunit.client.0.smithi100.stdout:0/858: write d2/dd/d54/d47/d34/d3c/f71 [92783,95622] 0 2024-09-13T02:50:35.907 INFO:tasks.workunit.client.0.smithi100.stdout:0/859: chown d2/dd/d54/d47/f77 2268103 1 2024-09-13T02:50:35.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/771: creat dd/d1b/d27/d51/de9/f114 x:0 0 0 2024-09-13T02:50:35.908 INFO:tasks.workunit.client.0.smithi100.stdout:9/772: write dd/d1b/d21/d86/f90 [217340,69646] 0 2024-09-13T02:50:35.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/773: dread dd/d1b/d24/f67 [0,4194304] 0 2024-09-13T02:50:35.909 INFO:tasks.workunit.client.0.smithi100.stdout:9/774: chown dd/d1b/d27/fc7 48244759 1 2024-09-13T02:50:35.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/914: unlink d3/fa 0 2024-09-13T02:50:35.909 INFO:tasks.workunit.client.0.smithi100.stdout:7/915: getdents d3/d16/db0/d131 0 2024-09-13T02:50:35.910 INFO:tasks.workunit.client.0.smithi100.stdout:4/781: link d3/d6/d2f/d60/l71 d3/d6/d21/d46/d2d/d42/l108 0 2024-09-13T02:50:35.911 INFO:tasks.workunit.client.0.smithi100.stdout:1/884: symlink de/d14/d22/d29/d108/l118 0 2024-09-13T02:50:35.913 INFO:tasks.workunit.client.0.smithi100.stdout:0/860: link d2/dd/db0/d3b/f6f d2/dd/d54/d3e/d5d/f11b 0 2024-09-13T02:50:35.913 INFO:tasks.workunit.client.0.smithi100.stdout:7/916: mkdir d3/d132 0 2024-09-13T02:50:35.914 INFO:tasks.workunit.client.0.smithi100.stdout:6/884: write d12/d2e/d90/fc8 [2642319,128794] 0 2024-09-13T02:50:35.914 INFO:tasks.workunit.client.0.smithi100.stdout:4/782: creat d3/dc/d4b/d8a/f109 x:0 0 0 2024-09-13T02:50:35.915 INFO:tasks.workunit.client.0.smithi100.stdout:1/885: creat de/d14/d44/d61/f119 x:0 0 0 2024-09-13T02:50:35.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/785: dwrite d0/db/d68/d6b/d71/f84 [0,4194304] 0 2024-09-13T02:50:35.916 INFO:tasks.workunit.client.0.smithi100.stdout:0/861: creat d2/dd/db0/d3b/f11c x:0 0 0 2024-09-13T02:50:35.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/786: fdatasync d0/d36/f6f 0 2024-09-13T02:50:35.916 INFO:tasks.workunit.client.0.smithi100.stdout:2/787: fdatasync d0/db/d68/d6b/d85/fd2 0 2024-09-13T02:50:35.917 INFO:tasks.workunit.client.0.smithi100.stdout:7/917: mknod d3/d16/c133 0 2024-09-13T02:50:35.919 INFO:tasks.workunit.client.0.smithi100.stdout:4/783: rename d3/d6/d2f/d60/dfe to d3/d63/dae/d10a 0 2024-09-13T02:50:35.919 INFO:tasks.workunit.client.0.smithi100.stdout:1/886: getdents de/d14/df5 0 2024-09-13T02:50:35.923 INFO:tasks.workunit.client.0.smithi100.stdout:9/775: dread dd/d1b/d1d/d43/d4f/fd9 [0,4194304] 0 2024-09-13T02:50:35.923 INFO:tasks.workunit.client.0.smithi100.stdout:6/885: dread d12/d43/d4b/d4c/f9e [0,4194304] 0 2024-09-13T02:50:35.925 INFO:tasks.workunit.client.0.smithi100.stdout:7/918: mknod d3/d9b/d115/c134 0 2024-09-13T02:50:35.927 INFO:tasks.workunit.client.0.smithi100.stdout:6/886: creat d12/d14/d4d/f10c x:0 0 0 2024-09-13T02:50:35.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/776: getdents dd/d1b/d1d/d43/d4f 0 2024-09-13T02:50:35.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/777: dread - dd/d1b/d24/da8/da9/f101 zero size 2024-09-13T02:50:35.928 INFO:tasks.workunit.client.0.smithi100.stdout:9/778: readlink dd/d1b/le4 0 2024-09-13T02:50:35.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/784: dread d3/dc/d4b/d9b/fe9 [0,4194304] 0 2024-09-13T02:50:35.935 INFO:tasks.workunit.client.0.smithi100.stdout:4/785: readlink d3/d6/d9/l16 0 2024-09-13T02:50:35.935 INFO:tasks.workunit.client.0.smithi100.stdout:9/779: write dd/d1b/d31/f8a [105962,2943] 0 2024-09-13T02:50:35.935 INFO:tasks.workunit.client.0.smithi100.stdout:9/780: write dd/d1b/d1d/f1f [4844708,30919] 0 2024-09-13T02:50:35.939 INFO:tasks.workunit.client.0.smithi100.stdout:9/781: dread dd/d1b/d24/f2e [0,4194304] 0 2024-09-13T02:50:35.939 INFO:tasks.workunit.client.0.smithi100.stdout:9/782: write dd/d1b/d27/d51/de9/f114 [299043,38286] 0 2024-09-13T02:50:35.950 INFO:tasks.workunit.client.0.smithi100.stdout:7/919: dwrite d3/d5/f1e [0,4194304] 0 2024-09-13T02:50:35.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/887: dwrite de/d14/d22/d29/d64/f7e [4194304,4194304] 0 2024-09-13T02:50:35.951 INFO:tasks.workunit.client.0.smithi100.stdout:1/888: write de/d14/d22/d29/d64/f89 [4567012,104196] 0 2024-09-13T02:50:35.954 INFO:tasks.workunit.client.0.smithi100.stdout:7/920: link d3/d5/fe0 d3/d9b/d115/f135 0 2024-09-13T02:50:35.954 INFO:tasks.workunit.client.0.smithi100.stdout:7/921: chown d3/cdd 875 1 2024-09-13T02:50:35.955 INFO:tasks.workunit.client.0.smithi100.stdout:0/862: dwrite d2/dd/d54/d47/d8a/dfa/d97/f103 [0,4194304] 0 2024-09-13T02:50:35.955 INFO:tasks.workunit.client.0.smithi100.stdout:1/889: unlink de/d14/d22/d52/d7a/ce6 0 2024-09-13T02:50:35.956 INFO:tasks.workunit.client.0.smithi100.stdout:9/783: dwrite dd/d1b/d24/f35 [0,4194304] 0 2024-09-13T02:50:35.956 INFO:tasks.workunit.client.0.smithi100.stdout:7/922: symlink d3/d16/d55/d56/d9e/d9f/de9/df0/l136 0 2024-09-13T02:50:35.959 INFO:tasks.workunit.client.0.smithi100.stdout:0/863: creat d2/df4/f11d x:0 0 0 2024-09-13T02:50:35.961 INFO:tasks.workunit.client.0.smithi100.stdout:9/784: mkdir dd/d1b/da3/dc9/d115 0 2024-09-13T02:50:35.962 INFO:tasks.workunit.client.0.smithi100.stdout:7/923: rename d3/d5/fd5 to d3/d16/d55/d56/d9e/d9f/de9/f137 0 2024-09-13T02:50:35.963 INFO:tasks.workunit.client.0.smithi100.stdout:9/785: symlink dd/d1b/d27/l116 0 2024-09-13T02:50:35.963 INFO:tasks.workunit.client.0.smithi100.stdout:9/786: write dd/d1b/d21/d86/f4c [1530386,66862] 0 2024-09-13T02:50:35.965 INFO:tasks.workunit.client.0.smithi100.stdout:7/924: link d3/d5/f101 d3/d16/d3b/f138 0 2024-09-13T02:50:35.965 INFO:tasks.workunit.client.0.smithi100.stdout:7/925: chown d3/d16/d55/d56/dbc/ff9 31 1 2024-09-13T02:50:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/787: mkdir dd/d1b/d1d/d28/d111/d117 0 2024-09-13T02:50:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/788: fsync dd/d1b/d24/d74/d4e/d58/f10b 0 2024-09-13T02:50:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:9/789: truncate dd/d1b/d24/d74/d4e/d58/f10b 673144 0 2024-09-13T02:50:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:7/926: mknod d3/d16/d55/d92/da9/c139 0 2024-09-13T02:50:35.966 INFO:tasks.workunit.client.0.smithi100.stdout:7/927: chown d3/d16/d3b/d8c/cc9 104 1 2024-09-13T02:50:35.967 INFO:tasks.workunit.client.0.smithi100.stdout:7/928: truncate d3/d16/d55/d92/da9/dde/d127/f71 540627 0 2024-09-13T02:50:35.967 INFO:tasks.workunit.client.0.smithi100.stdout:7/929: dread - d3/d16/d3b/da5/d87/f12d zero size 2024-09-13T02:50:35.968 INFO:tasks.workunit.client.0.smithi100.stdout:7/930: getdents d3/d16/d89 0 2024-09-13T02:50:35.969 INFO:tasks.workunit.client.0.smithi100.stdout:8/732: sync 2024-09-13T02:50:35.970 INFO:tasks.workunit.client.0.smithi100.stdout:8/733: symlink df/d13/d21/d81/db0/l104 0 2024-09-13T02:50:35.970 INFO:tasks.workunit.client.0.smithi100.stdout:8/734: chown df/d13/d21/d81/db0/fd5 7 1 2024-09-13T02:50:35.971 INFO:tasks.workunit.client.0.smithi100.stdout:8/735: link df/d13/d20/f9a df/d13/d21/f105 0 2024-09-13T02:50:35.971 INFO:tasks.workunit.client.0.smithi100.stdout:5/744: sync 2024-09-13T02:50:35.972 INFO:tasks.workunit.client.0.smithi100.stdout:3/934: sync 2024-09-13T02:50:35.972 INFO:tasks.workunit.client.0.smithi100.stdout:8/736: mkdir df/d5d/d70/d2c/d38/d9e/d106 0 2024-09-13T02:50:35.973 INFO:tasks.workunit.client.0.smithi100.stdout:5/745: mkdir db/de/ddc/d100 0 2024-09-13T02:50:35.973 INFO:tasks.workunit.client.0.smithi100.stdout:0/864: dwrite d2/dd/f10 [8388608,4194304] 0 2024-09-13T02:50:35.974 INFO:tasks.workunit.client.0.smithi100.stdout:3/935: mkdir d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/d13b 0 2024-09-13T02:50:35.975 INFO:tasks.workunit.client.0.smithi100.stdout:8/737: link df/d13/c4a df/d5d/d70/d2c/d38/d9e/dad/d101/c107 0 2024-09-13T02:50:35.977 INFO:tasks.workunit.client.0.smithi100.stdout:5/746: creat db/de/d3e/da2/ddb/f101 x:0 0 0 2024-09-13T02:50:35.978 INFO:tasks.workunit.client.0.smithi100.stdout:3/936: creat d10/d8a/df1/f13c x:0 0 0 2024-09-13T02:50:35.978 INFO:tasks.workunit.client.0.smithi100.stdout:3/937: chown d10/d21/d51/d5a/d5e/d99/lf3 38 1 2024-09-13T02:50:35.979 INFO:tasks.workunit.client.0.smithi100.stdout:3/938: rename d10/d21/d51/d5a/d5e/da1/la5 to d10/d21/d51/d5a/d5e/d90/l13d 0 2024-09-13T02:50:35.979 INFO:tasks.workunit.client.0.smithi100.stdout:7/931: dread d3/d16/d55/faf [0,4194304] 0 2024-09-13T02:50:35.982 INFO:tasks.workunit.client.0.smithi100.stdout:5/747: dread db/de/d1f/d78/fc4 [0,4194304] 0 2024-09-13T02:50:35.983 INFO:tasks.workunit.client.0.smithi100.stdout:5/748: mknod db/de/ddc/c102 0 2024-09-13T02:50:35.984 INFO:tasks.workunit.client.0.smithi100.stdout:5/749: mkdir db/de/ddc/d100/d103 0 2024-09-13T02:50:35.985 INFO:tasks.workunit.client.0.smithi100.stdout:5/750: symlink db/de/d3e/d7e/d81/l104 0 2024-09-13T02:50:35.986 INFO:tasks.workunit.client.0.smithi100.stdout:5/751: rename db/de/d1f/d2b/f2d to db/de/ddc/f105 0 2024-09-13T02:50:35.987 INFO:tasks.workunit.client.0.smithi100.stdout:5/752: mkdir db/de/ddc/d106 0 2024-09-13T02:50:35.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/753: symlink db/de/d3e/d7e/dfb/l107 0 2024-09-13T02:50:35.988 INFO:tasks.workunit.client.0.smithi100.stdout:5/754: creat db/de/d63/d9c/f108 x:0 0 0 2024-09-13T02:50:35.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/755: link db/de/ddc/fed db/de/d63/f109 0 2024-09-13T02:50:35.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/756: chown db/de/d3e/da2/ce2 1284885 1 2024-09-13T02:50:35.989 INFO:tasks.workunit.client.0.smithi100.stdout:5/757: readlink db/de/d3e/d7e/dfb/l107 0 2024-09-13T02:50:35.990 INFO:tasks.workunit.client.0.smithi100.stdout:5/758: link db/c26 db/de/d3e/c10a 0 2024-09-13T02:50:35.991 INFO:tasks.workunit.client.0.smithi100.stdout:5/759: symlink db/de/d3e/da2/l10b 0 2024-09-13T02:50:35.992 INFO:tasks.workunit.client.0.smithi100.stdout:3/939: dwrite f9 [0,4194304] 0 2024-09-13T02:50:35.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/940: rename d10/d8a/df1/c102 to d10/d21/d51/d6c/db7/c13e 0 2024-09-13T02:50:35.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/941: dread - d10/dec/f11a zero size 2024-09-13T02:50:35.994 INFO:tasks.workunit.client.0.smithi100.stdout:3/942: write d10/d21/d51/d5a/d5e/d71/d94/fb0 [132829,12819] 0 2024-09-13T02:50:35.995 INFO:tasks.workunit.client.0.smithi100.stdout:3/943: mknod d10/d21/d51/d5a/d5e/d90/c13f 0 2024-09-13T02:50:35.995 INFO:tasks.workunit.client.0.smithi100.stdout:3/944: getdents d10/d21/d51/d5a/d5e/d99/d121 0 2024-09-13T02:50:35.995 INFO:tasks.workunit.client.0.smithi100.stdout:5/760: dread db/de/d3e/f9a [0,4194304] 0 2024-09-13T02:50:35.996 INFO:tasks.workunit.client.0.smithi100.stdout:5/761: creat db/de/d3e/d7e/d81/f10c x:0 0 0 2024-09-13T02:50:35.996 INFO:tasks.workunit.client.0.smithi100.stdout:5/762: chown db/de/d3e/f9a 34451 1 2024-09-13T02:50:35.996 INFO:tasks.workunit.client.0.smithi100.stdout:5/763: write db/faf [386039,12896] 0 2024-09-13T02:50:35.997 INFO:tasks.workunit.client.0.smithi100.stdout:5/764: unlink db/de/d3e/d7e/d81/d85/cd6 0 2024-09-13T02:50:35.997 INFO:tasks.workunit.client.0.smithi100.stdout:5/765: readlink db/de/d63/d9c/lbf 0 2024-09-13T02:50:36.002 INFO:tasks.workunit.client.0.smithi100.stdout:3/945: dread d10/d21/d51/d5a/d5e/d71/f100 [0,4194304] 0 2024-09-13T02:50:36.003 INFO:tasks.workunit.client.0.smithi100.stdout:3/946: link d10/c80 d10/d21/d57/c140 0 2024-09-13T02:50:36.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/947: link d10/d21/l7e d10/d21/d51/d5a/d5e/d71/l141 0 2024-09-13T02:50:36.004 INFO:tasks.workunit.client.0.smithi100.stdout:3/948: chown d10/d21/f56 290 1 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/949: read d10/d21/f56 [7337323,51087] 0 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/950: write d10/d21/fa8 [812588,45553] 0 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/951: creat d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/f142 x:0 0 0 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/952: truncate d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 1899351 0 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/953: creat d10/d21/d51/d5a/d5e/d71/d94/f143 x:0 0 0 2024-09-13T02:50:36.010 INFO:tasks.workunit.client.0.smithi100.stdout:3/954: fdatasync d10/d21/d51/d5a/d5e/d71/d97/db1/fc3 0 2024-09-13T02:50:36.011 INFO:tasks.workunit.client.0.smithi100.stdout:3/955: rename d10/d21/l4b to d10/d21/d51/d5a/d73/l144 0 2024-09-13T02:50:36.011 INFO:tasks.workunit.client.0.smithi100.stdout:3/956: write d10/d21/f5d [814464,72645] 0 2024-09-13T02:50:36.012 INFO:tasks.workunit.client.0.smithi100.stdout:3/957: creat d10/d21/d51/d5a/d5e/d71/d94/d9c/d128/f145 x:0 0 0 2024-09-13T02:50:36.013 INFO:tasks.workunit.client.0.smithi100.stdout:3/958: creat d10/d21/d51/d5a/d5e/d71/d97/f146 x:0 0 0 2024-09-13T02:50:36.014 INFO:tasks.workunit.client.0.smithi100.stdout:3/959: mknod d10/d21/d51/d5a/d73/c147 0 2024-09-13T02:50:36.014 INFO:tasks.workunit.client.0.smithi100.stdout:3/960: rmdir d10/d21/d51/d6c/dee 39 2024-09-13T02:50:36.015 INFO:tasks.workunit.client.0.smithi100.stdout:3/961: mknod d10/dec/c148 0 2024-09-13T02:50:36.015 INFO:tasks.workunit.client.0.smithi100.stdout:3/962: write d10/d21/d51/d5a/d73/fb8 [149462,55930] 0 2024-09-13T02:50:36.015 INFO:tasks.workunit.client.0.smithi100.stdout:3/963: creat d10/dec/f149 x:0 0 0 2024-09-13T02:50:36.015 INFO:tasks.workunit.client.0.smithi100.stdout:3/964: readlink d10/d21/d51/d5a/d5e/d71/d93/l10e 0 2024-09-13T02:50:36.119 INFO:tasks.workunit.client.0.smithi100.stdout:1/890: dread de/d14/d86/dd1/f110 [0,4194304] 0 2024-09-13T02:50:36.119 INFO:tasks.workunit.client.0.smithi100.stdout:8/738: read df/d5d/d88/dc0/fc5 [112134,103725] 0 2024-09-13T02:50:36.119 INFO:tasks.workunit.client.0.smithi100.stdout:8/739: read df/d13/d21/d81/f82 [84112,49686] 0 2024-09-13T02:50:36.119 INFO:tasks.workunit.client.0.smithi100.stdout:8/740: stat df/d5d/dba/cf5 0 2024-09-13T02:50:36.122 INFO:tasks.workunit.client.0.smithi100.stdout:1/891: unlink de/d12/c16 0 2024-09-13T02:50:36.126 INFO:tasks.workunit.client.0.smithi100.stdout:6/887: write d12/d14/d5a/df0/f46 [1007034,101591] 0 2024-09-13T02:50:36.127 INFO:tasks.workunit.client.0.smithi100.stdout:6/888: write d12/d14/d1c/d6e/d71/d100/f51 [217067,33678] 0 2024-09-13T02:50:36.130 INFO:tasks.workunit.client.0.smithi100.stdout:6/889: symlink d12/d14/d1c/d28/d88/dd2/l10d 0 2024-09-13T02:50:36.130 INFO:tasks.workunit.client.0.smithi100.stdout:6/890: fdatasync d12/d14/d2f/fec 0 2024-09-13T02:50:36.130 INFO:tasks.workunit.client.0.smithi100.stdout:6/891: fsync d12/d43/d4b/d4c/fb3 0 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/932: dread d3/d16/d3b/f5d [0,4194304] 0 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/933: chown d3/d16/d89/d94 4 1 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/934: dread - d3/d16/d55/d56/dbc/ff9 zero size 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:7/935: readlink d3/d2d/l12a 0 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/892: read d12/d14/d1c/d28/f58 [161149,111464] 0 2024-09-13T02:50:36.131 INFO:tasks.workunit.client.0.smithi100.stdout:6/893: write d12/d14/d5a/df0/f98 [708058,64754] 0 2024-09-13T02:50:36.133 INFO:tasks.workunit.client.0.smithi100.stdout:7/936: rename d3/d16/d3b/f45 to d3/d16/d55/d56/f13a 0 2024-09-13T02:50:36.133 INFO:tasks.workunit.client.0.smithi100.stdout:7/937: write d3/d5/f53 [1298347,68117] 0 2024-09-13T02:50:36.133 INFO:tasks.workunit.client.0.smithi100.stdout:7/938: dread - d3/d16/d55/d56/f85 zero size 2024-09-13T02:50:36.134 INFO:tasks.workunit.client.0.smithi100.stdout:6/894: write d12/d14/d1c/f3a [818150,29822] 0 2024-09-13T02:50:36.138 INFO:tasks.workunit.client.0.smithi100.stdout:9/790: dwrite dd/d1b/d1d/d43/d5d/fcd [0,4194304] 0 2024-09-13T02:50:36.141 INFO:tasks.workunit.client.0.smithi100.stdout:6/895: dread d12/d43/d4b/f74 [0,4194304] 0 2024-09-13T02:50:36.141 INFO:tasks.workunit.client.0.smithi100.stdout:4/786: dwrite d3/d63/f106 [0,4194304] 0 2024-09-13T02:50:36.141 INFO:tasks.workunit.client.0.smithi100.stdout:9/791: dread dd/d1b/d21/d86/f90 [0,4194304] 0 2024-09-13T02:50:36.145 INFO:tasks.workunit.client.0.smithi100.stdout:7/939: read d3/d9b/d115/f119 [4001776,40779] 0 2024-09-13T02:50:36.145 INFO:tasks.workunit.client.0.smithi100.stdout:2/788: dwrite d0/db/d21/f22 [4194304,4194304] 0 2024-09-13T02:50:36.145 INFO:tasks.workunit.client.0.smithi100.stdout:2/789: truncate d0/fe 10044587 0 2024-09-13T02:50:36.148 INFO:tasks.workunit.client.0.smithi100.stdout:5/766: dwrite db/de/d3e/f7a [0,4194304] 0 2024-09-13T02:50:36.152 INFO:tasks.workunit.client.0.smithi100.stdout:2/790: dread d0/f19 [0,4194304] 0 2024-09-13T02:50:36.153 INFO:tasks.workunit.client.0.smithi100.stdout:2/791: creat d0/db/dbe/feb x:0 0 0 2024-09-13T02:50:36.153 INFO:tasks.workunit.client.0.smithi100.stdout:2/792: chown d0/db/d68/d9a/fb7 13 1 2024-09-13T02:50:36.153 INFO:tasks.workunit.client.0.smithi100.stdout:9/792: dread dd/d1b/d1d/d28/f8c [0,4194304] 0 2024-09-13T02:50:36.153 INFO:tasks.workunit.client.0.smithi100.stdout:8/741: dwrite df/d13/d20/f4e [0,4194304] 0 2024-09-13T02:50:36.154 INFO:tasks.workunit.client.0.smithi100.stdout:1/892: dwrite de/d12/f105 [0,4194304] 0 2024-09-13T02:50:36.154 INFO:tasks.workunit.client.0.smithi100.stdout:1/893: chown de/f46 87 1 2024-09-13T02:50:36.163 INFO:tasks.workunit.client.0.smithi100.stdout:6/896: rename d12/fc5 to d12/d14/d9d/db8/f10e 0 2024-09-13T02:50:36.164 INFO:tasks.workunit.client.0.smithi100.stdout:4/787: symlink d3/d6/d2f/d60/l10b 0 2024-09-13T02:50:36.164 INFO:tasks.workunit.client.0.smithi100.stdout:4/788: write d3/d63/dae/ffc [730440,97315] 0 2024-09-13T02:50:36.164 INFO:tasks.workunit.client.0.smithi100.stdout:4/789: readlink d3/d6/d21/d46/d34/l40 0 2024-09-13T02:50:36.170 INFO:tasks.workunit.client.0.smithi100.stdout:2/793: symlink d0/db/d68/d6b/da5/d8f/lec 0 2024-09-13T02:50:36.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/940: dwrite d3/d16/d55/d92/da2/fb7 [0,4194304] 0 2024-09-13T02:50:36.171 INFO:tasks.workunit.client.0.smithi100.stdout:7/941: chown d3/d5/d4f/c122 3 1 2024-09-13T02:50:36.171 INFO:tasks.workunit.client.0.smithi100.stdout:5/767: dwrite db/de/d63/f109 [0,4194304] 0 2024-09-13T02:50:36.171 INFO:tasks.workunit.client.0.smithi100.stdout:5/768: chown db/de/d3e/d7e/d81/l89 1172325 1 2024-09-13T02:50:36.172 INFO:tasks.workunit.client.0.smithi100.stdout:8/742: creat df/d13/d20/da2/f108 x:0 0 0 2024-09-13T02:50:36.172 INFO:tasks.workunit.client.0.smithi100.stdout:8/743: write df/d13/d20/f61 [578550,6679] 0 2024-09-13T02:50:36.173 INFO:tasks.workunit.client.0.smithi100.stdout:9/793: truncate dd/d1b/d21/fbc 1356088 0 2024-09-13T02:50:36.177 INFO:tasks.workunit.client.0.smithi100.stdout:2/794: write d0/db/f16 [195441,118646] 0 2024-09-13T02:50:36.178 INFO:tasks.workunit.client.0.smithi100.stdout:2/795: chown d0/db/d21/d88/fd4 1 1 2024-09-13T02:50:36.178 INFO:tasks.workunit.client.0.smithi100.stdout:2/796: fsync d0/d36/f75 0 2024-09-13T02:50:36.178 INFO:tasks.workunit.client.0.smithi100.stdout:1/894: rmdir de/d14/d22/d52 39 2024-09-13T02:50:36.179 INFO:tasks.workunit.client.0.smithi100.stdout:6/897: mknod d12/d14/d1c/d28/d88/da5/c10f 0 2024-09-13T02:50:36.183 INFO:tasks.workunit.client.0.smithi100.stdout:3/965: rmdir d10/d21/d51/d5a 39 2024-09-13T02:50:36.184 INFO:tasks.workunit.client.0.smithi100.stdout:4/790: dwrite d3/dc/d88/fba [4194304,4194304] 0 2024-09-13T02:50:36.185 INFO:tasks.workunit.client.0.smithi100.stdout:7/942: symlink d3/d16/d55/d92/da9/dde/d127/d1c/l13b 0 2024-09-13T02:50:36.185 INFO:tasks.workunit.client.0.smithi100.stdout:7/943: write d3/d16/db0/f124 [547633,107926] 0 2024-09-13T02:50:36.185 INFO:tasks.workunit.client.0.smithi100.stdout:7/944: fdatasync d3/d16/d55/d92/da9/dd3/ff7 0 2024-09-13T02:50:36.185 INFO:tasks.workunit.client.0.smithi100.stdout:5/769: chown db/de/c1a 3785 1 2024-09-13T02:50:36.186 INFO:tasks.workunit.client.0.smithi100.stdout:5/770: readlink db/de/d1f/l90 0 2024-09-13T02:50:36.186 INFO:tasks.workunit.client.0.smithi100.stdout:8/744: getdents df/d13/db5/dc3 0 2024-09-13T02:50:36.187 INFO:tasks.workunit.client.0.smithi100.stdout:9/794: mknod dd/d1b/d24/d74/d4e/c118 0 2024-09-13T02:50:36.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/797: getdents d0/db/d3f/d6a 0 2024-09-13T02:50:36.192 INFO:tasks.workunit.client.0.smithi100.stdout:6/898: rename d12/d14/d1c/d6e/d71/d100/d73/le5 to d12/d14/d9d/l110 0 2024-09-13T02:50:36.192 INFO:tasks.workunit.client.0.smithi100.stdout:3/966: getdents d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe 0 2024-09-13T02:50:36.192 INFO:tasks.workunit.client.0.smithi100.stdout:3/967: readlink d10/d21/d51/d5a/d5e/d71/d94/l10b 0 2024-09-13T02:50:36.194 INFO:tasks.workunit.client.0.smithi100.stdout:5/771: read db/de/d3e/d7e/d81/f8d [1390268,18704] 0 2024-09-13T02:50:36.198 INFO:tasks.workunit.client.0.smithi100.stdout:9/795: mkdir dd/d1b/d27/d119 0 2024-09-13T02:50:36.198 INFO:tasks.workunit.client.0.smithi100.stdout:7/945: dwrite d3/d16/fd0 [0,4194304] 0 2024-09-13T02:50:36.200 INFO:tasks.workunit.client.0.smithi100.stdout:2/798: link d0/db/d21/d88/c67 d0/db/d68/d6b/da5/dcf/ced 0 2024-09-13T02:50:36.200 INFO:tasks.workunit.client.0.smithi100.stdout:2/799: creat d0/db/d21/d57/d81/fee x:0 0 0 2024-09-13T02:50:36.201 INFO:tasks.workunit.client.0.smithi100.stdout:6/899: creat d12/d14/d68/d105/f111 x:0 0 0 2024-09-13T02:50:36.202 INFO:tasks.workunit.client.0.smithi100.stdout:3/968: getdents d10/d21/d51/d5a/d5e/d71/d94/d9c/db4 0 2024-09-13T02:50:36.204 INFO:tasks.workunit.client.0.smithi100.stdout:7/946: mknod d3/d16/d3b/c13c 0 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/969: chown d10/d21/d51/d5a/l68 492818155 1 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/970: creat d10/d21/d51/d6c/f14a x:0 0 0 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/971: write d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/f142 [68339,48196] 0 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/972: truncate d10/d21/d51/d5a/d5e/d99/dc7/dfa/dfe/f105 527044 0 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/973: write d10/ded/f112 [132022,117678] 0 2024-09-13T02:50:36.207 INFO:tasks.workunit.client.0.smithi100.stdout:3/974: truncate d10/d21/d51/d6c/f138 331569 0 2024-09-13T02:50:36.208 INFO:tasks.workunit.client.0.smithi100.stdout:5/772: mknod db/de/c10d 0 2024-09-13T02:50:36.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/975: rename d10/c4a to d10/d21/d51/d5a/d5e/d99/c14b 0 2024-09-13T02:50:36.214 INFO:tasks.workunit.client.0.smithi100.stdout:3/976: write d10/d21/d51/d6c/f8c [751826,32985] 0 2024-09-13T02:50:36.218 INFO:tasks.workunit.client.0.smithi100.stdout:6/900: getdents d12/d14/d1c/d28/d88/da5 0 2024-09-13T02:50:36.219 INFO:tasks.workunit.client.0.smithi100.stdout:6/901: read d12/d14/d1c/f3a [849216,43722] 0 2024-09-13T02:50:36.221 INFO:tasks.workunit.client.0.smithi100.stdout:6/902: mkdir d12/d14/d1c/d6e/d71/d100/db9/d112 0 2024-09-13T02:50:36.221 INFO:tasks.workunit.client.0.smithi100.stdout:5/773: write db/de/d1f/d2b/f35 [117117,4885] 0 2024-09-13T02:50:36.223 INFO:tasks.workunit.client.0.smithi100.stdout:0/865: sync 2024-09-13T02:50:36.225 INFO:tasks.workunit.client.0.smithi100.stdout:0/866: creat d2/dd/d54/d47/d8a/dfa/d97/d105/f11e x:0 0 0 2024-09-13T02:50:36.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/867: symlink d2/dd/d54/d47/d34/da3/l11f 0 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/796: dwrite dd/d1b/d21/d86/fca [0,4194304] 0 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/797: creat dd/d1b/d27/d51/f11a x:0 0 0 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/798: fsync dd/d1b/d21/d86/fda 0 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/799: fsync dd/d1b/d1d/d43/d5d/f7b 0 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:9/800: dread - dd/d1b/d24/d74/fce zero size 2024-09-13T02:50:36.228 INFO:tasks.workunit.client.0.smithi100.stdout:0/868: symlink d2/dd/d93/da2/l120 0 2024-09-13T02:50:36.231 INFO:tasks.workunit.client.0.smithi100.stdout:9/801: link dd/d1b/d1d/d43/d4f/fd9 dd/d1b/d24/d74/d4e/dc4/f11b 0 2024-09-13T02:50:36.232 INFO:tasks.workunit.client.0.smithi100.stdout:0/869: truncate d2/dd/d54/d28/f35 1338399 0 2024-09-13T02:50:36.233 INFO:tasks.workunit.client.0.smithi100.stdout:9/802: symlink dd/d1b/d1d/d43/d5e/l11c 0 2024-09-13T02:50:36.234 INFO:tasks.workunit.client.0.smithi100.stdout:3/977: write d10/d21/f3b [216212,65092] 0 2024-09-13T02:50:36.234 INFO:tasks.workunit.client.0.smithi100.stdout:2/800: dwrite d0/d36/d8a/fa2 [0,4194304] 0 2024-09-13T02:50:36.235 INFO:tasks.workunit.client.0.smithi100.stdout:9/803: dread dd/d1b/d27/d51/de9/f114 [0,4194304] 0 2024-09-13T02:50:36.235 INFO:tasks.workunit.client.0.smithi100.stdout:0/870: unlink d2/d9/c3d 0 2024-09-13T02:50:36.237 INFO:tasks.workunit.client.0.smithi100.stdout:3/978: mkdir d10/d21/d51/d6c/d14c 0 2024-09-13T02:50:36.237 INFO:tasks.workunit.client.0.smithi100.stdout:3/979: creat d10/d21/d51/d6c/f14d x:0 0 0 2024-09-13T02:50:36.237 INFO:tasks.workunit.client.0.smithi100.stdout:3/980: write d10/d21/d51/d5a/d5e/f98 [354846,67345] 0 2024-09-13T02:50:36.237 INFO:tasks.workunit.client.0.smithi100.stdout:6/903: dread d12/d14/d1c/d6e/d71/f97 [0,4194304] 0 2024-09-13T02:50:36.238 INFO:tasks.workunit.client.0.smithi100.stdout:9/804: creat dd/d1b/d1d/d28/d111/d117/f11d x:0 0 0 2024-09-13T02:50:36.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/871: dread d2/dd/d54/d47/d34/da3/f119 [0,4194304] 0 2024-09-13T02:50:36.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/872: chown d2/d1a/d4c/d7f/fbe 15765375 1 2024-09-13T02:50:36.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/873: fsync d2/dd/d54/d47/f2d 0 2024-09-13T02:50:36.238 INFO:tasks.workunit.client.0.smithi100.stdout:0/874: stat d2/dd/db0/f16 0 2024-09-13T02:50:36.239 INFO:tasks.workunit.client.0.smithi100.stdout:3/981: mkdir d10/d21/d57/d14e 0 2024-09-13T02:50:36.239 INFO:tasks.workunit.client.0.smithi100.stdout:3/982: chown d10/d21/d51/d5a/d5e/d99/dc7/cda 0 1 2024-09-13T02:50:36.240 INFO:tasks.workunit.client.0.smithi100.stdout:0/875: symlink d2/dd/l121 0 2024-09-13T02:50:36.241 INFO:tasks.workunit.client.0.smithi100.stdout:3/983: mkdir d10/ded/d14f 0 2024-09-13T02:50:36.243 INFO:tasks.workunit.client.0.smithi100.stdout:0/876: rename d2/d9/d6d/d85/de5/deb to d2/dd/d93/da2/dff/d122 0 2024-09-13T02:50:36.243 INFO:tasks.workunit.client.0.smithi100.stdout:7/947: dwrite d3/d16/d55/d92/da9/dde/f10e [0,4194304] 0 2024-09-13T02:50:36.244 INFO:tasks.workunit.client.0.smithi100.stdout:0/877: creat d2/d1a/d4c/f123 x:0 0 0 2024-09-13T02:50:36.245 INFO:tasks.workunit.client.0.smithi100.stdout:0/878: write d2/d9/f86 [2951885,118807] 0 2024-09-13T02:50:36.245 INFO:tasks.workunit.client.0.smithi100.stdout:0/879: chown d2/fa 15413 1 2024-09-13T02:50:36.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/948: rename d3/d16/d55/d92/da9/dd3/f11c to d3/d9b/f13d 0 2024-09-13T02:50:36.250 INFO:tasks.workunit.client.0.smithi100.stdout:7/949: truncate d3/d16/d55/fc7 636858 0 2024-09-13T02:50:36.250 INFO:tasks.workunit.client.0.smithi100.stdout:0/880: mknod d2/dd/d54/d28/ddf/c124 0 2024-09-13T02:50:36.250 INFO:tasks.workunit.client.0.smithi100.stdout:9/805: dread dd/d1b/d1d/d43/d5d/f64 [0,4194304] 0 2024-09-13T02:50:36.251 INFO:tasks.workunit.client.0.smithi100.stdout:2/801: write d0/f64 [3291044,119596] 0 2024-09-13T02:50:36.251 INFO:tasks.workunit.client.0.smithi100.stdout:7/950: mkdir d3/d16/d3b/da5/d87/d13e 0 2024-09-13T02:50:36.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/806: unlink dd/d1b/da3/lcc 0 2024-09-13T02:50:36.255 INFO:tasks.workunit.client.0.smithi100.stdout:9/807: readlink dd/d1b/d21/d86/l94 0 2024-09-13T02:50:36.255 INFO:tasks.workunit.client.0.smithi100.stdout:5/774: dwrite db/de/f7b [4194304,4194304] 0 2024-09-13T02:50:36.256 INFO:tasks.workunit.client.0.smithi100.stdout:6/904: dwrite d12/d43/fc2 [0,4194304] 0 2024-09-13T02:50:36.256 INFO:tasks.workunit.client.0.smithi100.stdout:2/802: symlink d0/db/d3f/d6a/d7f/lef 0 2024-09-13T02:50:36.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/775: symlink db/de/d3e/d7e/dfb/l10e 0 2024-09-13T02:50:36.257 INFO:tasks.workunit.client.0.smithi100.stdout:5/776: dread - db/de/d63/d9c/fca zero size 2024-09-13T02:50:36.260 INFO:tasks.workunit.client.0.smithi100.stdout:9/808: dread dd/d1b/d24/d74/d4e/d58/f10b [0,4194304] 0 2024-09-13T02:50:36.268 INFO:tasks.workunit.client.0.smithi100.stdout:6/905: mkdir d12/d14/df2/d113 0 2024-09-13T02:50:36.275 INFO:tasks.workunit.client.0.smithi100.stdout:2/803: rmdir d0/db/d68/d6b/d85/ddb 0 2024-09-13T02:50:36.277 INFO:tasks.workunit.client.0.smithi100.stdout:5/777: rename db/de/d3e/f9a to db/de/d3e/da2/ddb/f10f 0 2024-09-13T02:50:36.277 INFO:tasks.workunit.client.0.smithi100.stdout:5/778: fdatasync db/de/f52 0 2024-09-13T02:50:36.278 INFO:tasks.workunit.client.0.smithi100.stdout:0/881: dwrite d2/d9/fb [0,4194304] 0 2024-09-13T02:50:36.278 INFO:tasks.workunit.client.0.smithi100.stdout:0/882: chown d2/dd/d54/d28/f35 677373 1 2024-09-13T02:50:36.278 INFO:tasks.workunit.client.0.smithi100.stdout:7/951: dwrite d3/f4c [0,4194304] 0 2024-09-13T02:50:36.279 INFO:tasks.workunit.client.0.smithi100.stdout:7/952: chown d3/d16/d55/d92/da9/dde/d127/d1c 256294 1 2024-09-13T02:50:36.279 INFO:tasks.workunit.client.0.smithi100.stdout:7/953: dread - d3/d16/d3b/f138 zero size 2024-09-13T02:50:36.279 INFO:tasks.workunit.client.0.smithi100.stdout:9/809: unlink dd/d1b/d1d/d43/d5e/dc0/fdd 0 2024-09-13T02:50:36.279 INFO:tasks.workunit.client.0.smithi100.stdout:9/810: truncate dd/d1b/d31/f8a 671254 0 2024-09-13T02:50:36.279 INFO:tasks.workunit.client.0.smithi100.stdout:9/811: write dd/d1b/d1d/d43/d4f/da5/ff2 [245429,25244] 0 2024-09-13T02:50:36.280 INFO:tasks.workunit.client.0.smithi100.stdout:2/804: truncate d0/f2c 3445975 0 2024-09-13T02:50:36.282 INFO:tasks.workunit.client.0.smithi100.stdout:6/906: rename d12/d43/d4b/f74 to d12/d14/d9d/f114 0 2024-09-13T02:50:36.282 INFO:tasks.workunit.client.0.smithi100.stdout:6/907: dread - d12/d14/d1c/d6e/d71/f102 zero size 2024-09-13T02:50:36.283 INFO:tasks.workunit.client.0.smithi100.stdout:5/779: creat db/de/d3e/d71/dd9/f110 x:0 0 0 2024-09-13T02:50:36.283 INFO:tasks.workunit.client.0.smithi100.stdout:5/780: dread - db/de/d63/fb0 zero size 2024-09-13T02:50:36.283 INFO:tasks.workunit.client.0.smithi100.stdout:5/781: chown db/de/d3e/d71/dd9 12715 1 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:0/883: rmdir d2/d1a/d51/d11a 0 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:2/805: dread d0/db/d68/d6b/d85/fe8 [0,4194304] 0 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:0/884: write d2/d9/f1b [143565,50595] 0 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:2/806: chown d0/db/d68/d6b/d71/d73/f7e 0 1 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/812: dread dd/d1b/d7d/f7e [0,4194304] 0 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:9/813: creat dd/d1b/d24/d74/d4e/d58/db8/f11e x:0 0 0 2024-09-13T02:50:36.287 INFO:tasks.workunit.client.0.smithi100.stdout:7/954: creat d3/d16/d55/d92/da9/dde/d127/d1c/d36/f13f x:0 0 0 2024-09-13T02:50:36.288 INFO:tasks.workunit.client.0.smithi100.stdout:6/908: getdents d12/d14/d2f 0 2024-09-13T02:50:36.288 INFO:tasks.workunit.client.0.smithi100.stdout:6/909: write d12/d14/d68/f8d [670328,37629] 0 2024-09-13T02:50:36.289 INFO:tasks.workunit.client.0.smithi100.stdout:5/782: mknod db/de/d1f/d2b/c111 0 2024-09-13T02:50:36.290 INFO:tasks.workunit.client.0.smithi100.stdout:2/807: symlink d0/db/d21/d57/lf0 0 2024-09-13T02:50:36.292 INFO:tasks.workunit.client.0.smithi100.stdout:9/814: link dd/d1b/d1d/d43/d5d/c60 dd/d1b/d1d/d43/d5d/c11f 0 2024-09-13T02:50:36.293 INFO:tasks.workunit.client.0.smithi100.stdout:7/955: symlink d3/d16/d55/d92/da9/dde/d127/d1c/d36/d9c/l140 0 2024-09-13T02:50:36.295 INFO:tasks.workunit.client.0.smithi100.stdout:6/910: creat d12/d14/d2f/da4/f115 x:0 0 0 2024-09-13T02:50:36.297 INFO:tasks.workunit.client.0.smithi100.stdout:5/783: rename db/f5b to db/de/d3e/da2/dac/f112 0 2024-09-13T02:50:36.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/808: creat d0/db/dbe/dc3/ff1 x:0 0 0 2024-09-13T02:50:36.299 INFO:tasks.workunit.client.0.smithi100.stdout:2/809: truncate d0/db/d3f/f89 665190 0 2024-09-13T02:50:36.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/815: symlink dd/d1b/d1d/d43/d5e/dc0/l120 0 2024-09-13T02:50:36.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/816: fdatasync dd/d1b/d27/d51/f57 0 2024-09-13T02:50:36.301 INFO:tasks.workunit.client.0.smithi100.stdout:9/817: truncate f5 5189775 0 2024-09-13T02:50:36.302 INFO:tasks.workunit.client.0.smithi100.stdout:9/818: dread dd/d1b/d24/f67 [0,4194304] 0 2024-09-13T02:50:36.302 INFO:tasks.workunit.client.0.smithi100.stdout:7/956: mkdir d3/d5/d141 0 2024-09-13T02:50:36.304 INFO:tasks.workunit.client.0.smithi100.stdout:0/885: dwrite d2/d9/f1b [0,4194304] 0 2024-09-13T02:50:36.305 INFO:tasks.workunit.client.0.smithi100.stdout:6/911: unlink d12/d2e/d90/da2/dbc/dce/c107 0 2024-09-13T02:50:36.306 INFO:tasks.workunit.client.0.smithi100.stdout:5/784: symlink db/de/d3e/d71/dd9/l113 0 2024-09-13T02:50:36.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/895: sync 2024-09-13T02:50:36.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/896: write de/d14/d2e/d60/f109 [1139091,102541] 0 2024-09-13T02:50:36.309 INFO:tasks.workunit.client.0.smithi100.stdout:1/897: chown de/d14/d22/d52/d7a/d81/de0/ff1 16 1 2024-09-13T02:50:36.315 INFO:tasks.workunit.client.0.smithi100.stdout:1/898: dread de/f3a [0,4194304] 0 2024-09-13T02:50:36.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/886: mknod d2/d9/d6d/d85/c125 0 2024-09-13T02:50:36.317 INFO:tasks.workunit.client.0.smithi100.stdout:0/887: fdatasync d2/dd/d54/d47/d8a/dfa/d97/d105/f11e 0 2024-09-13T02:50:36.318 INFO:tasks.workunit.client.0.smithi100.stdout:6/912: creat d12/d14/d2f/f116 x:0 0 0 2024-09-13T02:50:36.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/913: read d12/d14/d1c/d6e/d71/fb6 [1444689,83108] 0 2024-09-13T02:50:36.319 INFO:tasks.workunit.client.0.smithi100.stdout:6/914: chown d12/d14/d68 1497 1 2024-09-13T02:50:36.319 INFO:tasks.workunit.client.0.smithi100.stdout:5/785: creat db/de/d1f/d2b/f114 x:0 0 0 2024-09-13T02:50:36.327 INFO:tasks.workunit.client.0.smithi100.stdout:0/888: truncate d2/dd/d54/d47/d8a/dfa/d4b/f4d 2440523 0 2024-09-13T02:50:36.329 INFO:tasks.workunit.client.0.smithi100.stdout:2/810: rename d0/db/d3f to d0/db/d68/d9a/df2 0 2024-09-13T02:50:36.329 INFO:tasks.workunit.client.0.smithi100.stdout:2/811: write d0/db/d68/d6b/d71/fb0 [716967,117729] 0 2024-09-13T02:50:36.330 INFO:tasks.workunit.client.0.smithi100.stdout:0/889: rmdir d2/dd/d54/d47/d34 39 2024-09-13T02:50:36.332 INFO:tasks.workunit.client.0.smithi100.stdout:0/890: mknod d2/dd/d54/d47/d34/d3c/c126 0 2024-09-13T02:50:36.337 INFO:tasks.workunit.client.0.smithi100.stdout:1/899: dwrite de/d14/d22/d52/db8/ff9 [0,4194304] 0 2024-09-13T02:50:36.338 INFO:tasks.workunit.client.0.smithi100.stdout:1/900: read de/d14/d44/d61/ded/df7/f100 [271180,105014] 0 2024-09-13T02:50:36.338 INFO:tasks.workunit.client.0.smithi100.stdout:1/901: fsync de/d14/d44/d7f/fb3 0 2024-09-13T02:50:36.341 INFO:tasks.workunit.client.0.smithi100.stdout:4/791: sync 2024-09-13T02:50:36.341 INFO:tasks.workunit.client.0.smithi100.stdout:8/745: sync 2024-09-13T02:50:36.341 INFO:tasks.workunit.client.0.smithi100.stdout:3/984: sync 2024-09-13T02:50:36.341 INFO:tasks.workunit.client.0.smithi100.stdout:3/985: creat d10/dec/f150 x:0 0 0 2024-09-13T02:50:36.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/812: dwrite d0/db/d21/d57/f98 [0,4194304] 0 2024-09-13T02:50:36.343 INFO:tasks.workunit.client.0.smithi100.stdout:1/902: rename de/d14/d44/d7f/f8b to de/d14/d2e/d48/f11a 0 2024-09-13T02:50:36.343 INFO:tasks.workunit.client.0.smithi100.stdout:0/891: dread d2/d9/fb [0,4194304] 0 2024-09-13T02:50:36.343 INFO:tasks.workunit.client.0.smithi100.stdout:0/892: read - d2/d1a/f9c zero size 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/746: unlink df/d5d/d70/d2c/ce6 0 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/747: write df/d5d/d70/d2c/d38/f5b [2339910,29636] 0 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/748: chown df/d5d/fb1 73722645 1 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/749: write df/d13/d21/d81/fc8 [151494,35624] 0 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/750: chown df/d5d/dba/le2 21048253 1 2024-09-13T02:50:36.345 INFO:tasks.workunit.client.0.smithi100.stdout:8/751: fsync df/d13/db5/dc3/de0/ff4 0 2024-09-13T02:50:36.346 INFO:tasks.workunit.client.0.smithi100.stdout:8/752: write df/d5d/d70/d2c/d38/f5b [2187279,30448] 0 2024-09-13T02:50:36.346 INFO:tasks.workunit.client.0.smithi100.stdout:8/753: write df/d13/d20/d98/fdf [843719,106351] 0 2024-09-13T02:50:36.348 INFO:tasks.workunit.client.0.smithi100.stdout:1/903: link de/d14/d2e/d60/f109 de/d14/d2e/d75/f11b 0 2024-09-13T02:50:36.348 INFO:tasks.workunit.client.0.smithi100.stdout:1/904: truncate de/d14/d22/d52/d65/dc6/fe2 4726112 0 2024-09-13T02:50:36.348 INFO:tasks.workunit.client.0.smithi100.stdout:1/905: readlink l3 0 2024-09-13T02:50:36.349 INFO:tasks.workunit.client.0.smithi100.stdout:0/893: creat d2/d9/d6d/d85/dcd/df8/f127 x:0 0 0 2024-09-13T02:50:36.349 INFO:tasks.workunit.client.0.smithi100.stdout:0/894: chown d2/dd/d54/d3e 1154609 1 2024-09-13T02:50:36.350 INFO:tasks.workunit.client.0.smithi100.stdout:3/986: truncate d10/d21/d51/d6c/f6f 3783309 0 2024-09-13T02:50:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:1/906: dread de/d14/d22/dfa/dd3/f78 [0,4194304] 0 2024-09-13T02:50:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:1/907: write de/d14/d22/d29/d108/f113 [358772,22237] 0 2024-09-13T02:50:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:0/895: unlink d2/dd/d54/d47/d34/d91/led 0 2024-09-13T02:50:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:0/896: truncate d2/dd/d93/da2/fd3 792208 0 2024-09-13T02:50:36.353 INFO:tasks.workunit.client.0.smithi100.stdout:0/897: creat d2/dd/f128 x:0 0 0 2024-09-13T02:50:36.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/792: read d3/dc/d4b/f87 [2246781,45722] 0 2024-09-13T02:50:36.354 INFO:tasks.workunit.client.0.smithi100.stdout:4/793: readlink d3/d6/d21/d46/lee 0 2024-09-13T02:50:36.354 INFO:tasks.workunit.client.0.smithi100.stdout:3/987: symlink d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/l151 0 2024-09-13T02:50:36.355 INFO:tasks.workunit.client.0.smithi100.stdout:1/908: symlink de/d14/d22/d52/d7a/l11c 0 2024-09-13T02:50:36.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/813: dread d0/db/d21/f30 [4194304,4194304] 0 2024-09-13T02:50:36.356 INFO:tasks.workunit.client.0.smithi100.stdout:2/814: fdatasync d0/db/d68/d6b/d85/fbf 0 2024-09-13T02:50:36.357 INFO:tasks.workunit.client.0.smithi100.stdout:0/898: symlink d2/dd/db0/de0/l129 0 2024-09-13T02:50:36.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/754: dwrite df/d13/d21/f105 [0,4194304] 0 2024-09-13T02:50:36.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/755: write df/d13/d21/d81/db0/fd5 [64298,23580] 0 2024-09-13T02:50:36.358 INFO:tasks.workunit.client.0.smithi100.stdout:8/756: fsync df/d13/d20/da2/fae 0 2024-09-13T02:50:36.359 INFO:tasks.workunit.client.0.smithi100.stdout:4/794: rename d3/d6/d2f/d60/lcf to d3/d63/l10c 0 2024-09-13T02:50:36.360 INFO:tasks.workunit.client.0.smithi100.stdout:1/909: mknod de/d14/d22/d52/d65/c11d 0 2024-09-13T02:50:36.361 INFO:tasks.workunit.client.0.smithi100.stdout:2/815: mknod d0/db/d68/d9a/df2/d6a/d7f/d95/cf3 0 2024-09-13T02:50:36.363 INFO:tasks.workunit.client.0.smithi100.stdout:8/757: dread df/d13/d21/d81/db0/fd5 [0,4194304] 0 2024-09-13T02:50:36.364 INFO:tasks.workunit.client.0.smithi100.stdout:0/899: dread d2/d1a/d51/fe4 [0,4194304] 0 2024-09-13T02:50:36.368 INFO:tasks.workunit.client.0.smithi100.stdout:4/795: symlink d3/dc/d4b/d52/dd1/l10d 0 2024-09-13T02:50:36.368 INFO:tasks.workunit.client.0.smithi100.stdout:8/758: creat df/d5d/d70/d2c/d38/d9e/dad/d101/f109 x:0 0 0 2024-09-13T02:50:36.371 INFO:tasks.workunit.client.0.smithi100.stdout:1/910: dread de/d14/d2e/d48/ff4 [0,4194304] 0 2024-09-13T02:50:36.372 INFO:tasks.workunit.client.0.smithi100.stdout:4/796: rename d3/d3a/d5c/ldd to d3/d3a/l10e 0 2024-09-13T02:50:36.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/759: getdents df/d13/d21/d81 0 2024-09-13T02:50:36.375 INFO:tasks.workunit.client.0.smithi100.stdout:4/797: truncate d3/dc/d88/db4/fcd 514360 0 2024-09-13T02:50:36.375 INFO:tasks.workunit.client.0.smithi100.stdout:4/798: fsync d3/dc/d4b/d8a/fe4 0 2024-09-13T02:50:36.377 INFO:tasks.workunit.client.0.smithi100.stdout:8/760: mknod df/d5d/d70/d2c/d38/d9e/d106/c10a 0 2024-09-13T02:50:36.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/799: truncate d3/d63/f6a 1971898 0 2024-09-13T02:50:36.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/800: chown d3/d6/d21/f43 61127 1 2024-09-13T02:50:36.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/801: write d3/d3a/d56/fe2 [942467,42642] 0 2024-09-13T02:50:36.380 INFO:tasks.workunit.client.0.smithi100.stdout:4/802: chown d3/dc/d4b/d52/f8c 760340 1 2024-09-13T02:50:36.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/761: symlink df/d5d/dba/dcb/l10b 0 2024-09-13T02:50:36.381 INFO:tasks.workunit.client.0.smithi100.stdout:8/762: fdatasync df/d13/d20/d98/fdf 0 2024-09-13T02:50:36.384 INFO:tasks.workunit.client.0.smithi100.stdout:3/988: dwrite d10/d21/d51/d5a/d5e/d71/d97/db1/f11e [0,4194304] 0 2024-09-13T02:50:36.386 INFO:tasks.workunit.client.0.smithi100.stdout:4/803: rmdir d3/dc/d88 39 2024-09-13T02:50:36.386 INFO:tasks.workunit.client.0.smithi100.stdout:4/804: fsync d3/d6/d2f/d7a/fc7 0 2024-09-13T02:50:36.386 INFO:tasks.workunit.client.0.smithi100.stdout:0/900: dwrite d2/dd/d54/d47/d8a/dfa/d4b/f72 [4194304,4194304] 0 2024-09-13T02:50:36.387 INFO:tasks.workunit.client.0.smithi100.stdout:2/816: dwrite d0/db/d21/d57/f98 [0,4194304] 0 2024-09-13T02:50:36.390 INFO:tasks.workunit.client.0.smithi100.stdout:3/989: mknod d10/d21/d51/d6c/dd3/c152 0 2024-09-13T02:50:36.390 INFO:tasks.workunit.client.0.smithi100.stdout:3/990: write d10/d21/f29 [3051312,81069] 0 2024-09-13T02:50:36.390 INFO:tasks.workunit.client.0.smithi100.stdout:3/991: chown d10/d21/d57/cef 1 1 2024-09-13T02:50:36.392 INFO:tasks.workunit.client.0.smithi100.stdout:4/805: creat d3/dc/d88/f10f x:0 0 0 2024-09-13T02:50:36.393 INFO:tasks.workunit.client.0.smithi100.stdout:0/901: mkdir d2/d1a/d4c/d12a 0 2024-09-13T02:50:36.396 INFO:tasks.workunit.client.0.smithi100.stdout:8/763: getdents df/d5d/d70/d2c/d38/d9e/dad/d101 0 2024-09-13T02:50:36.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/911: dwrite de/d14/d44/d61/f90 [0,4194304] 0 2024-09-13T02:50:36.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/912: creat de/d14/d86/dd1/f11e x:0 0 0 2024-09-13T02:50:36.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/913: readlink de/d14/d44/d7f/dc2/lf0 0 2024-09-13T02:50:36.398 INFO:tasks.workunit.client.0.smithi100.stdout:0/902: creat d2/dd/d54/d47/f12b x:0 0 0 2024-09-13T02:50:36.398 INFO:tasks.workunit.client.0.smithi100.stdout:0/903: write d2/dd/d54/d28/f94 [428381,38901] 0 2024-09-13T02:50:36.398 INFO:tasks.workunit.client.0.smithi100.stdout:0/904: chown d2/d1a/d4c/d7f/fbe 68 1 2024-09-13T02:50:36.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/764: symlink df/dac/dd3/l10c 0 2024-09-13T02:50:36.405 INFO:tasks.workunit.client.0.smithi100.stdout:1/914: mkdir de/d14/df5/dff/d101/d11f 0 2024-09-13T02:50:36.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/765: rename df/d85/cda to df/d6f/c10d 0 2024-09-13T02:50:36.408 INFO:tasks.workunit.client.0.smithi100.stdout:8/766: fdatasync df/d5d/d70/d2c/d38/d9e/dad/fc6 0 2024-09-13T02:50:36.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/915: truncate de/f46 2338698 0 2024-09-13T02:50:36.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/916: write de/d14/d44/d61/ded/df7/f100 [1135352,10338] 0 2024-09-13T02:50:36.409 INFO:tasks.workunit.client.0.smithi100.stdout:1/917: truncate de/d14/d22/d52/db8/faa 5179996 0 2024-09-13T02:50:36.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/905: getdents d2 0 2024-09-13T02:50:36.411 INFO:tasks.workunit.client.0.smithi100.stdout:0/906: dread - d2/d1a/d51/f7d zero size 2024-09-13T02:50:36.413 INFO:tasks.workunit.client.0.smithi100.stdout:8/767: mkdir df/d13/d5c/d10e 0 2024-09-13T02:50:36.414 INFO:tasks.workunit.client.0.smithi100.stdout:0/907: symlink d2/d9/d6d/d85/de5/l12c 0 2024-09-13T02:50:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:2/817: dwrite d0/db/d21/f30 [4194304,4194304] 0 2024-09-13T02:50:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:4/806: dread d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/768: creat df/d5d/d70/d2c/d38/d9e/f10f x:0 0 0 2024-09-13T02:50:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/769: truncate df/d13/f44 1834488 0 2024-09-13T02:50:36.415 INFO:tasks.workunit.client.0.smithi100.stdout:8/770: chown df/dac/dd3 57061 1 2024-09-13T02:50:36.416 INFO:tasks.workunit.client.0.smithi100.stdout:2/818: chown d0/db/d21/d5a/lb5 0 1 2024-09-13T02:50:36.417 INFO:tasks.workunit.client.0.smithi100.stdout:4/807: truncate d3/d6/d2f/d60/fbc 624259 0 2024-09-13T02:50:36.419 INFO:tasks.workunit.client.0.smithi100.stdout:8/771: getdents df 0 2024-09-13T02:50:36.420 INFO:tasks.workunit.client.0.smithi100.stdout:8/772: read df/d5d/d70/f39 [318849,110839] 0 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:7/957: sync 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:9/819: sync 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:7/958: chown d3/d16/d3b/lcb 1105 1 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:7/959: stat d3/d16/d55/d56/d9e/d9f/fbf 0 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:4/808: dread d3/d6/d21/d67/f90 [0,4194304] 0 2024-09-13T02:50:36.422 INFO:tasks.workunit.client.0.smithi100.stdout:1/918: dread de/d14/d44/d7f/dc2/fdf [0,4194304] 0 2024-09-13T02:50:36.423 INFO:tasks.workunit.client.0.smithi100.stdout:8/773: unlink df/d13/d21/l3d 0 2024-09-13T02:50:36.425 INFO:tasks.workunit.client.0.smithi100.stdout:9/820: dread dd/d1b/fb0 [0,4194304] 0 2024-09-13T02:50:36.425 INFO:tasks.workunit.client.0.smithi100.stdout:8/774: creat df/dbb/f110 x:0 0 0 2024-09-13T02:50:36.427 INFO:tasks.workunit.client.0.smithi100.stdout:9/821: mkdir dd/d1b/d27/d51/de9/d121 0 2024-09-13T02:50:36.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/775: creat df/d5d/d70/d2c/de3/f111 x:0 0 0 2024-09-13T02:50:36.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/776: write df/d5d/d70/d2c/faa [45686,5481] 0 2024-09-13T02:50:36.430 INFO:tasks.workunit.client.0.smithi100.stdout:9/822: mknod dd/d1b/d1d/d28/d111/c122 0 2024-09-13T02:50:36.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/823: dread dd/d1b/d1d/f3b [0,4194304] 0 2024-09-13T02:50:36.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/824: fdatasync dd/d1b/d21/d86/fca 0 2024-09-13T02:50:36.433 INFO:tasks.workunit.client.0.smithi100.stdout:9/825: fsync dd/d1b/d21/f109 0 2024-09-13T02:50:36.438 INFO:tasks.workunit.client.0.smithi100.stdout:9/826: read dd/fe [1005010,86447] 0 2024-09-13T02:50:36.438 INFO:tasks.workunit.client.0.smithi100.stdout:0/908: dwrite d2/dd/d54/d47/d8a/dfa/d4b/f4d [0,4194304] 0 2024-09-13T02:50:36.439 INFO:tasks.workunit.client.0.smithi100.stdout:9/827: mknod dd/d1b/d21/c123 0 2024-09-13T02:50:36.440 INFO:tasks.workunit.client.0.smithi100.stdout:0/909: mkdir d2/dd/d54/d47/d34/da3/d12d 0 2024-09-13T02:50:36.440 INFO:tasks.workunit.client.0.smithi100.stdout:9/828: creat dd/f124 x:0 0 0 2024-09-13T02:50:36.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/829: creat dd/d1b/d27/d51/f125 x:0 0 0 2024-09-13T02:50:36.441 INFO:tasks.workunit.client.0.smithi100.stdout:9/830: mknod dd/d1b/d27/d119/c126 0 2024-09-13T02:50:36.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/831: dread dd/d1b/d24/f67 [0,4194304] 0 2024-09-13T02:50:36.449 INFO:tasks.workunit.client.0.smithi100.stdout:8/777: dwrite df/d13/d5c/f6b [0,4194304] 0 2024-09-13T02:50:36.449 INFO:tasks.workunit.client.0.smithi100.stdout:4/809: dwrite d3/d63/dae/ffc [0,4194304] 0 2024-09-13T02:50:36.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/910: write d2/dd/d54/d47/d8a/dfa/d4b/db4/fbf [9317520,32801] 0 2024-09-13T02:50:36.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/911: creat d2/dd/d93/f12e x:0 0 0 2024-09-13T02:50:36.453 INFO:tasks.workunit.client.0.smithi100.stdout:0/912: read d2/dd/f10 [10634752,13127] 0 2024-09-13T02:50:36.458 INFO:tasks.workunit.client.0.smithi100.stdout:4/810: dread d3/d63/fa0 [0,4194304] 0 2024-09-13T02:50:36.459 INFO:tasks.workunit.client.0.smithi100.stdout:4/811: readlink d3/d6/d21/d46/ld4 0 2024-09-13T02:50:36.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/778: fdatasync df/d13/d21/d81/f82 0 2024-09-13T02:50:36.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/779: truncate df/d5d/d70/d41/fec 574429 0 2024-09-13T02:50:36.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/780: fsync df/d13/d21/d81/db0/f95 0 2024-09-13T02:50:36.459 INFO:tasks.workunit.client.0.smithi100.stdout:8/781: write df/d5d/f69 [4489497,83823] 0 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/832: dwrite fc [0,4194304] 0 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/833: stat dd/d1b/d1d/d43/d5e/dc0/l120 0 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/834: dread - dd/d1b/d1d/faf zero size 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/835: readlink dd/d1b/d24/da8/lf1 0 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:4/812: creat d3/dc/d4b/d7c/f110 x:0 0 0 2024-09-13T02:50:36.461 INFO:tasks.workunit.client.0.smithi100.stdout:4/813: stat d3/d6/d9/f11 0 2024-09-13T02:50:36.462 INFO:tasks.workunit.client.0.smithi100.stdout:0/913: dread d2/d1a/da5/fd2 [0,4194304] 0 2024-09-13T02:50:36.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/782: rename df/f64 to df/d13/d21/d81/f112 0 2024-09-13T02:50:36.464 INFO:tasks.workunit.client.0.smithi100.stdout:8/783: stat df/d13/d21/d81/d93/ca7 0 2024-09-13T02:50:36.465 INFO:tasks.workunit.client.0.smithi100.stdout:9/836: write dd/d1b/d1d/d43/d4f/da5/fba [264335,87233] 0 2024-09-13T02:50:36.465 INFO:tasks.workunit.client.0.smithi100.stdout:9/837: write dd/d1b/d24/d74/d4e/d58/db8/f11e [989152,56748] 0 2024-09-13T02:50:36.465 INFO:tasks.workunit.client.0.smithi100.stdout:4/814: mkdir d3/d6/d21/d46/d2d/d111 0 2024-09-13T02:50:36.466 INFO:tasks.workunit.client.0.smithi100.stdout:0/914: mknod d2/dd/d54/d47/d8a/dfa/c12f 0 2024-09-13T02:50:36.466 INFO:tasks.workunit.client.0.smithi100.stdout:0/915: fdatasync d2/dd/d54/d47/d8a/dfa/d4b/db4/fec 0 2024-09-13T02:50:36.466 INFO:tasks.workunit.client.0.smithi100.stdout:0/916: chown d2/dd/lf 72743272 1 2024-09-13T02:50:36.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/784: symlink df/d13/db5/l113 0 2024-09-13T02:50:36.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/785: fsync df/d5d/d88/dc0/f102 0 2024-09-13T02:50:36.467 INFO:tasks.workunit.client.0.smithi100.stdout:9/838: symlink dd/d1b/d1d/d28/d111/l127 0 2024-09-13T02:50:36.468 INFO:tasks.workunit.client.0.smithi100.stdout:4/815: creat d3/d6/d21/d67/de0/df0/f112 x:0 0 0 2024-09-13T02:50:36.469 INFO:tasks.workunit.client.0.smithi100.stdout:5/786: sync 2024-09-13T02:50:36.469 INFO:tasks.workunit.client.0.smithi100.stdout:6/915: sync 2024-09-13T02:50:36.469 INFO:tasks.workunit.client.0.smithi100.stdout:0/917: mknod d2/d9/d6d/d85/dcd/df8/c130 0 2024-09-13T02:50:36.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/918: dread - d2/dd/db0/d3b/f11c zero size 2024-09-13T02:50:36.470 INFO:tasks.workunit.client.0.smithi100.stdout:0/919: creat d2/dd/d93/da2/f131 x:0 0 0 2024-09-13T02:50:36.470 INFO:tasks.workunit.client.0.smithi100.stdout:8/786: rename df/l11 to df/d85/l114 0 2024-09-13T02:50:36.471 INFO:tasks.workunit.client.0.smithi100.stdout:4/816: creat d3/d63/dae/d10a/f113 x:0 0 0 2024-09-13T02:50:36.471 INFO:tasks.workunit.client.0.smithi100.stdout:4/817: stat d3/d6/d21/d46/d2d/la8 0 2024-09-13T02:50:36.472 INFO:tasks.workunit.client.0.smithi100.stdout:6/916: rmdir d12/d14/d1c/d7b/da6 39 2024-09-13T02:50:36.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/920: creat d2/d9/d6d/d85/f132 x:0 0 0 2024-09-13T02:50:36.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/921: readlink d2/dd/l121 0 2024-09-13T02:50:36.475 INFO:tasks.workunit.client.0.smithi100.stdout:0/922: truncate d2/d9/d6d/d85/db3/f115 475245 0 2024-09-13T02:50:36.476 INFO:tasks.workunit.client.0.smithi100.stdout:4/818: mkdir d3/d63/d114 0 2024-09-13T02:50:36.477 INFO:tasks.workunit.client.0.smithi100.stdout:5/787: read db/de/d3e/da2/fa4 [124949,7197] 0 2024-09-13T02:50:36.477 INFO:tasks.workunit.client.0.smithi100.stdout:5/788: read db/de/d1f/f31 [7129475,40950] 0 2024-09-13T02:50:36.477 INFO:tasks.workunit.client.0.smithi100.stdout:8/787: write df/d5d/d70/d41/fec [178533,11785] 0 2024-09-13T02:50:36.477 INFO:tasks.workunit.client.0.smithi100.stdout:8/788: stat df/d13/d5c/d10e 0 2024-09-13T02:50:36.477 INFO:tasks.workunit.client.0.smithi100.stdout:0/923: unlink d2/d9/d6d/d85/dcd/ce6 0 2024-09-13T02:50:36.478 INFO:tasks.workunit.client.0.smithi100.stdout:4/819: rename d3/d6/d2f/d7a/fa1 to d3/d6/d21/d67/dd2/dd8/f115 0 2024-09-13T02:50:36.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/789: mkdir df/d5d/d70/d2c/d38/d9e/d115 0 2024-09-13T02:50:36.479 INFO:tasks.workunit.client.0.smithi100.stdout:8/790: dread - df/d5d/d70/f91 zero size 2024-09-13T02:50:36.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/820: rename d3/d6/d21/d46/d2d/d58/c75 to d3/dc/d4b/d52/dda/c116 0 2024-09-13T02:50:36.480 INFO:tasks.workunit.client.0.smithi100.stdout:4/821: readlink d3/d3a/d5c/la7 0 2024-09-13T02:50:36.481 INFO:tasks.workunit.client.0.smithi100.stdout:8/791: unlink df/d13/d21/d81/db0/da3/ff9 0 2024-09-13T02:50:36.481 INFO:tasks.workunit.client.0.smithi100.stdout:8/792: chown df/d5d/d88/f8a 4 1 2024-09-13T02:50:36.481 INFO:tasks.workunit.client.0.smithi100.stdout:4/822: symlink d3/d6/d21/d46/d2d/d111/l117 0 2024-09-13T02:50:36.482 INFO:tasks.workunit.client.0.smithi100.stdout:4/823: creat d3/d6/d2f/d60/f118 x:0 0 0 2024-09-13T02:50:36.483 INFO:tasks.workunit.client.0.smithi100.stdout:4/824: fsync d3/d6/d9/d9e/fb0 0 2024-09-13T02:50:36.484 INFO:tasks.workunit.client.0.smithi100.stdout:6/917: dread d12/d14/d9d/fd4 [0,4194304] 0 2024-09-13T02:50:36.484 INFO:tasks.workunit.client.0.smithi100.stdout:6/918: fsync d12/f106 0 2024-09-13T02:50:36.485 INFO:tasks.workunit.client.0.smithi100.stdout:4/825: creat d3/dc/d4b/d52/dda/d99/f119 x:0 0 0 2024-09-13T02:50:36.487 INFO:tasks.workunit.client.0.smithi100.stdout:4/826: rename d3/d3a/d56/cea to d3/d6/d2f/d7a/c11a 0 2024-09-13T02:50:36.487 INFO:tasks.workunit.client.0.smithi100.stdout:4/827: write d3/dc/d88/ffd [821211,19721] 0 2024-09-13T02:50:36.487 INFO:tasks.workunit.client.0.smithi100.stdout:4/828: creat d3/dc/d4b/d7c/f11b x:0 0 0 2024-09-13T02:50:36.488 INFO:tasks.workunit.client.0.smithi100.stdout:4/829: symlink d3/d3a/d56/l11c 0 2024-09-13T02:50:36.490 INFO:tasks.workunit.client.0.smithi100.stdout:4/830: mknod d3/d6/d2f/d7a/c11d 0 2024-09-13T02:50:36.493 INFO:tasks.workunit.client.0.smithi100.stdout:4/831: symlink d3/d6/d9/l11e 0 2024-09-13T02:50:36.493 INFO:tasks.workunit.client.0.smithi100.stdout:6/919: write d12/d14/d5a/df0/f63 [1514702,75547] 0 2024-09-13T02:50:36.493 INFO:tasks.workunit.client.0.smithi100.stdout:6/920: creat d12/d14/d9d/f117 x:0 0 0 2024-09-13T02:50:36.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/832: symlink d3/d6/d2f/d60/l11f 0 2024-09-13T02:50:36.495 INFO:tasks.workunit.client.0.smithi100.stdout:4/833: getdents d3/d6/d9/d9e 0 2024-09-13T02:50:36.496 INFO:tasks.workunit.client.0.smithi100.stdout:6/921: creat d12/d2e/d90/da2/dbc/dce/dd6/f118 x:0 0 0 2024-09-13T02:50:36.497 INFO:tasks.workunit.client.0.smithi100.stdout:4/834: mkdir d3/dc/d88/db4/d120 0 2024-09-13T02:50:36.498 INFO:tasks.workunit.client.0.smithi100.stdout:6/922: getdents d12/d2e/d90/da2/dbc/dce 0 2024-09-13T02:50:36.500 INFO:tasks.workunit.client.0.smithi100.stdout:4/835: dread d3/d6/d21/d67/f90 [0,4194304] 0 2024-09-13T02:50:36.501 INFO:tasks.workunit.client.0.smithi100.stdout:4/836: creat d3/dc/d4b/d52/dda/d99/f121 x:0 0 0 2024-09-13T02:50:36.504 INFO:tasks.workunit.client.0.smithi100.stdout:9/839: dwrite dd/d1b/d7d/f7e [4194304,4194304] 0 2024-09-13T02:50:36.504 INFO:tasks.workunit.client.0.smithi100.stdout:9/840: creat dd/d1b/d1d/d43/d5e/dc0/f128 x:0 0 0 2024-09-13T02:50:36.505 INFO:tasks.workunit.client.0.smithi100.stdout:9/841: creat dd/d1b/d24/d74/d4e/d58/f129 x:0 0 0 2024-09-13T02:50:36.505 INFO:tasks.workunit.client.0.smithi100.stdout:9/842: stat dd/d1b/d1d/c22 0 2024-09-13T02:50:36.507 INFO:tasks.workunit.client.0.smithi100.stdout:9/843: unlink dd/d1b/d1d/f2c 0 2024-09-13T02:50:36.512 INFO:tasks.workunit.client.0.smithi100.stdout:0/924: dwrite d2/d1a/da5/db9/fd0 [0,4194304] 0 2024-09-13T02:50:36.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/789: dwrite db/de/d1f/d2b/f4a [0,4194304] 0 2024-09-13T02:50:36.516 INFO:tasks.workunit.client.0.smithi100.stdout:5/790: mkdir db/de/d63/d70/d115 0 2024-09-13T02:50:36.518 INFO:tasks.workunit.client.0.smithi100.stdout:8/793: dwrite df/d13/db5/dc3/de0/ff4 [0,4194304] 0 2024-09-13T02:50:36.519 INFO:tasks.workunit.client.0.smithi100.stdout:5/791: symlink db/de/d3e/dfa/l116 0 2024-09-13T02:50:36.521 INFO:tasks.workunit.client.0.smithi100.stdout:8/794: creat df/d13/d5c/f116 x:0 0 0 2024-09-13T02:50:36.523 INFO:tasks.workunit.client.0.smithi100.stdout:6/923: dwrite d12/d14/d2f/dca/dd8/fe6 [0,4194304] 0 2024-09-13T02:50:36.524 INFO:tasks.workunit.client.0.smithi100.stdout:9/844: dwrite dd/d1b/d27/fc7 [0,4194304] 0 2024-09-13T02:50:36.531 INFO:tasks.workunit.client.0.smithi100.stdout:9/845: rename dd/d1b/d1d/d43/l55 to dd/d1b/da3/dc9/l12a 0 2024-09-13T02:50:36.532 INFO:tasks.workunit.client.0.smithi100.stdout:9/846: mknod dd/d1b/d1d/d43/d4f/da5/d93/c12b 0 2024-09-13T02:50:36.532 INFO:tasks.workunit.client.0.smithi100.stdout:9/847: readlink dd/d1b/d1d/d28/d111/l127 0 2024-09-13T02:50:36.533 INFO:tasks.workunit.client.0.smithi100.stdout:9/848: dread - dd/d1b/d21/f109 zero size 2024-09-13T02:50:36.533 INFO:tasks.workunit.client.0.smithi100.stdout:0/925: getdents d2/dd/d93/da2 0 2024-09-13T02:50:36.533 INFO:tasks.workunit.client.0.smithi100.stdout:0/926: chown d2/d9/d6d/d85/db3/cf2 198558212 1 2024-09-13T02:50:36.541 INFO:tasks.workunit.client.0.smithi100.stdout:9/849: dread dd/d1b/d1d/d43/d5d/fd8 [0,4194304] 0 2024-09-13T02:50:36.542 INFO:tasks.workunit.client.0.smithi100.stdout:9/850: symlink dd/l12c 0 2024-09-13T02:50:36.544 INFO:tasks.workunit.client.0.smithi100.stdout:9/851: getdents dd/d1b/d1d/d28 0 2024-09-13T02:50:36.544 INFO:tasks.workunit.client.0.smithi100.stdout:9/852: dread - dd/d1b/d27/fd7 zero size 2024-09-13T02:50:36.550 INFO:tasks.workunit.client.0.smithi100.stdout:9/853: dread dd/f12 [0,4194304] 0 2024-09-13T02:50:36.551 INFO:tasks.workunit.client.0.smithi100.stdout:9/854: mknod dd/d1b/d1d/d43/d5d/c12d 0 2024-09-13T02:50:36.552 INFO:tasks.workunit.client.0.smithi100.stdout:9/855: mknod dd/d1b/d31/c12e 0 2024-09-13T02:50:36.552 INFO:tasks.workunit.client.0.smithi100.stdout:9/856: fdatasync dd/d1b/d24/d74/f37 0 2024-09-13T02:50:36.553 INFO:tasks.workunit.client.0.smithi100.stdout:9/857: rename dd/d1b/d1d/d43/d5d/c60 to dd/d1b/d24/d74/c12f 0 2024-09-13T02:50:36.554 INFO:tasks.workunit.client.0.smithi100.stdout:9/858: creat dd/d1b/d24/d74/d4e/dc4/dd4/f130 x:0 0 0 2024-09-13T02:50:36.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/859: read dd/d1b/d24/d74/d4e/f96 [730814,38705] 0 2024-09-13T02:50:36.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/860: chown dd/d1b/d31/c12e 13 1 2024-09-13T02:50:36.562 INFO:tasks.workunit.client.0.smithi100.stdout:9/861: truncate dd/d1b/d1d/d43/d5e/fed 488487 0 2024-09-13T02:50:36.563 INFO:tasks.workunit.client.0.smithi100.stdout:9/862: mknod dd/d1b/d24/d74/c131 0 2024-09-13T02:50:36.563 INFO:tasks.workunit.client.0.smithi100.stdout:9/863: write fc [4655982,33815] 0 2024-09-13T02:50:36.563 INFO:tasks.workunit.client.0.smithi100.stdout:9/864: read dd/d1b/d21/d86/f4c [493855,16060] 0 2024-09-13T02:50:36.563 INFO:tasks.workunit.client.0.smithi100.stdout:9/865: write dd/d1b/d21/ff8 [741661,38036] 0 2024-09-13T02:50:36.564 INFO:tasks.workunit.client.0.smithi100.stdout:9/866: write dd/d1b/d1d/d43/d5e/fed [538457,121143] 0 2024-09-13T02:50:36.570 INFO:tasks.workunit.client.0.smithi100.stdout:3/992: sync 2024-09-13T02:50:36.571 INFO:tasks.workunit.client.0.smithi100.stdout:3/993: symlink d10/d21/d51/d5a/d5e/d71/d94/d9c/l153 0 2024-09-13T02:50:36.572 INFO:tasks.workunit.client.0.smithi100.stdout:3/994: readlink d10/d21/l25 0 2024-09-13T02:50:36.572 INFO:tasks.workunit.client.0.smithi100.stdout:3/995: creat d10/d21/d129/f154 x:0 0 0 2024-09-13T02:50:36.606 INFO:tasks.workunit.client.0.smithi100.stdout:5/792: dwrite db/de/d3e/d7e/d81/f10c [0,4194304] 0 2024-09-13T02:50:36.606 INFO:tasks.workunit.client.0.smithi100.stdout:3/996: dread d10/d21/fa8 [0,4194304] 0 2024-09-13T02:50:36.606 INFO:tasks.workunit.client.0.smithi100.stdout:3/997: dread - d10/d21/d51/d5a/d5e/d71/d94/d9c/dcd/d104/f125 zero size 2024-09-13T02:50:36.606 INFO:tasks.workunit.client.0.smithi100.stdout:5/793: creat db/de/d1f/f117 x:0 0 0 2024-09-13T02:50:36.606 INFO:tasks.workunit.client.0.smithi100.stdout:5/794: chown db/de/d1f/c5d 960972018 1 2024-09-13T02:50:36.609 INFO:tasks.workunit.client.0.smithi100.stdout:6/924: dread d12/d14/d1c/f62 [0,4194304] 0 2024-09-13T02:50:36.611 INFO:tasks.workunit.client.0.smithi100.stdout:5/795: link db/de/d1f/d78/c95 db/de/d1f/d2b/d9b/c118 0 2024-09-13T02:50:36.611 INFO:tasks.workunit.client.0.smithi100.stdout:2/819: sync 2024-09-13T02:50:36.611 INFO:tasks.workunit.client.0.smithi100.stdout:7/960: sync 2024-09-13T02:50:36.611 INFO:tasks.workunit.client.0.smithi100.stdout:0/927: dread d2/dd/d54/d47/d8a/fe2 [0,4194304] 0 2024-09-13T02:50:36.614 INFO:tasks.workunit.client.0.smithi100.stdout:6/925: creat d12/d2e/d90/da2/dbc/f119 x:0 0 0 2024-09-13T02:50:36.617 INFO:tasks.workunit.client.0.smithi100.stdout:7/961: unlink d3/d16/d3b/fcd 0 2024-09-13T02:50:36.618 INFO:tasks.workunit.client.0.smithi100.stdout:0/928: truncate d2/dd/d54/d47/d8a/f90 106522 0 2024-09-13T02:50:36.623 INFO:tasks.workunit.client.0.smithi100.stdout:3/998: dwrite d10/d21/f86 [0,4194304] 0 2024-09-13T02:50:36.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/796: rmdir db/de/d3e 39 2024-09-13T02:50:36.625 INFO:tasks.workunit.client.0.smithi100.stdout:5/797: chown db/de/d3e/d71/f97 172 1 2024-09-13T02:50:36.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/962: rmdir d3/d16/d55 39 2024-09-13T02:50:36.627 INFO:tasks.workunit.client.0.smithi100.stdout:7/963: readlink d3/d16/d55/d92/da9/dde/d127/d1c/d36/lba 0 2024-09-13T02:50:36.627 INFO:tasks.workunit.client.0.smithi100.stdout:1/919: sync 2024-09-13T02:50:36.627 INFO:tasks.workunit.client.0.smithi100.stdout:3/999: truncate d10/d21/d51/d5a/d5e/d89/f8d 330640 0 2024-09-13T02:50:36.628 INFO:tasks.workunit.client.0.smithi100.stdout:1/920: dread de/d14/d22/dfa/dd3/f78 [0,4194304] 0 2024-09-13T02:50:36.628 INFO:tasks.workunit.client.0.smithi100.stdout:7/964: creat d3/d9b/ddc/f142 x:0 0 0 2024-09-13T02:50:36.629 INFO:tasks.workunit.client.0.smithi100.stdout:1/921: mknod de/d14/d44/d61/ded/df7/c120 0 2024-09-13T02:50:36.631 INFO:tasks.workunit.client.0.smithi100.stdout:7/965: mknod d3/d5/d4f/c143 0 2024-09-13T02:50:36.634 INFO:tasks.workunit.client.0.smithi100.stdout:0/929: dwrite d2/dd/d54/d47/f12b [0,4194304] 0 2024-09-13T02:50:36.634 INFO:tasks.workunit.client.0.smithi100.stdout:0/930: chown d2/d1a/d51/f7d 42071168 1 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/931: rename d2/dd/d54 to d2/dd/db0/de0/d113/d133 0 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/932: chown d2/dd/db0/de0/d113/d133/d3e/d5d/c114 1671312 1 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/933: read d2/dd/db0/de0/d113/d133/d47/d34/d3c/f71 [381311,80571] 0 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/934: chown d2/dd/db0/de0/d113/d133/d47/c52 307 1 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/935: chown d2/dd/db0/de0/d113/d133/d47/d34/cde 88018307 1 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/936: fdatasync d2/f11 0 2024-09-13T02:50:36.644 INFO:tasks.workunit.client.0.smithi100.stdout:0/937: chown d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/lfe 240 1 2024-09-13T02:50:36.645 INFO:tasks.workunit.client.0.smithi100.stdout:1/922: write de/d14/d22/d52/db8/ff9 [498884,63640] 0 2024-09-13T02:50:36.645 INFO:tasks.workunit.client.0.smithi100.stdout:0/938: creat d2/dd/db0/de0/d113/d133/f134 x:0 0 0 2024-09-13T02:50:36.647 INFO:tasks.workunit.client.0.smithi100.stdout:0/939: link d2/dd/db0/de0/d113/d133/d47/f100 d2/dd/db0/de0/d113/d133/d47/d34/da3/f135 0 2024-09-13T02:50:36.647 INFO:tasks.workunit.client.0.smithi100.stdout:0/940: truncate d2/dd/db0/f16 1286122 0 2024-09-13T02:50:36.648 INFO:tasks.workunit.client.0.smithi100.stdout:0/941: rename d2/dd/db0/de0/d113/d133/d47/d34/f39 to d2/df4/f136 0 2024-09-13T02:50:36.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/798: dwrite db/de/d3e/d7e/d81/fff [0,4194304] 0 2024-09-13T02:50:36.652 INFO:tasks.workunit.client.0.smithi100.stdout:5/799: stat db/de/d1f/d2b/f79 0 2024-09-13T02:50:36.652 INFO:tasks.workunit.client.0.smithi100.stdout:0/942: dread d2/dd/db0/de0/d113/d133/d28/fc7 [0,4194304] 0 2024-09-13T02:50:36.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/966: dwrite d3/d16/d55/fc7 [0,4194304] 0 2024-09-13T02:50:36.652 INFO:tasks.workunit.client.0.smithi100.stdout:7/967: write d3/d16/d3b/da5/f114 [4385414,87432] 0 2024-09-13T02:50:36.655 INFO:tasks.workunit.client.0.smithi100.stdout:5/800: unlink db/c26 0 2024-09-13T02:50:36.658 INFO:tasks.workunit.client.0.smithi100.stdout:0/943: creat d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/db4/f137 x:0 0 0 2024-09-13T02:50:36.659 INFO:tasks.workunit.client.0.smithi100.stdout:7/968: truncate d3/fd2 1381735 0 2024-09-13T02:50:36.660 INFO:tasks.workunit.client.0.smithi100.stdout:5/801: creat db/de/d3e/d71/dd9/f119 x:0 0 0 2024-09-13T02:50:36.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/802: mknod db/de/d3e/dfa/c11a 0 2024-09-13T02:50:36.661 INFO:tasks.workunit.client.0.smithi100.stdout:5/803: dread - db/de/d63/fb0 zero size 2024-09-13T02:50:36.662 INFO:tasks.workunit.client.0.smithi100.stdout:5/804: symlink db/de/d3e/d71/l11b 0 2024-09-13T02:50:36.663 INFO:tasks.workunit.client.0.smithi100.stdout:0/944: dread d2/dd/db0/de0/d113/d133/d28/fa1 [0,4194304] 0 2024-09-13T02:50:36.664 INFO:tasks.workunit.client.0.smithi100.stdout:5/805: symlink db/de/d3e/dfa/dfc/l11c 0 2024-09-13T02:50:36.664 INFO:tasks.workunit.client.0.smithi100.stdout:0/945: symlink d2/dd/d93/da2/da9/l138 0 2024-09-13T02:50:36.665 INFO:tasks.workunit.client.0.smithi100.stdout:5/806: rmdir db/de/d3e/d7e/d81 39 2024-09-13T02:50:36.665 INFO:tasks.workunit.client.0.smithi100.stdout:0/946: symlink d2/df4/l139 0 2024-09-13T02:50:36.666 INFO:tasks.workunit.client.0.smithi100.stdout:7/969: dread d3/d16/d55/d56/d9e/d9f/de9/f137 [4194304,4194304] 0 2024-09-13T02:50:36.668 INFO:tasks.workunit.client.0.smithi100.stdout:7/970: creat d3/d16/d55/d92/da9/dde/f144 x:0 0 0 2024-09-13T02:50:36.668 INFO:tasks.workunit.client.0.smithi100.stdout:5/807: dread db/de/d3e/da2/ddb/f10f [0,4194304] 0 2024-09-13T02:50:36.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/808: fsync db/f57 0 2024-09-13T02:50:36.669 INFO:tasks.workunit.client.0.smithi100.stdout:5/809: chown db/de/ddc/f105 461769 1 2024-09-13T02:50:36.671 INFO:tasks.workunit.client.0.smithi100.stdout:7/971: link d3/d16/d89/d94/c128 d3/d16/db0/d11b/c145 0 2024-09-13T02:50:36.672 INFO:tasks.workunit.client.0.smithi100.stdout:0/947: dread d2/dd/f10 [0,4194304] 0 2024-09-13T02:50:36.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/948: read d2/dd/db0/de0/d113/d133/d28/fc7 [418188,61336] 0 2024-09-13T02:50:36.674 INFO:tasks.workunit.client.0.smithi100.stdout:0/949: fsync d2/d9/fb 0 2024-09-13T02:50:36.677 INFO:tasks.workunit.client.0.smithi100.stdout:0/950: rename d2/d1a/d4c to d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d97/dbd/d13a 0 2024-09-13T02:50:36.678 INFO:tasks.workunit.client.0.smithi100.stdout:0/951: stat d2/d1a 0 2024-09-13T02:50:36.693 INFO:tasks.workunit.client.0.smithi100.stdout:4/837: sync 2024-09-13T02:50:36.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/838: truncate f0 3512566 0 2024-09-13T02:50:36.694 INFO:tasks.workunit.client.0.smithi100.stdout:4/839: write d3/d6/d21/d46/d2d/d42/f105 [348259,19452] 0 2024-09-13T02:50:36.695 INFO:tasks.workunit.client.0.smithi100.stdout:4/840: creat d3/d6/d21/d67/f122 x:0 0 0 2024-09-13T02:50:36.696 INFO:tasks.workunit.client.0.smithi100.stdout:4/841: unlink d3/d6/d21/d46/d2d/d3f/l51 0 2024-09-13T02:50:36.697 INFO:tasks.workunit.client.0.smithi100.stdout:4/842: fdatasync d3/dc/d4b/f91 0 2024-09-13T02:50:36.697 INFO:tasks.workunit.client.0.smithi100.stdout:4/843: fdatasync d3/d6/d21/d46/fa3 0 2024-09-13T02:50:36.697 INFO:tasks.workunit.client.0.smithi100.stdout:0/952: dwrite d2/dd/db0/de0/d113/d133/d47/f12b [0,4194304] 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/972: dwrite d3/d2d/f7d [0,4194304] 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/973: fdatasync d3/d9b/d115/f135 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/974: write d3/d5/d4f/f118 [345037,80753] 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:7/975: write d3/d16/d55/d92/da2/fb7 [5102880,98106] 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:4/844: dread d3/d6/d21/d46/d2d/f95 [0,4194304] 0 2024-09-13T02:50:36.702 INFO:tasks.workunit.client.0.smithi100.stdout:5/810: dwrite db/de/d3e/dc3/fd0 [0,4194304] 0 2024-09-13T02:50:36.703 INFO:tasks.workunit.client.0.smithi100.stdout:0/953: write d2/dd/db0/de0/d113/d133/d28/dac/fc5 [1047788,62161] 0 2024-09-13T02:50:36.705 INFO:tasks.workunit.client.0.smithi100.stdout:4/845: dread d3/d3a/d56/fe2 [0,4194304] 0 2024-09-13T02:50:36.707 INFO:tasks.workunit.client.0.smithi100.stdout:0/954: rename d2/d9/d6d/d85/de5/l12c to d2/d1a/da5/l13b 0 2024-09-13T02:50:36.707 INFO:tasks.workunit.client.0.smithi100.stdout:4/846: mknod d3/d6/d21/d103/c123 0 2024-09-13T02:50:36.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/955: dread d2/dd/db0/de0/d113/d133/d3e/d5d/f6b [0,4194304] 0 2024-09-13T02:50:36.708 INFO:tasks.workunit.client.0.smithi100.stdout:0/956: dread - d2/dd/d93/fea zero size 2024-09-13T02:50:36.710 INFO:tasks.workunit.client.0.smithi100.stdout:4/847: link d3/d6/d21/d46/d34/l49 d3/d6/d21/d46/d2d/d42/l124 0 2024-09-13T02:50:36.713 INFO:tasks.workunit.client.0.smithi100.stdout:0/957: creat d2/d9/d6d/d85/dcd/f13c x:0 0 0 2024-09-13T02:50:36.713 INFO:tasks.workunit.client.0.smithi100.stdout:5/811: write db/f3c [2889991,27392] 0 2024-09-13T02:50:36.713 INFO:tasks.workunit.client.0.smithi100.stdout:5/812: read db/de/d1f/d78/f94 [3239092,111459] 0 2024-09-13T02:50:36.713 INFO:tasks.workunit.client.0.smithi100.stdout:4/848: creat d3/dc/d4b/d52/dd1/f125 x:0 0 0 2024-09-13T02:50:36.719 INFO:tasks.workunit.client.0.smithi100.stdout:7/976: dwrite d3/d16/f32 [0,4194304] 0 2024-09-13T02:50:36.724 INFO:tasks.workunit.client.0.smithi100.stdout:4/849: dread d3/d6/d2f/f9c [0,4194304] 0 2024-09-13T02:50:36.724 INFO:tasks.workunit.client.0.smithi100.stdout:7/977: rename d3/d5/d4f/f80 to d3/d16/d55/d92/db3/f146 0 2024-09-13T02:50:36.724 INFO:tasks.workunit.client.0.smithi100.stdout:7/978: dread - d3/d16/d55/d92/da9/dde/d127/d1c/f7f zero size 2024-09-13T02:50:36.724 INFO:tasks.workunit.client.0.smithi100.stdout:7/979: fsync d3/d16/d3b/da5/f114 0 2024-09-13T02:50:36.725 INFO:tasks.workunit.client.0.smithi100.stdout:0/958: write d2/dd/db0/de0/d113/d133/d3e/d5d/f11b [82600,68055] 0 2024-09-13T02:50:36.730 INFO:tasks.workunit.client.0.smithi100.stdout:0/959: mknod d2/dd/d93/c13d 0 2024-09-13T02:50:36.731 INFO:tasks.workunit.client.0.smithi100.stdout:0/960: stat d2/dd/d93/da2 0 2024-09-13T02:50:36.732 INFO:tasks.workunit.client.0.smithi100.stdout:5/813: dwrite db/de/ddc/fde [0,4194304] 0 2024-09-13T02:50:36.741 INFO:tasks.workunit.client.0.smithi100.stdout:7/980: dwrite d3/d16/d55/f109 [0,4194304] 0 2024-09-13T02:50:36.745 INFO:tasks.workunit.client.0.smithi100.stdout:8/795: sync 2024-09-13T02:50:36.746 INFO:tasks.workunit.client.0.smithi100.stdout:5/814: dread db/de/d1f/d2b/f55 [0,4194304] 0 2024-09-13T02:50:36.746 INFO:tasks.workunit.client.0.smithi100.stdout:2/820: sync 2024-09-13T02:50:36.746 INFO:tasks.workunit.client.0.smithi100.stdout:9/867: sync 2024-09-13T02:50:36.746 INFO:tasks.workunit.client.0.smithi100.stdout:2/821: write d0/d36/fcb [46199,40734] 0 2024-09-13T02:50:36.746 INFO:tasks.workunit.client.0.smithi100.stdout:8/796: mkdir df/d13/db5/dc3/d117 0 2024-09-13T02:50:36.748 INFO:tasks.workunit.client.0.smithi100.stdout:2/822: mkdir d0/db/dbe/dc3/df4 0 2024-09-13T02:50:36.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/797: unlink df/d13/d20/d98/cd0 0 2024-09-13T02:50:36.749 INFO:tasks.workunit.client.0.smithi100.stdout:8/798: fsync df/d13/d20/d98/fdf 0 2024-09-13T02:50:36.751 INFO:tasks.workunit.client.0.smithi100.stdout:8/799: link df/dbb/ccd df/dac/dd3/c118 0 2024-09-13T02:50:36.753 INFO:tasks.workunit.client.0.smithi100.stdout:8/800: creat df/f119 x:0 0 0 2024-09-13T02:50:36.765 INFO:tasks.workunit.client.0.smithi100.stdout:0/961: dwrite d2/df4/f11d [0,4194304] 0 2024-09-13T02:50:36.765 INFO:tasks.workunit.client.0.smithi100.stdout:0/962: write d2/dd/d93/da2/fd3 [1489475,8675] 0 2024-09-13T02:50:36.768 INFO:tasks.workunit.client.0.smithi100.stdout:0/963: getdents d2/d1a/da5 0 2024-09-13T02:50:36.787 INFO:tasks.workunit.client.0.smithi100.stdout:7/981: dwrite d3/d2d/f74 [0,4194304] 0 2024-09-13T02:50:36.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/815: dwrite f8 [0,4194304] 0 2024-09-13T02:50:36.797 INFO:tasks.workunit.client.0.smithi100.stdout:9/868: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:50:36.798 INFO:tasks.workunit.client.0.smithi100.stdout:7/982: truncate d3/d16/d55/f109 3965249 0 2024-09-13T02:50:36.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/823: dwrite d0/db/d68/d6b/d71/fa7 [0,4194304] 0 2024-09-13T02:50:36.799 INFO:tasks.workunit.client.0.smithi100.stdout:2/824: creat d0/db/d21/d88/ff5 x:0 0 0 2024-09-13T02:50:36.799 INFO:tasks.workunit.client.0.smithi100.stdout:8/801: dwrite df/d13/d5c/f83 [4194304,4194304] 0 2024-09-13T02:50:36.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/869: creat dd/d1b/d1d/d28/d111/f132 x:0 0 0 2024-09-13T02:50:36.801 INFO:tasks.workunit.client.0.smithi100.stdout:9/870: chown dd/d1b/d24/d74/f65 23 1 2024-09-13T02:50:36.803 INFO:tasks.workunit.client.0.smithi100.stdout:7/983: mkdir d3/d147 0 2024-09-13T02:50:36.804 INFO:tasks.workunit.client.0.smithi100.stdout:5/816: mknod db/de/d3e/dfa/c11d 0 2024-09-13T02:50:36.805 INFO:tasks.workunit.client.0.smithi100.stdout:0/964: dread d2/df4/f136 [0,4194304] 0 2024-09-13T02:50:36.805 INFO:tasks.workunit.client.0.smithi100.stdout:0/965: chown d2/dd/db0/de0/d113/d133/d47/d34/d91 10417188 1 2024-09-13T02:50:36.812 INFO:tasks.workunit.client.0.smithi100.stdout:8/802: creat df/d6f/f11a x:0 0 0 2024-09-13T02:50:36.813 INFO:tasks.workunit.client.0.smithi100.stdout:8/803: fsync df/f67 0 2024-09-13T02:50:36.814 INFO:tasks.workunit.client.0.smithi100.stdout:7/984: rename d3/d16/d89/fe3 to d3/d16/db0/f148 0 2024-09-13T02:50:36.815 INFO:tasks.workunit.client.0.smithi100.stdout:7/985: write d3/fe6 [288685,123757] 0 2024-09-13T02:50:36.815 INFO:tasks.workunit.client.0.smithi100.stdout:5/817: creat db/de/d3e/dc3/f11e x:0 0 0 2024-09-13T02:50:36.815 INFO:tasks.workunit.client.0.smithi100.stdout:0/966: rmdir d2/d9/d6d/d85/de5 39 2024-09-13T02:50:36.816 INFO:tasks.workunit.client.0.smithi100.stdout:8/804: rename df/dbb/cf3 to df/c11b 0 2024-09-13T02:50:36.818 INFO:tasks.workunit.client.0.smithi100.stdout:9/871: dwrite dd/d1b/d1d/f81 [0,4194304] 0 2024-09-13T02:50:36.818 INFO:tasks.workunit.client.0.smithi100.stdout:7/986: link d3/fc d3/d16/d55/d92/da9/dd3/f149 0 2024-09-13T02:50:36.819 INFO:tasks.workunit.client.0.smithi100.stdout:5/818: write db/de/d3e/d7e/d81/d85/fd7 [335785,13095] 0 2024-09-13T02:50:36.820 INFO:tasks.workunit.client.0.smithi100.stdout:0/967: mkdir d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d97/dbd/d13e 0 2024-09-13T02:50:36.821 INFO:tasks.workunit.client.0.smithi100.stdout:6/926: sync 2024-09-13T02:50:36.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/923: sync 2024-09-13T02:50:36.821 INFO:tasks.workunit.client.0.smithi100.stdout:1/924: fdatasync de/d14/d2e/d75/f11b 0 2024-09-13T02:50:36.822 INFO:tasks.workunit.client.0.smithi100.stdout:8/805: unlink df/d13/d5c/f6b 0 2024-09-13T02:50:36.824 INFO:tasks.workunit.client.0.smithi100.stdout:9/872: mknod dd/d1b/d31/c133 0 2024-09-13T02:50:36.825 INFO:tasks.workunit.client.0.smithi100.stdout:1/925: dread de/d14/d22/d52/db8/faa [0,4194304] 0 2024-09-13T02:50:36.826 INFO:tasks.workunit.client.0.smithi100.stdout:1/926: chown de/d14/d86/dd1/f11e 2931040 1 2024-09-13T02:50:36.826 INFO:tasks.workunit.client.0.smithi100.stdout:1/927: chown de/d14/d2e/d60/fe4 1 1 2024-09-13T02:50:36.826 INFO:tasks.workunit.client.0.smithi100.stdout:5/819: creat db/de/d3e/f11f x:0 0 0 2024-09-13T02:50:36.826 INFO:tasks.workunit.client.0.smithi100.stdout:8/806: mknod df/d13/d68/c11c 0 2024-09-13T02:50:36.828 INFO:tasks.workunit.client.0.smithi100.stdout:9/873: rename dd/d1b/d1d/d43/d5d/f9c to dd/d1b/d1d/f134 0 2024-09-13T02:50:36.828 INFO:tasks.workunit.client.0.smithi100.stdout:6/927: dread d12/d2e/d90/da2/f6d [0,4194304] 0 2024-09-13T02:50:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:7/987: getdents d3 0 2024-09-13T02:50:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:0/968: dread d2/dd/db0/de0/d113/d133/d47/d34/da3/f119 [0,4194304] 0 2024-09-13T02:50:36.829 INFO:tasks.workunit.client.0.smithi100.stdout:0/969: readlink d2/dd/lf 0 2024-09-13T02:50:36.830 INFO:tasks.workunit.client.0.smithi100.stdout:1/928: symlink de/d14/l121 0 2024-09-13T02:50:36.831 INFO:tasks.workunit.client.0.smithi100.stdout:5/820: creat db/f120 x:0 0 0 2024-09-13T02:50:36.831 INFO:tasks.workunit.client.0.smithi100.stdout:0/970: dread d2/dd/db0/de0/d113/d133/d28/f65 [0,4194304] 0 2024-09-13T02:50:36.831 INFO:tasks.workunit.client.0.smithi100.stdout:0/971: chown d2/dd/db0/de0/d113/d133/d68/dae 354 1 2024-09-13T02:50:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/972: chown d2/dd/db0/de0/d113/d133/d47/f2d 401934828 1 2024-09-13T02:50:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:0/973: chown d2/dd/db0/de0/d113/d133/d47/d8a/dfa/c66 44 1 2024-09-13T02:50:36.832 INFO:tasks.workunit.client.0.smithi100.stdout:8/807: unlink df/d5d/d88/f90 0 2024-09-13T02:50:36.833 INFO:tasks.workunit.client.0.smithi100.stdout:9/874: creat dd/d1b/d1d/d43/d4f/f135 x:0 0 0 2024-09-13T02:50:36.833 INFO:tasks.workunit.client.0.smithi100.stdout:9/875: chown dd/d1b/d1d/d43/l84 14 1 2024-09-13T02:50:36.833 INFO:tasks.workunit.client.0.smithi100.stdout:9/876: truncate dd/d1b/d1d/d43/d5d/fcd 5103222 0 2024-09-13T02:50:36.833 INFO:tasks.workunit.client.0.smithi100.stdout:6/928: getdents d12/d14/d1c/d7b/da6 0 2024-09-13T02:50:36.833 INFO:tasks.workunit.client.0.smithi100.stdout:1/929: symlink de/d14/d22/d52/d7a/d81/l122 0 2024-09-13T02:50:36.834 INFO:tasks.workunit.client.0.smithi100.stdout:5/821: mknod db/de/d3e/dfa/c121 0 2024-09-13T02:50:36.835 INFO:tasks.workunit.client.0.smithi100.stdout:0/974: truncate d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/db4/fbf 6828987 0 2024-09-13T02:50:36.836 INFO:tasks.workunit.client.0.smithi100.stdout:6/929: mknod d12/d14/d1c/d7b/c11a 0 2024-09-13T02:50:36.837 INFO:tasks.workunit.client.0.smithi100.stdout:1/930: creat de/d14/d44/f123 x:0 0 0 2024-09-13T02:50:36.838 INFO:tasks.workunit.client.0.smithi100.stdout:0/975: rmdir d2/dd/db0/de0/d113/d133/d68/dae 39 2024-09-13T02:50:36.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/930: rmdir d12/d14/d1c/d28/d88/dd2 39 2024-09-13T02:50:36.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/931: dread - d12/d14/d2f/f116 zero size 2024-09-13T02:50:36.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/932: write d12/dcd/ff7 [851228,95014] 0 2024-09-13T02:50:36.839 INFO:tasks.workunit.client.0.smithi100.stdout:6/933: fsync d12/d2e/d90/fc8 0 2024-09-13T02:50:36.840 INFO:tasks.workunit.client.0.smithi100.stdout:7/988: write d3/d16/d55/d92/da9/dde/d127/d1c/f39 [950526,31632] 0 2024-09-13T02:50:36.841 INFO:tasks.workunit.client.0.smithi100.stdout:1/931: rename de/d14/f83 to de/d14/d22/d52/d65/f124 0 2024-09-13T02:50:36.842 INFO:tasks.workunit.client.0.smithi100.stdout:5/822: symlink db/de/l122 0 2024-09-13T02:50:36.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/934: mkdir d12/d2e/d90/d92/d11b 0 2024-09-13T02:50:36.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/935: dread - d12/d14/d1c/d6e/d71/f102 zero size 2024-09-13T02:50:36.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/936: write d12/d14/d2f/da4/f115 [685349,36784] 0 2024-09-13T02:50:36.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/937: write d12/d2e/d90/da2/f8c [1908314,25062] 0 2024-09-13T02:50:36.845 INFO:tasks.workunit.client.0.smithi100.stdout:6/938: fsync d12/d14/d21/f55 0 2024-09-13T02:50:36.846 INFO:tasks.workunit.client.0.smithi100.stdout:1/932: mknod de/d14/df5/dff/d101/d11f/c125 0 2024-09-13T02:50:36.847 INFO:tasks.workunit.client.0.smithi100.stdout:5/823: chown db/de/d3e/da2 194914 1 2024-09-13T02:50:36.852 INFO:tasks.workunit.client.0.smithi100.stdout:0/976: mknod d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/c13f 0 2024-09-13T02:50:36.852 INFO:tasks.workunit.client.0.smithi100.stdout:8/808: dwrite f2 [4194304,4194304] 0 2024-09-13T02:50:36.853 INFO:tasks.workunit.client.0.smithi100.stdout:7/989: rename c2 to d3/d16/d55/d56/dbc/c14a 0 2024-09-13T02:50:36.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/809: getdents df/d5d/d70/d2c/d38/d9e/dad 0 2024-09-13T02:50:36.854 INFO:tasks.workunit.client.0.smithi100.stdout:8/810: write df/d13/db5/fb7 [2843242,127466] 0 2024-09-13T02:50:36.857 INFO:tasks.workunit.client.0.smithi100.stdout:1/933: rename de/d14/d2e/d60/la5 to de/d14/df5/l126 0 2024-09-13T02:50:36.857 INFO:tasks.workunit.client.0.smithi100.stdout:9/877: dwrite dd/d1b/f70 [0,4194304] 0 2024-09-13T02:50:36.858 INFO:tasks.workunit.client.0.smithi100.stdout:7/990: creat d3/d5/df3/f14b x:0 0 0 2024-09-13T02:50:36.861 INFO:tasks.workunit.client.0.smithi100.stdout:1/934: symlink de/d14/d2e/d75/d10e/l127 0 2024-09-13T02:50:36.864 INFO:tasks.workunit.client.0.smithi100.stdout:6/939: dread d12/d14/d1c/d6e/d71/d100/d73/f81 [0,4194304] 0 2024-09-13T02:50:36.869 INFO:tasks.workunit.client.0.smithi100.stdout:7/991: link d3/d16/d3b/f5d d3/d16/db0/d11b/f14c 0 2024-09-13T02:50:36.870 INFO:tasks.workunit.client.0.smithi100.stdout:5/824: rename db/de/d63/dec/lef to db/de/l123 0 2024-09-13T02:50:36.871 INFO:tasks.workunit.client.0.smithi100.stdout:1/935: getdents de/d14/df5/dff/d101 0 2024-09-13T02:50:36.872 INFO:tasks.workunit.client.0.smithi100.stdout:5/825: write db/de/d1f/f69 [179443,17510] 0 2024-09-13T02:50:36.873 INFO:tasks.workunit.client.0.smithi100.stdout:1/936: mknod de/d14/d22/d29/d68/c128 0 2024-09-13T02:50:36.874 INFO:tasks.workunit.client.0.smithi100.stdout:5/826: fdatasync db/de/d3e/fe1 0 2024-09-13T02:50:36.874 INFO:tasks.workunit.client.0.smithi100.stdout:9/878: dread fc [0,4194304] 0 2024-09-13T02:50:36.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/937: rename de/d14/d22/d52/d7a/d111 to de/d14/d44/d7f/dc2/d129 0 2024-09-13T02:50:36.875 INFO:tasks.workunit.client.0.smithi100.stdout:1/938: readlink de/l18 0 2024-09-13T02:50:36.875 INFO:tasks.workunit.client.0.smithi100.stdout:5/827: mkdir db/de/d3e/d7e/dfb/d124 0 2024-09-13T02:50:36.876 INFO:tasks.workunit.client.0.smithi100.stdout:5/828: stat db/de/d1f/f117 0 2024-09-13T02:50:36.878 INFO:tasks.workunit.client.0.smithi100.stdout:1/939: mkdir de/d14/d22/d29/d68/d10d/d12a 0 2024-09-13T02:50:36.879 INFO:tasks.workunit.client.0.smithi100.stdout:9/879: getdents dd/d1b/d24/da8/da9 0 2024-09-13T02:50:36.891 INFO:tasks.workunit.client.0.smithi100.stdout:0/977: dwrite d2/d1a/da5/db9/fd0 [4194304,4194304] 0 2024-09-13T02:50:36.897 INFO:tasks.workunit.client.0.smithi100.stdout:5/829: write db/de/d3e/f7a [652216,33967] 0 2024-09-13T02:50:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:5/830: creat db/de/ddc/f125 x:0 0 0 2024-09-13T02:50:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:5/831: chown db/de/d1f/d2b/l3a 277212328 1 2024-09-13T02:50:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:5/832: write db/de/d1f/d2b/d9b/fb5 [706778,84409] 0 2024-09-13T02:50:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/811: dwrite df/d6f/f11a [0,4194304] 0 2024-09-13T02:50:36.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/812: read f5 [3294825,28959] 0 2024-09-13T02:50:36.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/833: mknod db/de/d1f/c126 0 2024-09-13T02:50:36.901 INFO:tasks.workunit.client.0.smithi100.stdout:5/834: creat db/de/d3e/d7e/dfb/d124/f127 x:0 0 0 2024-09-13T02:50:36.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/835: unlink db/de/l6a 0 2024-09-13T02:50:36.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/836: write db/de/d3e/da2/dac/db1/fb7 [878073,18480] 0 2024-09-13T02:50:36.904 INFO:tasks.workunit.client.0.smithi100.stdout:5/837: rename db/de/d3e/dfa/c121 to db/de/d3e/da2/ddb/c128 0 2024-09-13T02:50:36.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/940: dwrite d12/d43/d4b/d4c/f5b [0,4194304] 0 2024-09-13T02:50:36.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/941: readlink d12/d14/d9d/lbb 0 2024-09-13T02:50:36.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/942: fdatasync d12/d14/d9d/ff5 0 2024-09-13T02:50:36.905 INFO:tasks.workunit.client.0.smithi100.stdout:6/943: write d12/d43/f54 [4367034,41829] 0 2024-09-13T02:50:36.906 INFO:tasks.workunit.client.0.smithi100.stdout:1/940: dwrite de/d14/d86/dd1/f11e [0,4194304] 0 2024-09-13T02:50:36.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/838: unlink db/de/d3e/d7e/fe6 0 2024-09-13T02:50:36.906 INFO:tasks.workunit.client.0.smithi100.stdout:9/880: dwrite dd/d1b/d1d/f134 [4194304,4194304] 0 2024-09-13T02:50:36.907 INFO:tasks.workunit.client.0.smithi100.stdout:7/992: dwrite d3/d9b/d115/f135 [0,4194304] 0 2024-09-13T02:50:36.910 INFO:tasks.workunit.client.0.smithi100.stdout:9/881: dread dd/d1b/d21/d86/f52 [0,4194304] 0 2024-09-13T02:50:36.910 INFO:tasks.workunit.client.0.smithi100.stdout:9/882: truncate dd/d1b/d24/d74/d4e/dc4/fd2 552938 0 2024-09-13T02:50:36.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/978: dread d2/f56 [0,4194304] 0 2024-09-13T02:50:36.911 INFO:tasks.workunit.client.0.smithi100.stdout:0/979: dread - d2/dd/db0/de0/d113/d133/d47/d34/d91/df9/f112 zero size 2024-09-13T02:50:36.912 INFO:tasks.workunit.client.0.smithi100.stdout:1/941: mkdir de/d14/d44/d61/d12b 0 2024-09-13T02:50:36.924 INFO:tasks.workunit.client.0.smithi100.stdout:7/993: symlink d3/d16/d55/d56/d9e/d9f/de9/d110/l14d 0 2024-09-13T02:50:36.925 INFO:tasks.workunit.client.0.smithi100.stdout:9/883: unlink dd/d1b/d27/d51/f125 0 2024-09-13T02:50:36.925 INFO:tasks.workunit.client.0.smithi100.stdout:9/884: readlink l6 0 2024-09-13T02:50:36.925 INFO:tasks.workunit.client.0.smithi100.stdout:9/885: chown dd/d1b/d1d/d43/d4f/da5/ffd 518 1 2024-09-13T02:50:36.926 INFO:tasks.workunit.client.0.smithi100.stdout:0/980: symlink d2/dd/db0/de0/d113/d133/d3e/d5d/l140 0 2024-09-13T02:50:36.926 INFO:tasks.workunit.client.0.smithi100.stdout:6/944: dwrite d12/d14/d1c/d6e/f8b [0,4194304] 0 2024-09-13T02:50:36.927 INFO:tasks.workunit.client.0.smithi100.stdout:1/942: mknod de/d14/d22/dfa/c12c 0 2024-09-13T02:50:36.928 INFO:tasks.workunit.client.0.smithi100.stdout:7/994: stat d3/cf 0 2024-09-13T02:50:36.929 INFO:tasks.workunit.client.0.smithi100.stdout:0/981: mkdir d2/d9/d6d/d85/dcd/d141 0 2024-09-13T02:50:36.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/886: dread dd/d1b/d27/f59 [0,4194304] 0 2024-09-13T02:50:36.930 INFO:tasks.workunit.client.0.smithi100.stdout:9/887: dread - dd/d1b/d1d/d43/d4f/da5/ffd zero size 2024-09-13T02:50:36.930 INFO:tasks.workunit.client.0.smithi100.stdout:5/839: dwrite db/de/d3e/f51 [0,4194304] 0 2024-09-13T02:50:36.931 INFO:tasks.workunit.client.0.smithi100.stdout:6/945: rename d12/d14/d1c/d6e/f79 to d12/d14/d1c/d7b/da6/f11c 0 2024-09-13T02:50:36.932 INFO:tasks.workunit.client.0.smithi100.stdout:9/888: unlink dd/d1b/d1d/d28/lfb 0 2024-09-13T02:50:36.932 INFO:tasks.workunit.client.0.smithi100.stdout:9/889: stat dd/d1b/d24/d74 0 2024-09-13T02:50:36.933 INFO:tasks.workunit.client.0.smithi100.stdout:5/840: truncate db/f57 3032168 0 2024-09-13T02:50:36.935 INFO:tasks.workunit.client.0.smithi100.stdout:1/943: rename de/d14/d22/d52/ccb to de/d14/d22/d52/d7a/d81/de0/c12d 0 2024-09-13T02:50:36.935 INFO:tasks.workunit.client.0.smithi100.stdout:1/944: write de/d14/d2e/d60/f116 [756032,42712] 0 2024-09-13T02:50:36.935 INFO:tasks.workunit.client.0.smithi100.stdout:1/945: chown de/d14/df5/c10a 4 1 2024-09-13T02:50:36.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:36 smithi122 ceph-mon[34559]: pgmap v249: 65 pgs: 65 active+clean; 1.5 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 197 MiB/s wr, 691 op/s 2024-09-13T02:50:36.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:36 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:36.938 INFO:tasks.workunit.client.0.smithi100.stdout:6/946: creat d12/d14/d2f/dca/dfe/f11d x:0 0 0 2024-09-13T02:50:36.938 INFO:tasks.workunit.client.0.smithi100.stdout:9/890: symlink dd/d1b/d1d/d28/l136 0 2024-09-13T02:50:36.939 INFO:tasks.workunit.client.0.smithi100.stdout:5/841: symlink db/l129 0 2024-09-13T02:50:36.940 INFO:tasks.workunit.client.0.smithi100.stdout:4/850: sync 2024-09-13T02:50:36.940 INFO:tasks.workunit.client.0.smithi100.stdout:2/825: sync 2024-09-13T02:50:36.942 INFO:tasks.workunit.client.0.smithi100.stdout:4/851: creat d3/d6/d21/d46/d2d/d42/d8f/f126 x:0 0 0 2024-09-13T02:50:36.945 INFO:tasks.workunit.client.0.smithi100.stdout:4/852: unlink d3/dc/d4b/d52/ld5 0 2024-09-13T02:50:36.945 INFO:tasks.workunit.client.0.smithi100.stdout:4/853: write d3/dc/d4b/d52/f8c [373508,112219] 0 2024-09-13T02:50:36.947 INFO:tasks.workunit.client.0.smithi100.stdout:1/946: write de/d14/d22/d52/d65/f124 [3809713,33413] 0 2024-09-13T02:50:36.947 INFO:tasks.workunit.client.0.smithi100.stdout:1/947: stat de/d14/d44/ca1 0 2024-09-13T02:50:36.947 INFO:tasks.workunit.client.0.smithi100.stdout:4/854: mkdir d3/d6/d21/d67/dd2/dd8/d127 0 2024-09-13T02:50:36.951 INFO:tasks.workunit.client.0.smithi100.stdout:4/855: mknod d3/d6/d21/d67/dd2/dd8/c128 0 2024-09-13T02:50:36.952 INFO:tasks.workunit.client.0.smithi100.stdout:9/891: write dd/d1b/d24/da8/fe5 [175983,106545] 0 2024-09-13T02:50:36.953 INFO:tasks.workunit.client.0.smithi100.stdout:9/892: creat dd/d1b/d27/d51/de9/d121/f137 x:0 0 0 2024-09-13T02:50:36.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/995: dwrite d3/d5/f1e [0,4194304] 0 2024-09-13T02:50:36.959 INFO:tasks.workunit.client.0.smithi100.stdout:7/996: chown d3/d16/d55/d92/da9/dde/d127/d1c/d36/d9c/cda 453894 1 2024-09-13T02:50:36.962 INFO:tasks.workunit.client.0.smithi100.stdout:7/997: unlink d3/cdd 0 2024-09-13T02:50:36.962 INFO:tasks.workunit.client.0.smithi100.stdout:7/998: fsync d3/d5/df3/f14b 0 2024-09-13T02:50:36.964 INFO:tasks.workunit.client.0.smithi100.stdout:7/999: creat d3/d16/db0/dd4/f14e x:0 0 0 2024-09-13T02:50:36.977 INFO:tasks.workunit.client.0.smithi100.stdout:0/982: dwrite d2/dd/db0/de0/d113/d133/d28/fa1 [0,4194304] 0 2024-09-13T02:50:36.979 INFO:tasks.workunit.client.0.smithi100.stdout:0/983: truncate d2/dd/f10 3078091 0 2024-09-13T02:50:36.980 INFO:tasks.workunit.client.0.smithi100.stdout:0/984: truncate d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/f72 4076450 0 2024-09-13T02:50:36.990 INFO:tasks.workunit.client.0.smithi100.stdout:0/985: read d2/dd/db0/de0/d113/d133/d28/fc9 [1177789,128411] 0 2024-09-13T02:50:36.994 INFO:tasks.workunit.client.0.smithi100.stdout:6/947: dwrite d12/d43/fc2 [0,4194304] 0 2024-09-13T02:50:36.994 INFO:tasks.workunit.client.0.smithi100.stdout:5/842: dwrite db/f3c [0,4194304] 0 2024-09-13T02:50:36.995 INFO:tasks.workunit.client.0.smithi100.stdout:4/856: dwrite d3/d63/fd3 [0,4194304] 0 2024-09-13T02:50:36.995 INFO:tasks.workunit.client.0.smithi100.stdout:4/857: chown d3/dc/d4b/d7c/ffa 398148 1 2024-09-13T02:50:36.995 INFO:tasks.workunit.client.0.smithi100.stdout:4/858: chown d3/d6/d2f/d7a/cd7 0 1 2024-09-13T02:50:36.995 INFO:tasks.workunit.client.0.smithi100.stdout:2/826: dwrite d0/db/d68/d9a/df2/f9e [0,4194304] 0 2024-09-13T02:50:36.995 INFO:tasks.workunit.client.0.smithi100.stdout:9/893: dwrite dd/d1b/d24/d74/d4e/dc4/fd6 [0,4194304] 0 2024-09-13T02:50:36.997 INFO:tasks.workunit.client.0.smithi100.stdout:6/948: creat d12/d14/d1c/d6e/d71/d100/f11e x:0 0 0 2024-09-13T02:50:37.000 INFO:tasks.workunit.client.0.smithi100.stdout:4/859: symlink d3/d63/dae/d10a/l129 0 2024-09-13T02:50:37.004 INFO:tasks.workunit.client.0.smithi100.stdout:0/986: dwrite d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d97/dbd/d13a/d7f/fbe [0,4194304] 0 2024-09-13T02:50:37.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/894: creat dd/d1b/d27/d119/f138 x:0 0 0 2024-09-13T02:50:37.006 INFO:tasks.workunit.client.0.smithi100.stdout:9/895: chown dd/d1b/d24/f2e 0 1 2024-09-13T02:50:37.007 INFO:tasks.workunit.client.0.smithi100.stdout:5/843: unlink db/de/d3e/feb 0 2024-09-13T02:50:37.008 INFO:tasks.workunit.client.0.smithi100.stdout:6/949: creat d12/d14/d5a/df0/f11f x:0 0 0 2024-09-13T02:50:37.017 INFO:tasks.workunit.client.0.smithi100.stdout:4/860: mknod d3/dc/d4b/d7c/c12a 0 2024-09-13T02:50:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:0/987: mkdir d2/d9/d6d/d85/dcd/d142 0 2024-09-13T02:50:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/896: dread dd/d1b/d24/d74/d4e/dc4/fd6 [0,4194304] 0 2024-09-13T02:50:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/897: write dd/d1b/d1d/faf [39159,13674] 0 2024-09-13T02:50:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/898: creat dd/d1b/d1d/d43/f139 x:0 0 0 2024-09-13T02:50:37.018 INFO:tasks.workunit.client.0.smithi100.stdout:9/899: creat dd/d1b/d27/d51/de9/f13a x:0 0 0 2024-09-13T02:50:37.029 INFO:tasks.workunit.client.0.smithi100.stdout:9/900: dread dd/f15 [0,4194304] 0 2024-09-13T02:50:37.029 INFO:tasks.workunit.client.0.smithi100.stdout:9/901: stat dd/d1b/d24/d74/d4e/dc4/f11b 0 2024-09-13T02:50:37.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/902: write dd/d1b/d24/f2e [2072472,107305] 0 2024-09-13T02:50:37.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/903: stat dd/d1b/d27/d51/lb7 0 2024-09-13T02:50:37.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/904: creat dd/d1b/d1d/d43/d5d/f13b x:0 0 0 2024-09-13T02:50:37.033 INFO:tasks.workunit.client.0.smithi100.stdout:9/905: write dd/d1b/d24/d74/d4e/d58/f129 [565865,20056] 0 2024-09-13T02:50:37.036 INFO:tasks.workunit.client.0.smithi100.stdout:9/906: unlink dd/d1b/d1d/d43/l10e 0 2024-09-13T02:50:37.036 INFO:tasks.workunit.client.0.smithi100.stdout:9/907: read dd/d1b/d24/d74/d4e/f96 [1423625,24788] 0 2024-09-13T02:50:37.036 INFO:tasks.workunit.client.0.smithi100.stdout:5/844: dwrite db/de/d3e/dc3/fe0 [0,4194304] 0 2024-09-13T02:50:37.037 INFO:tasks.workunit.client.0.smithi100.stdout:4/861: dwrite d3/d3a/d56/fe2 [0,4194304] 0 2024-09-13T02:50:37.038 INFO:tasks.workunit.client.0.smithi100.stdout:9/908: unlink dd/d1b/d7d/l9a 0 2024-09-13T02:50:37.040 INFO:tasks.workunit.client.0.smithi100.stdout:8/813: sync 2024-09-13T02:50:37.041 INFO:tasks.workunit.client.0.smithi100.stdout:4/862: creat d3/d6/d21/d46/d2d/f12b x:0 0 0 2024-09-13T02:50:37.046 INFO:tasks.workunit.client.0.smithi100.stdout:5/845: dread db/f3c [0,4194304] 0 2024-09-13T02:50:37.166 INFO:tasks.workunit.client.0.smithi100.stdout:9/909: creat dd/d1b/d1d/dad/d106/f13c x:0 0 0 2024-09-13T02:50:37.169 INFO:tasks.workunit.client.0.smithi100.stdout:8/814: mkdir df/d13/d5c/d10e/d11d 0 2024-09-13T02:50:37.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:36 smithi100 ceph-mon[27894]: pgmap v249: 65 pgs: 65 active+clean; 1.5 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 197 MiB/s wr, 691 op/s 2024-09-13T02:50:37.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:36 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:37.180 INFO:tasks.workunit.client.0.smithi100.stdout:9/910: dwrite dd/d1b/d1d/d43/d5d/f72 [0,4194304] 0 2024-09-13T02:50:37.208 INFO:tasks.workunit.client.0.smithi100.stdout:4/863: rename d3/d6/d2f/l32 to d3/d6/d21/d67/dd2/l12c 0 2024-09-13T02:50:37.212 INFO:tasks.workunit.client.0.smithi100.stdout:8/815: symlink df/d13/d21/df1/l11e 0 2024-09-13T02:50:37.212 INFO:tasks.workunit.client.0.smithi100.stdout:8/816: readlink df/d13/d21/lb4 0 2024-09-13T02:50:37.214 INFO:tasks.workunit.client.0.smithi100.stdout:9/911: truncate dd/d1b/d27/f63 1269888 0 2024-09-13T02:50:37.214 INFO:tasks.workunit.client.0.smithi100.stdout:8/817: dread df/d5d/d70/f36 [0,4194304] 0 2024-09-13T02:50:37.218 INFO:tasks.workunit.client.0.smithi100.stdout:4/864: dread d3/d6/d21/d46/f83 [0,4194304] 0 2024-09-13T02:50:37.218 INFO:tasks.workunit.client.0.smithi100.stdout:4/865: stat d3/d6/d21/d46/fa3 0 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:5/846: rmdir db 39 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:5/847: readlink db/de/d3e/dfa/l116 0 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:9/912: getdents dd/d1b/d1d/d43/d4f/da5/d93 0 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:9/913: chown dd/d1b/d24/d74/fbf 0 1 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:9/914: chown dd/d1b/d27/d119/f138 7760196 1 2024-09-13T02:50:37.222 INFO:tasks.workunit.client.0.smithi100.stdout:9/915: truncate dd/d1b/d1d/faf 760916 0 2024-09-13T02:50:37.224 INFO:tasks.workunit.client.0.smithi100.stdout:0/988: sync 2024-09-13T02:50:37.224 INFO:tasks.workunit.client.0.smithi100.stdout:1/948: sync 2024-09-13T02:50:37.224 INFO:tasks.workunit.client.0.smithi100.stdout:6/950: sync 2024-09-13T02:50:37.224 INFO:tasks.workunit.client.0.smithi100.stdout:6/951: chown d12/d2e/d90/da2/dbc/dce/dd6/cfa 8 1 2024-09-13T02:50:37.224 INFO:tasks.workunit.client.0.smithi100.stdout:1/949: read - de/d14/d22/d52/fb1 zero size 2024-09-13T02:50:37.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/827: sync 2024-09-13T02:50:37.225 INFO:tasks.workunit.client.0.smithi100.stdout:2/828: chown d0/db/d68/d6b/de1 26880 1 2024-09-13T02:50:37.225 INFO:tasks.workunit.client.0.smithi100.stdout:6/952: creat d12/d2e/d90/da2/dbc/f120 x:0 0 0 2024-09-13T02:50:37.225 INFO:tasks.workunit.client.0.smithi100.stdout:1/950: write de/d14/d22/d52/d65/fc8 [859768,71929] 0 2024-09-13T02:50:37.225 INFO:tasks.workunit.client.0.smithi100.stdout:8/818: rename df/d5d/dba/dcb/fde to df/d5d/d70/d2c/d38/d9e/d115/f11f 0 2024-09-13T02:50:37.226 INFO:tasks.workunit.client.0.smithi100.stdout:0/989: rmdir d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d97/dbd/d13e 0 2024-09-13T02:50:37.229 INFO:tasks.workunit.client.0.smithi100.stdout:6/953: mkdir d12/d43/d4b/d4c/d121 0 2024-09-13T02:50:37.229 INFO:tasks.workunit.client.0.smithi100.stdout:6/954: stat d12/d14/c3e 0 2024-09-13T02:50:37.229 INFO:tasks.workunit.client.0.smithi100.stdout:8/819: dread df/d13/f59 [0,4194304] 0 2024-09-13T02:50:37.231 INFO:tasks.workunit.client.0.smithi100.stdout:2/829: rename d0/db/d68/d6b/da5/d8f/faf to d0/db/d68/d6b/d85/ff6 0 2024-09-13T02:50:37.232 INFO:tasks.workunit.client.0.smithi100.stdout:0/990: mkdir d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d143 0 2024-09-13T02:50:37.235 INFO:tasks.workunit.client.0.smithi100.stdout:2/830: mknod d0/cf7 0 2024-09-13T02:50:37.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/951: write de/d14/d22/d52/d7a/feb [454734,65229] 0 2024-09-13T02:50:37.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/952: chown de/d14/d22/d52/d65/f124 154 1 2024-09-13T02:50:37.236 INFO:tasks.workunit.client.0.smithi100.stdout:1/953: chown de/d12/l13 0 1 2024-09-13T02:50:37.239 INFO:tasks.workunit.client.0.smithi100.stdout:2/831: mknod d0/cf8 0 2024-09-13T02:50:37.241 INFO:tasks.workunit.client.0.smithi100.stdout:1/954: dread de/d12/f8f [0,4194304] 0 2024-09-13T02:50:37.242 INFO:tasks.workunit.client.0.smithi100.stdout:1/955: chown de/d14/d44/d61/da9/db7/cdb 673 1 2024-09-13T02:50:37.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/955: rename d12/d14/d1c/d28/d88 to d12/d2e/d90/da2/dbc/dce/d122 0 2024-09-13T02:50:37.242 INFO:tasks.workunit.client.0.smithi100.stdout:6/956: read - d12/d2e/d90/da2/f70 zero size 2024-09-13T02:50:37.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/832: creat d0/db/d23/ff9 x:0 0 0 2024-09-13T02:50:37.244 INFO:tasks.workunit.client.0.smithi100.stdout:2/833: stat d0/db/d68/d6b/d71/d73 0 2024-09-13T02:50:37.248 INFO:tasks.workunit.client.0.smithi100.stdout:2/834: rename d0/db/d68/d9a/df2/ce3 to d0/db/d21/d69/cfa 0 2024-09-13T02:50:37.249 INFO:tasks.workunit.client.0.smithi100.stdout:1/956: getdents de/d14/d22/d52/d7a/d81 0 2024-09-13T02:50:37.250 INFO:tasks.workunit.client.0.smithi100.stdout:1/957: read - de/d14/d22/d29/d68/fda zero size 2024-09-13T02:50:37.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/958: mkdir de/d14/d44/d7f/dc2/d129/d12e 0 2024-09-13T02:50:37.251 INFO:tasks.workunit.client.0.smithi100.stdout:1/959: getdents de/d14/d22/d29/d64 0 2024-09-13T02:50:37.252 INFO:tasks.workunit.client.0.smithi100.stdout:1/960: symlink de/d14/d2e/d75/l12f 0 2024-09-13T02:50:37.257 INFO:tasks.workunit.client.0.smithi100.stdout:4/866: dwrite d3/d6/d21/d46/d2d/d42/fa5 [4194304,4194304] 0 2024-09-13T02:50:37.257 INFO:tasks.workunit.client.0.smithi100.stdout:4/867: mknod d3/d6/d21/d46/d2d/d42/d8f/c12d 0 2024-09-13T02:50:37.258 INFO:tasks.workunit.client.0.smithi100.stdout:4/868: symlink d3/d3a/d5c/l12e 0 2024-09-13T02:50:37.259 INFO:tasks.workunit.client.0.smithi100.stdout:4/869: creat d3/d6/d9/d9e/f12f x:0 0 0 2024-09-13T02:50:37.260 INFO:tasks.workunit.client.0.smithi100.stdout:4/870: dread d3/d6/d9/f73 [0,4194304] 0 2024-09-13T02:50:37.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/961: dread de/f11 [0,4194304] 0 2024-09-13T02:50:37.265 INFO:tasks.workunit.client.0.smithi100.stdout:1/962: creat de/d14/d86/f130 x:0 0 0 2024-09-13T02:50:37.267 INFO:tasks.workunit.client.0.smithi100.stdout:0/991: dwrite d2/dd/db0/de0/d113/d133/d28/dac/fb8 [0,4194304] 0 2024-09-13T02:50:37.267 INFO:tasks.workunit.client.0.smithi100.stdout:0/992: write d2/dd/db0/de0/d113/d133/d28/dac/fc5 [525555,110059] 0 2024-09-13T02:50:37.269 INFO:tasks.workunit.client.0.smithi100.stdout:8/820: dwrite df/d13/d21/d81/f8d [0,4194304] 0 2024-09-13T02:50:37.269 INFO:tasks.workunit.client.0.smithi100.stdout:8/821: truncate df/d13/d20/d98/fee 977732 0 2024-09-13T02:50:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:9/916: dwrite dd/d1b/d1d/d43/fb3 [0,4194304] 0 2024-09-13T02:50:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:2/835: dread d0/db/d68/d6b/d71/d73/f7e [0,4194304] 0 2024-09-13T02:50:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:5/848: dwrite db/de/d3e/da2/ddb/f10f [0,4194304] 0 2024-09-13T02:50:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:5/849: chown db/de/d3e/dfa/c11d 6600288 1 2024-09-13T02:50:37.270 INFO:tasks.workunit.client.0.smithi100.stdout:9/917: write dd/d1b/d27/ffa [1554265,130407] 0 2024-09-13T02:50:37.271 INFO:tasks.workunit.client.0.smithi100.stdout:0/993: unlink d2/dd/db0/de0/d113/d133/d47/l101 0 2024-09-13T02:50:37.272 INFO:tasks.workunit.client.0.smithi100.stdout:5/850: dread db/de/d1f/d78/fc4 [0,4194304] 0 2024-09-13T02:50:37.280 INFO:tasks.workunit.client.0.smithi100.stdout:2/836: creat d0/db/d68/d6b/da5/dcf/ffb x:0 0 0 2024-09-13T02:50:37.282 INFO:tasks.workunit.client.0.smithi100.stdout:9/918: mknod dd/d1b/d1d/dad/c13d 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/919: readlink dd/l11 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:9/920: stat dd/d1b/d24/da8 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:0/994: creat d2/d9/d6d/f144 x:0 0 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:0/995: fdatasync d2/dd/db0/de0/d113/d133/d28/fa1 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:0/996: fsync d2/dd/db0/de0/d113/d133/ff7 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:0/997: fdatasync d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d97/dbd/d13a/f123 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:0/998: write d2/dd/d93/f12e [788631,118057] 0 2024-09-13T02:50:37.283 INFO:tasks.workunit.client.0.smithi100.stdout:5/851: creat db/de/ddc/f12a x:0 0 0 2024-09-13T02:50:37.284 INFO:tasks.workunit.client.0.smithi100.stdout:9/921: symlink dd/d1b/d1d/d28/d111/l13e 0 2024-09-13T02:50:37.285 INFO:tasks.workunit.client.0.smithi100.stdout:5/852: creat db/de/d3e/da2/dac/f12b x:0 0 0 2024-09-13T02:50:37.288 INFO:tasks.workunit.client.0.smithi100.stdout:9/922: mknod dd/c13f 0 2024-09-13T02:50:37.288 INFO:tasks.workunit.client.0.smithi100.stdout:4/871: dwrite d3/dc/d4b/d52/f8c [0,4194304] 0 2024-09-13T02:50:37.288 INFO:tasks.workunit.client.0.smithi100.stdout:1/963: dwrite de/d14/d22/dfa/fc3 [0,4194304] 0 2024-09-13T02:50:37.288 INFO:tasks.workunit.client.0.smithi100.stdout:1/964: chown de/d14/d44/d7f/dc2/d129/d12e 1639 1 2024-09-13T02:50:37.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/965: creat de/d14/d2e/ddc/f131 x:0 0 0 2024-09-13T02:50:37.289 INFO:tasks.workunit.client.0.smithi100.stdout:1/966: fdatasync de/d14/d44/f123 0 2024-09-13T02:50:37.291 INFO:tasks.workunit.client.0.smithi100.stdout:9/923: truncate dd/d1b/d24/d74/d4e/dc4/f11b 3713849 0 2024-09-13T02:50:37.291 INFO:tasks.workunit.client.0.smithi100.stdout:9/924: write dd/d1b/d1d/d43/d5e/f105 [35432,104273] 0 2024-09-13T02:50:37.294 INFO:tasks.workunit.client.0.smithi100.stdout:1/967: dread de/d14/d86/fb9 [0,4194304] 0 2024-09-13T02:50:37.298 INFO:tasks.workunit.client.0.smithi100.stdout:9/925: mknod dd/d1b/d21/d86/c140 0 2024-09-13T02:50:37.298 INFO:tasks.workunit.client.0.smithi100.stdout:5/853: write db/de/d3e/fab [3565321,30904] 0 2024-09-13T02:50:37.300 INFO:tasks.workunit.client.0.smithi100.stdout:1/968: link de/d14/d22/d52/d65/fd6 de/d14/d22/d29/d68/d10d/d12a/f132 0 2024-09-13T02:50:37.300 INFO:tasks.workunit.client.0.smithi100.stdout:1/969: dread - de/d14/d22/d52/d65/dc6/fee zero size 2024-09-13T02:50:37.302 INFO:tasks.workunit.client.0.smithi100.stdout:8/822: dwrite df/dbb/f110 [0,4194304] 0 2024-09-13T02:50:37.302 INFO:tasks.workunit.client.0.smithi100.stdout:8/823: creat df/d5d/d70/d2c/f120 x:0 0 0 2024-09-13T02:50:37.303 INFO:tasks.workunit.client.0.smithi100.stdout:9/926: mkdir dd/d1b/d24/d74/d4e/dc4/d141 0 2024-09-13T02:50:37.305 INFO:tasks.workunit.client.0.smithi100.stdout:1/970: mknod de/d14/d44/d61/ded/c133 0 2024-09-13T02:50:37.305 INFO:tasks.workunit.client.0.smithi100.stdout:1/971: fsync de/d14/d22/d52/d65/f6f 0 2024-09-13T02:50:37.306 INFO:tasks.workunit.client.0.smithi100.stdout:2/837: dwrite d0/db/d68/d9a/fa3 [0,4194304] 0 2024-09-13T02:50:37.306 INFO:tasks.workunit.client.0.smithi100.stdout:0/999: dwrite d2/dd/db0/de0/d113/d133/d47/d8a/dfa/d4b/db4/f137 [0,4194304] 0 2024-09-13T02:50:37.308 INFO:tasks.workunit.client.0.smithi100.stdout:9/927: truncate dd/d1b/d1d/d43/d5d/fd8 2662692 0 2024-09-13T02:50:37.308 INFO:tasks.workunit.client.0.smithi100.stdout:9/928: fdatasync dd/d1b/d1d/f3b 0 2024-09-13T02:50:37.309 INFO:tasks.workunit.client.0.smithi100.stdout:5/854: mknod db/de/d3e/d71/c12c 0 2024-09-13T02:50:37.310 INFO:tasks.workunit.client.0.smithi100.stdout:1/972: symlink de/d14/df5/dff/d101/d114/l134 0 2024-09-13T02:50:37.313 INFO:tasks.workunit.client.0.smithi100.stdout:8/824: read df/d13/db5/dc3/de0/ff4 [2644157,9857] 0 2024-09-13T02:50:37.315 INFO:tasks.workunit.client.0.smithi100.stdout:1/973: rmdir de/d14/d22/d29/d68/d10d 39 2024-09-13T02:50:37.319 INFO:tasks.workunit.client.0.smithi100.stdout:2/838: dread d0/db/d68/d9a/fa3 [0,4194304] 0 2024-09-13T02:50:37.319 INFO:tasks.workunit.client.0.smithi100.stdout:9/929: rename dd/d1b/d7d to dd/d1b/d1d/d43/d5d/d142 0 2024-09-13T02:50:37.320 INFO:tasks.workunit.client.0.smithi100.stdout:2/839: getdents d0/db/d21 0 2024-09-13T02:50:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/840: link d0/db/d68/cb6 d0/db/d68/d9a/df2/d6a/d7f/cfc 0 2024-09-13T02:50:37.322 INFO:tasks.workunit.client.0.smithi100.stdout:2/841: chown d0/db/d68/d9a/df2/d6a/d7f 10 1 2024-09-13T02:50:37.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/974: write de/d14/d22/d52/f71 [3615985,3968] 0 2024-09-13T02:50:37.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/825: dwrite df/d13/d20/da2/f108 [0,4194304] 0 2024-09-13T02:50:37.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/826: readlink df/d13/lb9 0 2024-09-13T02:50:37.333 INFO:tasks.workunit.client.0.smithi100.stdout:8/827: stat df/d5d/d88/fed 0 2024-09-13T02:50:37.333 INFO:tasks.workunit.client.0.smithi100.stdout:1/975: creat de/d14/d22/d29/d108/f135 x:0 0 0 2024-09-13T02:50:37.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/930: dread dd/d1b/d1d/f134 [4194304,4194304] 0 2024-09-13T02:50:37.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/931: stat dd/d1b/d1d/d28/d111/d117/f11d 0 2024-09-13T02:50:37.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/932: creat dd/d1b/d1d/d28/d111/f143 x:0 0 0 2024-09-13T02:50:37.334 INFO:tasks.workunit.client.0.smithi100.stdout:9/933: readlink dd/d1b/d24/da8/lf1 0 2024-09-13T02:50:37.335 INFO:tasks.workunit.client.0.smithi100.stdout:9/934: dread dd/d1b/d1d/d43/d4f/da5/ff2 [0,4194304] 0 2024-09-13T02:50:37.336 INFO:tasks.workunit.client.0.smithi100.stdout:8/828: unlink df/d85/cf6 0 2024-09-13T02:50:37.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/842: dwrite d0/db/d68/d9a/df2/d6a/d7f/f83 [4194304,4194304] 0 2024-09-13T02:50:37.342 INFO:tasks.workunit.client.0.smithi100.stdout:2/843: write d0/db/d21/f6c [21266,24303] 0 2024-09-13T02:50:37.344 INFO:tasks.workunit.client.0.smithi100.stdout:1/976: read de/d12/f105 [317305,92102] 0 2024-09-13T02:50:37.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/844: rename d0/db/d68/d9a/df2/l86 to d0/db/dbe/lfd 0 2024-09-13T02:50:37.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/845: getdents d0/db/d68/d9a/df2/d6a/db2 0 2024-09-13T02:50:37.346 INFO:tasks.workunit.client.0.smithi100.stdout:2/846: fsync d0/d36/f75 0 2024-09-13T02:50:37.346 INFO:tasks.workunit.client.0.smithi100.stdout:1/977: mkdir de/d14/d22/d29/d68/d136 0 2024-09-13T02:50:37.348 INFO:tasks.workunit.client.0.smithi100.stdout:2/847: mkdir d0/db/d68/d6b/d85/dfe 0 2024-09-13T02:50:37.349 INFO:tasks.workunit.client.0.smithi100.stdout:1/978: symlink de/d14/d22/d52/l137 0 2024-09-13T02:50:37.349 INFO:tasks.workunit.client.0.smithi100.stdout:9/935: rmdir dd/d1b/d1d/d28 39 2024-09-13T02:50:37.350 INFO:tasks.workunit.client.0.smithi100.stdout:9/936: write dd/d1b/d24/f67 [2450933,30095] 0 2024-09-13T02:50:37.350 INFO:tasks.workunit.client.0.smithi100.stdout:9/937: stat dd/d1b/d1d/dad 0 2024-09-13T02:50:37.350 INFO:tasks.workunit.client.0.smithi100.stdout:6/957: sync 2024-09-13T02:50:37.351 INFO:tasks.workunit.client.0.smithi100.stdout:2/848: creat d0/db/d68/fff x:0 0 0 2024-09-13T02:50:37.352 INFO:tasks.workunit.client.0.smithi100.stdout:6/958: mknod d12/d43/d4b/c123 0 2024-09-13T02:50:37.354 INFO:tasks.workunit.client.0.smithi100.stdout:2/849: mknod d0/db/d21/d57/d81/db3/c100 0 2024-09-13T02:50:37.354 INFO:tasks.workunit.client.0.smithi100.stdout:1/979: dread de/d14/d22/f77 [0,4194304] 0 2024-09-13T02:50:37.355 INFO:tasks.workunit.client.0.smithi100.stdout:6/959: creat d12/d2e/d90/d92/f124 x:0 0 0 2024-09-13T02:50:37.355 INFO:tasks.workunit.client.0.smithi100.stdout:2/850: rmdir d0/db/d21/d69 39 2024-09-13T02:50:37.356 INFO:tasks.workunit.client.0.smithi100.stdout:1/980: mkdir de/d14/df5/d138 0 2024-09-13T02:50:37.357 INFO:tasks.workunit.client.0.smithi100.stdout:6/960: symlink d12/d14/d5a/l125 0 2024-09-13T02:50:37.359 INFO:tasks.workunit.client.0.smithi100.stdout:2/851: dread d0/db/d23/f35 [0,4194304] 0 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/829: dwrite df/d5d/d88/dc0/f102 [0,4194304] 0 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/830: chown df/d5d/d70/d2c/f7f 16 1 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/831: readlink df/d13/d20/da2/lfd 0 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/832: creat df/d13/d20/da2/f121 x:0 0 0 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:8/833: fsync df/d13/d21/d81/db0/fdc 0 2024-09-13T02:50:37.360 INFO:tasks.workunit.client.0.smithi100.stdout:6/961: link d12/d2e/fd1 d12/f126 0 2024-09-13T02:50:37.363 INFO:tasks.workunit.client.0.smithi100.stdout:8/834: unlink df/d5d/dba/cbe 0 2024-09-13T02:50:37.364 INFO:tasks.workunit.client.0.smithi100.stdout:8/835: truncate df/d13/d20/f42 2592184 0 2024-09-13T02:50:37.367 INFO:tasks.workunit.client.0.smithi100.stdout:8/836: link df/d5d/d70/d2c/l4b df/d13/db5/dc3/df0/l122 0 2024-09-13T02:50:37.368 INFO:tasks.workunit.client.0.smithi100.stdout:1/981: dread de/d14/d2e/d60/fa0 [0,4194304] 0 2024-09-13T02:50:37.369 INFO:tasks.workunit.client.0.smithi100.stdout:8/837: unlink df/d5d/d70/ffa 0 2024-09-13T02:50:37.371 INFO:tasks.workunit.client.0.smithi100.stdout:1/982: link de/d14/d2e/d75/f11b de/d14/d44/d61/ded/df7/df8/f139 0 2024-09-13T02:50:37.371 INFO:tasks.workunit.client.0.smithi100.stdout:1/983: read de/d14/d22/d52/db8/ff9 [160627,44826] 0 2024-09-13T02:50:37.373 INFO:tasks.workunit.client.0.smithi100.stdout:9/938: dwrite dd/d1b/d1d/d43/d4f/da5/fdb [0,4194304] 0 2024-09-13T02:50:37.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/838: truncate f2 3520964 0 2024-09-13T02:50:37.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/839: creat df/d13/d20/d98/f123 x:0 0 0 2024-09-13T02:50:37.373 INFO:tasks.workunit.client.0.smithi100.stdout:8/840: chown df/d13/d21/f105 6162518 1 2024-09-13T02:50:37.377 INFO:tasks.workunit.client.0.smithi100.stdout:1/984: creat de/d14/df5/dff/d101/f13a x:0 0 0 2024-09-13T02:50:37.380 INFO:tasks.workunit.client.0.smithi100.stdout:9/939: chown dd/d1b/d1d/d43/d4f/l6d 26117 1 2024-09-13T02:50:37.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/985: creat de/d14/df5/dff/d101/d11f/f13b x:0 0 0 2024-09-13T02:50:37.384 INFO:tasks.workunit.client.0.smithi100.stdout:1/986: chown de/d14/d44/d61/ded/l82 2360 1 2024-09-13T02:50:37.385 INFO:tasks.workunit.client.0.smithi100.stdout:1/987: mkdir de/d14/d22/d29/d108/d13c 0 2024-09-13T02:50:37.386 INFO:tasks.workunit.client.0.smithi100.stdout:1/988: truncate de/d14/d22/d52/d7a/d81/de0/f107 856446 0 2024-09-13T02:50:37.390 INFO:tasks.workunit.client.0.smithi100.stdout:1/989: rename de/d14/d22/d52/lb2 to de/d14/d22/d29/l13d 0 2024-09-13T02:50:37.391 INFO:tasks.workunit.client.0.smithi100.stdout:1/990: rename de/d14/d86/dd0/lf2 to de/d14/d22/dfa/dd3/l13e 0 2024-09-13T02:50:37.392 INFO:tasks.workunit.client.0.smithi100.stdout:6/962: dwrite d12/d2e/fd1 [0,4194304] 0 2024-09-13T02:50:37.392 INFO:tasks.workunit.client.0.smithi100.stdout:6/963: write d12/d14/d1c/d6e/d71/fcb [950637,97907] 0 2024-09-13T02:50:37.392 INFO:tasks.workunit.client.0.smithi100.stdout:1/991: creat de/d14/d44/d61/ded/f13f x:0 0 0 2024-09-13T02:50:37.394 INFO:tasks.workunit.client.0.smithi100.stdout:6/964: rmdir d12/d14/d1c/d6e 39 2024-09-13T02:50:37.394 INFO:tasks.workunit.client.0.smithi100.stdout:6/965: fsync d12/d14/d1c/fa1 0 2024-09-13T02:50:37.395 INFO:tasks.workunit.client.0.smithi100.stdout:1/992: truncate de/d14/d2e/d48/fe3 2298902 0 2024-09-13T02:50:37.395 INFO:tasks.workunit.client.0.smithi100.stdout:1/993: dread - de/d14/d86/f130 zero size 2024-09-13T02:50:37.395 INFO:tasks.workunit.client.0.smithi100.stdout:1/994: read de/d14/d22/d52/d65/dc6/fe9 [1313395,62813] 0 2024-09-13T02:50:37.396 INFO:tasks.workunit.client.0.smithi100.stdout:6/966: truncate d12/d2e/d90/da2/f6d 380495 0 2024-09-13T02:50:37.396 INFO:tasks.workunit.client.0.smithi100.stdout:6/967: truncate d12/d14/d1c/d6e/d71/fcb 1839708 0 2024-09-13T02:50:37.396 INFO:tasks.workunit.client.0.smithi100.stdout:6/968: read - d12/d14/d1c/d7b/da6/f11c zero size 2024-09-13T02:50:37.396 INFO:tasks.workunit.client.0.smithi100.stdout:6/969: stat d12/d14/d1c/c4a 0 2024-09-13T02:50:37.397 INFO:tasks.workunit.client.0.smithi100.stdout:1/995: creat de/d14/d22/dfa/dd3/f140 x:0 0 0 2024-09-13T02:50:37.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/852: dwrite d0/db/d21/f6c [0,4194304] 0 2024-09-13T02:50:37.399 INFO:tasks.workunit.client.0.smithi100.stdout:8/841: dwrite df/d5d/d70/d2c/fc2 [0,4194304] 0 2024-09-13T02:50:37.399 INFO:tasks.workunit.client.0.smithi100.stdout:2/853: chown d0/db/d21/d57/lf0 16552633 1 2024-09-13T02:50:37.399 INFO:tasks.workunit.client.0.smithi100.stdout:9/940: read dd/d1b/d1d/d43/d5e/f9b [2750333,95131] 0 2024-09-13T02:50:37.399 INFO:tasks.workunit.client.0.smithi100.stdout:9/941: fsync dd/d1b/d21/fbc 0 2024-09-13T02:50:37.400 INFO:tasks.workunit.client.0.smithi100.stdout:9/942: write dd/d1b/d24/da8/ffe [159141,98260] 0 2024-09-13T02:50:37.407 INFO:tasks.workunit.client.0.smithi100.stdout:1/996: dread de/d14/d22/d52/d65/fd6 [0,4194304] 0 2024-09-13T02:50:37.407 INFO:tasks.workunit.client.0.smithi100.stdout:1/997: stat de/d14/d22/d29/d68/d136 0 2024-09-13T02:50:37.416 INFO:tasks.workunit.client.0.smithi100.stdout:2/854: creat d0/db/d68/d6b/da5/de7/f101 x:0 0 0 2024-09-13T02:50:37.417 INFO:tasks.workunit.client.0.smithi100.stdout:2/855: write d0/db/d68/d6b/d85/fbf [332334,26232] 0 2024-09-13T02:50:37.417 INFO:tasks.workunit.client.0.smithi100.stdout:6/970: dwrite d12/d14/d2f/da4/f115 [0,4194304] 0 2024-09-13T02:50:37.420 INFO:tasks.workunit.client.0.smithi100.stdout:6/971: mknod d12/dcd/c127 0 2024-09-13T02:50:37.421 INFO:tasks.workunit.client.0.smithi100.stdout:1/998: dread de/d14/d22/d52/d65/dc6/fe9 [0,4194304] 0 2024-09-13T02:50:37.422 INFO:tasks.workunit.client.0.smithi100.stdout:6/972: rename d12/dcd/c127 to d12/d2e/d90/da2/dbc/dce/d122/dd2/c128 0 2024-09-13T02:50:37.424 INFO:tasks.workunit.client.0.smithi100.stdout:1/999: rmdir de/d14/d44/d7f 39 2024-09-13T02:50:37.429 INFO:tasks.workunit.client.0.smithi100.stdout:8/842: dwrite df/d13/d21/f57 [4194304,4194304] 0 2024-09-13T02:50:37.434 INFO:tasks.workunit.client.0.smithi100.stdout:8/843: link df/d6f/f11a df/d13/d21/d81/db0/da3/dc7/f124 0 2024-09-13T02:50:37.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/856: write d0/db/d68/d9a/df2/d6a/d7f/dbb/fc1 [3019537,110957] 0 2024-09-13T02:50:37.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/857: fdatasync d0/db/d21/d57/fea 0 2024-09-13T02:50:37.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/858: chown d0/db/dbe/fd1 20641353 1 2024-09-13T02:50:37.435 INFO:tasks.workunit.client.0.smithi100.stdout:2/859: dread - d0/db/d68/d6b/d85/ff6 zero size 2024-09-13T02:50:37.435 INFO:tasks.workunit.client.0.smithi100.stdout:8/844: truncate df/d5d/f69 3204095 0 2024-09-13T02:50:37.436 INFO:tasks.workunit.client.0.smithi100.stdout:2/860: creat d0/db/d68/d9a/df2/f102 x:0 0 0 2024-09-13T02:50:37.438 INFO:tasks.workunit.client.0.smithi100.stdout:8/845: rename df/d5d/d70/l34 to df/d13/d21/d81/l125 0 2024-09-13T02:50:37.440 INFO:tasks.workunit.client.0.smithi100.stdout:4/872: sync 2024-09-13T02:50:37.440 INFO:tasks.workunit.client.0.smithi100.stdout:5/855: sync 2024-09-13T02:50:37.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/943: dwrite dd/d1b/d1d/d43/d5e/f9b [0,4194304] 0 2024-09-13T02:50:37.442 INFO:tasks.workunit.client.0.smithi100.stdout:9/944: fsync dd/d1b/d1d/d43/d5d/d142/f7f 0 2024-09-13T02:50:37.442 INFO:tasks.workunit.client.0.smithi100.stdout:8/846: link df/d6f/f11a df/d13/de1/f126 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/973: dwrite d12/d14/d1c/d6e/d71/d100/f51 [0,4194304] 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/974: fsync d12/d14/d1c/d6e/d71/fb6 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/975: fdatasync d12/d14/d1c/d7b/da6/fc9 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/976: write d12/d43/d4b/d4c/f87 [517034,91416] 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:6/977: fdatasync d12/d14/d1c/f62 0 2024-09-13T02:50:37.443 INFO:tasks.workunit.client.0.smithi100.stdout:2/861: dread d0/db/d23/f35 [0,4194304] 0 2024-09-13T02:50:37.447 INFO:tasks.workunit.client.0.smithi100.stdout:4/873: creat d3/d63/d114/f130 x:0 0 0 2024-09-13T02:50:37.447 INFO:tasks.workunit.client.0.smithi100.stdout:4/874: readlink d3/d6/d2f/d60/l10b 0 2024-09-13T02:50:37.447 INFO:tasks.workunit.client.0.smithi100.stdout:4/875: getdents d3/dc/d4b/d9b/db2/df6 0 2024-09-13T02:50:37.461 INFO:tasks.workunit.client.0.smithi100.stdout:9/945: read dd/d1b/d1d/d43/d5e/f9b [2102612,95991] 0 2024-09-13T02:50:37.461 INFO:tasks.workunit.client.0.smithi100.stdout:8/847: rename df/d5d/d70/d41 to df/d13/d21/d81/d127 0 2024-09-13T02:50:37.462 INFO:tasks.workunit.client.0.smithi100.stdout:8/848: write df/d13/d21/f57 [3235828,32079] 0 2024-09-13T02:50:37.462 INFO:tasks.workunit.client.0.smithi100.stdout:9/946: creat dd/d1b/d1d/f144 x:0 0 0 2024-09-13T02:50:37.462 INFO:tasks.workunit.client.0.smithi100.stdout:9/947: stat dd/d1b/d21/fde 0 2024-09-13T02:50:37.462 INFO:tasks.workunit.client.0.smithi100.stdout:9/948: chown dd/d1b/d21/fde 29 1 2024-09-13T02:50:37.464 INFO:tasks.workunit.client.0.smithi100.stdout:4/876: rename d3/dc/d4b/d8a/fe4 to d3/dc/f131 0 2024-09-13T02:50:37.464 INFO:tasks.workunit.client.0.smithi100.stdout:4/877: dread - d3/d6/d21/d46/d34/f77 zero size 2024-09-13T02:50:37.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/849: mknod df/d13/de1/c128 0 2024-09-13T02:50:37.467 INFO:tasks.workunit.client.0.smithi100.stdout:8/850: fsync df/d13/d21/f40 0 2024-09-13T02:50:37.468 INFO:tasks.workunit.client.0.smithi100.stdout:9/949: mknod dd/d1b/d24/d74/d4e/c145 0 2024-09-13T02:50:37.469 INFO:tasks.workunit.client.0.smithi100.stdout:8/851: mknod df/d13/d68/c129 0 2024-09-13T02:50:37.469 INFO:tasks.workunit.client.0.smithi100.stdout:9/950: symlink dd/d1b/d1d/dad/d106/l146 0 2024-09-13T02:50:37.475 INFO:tasks.workunit.client.0.smithi100.stdout:5/856: dwrite db/de/d3e/da2/fa4 [0,4194304] 0 2024-09-13T02:50:37.478 INFO:tasks.workunit.client.0.smithi100.stdout:6/978: dwrite d12/d14/d21/f76 [0,4194304] 0 2024-09-13T02:50:37.478 INFO:tasks.workunit.client.0.smithi100.stdout:2/862: dwrite d0/f64 [0,4194304] 0 2024-09-13T02:50:37.484 INFO:tasks.workunit.client.0.smithi100.stdout:6/979: rename d12/d14/d1c/l1d to d12/d14/d2f/dca/dd8/l129 0 2024-09-13T02:50:37.489 INFO:tasks.workunit.client.0.smithi100.stdout:8/852: dwrite df/d13/d68/f9d [0,4194304] 0 2024-09-13T02:50:37.492 INFO:tasks.workunit.client.0.smithi100.stdout:2/863: mknod d0/db/d68/d9a/df2/d6a/db2/c103 0 2024-09-13T02:50:37.492 INFO:tasks.workunit.client.0.smithi100.stdout:2/864: chown d0/db/c41 242724974 1 2024-09-13T02:50:37.494 INFO:tasks.workunit.client.0.smithi100.stdout:5/857: mknod db/de/d3e/c12d 0 2024-09-13T02:50:37.496 INFO:tasks.workunit.client.0.smithi100.stdout:8/853: write fc [2119577,93210] 0 2024-09-13T02:50:37.498 INFO:tasks.workunit.client.0.smithi100.stdout:2/865: mkdir d0/db/d68/d9a/df2/d6a/d7f/d104 0 2024-09-13T02:50:37.502 INFO:tasks.workunit.client.0.smithi100.stdout:5/858: link db/de/d1f/fb9 db/de/ddc/d100/f12e 0 2024-09-13T02:50:37.502 INFO:tasks.workunit.client.0.smithi100.stdout:8/854: link df/c12 df/d5d/d70/d2c/d38/d9e/d106/c12a 0 2024-09-13T02:50:37.503 INFO:tasks.workunit.client.0.smithi100.stdout:2/866: mkdir d0/db/d68/d6b/d71/d105 0 2024-09-13T02:50:37.504 INFO:tasks.workunit.client.0.smithi100.stdout:2/867: write d0/d36/f6f [111506,13601] 0 2024-09-13T02:50:37.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/859: symlink db/de/d1f/d2b/d9b/l12f 0 2024-09-13T02:50:37.505 INFO:tasks.workunit.client.0.smithi100.stdout:5/860: chown db/de/d3e/d7e/dfb/d124 165 1 2024-09-13T02:50:37.507 INFO:tasks.workunit.client.0.smithi100.stdout:6/980: dwrite d12/d14/d68/d105/f111 [0,4194304] 0 2024-09-13T02:50:37.507 INFO:tasks.workunit.client.0.smithi100.stdout:5/861: unlink db/ce7 0 2024-09-13T02:50:37.507 INFO:tasks.workunit.client.0.smithi100.stdout:5/862: truncate db/de/ddc/f125 34922 0 2024-09-13T02:50:37.511 INFO:tasks.workunit.client.0.smithi100.stdout:6/981: mknod d12/d2e/d90/da2/dbc/dce/d122/c12a 0 2024-09-13T02:50:37.513 INFO:tasks.workunit.client.0.smithi100.stdout:5/863: getdents db/de/d63/d9c 0 2024-09-13T02:50:37.515 INFO:tasks.workunit.client.0.smithi100.stdout:5/864: read db/faf [141749,47323] 0 2024-09-13T02:50:37.516 INFO:tasks.workunit.client.0.smithi100.stdout:5/865: dread - db/de/d63/d9c/fca zero size 2024-09-13T02:50:37.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/866: link db/de/d1f/d2b/fd3 db/de/d3e/da2/ddb/f130 0 2024-09-13T02:50:37.518 INFO:tasks.workunit.client.0.smithi100.stdout:5/867: chown db/l129 5657 1 2024-09-13T02:50:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:5/868: mkdir db/de/d3e/d71/dd9/d131 0 2024-09-13T02:50:37.521 INFO:tasks.workunit.client.0.smithi100.stdout:5/869: chown db/de/d1f/d2b/dbe/cf1 61733254 1 2024-09-13T02:50:37.524 INFO:tasks.workunit.client.0.smithi100.stdout:5/870: rename db/de/d3e/f7a to db/de/ddc/d100/f132 0 2024-09-13T02:50:37.534 INFO:tasks.workunit.client.0.smithi100.stdout:8/855: dwrite df/d13/d20/f61 [0,4194304] 0 2024-09-13T02:50:37.536 INFO:tasks.workunit.client.0.smithi100.stdout:8/856: link df/d5d/d88/dc0/f102 df/d5d/d70/d2c/de3/f12b 0 2024-09-13T02:50:37.536 INFO:tasks.workunit.client.0.smithi100.stdout:8/857: chown df/dac/dd3/c118 19920 1 2024-09-13T02:50:37.536 INFO:tasks.workunit.client.0.smithi100.stdout:8/858: fsync df/d13/d68/f8e 0 2024-09-13T02:50:37.537 INFO:tasks.workunit.client.0.smithi100.stdout:8/859: unlink df/d13/d21/d81/l125 0 2024-09-13T02:50:37.539 INFO:tasks.workunit.client.0.smithi100.stdout:8/860: rmdir df/d13/d20/da2 39 2024-09-13T02:50:37.539 INFO:tasks.workunit.client.0.smithi100.stdout:8/861: stat df/d5d/d88/fed 0 2024-09-13T02:50:37.540 INFO:tasks.workunit.client.0.smithi100.stdout:8/862: creat df/d13/d21/df1/f12c x:0 0 0 2024-09-13T02:50:37.540 INFO:tasks.workunit.client.0.smithi100.stdout:8/863: getdents df/d13/db5/dc3/df0 0 2024-09-13T02:50:37.542 INFO:tasks.workunit.client.0.smithi100.stdout:8/864: rmdir df/d13/d21/d81/db0/da3 39 2024-09-13T02:50:37.546 INFO:tasks.workunit.client.0.smithi100.stdout:6/982: dwrite d12/d43/d4b/d4c/fdf [0,4194304] 0 2024-09-13T02:50:37.549 INFO:tasks.workunit.client.0.smithi100.stdout:6/983: creat d12/d14/df2/d113/f12b x:0 0 0 2024-09-13T02:50:37.554 INFO:tasks.workunit.client.0.smithi100.stdout:2/868: dwrite d0/db/d68/d6b/f76 [0,4194304] 0 2024-09-13T02:50:37.554 INFO:tasks.workunit.client.0.smithi100.stdout:5/871: dwrite db/f8f [0,4194304] 0 2024-09-13T02:50:37.560 INFO:tasks.workunit.client.0.smithi100.stdout:8/865: dwrite df/d13/d20/d98/fee [0,4194304] 0 2024-09-13T02:50:37.560 INFO:tasks.workunit.client.0.smithi100.stdout:8/866: fsync df/f67 0 2024-09-13T02:50:37.564 INFO:tasks.workunit.client.0.smithi100.stdout:5/872: mknod db/de/d1f/d2b/d9b/c133 0 2024-09-13T02:50:37.566 INFO:tasks.workunit.client.0.smithi100.stdout:2/869: getdents d0/db/d68/d6b/d85 0 2024-09-13T02:50:37.568 INFO:tasks.workunit.client.0.smithi100.stdout:2/870: creat d0/db/d21/d57/d81/db3/f106 x:0 0 0 2024-09-13T02:50:37.571 INFO:tasks.workunit.client.0.smithi100.stdout:6/984: dwrite d12/d2e/d90/d92/f124 [0,4194304] 0 2024-09-13T02:50:37.573 INFO:tasks.workunit.client.0.smithi100.stdout:2/871: unlink d0/db/d68/d6b/f77 0 2024-09-13T02:50:37.573 INFO:tasks.workunit.client.0.smithi100.stdout:2/872: write d0/d36/d8a/fa2 [4837481,126381] 0 2024-09-13T02:50:37.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/873: fdatasync d0/d36/fcb 0 2024-09-13T02:50:37.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/874: readlink d0/db/d21/d57/lf0 0 2024-09-13T02:50:37.574 INFO:tasks.workunit.client.0.smithi100.stdout:2/875: stat d0/db/d68/d6b/d71/fb0 0 2024-09-13T02:50:37.574 INFO:tasks.workunit.client.0.smithi100.stdout:8/867: dread df/d5d/fa8 [0,4194304] 0 2024-09-13T02:50:37.575 INFO:tasks.workunit.client.0.smithi100.stdout:6/985: symlink d12/d14/d1c/d6e/l12c 0 2024-09-13T02:50:37.578 INFO:tasks.workunit.client.0.smithi100.stdout:2/876: link d0/db/d68/d9a/df2/f102 d0/db/d68/d9a/f107 0 2024-09-13T02:50:37.579 INFO:tasks.workunit.client.0.smithi100.stdout:6/986: mknod d12/d14/d4d/ded/c12d 0 2024-09-13T02:50:37.580 INFO:tasks.workunit.client.0.smithi100.stdout:4/878: sync 2024-09-13T02:50:37.580 INFO:tasks.workunit.client.0.smithi100.stdout:9/951: sync 2024-09-13T02:50:37.580 INFO:tasks.workunit.client.0.smithi100.stdout:2/877: mknod d0/db/d68/d6b/d71/c108 0 2024-09-13T02:50:37.581 INFO:tasks.workunit.client.0.smithi100.stdout:8/868: dread df/d5d/d70/d2c/d38/f5b [0,4194304] 0 2024-09-13T02:50:37.581 INFO:tasks.workunit.client.0.smithi100.stdout:5/873: rmdir db 39 2024-09-13T02:50:37.582 INFO:tasks.workunit.client.0.smithi100.stdout:5/874: read db/de/d3e/d7e/f91 [6093,129241] 0 2024-09-13T02:50:37.582 INFO:tasks.workunit.client.0.smithi100.stdout:5/875: fsync db/de/ddc/f105 0 2024-09-13T02:50:37.582 INFO:tasks.workunit.client.0.smithi100.stdout:6/987: truncate d12/d14/f75 905849 0 2024-09-13T02:50:37.584 INFO:tasks.workunit.client.0.smithi100.stdout:4/879: getdents d3/dc/d88/db4 0 2024-09-13T02:50:37.586 INFO:tasks.workunit.client.0.smithi100.stdout:5/876: mknod db/de/d3e/dfa/c134 0 2024-09-13T02:50:37.588 INFO:tasks.workunit.client.0.smithi100.stdout:9/952: getdents dd/d1b/d1d/d43 0 2024-09-13T02:50:37.591 INFO:tasks.workunit.client.0.smithi100.stdout:4/880: creat d3/d6/da6/f132 x:0 0 0 2024-09-13T02:50:37.592 INFO:tasks.workunit.client.0.smithi100.stdout:8/869: mkdir df/d6f/d12d 0 2024-09-13T02:50:37.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/878: dread d0/db/d21/f6c [0,4194304] 0 2024-09-13T02:50:37.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/953: creat dd/d1b/d1d/d43/d5d/d142/f147 x:0 0 0 2024-09-13T02:50:37.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/954: truncate dd/d1b/d1d/d43/f139 874687 0 2024-09-13T02:50:37.594 INFO:tasks.workunit.client.0.smithi100.stdout:9/955: write dd/d1b/d1d/d43/d4f/da5/f91 [497855,109429] 0 2024-09-13T02:50:37.595 INFO:tasks.workunit.client.0.smithi100.stdout:4/881: creat d3/d6/d21/d46/d2d/d42/f133 x:0 0 0 2024-09-13T02:50:37.597 INFO:tasks.workunit.client.0.smithi100.stdout:8/870: mkdir df/d13/d21/d81/d12e 0 2024-09-13T02:50:37.598 INFO:tasks.workunit.client.0.smithi100.stdout:2/879: symlink d0/dd5/l109 0 2024-09-13T02:50:37.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/956: creat dd/d1b/da3/dc9/f148 x:0 0 0 2024-09-13T02:50:37.600 INFO:tasks.workunit.client.0.smithi100.stdout:9/957: creat dd/d1b/d24/d74/f149 x:0 0 0 2024-09-13T02:50:37.601 INFO:tasks.workunit.client.0.smithi100.stdout:4/882: creat d3/daf/f134 x:0 0 0 2024-09-13T02:50:37.601 INFO:tasks.workunit.client.0.smithi100.stdout:4/883: fdatasync d3/d63/d114/f130 0 2024-09-13T02:50:37.601 INFO:tasks.workunit.client.0.smithi100.stdout:4/884: write d3/dc/d4b/d52/dda/d99/f119 [521357,87320] 0 2024-09-13T02:50:37.602 INFO:tasks.workunit.client.0.smithi100.stdout:2/880: mknod d0/db/d21/d69/c10a 0 2024-09-13T02:50:37.603 INFO:tasks.workunit.client.0.smithi100.stdout:6/988: dwrite d12/dcd/fe9 [0,4194304] 0 2024-09-13T02:50:37.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/958: mkdir dd/d1b/d1d/dad/d106/d14a 0 2024-09-13T02:50:37.605 INFO:tasks.workunit.client.0.smithi100.stdout:9/959: write dd/d1b/d24/d74/d4e/d58/f68 [255011,32285] 0 2024-09-13T02:50:37.607 INFO:tasks.workunit.client.0.smithi100.stdout:8/871: getdents df/d5d/d88 0 2024-09-13T02:50:37.609 INFO:tasks.workunit.client.0.smithi100.stdout:2/881: link d0/db/d21/d88/l3b d0/db/d68/d9a/df2/d6a/d7f/dbb/l10b 0 2024-09-13T02:50:37.611 INFO:tasks.workunit.client.0.smithi100.stdout:4/885: getdents d3/dc/d4b/d8a 0 2024-09-13T02:50:37.612 INFO:tasks.workunit.client.0.smithi100.stdout:4/886: getdents d3/d6/d21/d46/d2d/d58 0 2024-09-13T02:50:37.613 INFO:tasks.workunit.client.0.smithi100.stdout:4/887: readlink d3/d6/d9/l1f 0 2024-09-13T02:50:37.617 INFO:tasks.workunit.client.0.smithi100.stdout:9/960: dread dd/d1b/d1d/d43/d5d/f9e [0,4194304] 0 2024-09-13T02:50:37.620 INFO:tasks.workunit.client.0.smithi100.stdout:4/888: dread d3/d6/d21/f43 [0,4194304] 0 2024-09-13T02:50:37.622 INFO:tasks.workunit.client.0.smithi100.stdout:4/889: rename d3/dc/c20 to d3/dc/d4b/c135 0 2024-09-13T02:50:37.629 INFO:tasks.workunit.client.0.smithi100.stdout:9/961: dread f5 [0,4194304] 0 2024-09-13T02:50:37.629 INFO:tasks.workunit.client.0.smithi100.stdout:9/962: dread - dd/d1b/d27/d51/de9/d121/f137 zero size 2024-09-13T02:50:37.635 INFO:tasks.workunit.client.0.smithi100.stdout:4/890: dread d3/d6/d21/d46/fa3 [0,4194304] 0 2024-09-13T02:50:37.636 INFO:tasks.workunit.client.0.smithi100.stdout:8/872: dwrite df/d13/f44 [0,4194304] 0 2024-09-13T02:50:37.636 INFO:tasks.workunit.client.0.smithi100.stdout:6/989: dwrite d12/d14/d1c/d28/f78 [0,4194304] 0 2024-09-13T02:50:37.636 INFO:tasks.workunit.client.0.smithi100.stdout:4/891: mkdir d3/d3a/d136 0 2024-09-13T02:50:37.637 INFO:tasks.workunit.client.0.smithi100.stdout:8/873: mkdir df/d13/d20/d98/d12f 0 2024-09-13T02:50:37.638 INFO:tasks.workunit.client.0.smithi100.stdout:4/892: mknod d3/d6/d21/d67/dd2/dd8/c137 0 2024-09-13T02:50:37.638 INFO:tasks.workunit.client.0.smithi100.stdout:4/893: stat d3/d6/d2f/d7a/fca 0 2024-09-13T02:50:37.638 INFO:tasks.workunit.client.0.smithi100.stdout:8/874: getdents df/d5d/d70/d2c/d38 0 2024-09-13T02:50:37.639 INFO:tasks.workunit.client.0.smithi100.stdout:4/894: creat d3/dc/d4b/d52/f138 x:0 0 0 2024-09-13T02:50:37.639 INFO:tasks.workunit.client.0.smithi100.stdout:4/895: chown d3/dc/d4b/d52/feb 3852392 1 2024-09-13T02:50:37.639 INFO:tasks.workunit.client.0.smithi100.stdout:4/896: read - d3/d63/dae/d10a/f113 zero size 2024-09-13T02:50:37.640 INFO:tasks.workunit.client.0.smithi100.stdout:8/875: link df/d13/d21/d81/db0/da3/dc7/cd8 df/d5d/d70/c130 0 2024-09-13T02:50:37.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/897: link d3/d6/d21/l30 d3/dc/d4b/d7c/l139 0 2024-09-13T02:50:37.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/898: dread - d3/d6/d21/d67/f122 zero size 2024-09-13T02:50:37.641 INFO:tasks.workunit.client.0.smithi100.stdout:4/899: fdatasync d3/dc/f131 0 2024-09-13T02:50:37.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/900: chown d3/d63/dae/ffc 2 1 2024-09-13T02:50:37.642 INFO:tasks.workunit.client.0.smithi100.stdout:4/901: truncate d3/dc/d4b/d52/dda/d99/f119 859356 0 2024-09-13T02:50:37.642 INFO:tasks.workunit.client.0.smithi100.stdout:8/876: creat df/d13/d5c/d10e/f131 x:0 0 0 2024-09-13T02:50:37.643 INFO:tasks.workunit.client.0.smithi100.stdout:2/882: dwrite d0/db/d68/d9a/df2/d6a/dac/f7a [0,4194304] 0 2024-09-13T02:50:37.643 INFO:tasks.workunit.client.0.smithi100.stdout:4/902: mknod d3/d6/d21/d67/dd2/dd8/d127/c13a 0 2024-09-13T02:50:37.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/883: read d0/db/d68/d9a/fc8 [181567,76780] 0 2024-09-13T02:50:37.645 INFO:tasks.workunit.client.0.smithi100.stdout:8/877: mkdir df/d13/d21/d81/d127/d132 0 2024-09-13T02:50:37.645 INFO:tasks.workunit.client.0.smithi100.stdout:2/884: write d0/db/d68/d6b/d85/ff6 [199196,22384] 0 2024-09-13T02:50:37.645 INFO:tasks.workunit.client.0.smithi100.stdout:8/878: fdatasync df/d13/f14 0 2024-09-13T02:50:37.647 INFO:tasks.workunit.client.0.smithi100.stdout:2/885: symlink d0/db/dbe/dc3/df4/l10c 0 2024-09-13T02:50:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:8/879: rmdir df/d5d/dba/dcb 39 2024-09-13T02:50:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:8/880: dread - df/d13/d5c/fd2 zero size 2024-09-13T02:50:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/963: dwrite dd/d1b/d24/d74/f149 [0,4194304] 0 2024-09-13T02:50:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/964: fdatasync dd/d1b/d1d/d43/d5e/dc0/f128 0 2024-09-13T02:50:37.648 INFO:tasks.workunit.client.0.smithi100.stdout:9/965: fsync dd/d1b/d27/fc7 0 2024-09-13T02:50:37.653 INFO:tasks.workunit.client.0.smithi100.stdout:8/881: rename df/d5d/dba/cf5 to df/d13/d21/d81/db0/da3/c133 0 2024-09-13T02:50:37.655 INFO:tasks.workunit.client.0.smithi100.stdout:8/882: creat df/d13/db5/f134 x:0 0 0 2024-09-13T02:50:37.656 INFO:tasks.workunit.client.0.smithi100.stdout:8/883: creat df/d6f/f135 x:0 0 0 2024-09-13T02:50:37.656 INFO:tasks.workunit.client.0.smithi100.stdout:6/990: dwrite d12/d2e/d90/da2/fd0 [0,4194304] 0 2024-09-13T02:50:37.661 INFO:tasks.workunit.client.0.smithi100.stdout:2/886: write d0/db/f12 [6872072,63198] 0 2024-09-13T02:50:37.661 INFO:tasks.workunit.client.0.smithi100.stdout:8/884: mkdir df/d13/d20/da2/d136 0 2024-09-13T02:50:37.661 INFO:tasks.workunit.client.0.smithi100.stdout:6/991: dread d12/d14/d1c/f3a [0,4194304] 0 2024-09-13T02:50:37.666 INFO:tasks.workunit.client.0.smithi100.stdout:2/887: rename d0/db/d79 to d0/db/d68/d6b/d71/d10d 0 2024-09-13T02:50:37.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/992: dread f7 [0,4194304] 0 2024-09-13T02:50:37.673 INFO:tasks.workunit.client.0.smithi100.stdout:6/993: write d12/d14/d1c/d6e/d71/d100/f49 [2858115,20627] 0 2024-09-13T02:50:37.673 INFO:tasks.workunit.client.0.smithi100.stdout:9/966: dwrite dd/d1b/d24/d74/f149 [0,4194304] 0 2024-09-13T02:50:37.674 INFO:tasks.workunit.client.0.smithi100.stdout:8/885: getdents df/d13/db5 0 2024-09-13T02:50:37.674 INFO:tasks.workunit.client.0.smithi100.stdout:8/886: chown df/d5d/d70/d2c/d38/d9e/dad/d101/c107 1995179992 1 2024-09-13T02:50:37.674 INFO:tasks.workunit.client.0.smithi100.stdout:9/967: dread dd/d1b/d1d/d43/f139 [0,4194304] 0 2024-09-13T02:50:37.675 INFO:tasks.workunit.client.0.smithi100.stdout:2/888: write d0/db/d21/f30 [2682890,42732] 0 2024-09-13T02:50:37.675 INFO:tasks.workunit.client.0.smithi100.stdout:4/903: dwrite d3/dc/d4b/d52/dda/d99/fbb [0,4194304] 0 2024-09-13T02:50:37.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/994: dread d12/dcd/ff7 [0,4194304] 0 2024-09-13T02:50:37.676 INFO:tasks.workunit.client.0.smithi100.stdout:6/995: truncate d12/d2e/d90/da2/dbc/f119 270676 0 2024-09-13T02:50:37.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/904: mknod d3/d6/d21/d67/dd2/c13b 0 2024-09-13T02:50:37.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/905: chown d3/d6/d21/d67/de0 14591269 1 2024-09-13T02:50:37.678 INFO:tasks.workunit.client.0.smithi100.stdout:4/906: write d3/dc/d4b/d52/dd1/fdc [724220,130009] 0 2024-09-13T02:50:37.679 INFO:tasks.workunit.client.0.smithi100.stdout:6/996: mknod d12/d14/d1c/d6e/d71/d100/db9/d112/c12e 0 2024-09-13T02:50:37.679 INFO:tasks.workunit.client.0.smithi100.stdout:6/997: fsync d12/d14/d1c/d6e/d71/fcb 0 2024-09-13T02:50:37.681 INFO:tasks.workunit.client.0.smithi100.stdout:6/998: rename d12/d14/d1c/d7b/da6/ca7 to d12/d14/d5a/c12f 0 2024-09-13T02:50:37.683 INFO:tasks.workunit.client.0.smithi100.stdout:4/907: rename d3/d6/d9/l1f to d3/d6/d21/d46/d2d/d3f/d79/l13c 0 2024-09-13T02:50:37.685 INFO:tasks.workunit.client.0.smithi100.stdout:4/908: symlink d3/daf/l13d 0 2024-09-13T02:50:37.685 INFO:tasks.workunit.client.0.smithi100.stdout:4/909: fsync d3/d63/f106 0 2024-09-13T02:50:37.685 INFO:tasks.workunit.client.0.smithi100.stdout:2/889: write d0/db/d68/d6b/d71/f84 [941125,90748] 0 2024-09-13T02:50:37.686 INFO:tasks.workunit.client.0.smithi100.stdout:4/910: mknod d3/d6/d21/d67/de0/c13e 0 2024-09-13T02:50:37.688 INFO:tasks.workunit.client.0.smithi100.stdout:9/968: dread dd/d1b/d1d/d28/f8c [0,4194304] 0 2024-09-13T02:50:37.688 INFO:tasks.workunit.client.0.smithi100.stdout:2/890: getdents d0/db/d68 0 2024-09-13T02:50:37.689 INFO:tasks.workunit.client.0.smithi100.stdout:2/891: creat d0/db/d68/d9a/df2/d6a/d7f/f10e x:0 0 0 2024-09-13T02:50:37.689 INFO:tasks.workunit.client.0.smithi100.stdout:2/892: readlink d0/db/d21/d88/l7b 0 2024-09-13T02:50:37.693 INFO:tasks.workunit.client.0.smithi100.stdout:6/999: read d12/d14/d2f/dca/dd8/fe6 [3645790,105904] 0 2024-09-13T02:50:37.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/893: write d0/db/f80 [3635435,95839] 0 2024-09-13T02:50:37.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/894: fdatasync d0/fa1 0 2024-09-13T02:50:37.703 INFO:tasks.workunit.client.0.smithi100.stdout:2/895: creat d0/db/dbe/f10f x:0 0 0 2024-09-13T02:50:37.705 INFO:tasks.workunit.client.0.smithi100.stdout:2/896: mkdir d0/db/d23/d110 0 2024-09-13T02:50:37.706 INFO:tasks.workunit.client.0.smithi100.stdout:2/897: mkdir d0/db/d68/d6b/de1/d111 0 2024-09-13T02:50:37.706 INFO:tasks.workunit.client.0.smithi100.stdout:2/898: unlink d0/db/d68/d6b/d71/d10d/fb1 0 2024-09-13T02:50:37.707 INFO:tasks.workunit.client.0.smithi100.stdout:2/899: mkdir d0/db/d68/d9a/df2/d6a/d7f/dbb/d112 0 2024-09-13T02:50:37.708 INFO:tasks.workunit.client.0.smithi100.stdout:8/887: dwrite df/d13/d20/f42 [0,4194304] 0 2024-09-13T02:50:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/900: mkdir d0/db/d68/d9a/df2/d6a/d113 0 2024-09-13T02:50:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:4/911: dwrite d3/d6/d21/d67/de0/df0/f112 [0,4194304] 0 2024-09-13T02:50:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:4/912: dread - d3/d6/d9/d9e/f12f zero size 2024-09-13T02:50:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:8/888: getdents df/d5d/d70/d2c/d38/d9e/d115 0 2024-09-13T02:50:37.709 INFO:tasks.workunit.client.0.smithi100.stdout:2/901: dread d0/db/d21/d57/fea [0,4194304] 0 2024-09-13T02:50:37.712 INFO:tasks.workunit.client.0.smithi100.stdout:4/913: mkdir d3/d6/d21/d46/d2d/d111/d13f 0 2024-09-13T02:50:37.715 INFO:tasks.workunit.client.0.smithi100.stdout:5/877: sync 2024-09-13T02:50:37.717 INFO:tasks.workunit.client.0.smithi100.stdout:5/878: mknod db/de/d3e/da2/c135 0 2024-09-13T02:50:37.720 INFO:tasks.workunit.client.0.smithi100.stdout:5/879: rename db/de/d1f/c5a to db/de/d3e/c136 0 2024-09-13T02:50:37.722 INFO:tasks.workunit.client.0.smithi100.stdout:2/902: dread d0/db/d68/d6b/d71/d73/f7e [0,4194304] 0 2024-09-13T02:50:37.723 INFO:tasks.workunit.client.0.smithi100.stdout:2/903: symlink d0/db/d68/d9a/df2/d6a/d7f/d95/l114 0 2024-09-13T02:50:37.724 INFO:tasks.workunit.client.0.smithi100.stdout:2/904: mknod d0/db/d68/d9a/df2/d6a/d7f/dbb/c115 0 2024-09-13T02:50:37.726 INFO:tasks.workunit.client.0.smithi100.stdout:2/905: rename d0/c7d to d0/db/d68/d6b/d85/dfe/c116 0 2024-09-13T02:50:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/889: dwrite df/d5d/f69 [0,4194304] 0 2024-09-13T02:50:37.729 INFO:tasks.workunit.client.0.smithi100.stdout:8/890: chown df/d13/d68/f9d 1075282 1 2024-09-13T02:50:37.730 INFO:tasks.workunit.client.0.smithi100.stdout:8/891: symlink df/d85/l137 0 2024-09-13T02:50:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:8/892: write df/d13/db5/fb7 [2840775,41679] 0 2024-09-13T02:50:37.731 INFO:tasks.workunit.client.0.smithi100.stdout:8/893: readlink df/d13/d21/l78 0 2024-09-13T02:50:37.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/894: dread df/d13/d20/f4e [0,4194304] 0 2024-09-13T02:50:37.738 INFO:tasks.workunit.client.0.smithi100.stdout:8/895: chown df/d13/d21 114855125 1 2024-09-13T02:50:37.739 INFO:tasks.workunit.client.0.smithi100.stdout:8/896: truncate df/d5d/fa8 3910526 0 2024-09-13T02:50:37.742 INFO:tasks.workunit.client.0.smithi100.stdout:5/880: write db/de/fbd [1023576,74075] 0 2024-09-13T02:50:37.743 INFO:tasks.workunit.client.0.smithi100.stdout:5/881: chown db/de/d3e/l5f 14097050 1 2024-09-13T02:50:37.745 INFO:tasks.workunit.client.0.smithi100.stdout:5/882: creat db/de/d63/d70/f137 x:0 0 0 2024-09-13T02:50:37.800 INFO:tasks.workunit.client.0.smithi100.stdout:2/906: dwrite d0/db/d21/d57/f6e [0,4194304] 0 2024-09-13T02:50:37.800 INFO:tasks.workunit.client.0.smithi100.stdout:2/907: readlink d0/db/d68/d9a/df2/d6a/d7f/dbb/lbc 0 2024-09-13T02:50:37.802 INFO:tasks.workunit.client.0.smithi100.stdout:5/883: write db/de/d3e/d7e/d81/f10c [2761805,119997] 0 2024-09-13T02:50:37.809 INFO:tasks.workunit.client.0.smithi100.stdout:2/908: write d0/f38 [2952305,63902] 0 2024-09-13T02:50:37.809 INFO:tasks.workunit.client.0.smithi100.stdout:2/909: creat d0/db/d21/d88/f117 x:0 0 0 2024-09-13T02:50:37.953 INFO:tasks.workunit.client.0.smithi100.stdout:2/910: dwrite d0/db/dbe/dc3/ff1 [0,4194304] 0 2024-09-13T02:50:37.953 INFO:tasks.workunit.client.0.smithi100.stdout:2/911: write d0/f19 [1260293,71458] 0 2024-09-13T02:50:37.956 INFO:tasks.workunit.client.0.smithi100.stdout:2/912: symlink d0/db/d68/d6b/da5/d8f/l118 0 2024-09-13T02:50:37.957 INFO:tasks.workunit.client.0.smithi100.stdout:2/913: chown d0/db/d68/d9a/df2/f102 520 1 2024-09-13T02:50:37.959 INFO:tasks.workunit.client.0.smithi100.stdout:2/914: getdents d0/db/dbe 0 2024-09-13T02:50:37.959 INFO:tasks.workunit.client.0.smithi100.stdout:2/915: creat d0/db/d68/d9a/df2/f119 x:0 0 0 2024-09-13T02:50:37.959 INFO:tasks.workunit.client.0.smithi100.stdout:2/916: fsync d0/f3d 0 2024-09-13T02:50:37.960 INFO:tasks.workunit.client.0.smithi100.stdout:2/917: rmdir d0/dd5 39 2024-09-13T02:50:37.961 INFO:tasks.workunit.client.0.smithi100.stdout:2/918: getdents d0/db/d21/d5a 0 2024-09-13T02:50:37.962 INFO:tasks.workunit.client.0.smithi100.stdout:2/919: creat d0/db/d68/d6b/d71/d10d/f11a x:0 0 0 2024-09-13T02:50:37.962 INFO:tasks.workunit.client.0.smithi100.stdout:2/920: fdatasync d0/d36/f6f 0 2024-09-13T02:50:37.964 INFO:tasks.workunit.client.0.smithi100.stdout:9/969: sync 2024-09-13T02:50:37.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/921: write d0/db/f2e [3827630,51208] 0 2024-09-13T02:50:37.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/922: readlink d0/db/d68/d9a/df2/d6a/d7f/dbb/lc9 0 2024-09-13T02:50:37.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/923: read d0/db/d21/f94 [3506922,94932] 0 2024-09-13T02:50:37.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/924: creat d0/db/d21/d57/f11b x:0 0 0 2024-09-13T02:50:37.971 INFO:tasks.workunit.client.0.smithi100.stdout:2/925: read d0/db/d68/d9a/fc8 [163439,101796] 0 2024-09-13T02:50:37.972 INFO:tasks.workunit.client.0.smithi100.stdout:2/926: write d0/db/d68/d6b/d85/f9b [386647,17894] 0 2024-09-13T02:50:37.972 INFO:tasks.workunit.client.0.smithi100.stdout:2/927: chown d0/f11 6930460 1 2024-09-13T02:50:37.972 INFO:tasks.workunit.client.0.smithi100.stdout:9/970: write dd/d1b/d1d/d43/d5d/f64 [419262,48098] 0 2024-09-13T02:50:37.976 INFO:tasks.workunit.client.0.smithi100.stdout:9/971: rename dd/d1b/d27 to dd/d1b/d31/d14b 0 2024-09-13T02:50:37.976 INFO:tasks.workunit.client.0.smithi100.stdout:9/972: readlink dd/d1b/d1d/d43/d5d/d142/l99 0 2024-09-13T02:50:37.976 INFO:tasks.workunit.client.0.smithi100.stdout:9/973: fdatasync dd/f4a 0 2024-09-13T02:50:37.978 INFO:tasks.workunit.client.0.smithi100.stdout:2/928: dread d0/db/d21/d88/f49 [0,4194304] 0 2024-09-13T02:50:37.979 INFO:tasks.workunit.client.0.smithi100.stdout:2/929: creat d0/db/d68/d9a/df2/d6a/f11c x:0 0 0 2024-09-13T02:50:37.979 INFO:tasks.workunit.client.0.smithi100.stdout:2/930: creat d0/db/d68/d9a/df2/d6a/db2/f11d x:0 0 0 2024-09-13T02:50:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:9/974: dwrite dd/d1b/d1d/d43/d5e/f105 [0,4194304] 0 2024-09-13T02:50:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:2/931: dwrite d0/d36/f6f [4194304,4194304] 0 2024-09-13T02:50:38.001 INFO:tasks.workunit.client.0.smithi100.stdout:2/932: dread - d0/f4d zero size 2024-09-13T02:50:38.002 INFO:tasks.workunit.client.0.smithi100.stdout:9/975: mkdir dd/d1b/d21/d86/d14c 0 2024-09-13T02:50:38.013 INFO:tasks.workunit.client.0.smithi100.stdout:9/976: dread dd/d1b/d1d/d28/f54 [0,4194304] 0 2024-09-13T02:50:38.014 INFO:tasks.workunit.client.0.smithi100.stdout:9/977: rename dd/d1b/d1d/d28/d111/c122 to dd/d1b/d1d/d43/d5e/c14d 0 2024-09-13T02:50:38.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/933: dwrite d0/db/d21/d88/ff5 [0,4194304] 0 2024-09-13T02:50:38.015 INFO:tasks.workunit.client.0.smithi100.stdout:2/934: creat d0/db/d68/d9a/df2/f11e x:0 0 0 2024-09-13T02:50:38.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/978: mkdir dd/d1b/d24/da8/d14e 0 2024-09-13T02:50:38.015 INFO:tasks.workunit.client.0.smithi100.stdout:9/979: dread - dd/d1b/d31/d14b/d51/f11a zero size 2024-09-13T02:50:38.016 INFO:tasks.workunit.client.0.smithi100.stdout:9/980: truncate dd/d1b/d1d/d43/d4f/da5/f91 1231642 0 2024-09-13T02:50:38.024 INFO:tasks.workunit.client.0.smithi100.stdout:9/981: rmdir dd/d1b/da3 39 2024-09-13T02:50:38.024 INFO:tasks.workunit.client.0.smithi100.stdout:9/982: fdatasync dd/d1b/d24/f67 0 2024-09-13T02:50:38.024 INFO:tasks.workunit.client.0.smithi100.stdout:9/983: chown dd/d1b/d21/fde 70376 1 2024-09-13T02:50:38.026 INFO:tasks.workunit.client.0.smithi100.stdout:4/914: sync 2024-09-13T02:50:38.026 INFO:tasks.workunit.client.0.smithi100.stdout:5/884: sync 2024-09-13T02:50:38.026 INFO:tasks.workunit.client.0.smithi100.stdout:8/897: sync 2024-09-13T02:50:38.026 INFO:tasks.workunit.client.0.smithi100.stdout:4/915: write d3/d6/d21/d46/d2d/f95 [1509522,27464] 0 2024-09-13T02:50:38.028 INFO:tasks.workunit.client.0.smithi100.stdout:8/898: rename ld to df/d13/d20/d98/d12f/l138 0 2024-09-13T02:50:38.030 INFO:tasks.workunit.client.0.smithi100.stdout:8/899: link df/d85/ccc df/d13/d21/d81/db0/da3/c139 0 2024-09-13T02:50:38.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/900: dread df/d5d/d70/d2c/d38/f5b [0,4194304] 0 2024-09-13T02:50:38.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/901: write df/d13/d21/f40 [475826,61247] 0 2024-09-13T02:50:38.036 INFO:tasks.workunit.client.0.smithi100.stdout:2/935: dwrite d0/db/d68/d9a/df2/fa4 [0,4194304] 0 2024-09-13T02:50:38.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/902: link df/d13/db5/dc3/df0/l122 df/d5d/l13a 0 2024-09-13T02:50:38.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/903: symlink df/d13/d20/d98/d12f/l13b 0 2024-09-13T02:50:38.041 INFO:tasks.workunit.client.0.smithi100.stdout:8/904: mknod df/d5d/d70/d2c/d38/d9e/c13c 0 2024-09-13T02:50:38.042 INFO:tasks.workunit.client.0.smithi100.stdout:8/905: mknod df/d5d/d70/d2c/d38/d9e/dad/d101/c13d 0 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:9/984: read dd/d1b/d1d/f5b [2692778,50948] 0 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/906: mknod df/d13/d5c/c13e 0 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/907: chown df/d13/d5c/f116 6663342 1 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:9/985: write dd/d1b/d24/d74/f37 [5089342,35673] 0 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:8/908: chown df/d13/d20/f9a 181612223 1 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:4/916: read d3/d6/d2f/d7a/fc7 [4182873,36755] 0 2024-09-13T02:50:38.045 INFO:tasks.workunit.client.0.smithi100.stdout:5/885: dwrite db/de/d3e/d71/dd9/f110 [0,4194304] 0 2024-09-13T02:50:38.047 INFO:tasks.workunit.client.0.smithi100.stdout:9/986: getdents dd/d100 0 2024-09-13T02:50:38.047 INFO:tasks.workunit.client.0.smithi100.stdout:9/987: write dd/d1b/d1d/d43/d4f/da5/fe3 [611164,17440] 0 2024-09-13T02:50:38.049 INFO:tasks.workunit.client.0.smithi100.stdout:8/909: link df/d5d/d70/cb8 df/d13/db5/dc3/de0/c13f 0 2024-09-13T02:50:38.051 INFO:tasks.workunit.client.0.smithi100.stdout:4/917: symlink d3/dc/d88/l140 0 2024-09-13T02:50:38.052 INFO:tasks.workunit.client.0.smithi100.stdout:9/988: symlink dd/d1b/d1d/d43/d4f/da5/l14f 0 2024-09-13T02:50:38.052 INFO:tasks.workunit.client.0.smithi100.stdout:9/989: dread - dd/d1b/d1d/f144 zero size 2024-09-13T02:50:38.053 INFO:tasks.workunit.client.0.smithi100.stdout:8/910: creat df/dac/f140 x:0 0 0 2024-09-13T02:50:38.053 INFO:tasks.workunit.client.0.smithi100.stdout:4/918: mkdir d3/d63/d114/d141 0 2024-09-13T02:50:38.055 INFO:tasks.workunit.client.0.smithi100.stdout:9/990: rename dd/d1b/da3/dc9/d115 to dd/d1b/d1d/d28/d150 0 2024-09-13T02:50:38.055 INFO:tasks.workunit.client.0.smithi100.stdout:5/886: write db/de/d1f/d2b/fd3 [1822595,104066] 0 2024-09-13T02:50:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/991: creat dd/d1b/d24/da8/da9/f151 x:0 0 0 2024-09-13T02:50:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/992: fdatasync dd/d1b/d1d/d28/d111/f143 0 2024-09-13T02:50:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/993: stat dd/d1b/d1d/d43/d4f/da5/fdb 0 2024-09-13T02:50:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/994: write dd/d1b/d24/d74/d4e/d58/f88 [1130558,76239] 0 2024-09-13T02:50:38.056 INFO:tasks.workunit.client.0.smithi100.stdout:9/995: stat dd/d1b/d21/d86/c71 0 2024-09-13T02:50:38.057 INFO:tasks.workunit.client.0.smithi100.stdout:5/887: unlink db/de/d3e/da2/ddb/c128 0 2024-09-13T02:50:38.057 INFO:tasks.workunit.client.0.smithi100.stdout:9/996: creat dd/d1b/d1d/d43/f152 x:0 0 0 2024-09-13T02:50:38.058 INFO:tasks.workunit.client.0.smithi100.stdout:9/997: mknod dd/d1b/d1d/dad/d106/c153 0 2024-09-13T02:50:38.059 INFO:tasks.workunit.client.0.smithi100.stdout:9/998: creat dd/f154 x:0 0 0 2024-09-13T02:50:38.065 INFO:tasks.workunit.client.0.smithi100.stdout:5/888: dread db/de/d1f/f87 [0,4194304] 0 2024-09-13T02:50:38.066 INFO:tasks.workunit.client.0.smithi100.stdout:5/889: stat db/de/d3e/dc3/fd0 0 2024-09-13T02:50:38.066 INFO:tasks.workunit.client.0.smithi100.stdout:5/890: chown db/de/d3e/d7e/d81/d85/cda 245350 1 2024-09-13T02:50:38.067 INFO:tasks.workunit.client.0.smithi100.stdout:5/891: unlink db/f120 0 2024-09-13T02:50:38.067 INFO:tasks.workunit.client.0.smithi100.stdout:5/892: chown db/de/d3e/d71/fcd 25244 1 2024-09-13T02:50:38.068 INFO:tasks.workunit.client.0.smithi100.stdout:4/919: write d3/d3a/d56/fe2 [1622707,37519] 0 2024-09-13T02:50:38.068 INFO:tasks.workunit.client.0.smithi100.stdout:5/893: truncate db/de/d63/f65 2798044 0 2024-09-13T02:50:38.069 INFO:tasks.workunit.client.0.smithi100.stdout:2/936: dwrite d0/db/d21/d57/f98 [4194304,4194304] 0 2024-09-13T02:50:38.069 INFO:tasks.workunit.client.0.smithi100.stdout:8/911: dread df/d13/db5/dc3/de0/ff4 [0,4194304] 0 2024-09-13T02:50:38.071 INFO:tasks.workunit.client.0.smithi100.stdout:4/920: mkdir d3/dc/d4b/d52/dda/de8/d142 0 2024-09-13T02:50:38.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/921: fsync d3/d6/d21/d67/f90 0 2024-09-13T02:50:38.072 INFO:tasks.workunit.client.0.smithi100.stdout:4/922: dread - d3/d6/d21/d46/d2d/d42/d8f/f126 zero size 2024-09-13T02:50:38.072 INFO:tasks.workunit.client.0.smithi100.stdout:5/894: symlink db/de/d63/l138 0 2024-09-13T02:50:38.072 INFO:tasks.workunit.client.0.smithi100.stdout:5/895: fdatasync db/de/d1f/d2b/fd3 0 2024-09-13T02:50:38.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/896: write db/de/d1f/d78/f94 [1638074,93018] 0 2024-09-13T02:50:38.073 INFO:tasks.workunit.client.0.smithi100.stdout:5/897: readlink db/lc7 0 2024-09-13T02:50:38.079 INFO:tasks.workunit.client.0.smithi100.stdout:2/937: unlink d0/db/d21/d57/d81/db3/f106 0 2024-09-13T02:50:38.080 INFO:tasks.workunit.client.0.smithi100.stdout:2/938: truncate d0/db/d68/d6b/da5/dcf/ffb 695489 0 2024-09-13T02:50:38.080 INFO:tasks.workunit.client.0.smithi100.stdout:2/939: dread - d0/db/dbe/fd1 zero size 2024-09-13T02:50:38.080 INFO:tasks.workunit.client.0.smithi100.stdout:2/940: fsync d0/db/d68/d9a/df2/d6a/d7f/f83 0 2024-09-13T02:50:38.082 INFO:tasks.workunit.client.0.smithi100.stdout:5/898: unlink db/de/d3e/da2/ddb/ce3 0 2024-09-13T02:50:38.083 INFO:tasks.workunit.client.0.smithi100.stdout:5/899: symlink db/de/ddc/d106/l139 0 2024-09-13T02:50:38.084 INFO:tasks.workunit.client.0.smithi100.stdout:5/900: mkdir db/d13a 0 2024-09-13T02:50:38.091 INFO:tasks.workunit.client.0.smithi100.stdout:4/923: dwrite d3/dc/d4b/f91 [0,4194304] 0 2024-09-13T02:50:38.092 INFO:tasks.workunit.client.0.smithi100.stdout:8/912: dwrite df/d5d/d70/d2c/de3/f111 [0,4194304] 0 2024-09-13T02:50:38.092 INFO:tasks.workunit.client.0.smithi100.stdout:2/941: write d0/d36/d8a/fa2 [2095407,68664] 0 2024-09-13T02:50:38.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/942: dread d0/d36/fcb [0,4194304] 0 2024-09-13T02:50:38.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/943: chown d0/db/d21/d57/d81 7741100 1 2024-09-13T02:50:38.095 INFO:tasks.workunit.client.0.smithi100.stdout:2/944: chown d0/db/d21/d69 300898 1 2024-09-13T02:50:38.095 INFO:tasks.workunit.client.0.smithi100.stdout:8/913: symlink df/d13/d21/d81/d12e/l141 0 2024-09-13T02:50:38.096 INFO:tasks.workunit.client.0.smithi100.stdout:8/914: creat df/d13/d20/d98/f142 x:0 0 0 2024-09-13T02:50:38.096 INFO:tasks.workunit.client.0.smithi100.stdout:8/915: dread - df/d5d/d70/d2c/f120 zero size 2024-09-13T02:50:38.096 INFO:tasks.workunit.client.0.smithi100.stdout:2/945: mkdir d0/db/d68/d6b/d71/d10d/d11f 0 2024-09-13T02:50:38.100 INFO:tasks.workunit.client.0.smithi100.stdout:8/916: write df/d6f/fd7 [1417418,1806] 0 2024-09-13T02:50:38.101 INFO:tasks.workunit.client.0.smithi100.stdout:8/917: mkdir df/d13/d21/d143 0 2024-09-13T02:50:38.111 INFO:tasks.workunit.client.0.smithi100.stdout:5/901: dwrite db/de/d1f/d2b/d9b/fb5 [0,4194304] 0 2024-09-13T02:50:38.116 INFO:tasks.workunit.client.0.smithi100.stdout:4/924: dwrite d3/d6/d9/f2e [0,4194304] 0 2024-09-13T02:50:38.118 INFO:tasks.workunit.client.0.smithi100.stdout:4/925: symlink d3/d6/d21/d103/l143 0 2024-09-13T02:50:38.119 INFO:tasks.workunit.client.0.smithi100.stdout:4/926: getdents d3/d6/d2f/d60 0 2024-09-13T02:50:38.120 INFO:tasks.workunit.client.0.smithi100.stdout:4/927: mknod d3/d63/dae/c144 0 2024-09-13T02:50:38.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/928: link d3/dc/f131 d3/d6/da6/f145 0 2024-09-13T02:50:38.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/929: fsync d3/d6/d9/d9e/f12f 0 2024-09-13T02:50:38.122 INFO:tasks.workunit.client.0.smithi100.stdout:4/930: fdatasync d3/dc/d4b/d9b/fb6 0 2024-09-13T02:50:38.123 INFO:tasks.workunit.client.0.smithi100.stdout:8/918: dwrite df/d5d/d70/d2c/d38/f5b [0,4194304] 0 2024-09-13T02:50:38.124 INFO:tasks.workunit.client.0.smithi100.stdout:4/931: rename d3/d6/d21/d46/d2d/la8 to d3/d6/d2f/d60/l146 0 2024-09-13T02:50:38.124 INFO:tasks.workunit.client.0.smithi100.stdout:4/932: chown d3/d6/d9/ce 128577280 1 2024-09-13T02:50:38.125 INFO:tasks.workunit.client.0.smithi100.stdout:5/902: dwrite db/de/ddc/fde [4194304,4194304] 0 2024-09-13T02:50:38.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/933: link d3/d6/da6/f145 d3/dc/d88/db4/d120/f147 0 2024-09-13T02:50:38.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/934: read - d3/dc/d4b/d7c/ffa zero size 2024-09-13T02:50:38.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/935: creat d3/d6/da6/f148 x:0 0 0 2024-09-13T02:50:38.126 INFO:tasks.workunit.client.0.smithi100.stdout:4/936: write d3/d63/f6a [2963569,81220] 0 2024-09-13T02:50:38.128 INFO:tasks.workunit.client.0.smithi100.stdout:4/937: stat d3/d63/l10c 0 2024-09-13T02:50:38.128 INFO:tasks.workunit.client.0.smithi100.stdout:4/938: readlink d3/d6/d2f/d60/l146 0 2024-09-13T02:50:38.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/939: rename d3/l1a to d3/d6/d2f/d7a/l149 0 2024-09-13T02:50:38.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/940: readlink d3/d6/d2f/d60/l146 0 2024-09-13T02:50:38.131 INFO:tasks.workunit.client.0.smithi100.stdout:4/941: creat d3/dc/d88/f14a x:0 0 0 2024-09-13T02:50:38.132 INFO:tasks.workunit.client.0.smithi100.stdout:4/942: write d3/dc/d88/fed [928262,16796] 0 2024-09-13T02:50:38.134 INFO:tasks.workunit.client.0.smithi100.stdout:4/943: mkdir d3/d63/dae/d14b 0 2024-09-13T02:50:38.146 INFO:tasks.workunit.client.0.smithi100.stdout:8/919: dwrite df/d13/d20/d98/fdf [0,4194304] 0 2024-09-13T02:50:38.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/920: rename df/d85/faf to df/d13/d20/f144 0 2024-09-13T02:50:38.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/921: chown df/d13/d20/f61 3798284 1 2024-09-13T02:50:38.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/922: chown df/d13/d20/d98/d12f 1102820 1 2024-09-13T02:50:38.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/923: write df/d5d/d70/d2c/d38/f71 [4490020,91724] 0 2024-09-13T02:50:38.148 INFO:tasks.workunit.client.0.smithi100.stdout:8/924: mknod df/dbb/c145 0 2024-09-13T02:50:38.149 INFO:tasks.workunit.client.0.smithi100.stdout:8/925: symlink df/d5d/l146 0 2024-09-13T02:50:38.153 INFO:tasks.workunit.client.0.smithi100.stdout:5/903: dwrite db/de/d1f/f87 [0,4194304] 0 2024-09-13T02:50:38.153 INFO:tasks.workunit.client.0.smithi100.stdout:5/904: fsync db/de/d63/d9c/fca 0 2024-09-13T02:50:38.154 INFO:tasks.workunit.client.0.smithi100.stdout:4/944: dwrite d3/d6/d21/d46/f47 [0,4194304] 0 2024-09-13T02:50:38.154 INFO:tasks.workunit.client.0.smithi100.stdout:4/945: readlink d3/d6/d2f/d60/ldb 0 2024-09-13T02:50:38.154 INFO:tasks.workunit.client.0.smithi100.stdout:4/946: dread - d3/d6/d21/d67/ff8 zero size 2024-09-13T02:50:38.157 INFO:tasks.workunit.client.0.smithi100.stdout:5/905: dread db/de/d1f/f69 [0,4194304] 0 2024-09-13T02:50:38.158 INFO:tasks.workunit.client.0.smithi100.stdout:4/947: creat d3/d6/d21/d67/de0/f14c x:0 0 0 2024-09-13T02:50:38.158 INFO:tasks.workunit.client.0.smithi100.stdout:4/948: chown d3/dc/d4b/d8a/cce 38736 1 2024-09-13T02:50:38.158 INFO:tasks.workunit.client.0.smithi100.stdout:4/949: write d3/dc/d4b/d52/dda/d99/fbb [4951512,48602] 0 2024-09-13T02:50:38.162 INFO:tasks.workunit.client.0.smithi100.stdout:4/950: dread d3/d6/d21/d67/f90 [0,4194304] 0 2024-09-13T02:50:38.162 INFO:tasks.workunit.client.0.smithi100.stdout:9/999: sync 2024-09-13T02:50:38.162 INFO:tasks.workunit.client.0.smithi100.stdout:2/946: sync 2024-09-13T02:50:38.162 INFO:tasks.workunit.client.0.smithi100.stdout:2/947: write d0/db/dbe/dc3/ff1 [4806585,44664] 0 2024-09-13T02:50:38.163 INFO:tasks.workunit.client.0.smithi100.stdout:2/948: unlink d0/db/c4c 0 2024-09-13T02:50:38.165 INFO:tasks.workunit.client.0.smithi100.stdout:2/949: creat d0/db/d21/d5a/f120 x:0 0 0 2024-09-13T02:50:38.165 INFO:tasks.workunit.client.0.smithi100.stdout:2/950: chown d0/db/d68/d6b 243998 1 2024-09-13T02:50:38.165 INFO:tasks.workunit.client.0.smithi100.stdout:5/906: write db/de/ddc/f105 [4821912,81494] 0 2024-09-13T02:50:38.165 INFO:tasks.workunit.client.0.smithi100.stdout:5/907: write db/de/d3e/da2/dac/db1/fb7 [1535196,128929] 0 2024-09-13T02:50:38.166 INFO:tasks.workunit.client.0.smithi100.stdout:2/951: creat d0/db/d68/d9a/df2/d6a/d113/f121 x:0 0 0 2024-09-13T02:50:38.167 INFO:tasks.workunit.client.0.smithi100.stdout:5/908: truncate db/de/d3e/dc3/fe0 2163436 0 2024-09-13T02:50:38.168 INFO:tasks.workunit.client.0.smithi100.stdout:4/951: dread d3/dc/f6e [0,4194304] 0 2024-09-13T02:50:38.168 INFO:tasks.workunit.client.0.smithi100.stdout:2/952: mkdir d0/db/d68/d6b/d71/d105/d122 0 2024-09-13T02:50:38.169 INFO:tasks.workunit.client.0.smithi100.stdout:5/909: mknod db/de/d3e/d71/dd9/c13b 0 2024-09-13T02:50:38.169 INFO:tasks.workunit.client.0.smithi100.stdout:5/910: readlink db/de/d1f/d2b/l3a 0 2024-09-13T02:50:38.170 INFO:tasks.workunit.client.0.smithi100.stdout:5/911: mknod db/de/d3e/d7e/c13c 0 2024-09-13T02:50:38.173 INFO:tasks.workunit.client.0.smithi100.stdout:2/953: dread d0/db/d68/d6b/d71/d73/f7c [0,4194304] 0 2024-09-13T02:50:38.175 INFO:tasks.workunit.client.0.smithi100.stdout:2/954: link d0/db/d68/d6b/d71/fa7 d0/db/d68/d9a/df2/d6a/d113/f123 0 2024-09-13T02:50:38.176 INFO:tasks.workunit.client.0.smithi100.stdout:2/955: dread - d0/db/d68/d9a/df2/d6a/d7f/f10e zero size 2024-09-13T02:50:38.176 INFO:tasks.workunit.client.0.smithi100.stdout:2/956: readlink d0/db/l48 0 2024-09-13T02:50:38.187 INFO:tasks.workunit.client.0.smithi100.stdout:2/957: dread d0/db/d68/d9a/df2/d6a/dac/f7a [0,4194304] 0 2024-09-13T02:50:38.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/958: write d0/d36/d8a/fa2 [4041244,13237] 0 2024-09-13T02:50:38.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/959: dread - d0/db/d68/d6b/da5/fc5 zero size 2024-09-13T02:50:38.188 INFO:tasks.workunit.client.0.smithi100.stdout:2/960: chown d0/db/d68/d6b/d85/fbf 2438629 1 2024-09-13T02:50:38.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/961: rmdir d0/db/d23 39 2024-09-13T02:50:38.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/962: creat d0/db/d68/d6b/da5/dcf/f124 x:0 0 0 2024-09-13T02:50:38.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/963: readlink d0/db/d68/d9a/df2/d6a/lde 0 2024-09-13T02:50:38.189 INFO:tasks.workunit.client.0.smithi100.stdout:2/964: stat d0/db/d21/d57/d81/db3/c100 0 2024-09-13T02:50:38.192 INFO:tasks.workunit.client.0.smithi100.stdout:5/912: dwrite db/de/d3e/d7e/d81/d85/fd7 [0,4194304] 0 2024-09-13T02:50:38.192 INFO:tasks.workunit.client.0.smithi100.stdout:5/913: fsync db/de/d3e/da2/ddb/f10f 0 2024-09-13T02:50:38.192 INFO:tasks.workunit.client.0.smithi100.stdout:5/914: fsync db/de/d3e/dc3/f11e 0 2024-09-13T02:50:38.193 INFO:tasks.workunit.client.0.smithi100.stdout:5/915: dread - db/de/d3e/dc3/f11e zero size 2024-09-13T02:50:38.193 INFO:tasks.workunit.client.0.smithi100.stdout:4/952: dwrite d3/d6/d2f/f54 [0,4194304] 0 2024-09-13T02:50:38.193 INFO:tasks.workunit.client.0.smithi100.stdout:4/953: truncate d3/d6/d21/d46/d2d/d58/f84 3799814 0 2024-09-13T02:50:38.194 INFO:tasks.workunit.client.0.smithi100.stdout:5/916: getdents db/de/d3e/dc3 0 2024-09-13T02:50:38.199 INFO:tasks.workunit.client.0.smithi100.stdout:4/954: mknod d3/d6/d21/d46/d2d/d3f/d79/c14d 0 2024-09-13T02:50:38.223 INFO:tasks.workunit.client.0.smithi100.stdout:2/965: dwrite d0/db/d68/d6b/d71/fa7 [0,4194304] 0 2024-09-13T02:50:38.225 INFO:tasks.workunit.client.0.smithi100.stdout:5/917: dwrite db/de/d1f/d2b/d9b/fa1 [0,4194304] 0 2024-09-13T02:50:38.225 INFO:tasks.workunit.client.0.smithi100.stdout:4/955: dwrite d3/d6/d21/f24 [0,4194304] 0 2024-09-13T02:50:38.227 INFO:tasks.workunit.client.0.smithi100.stdout:5/918: rename db/de/d1f/d2b/d9b/c118 to db/de/d3e/d7e/d81/d85/c13d 0 2024-09-13T02:50:38.227 INFO:tasks.workunit.client.0.smithi100.stdout:5/919: mkdir db/de/d3e/da2/dac/d13e 0 2024-09-13T02:50:38.228 INFO:tasks.workunit.client.0.smithi100.stdout:4/956: read d3/d63/f6a [928498,28913] 0 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:4/957: dread - d3/d6/d21/d46/d2d/d42/d8f/f126 zero size 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:4/958: readlink d3/d63/dae/l107 0 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:2/966: write d0/db/d68/d6b/d71/d73/f7c [3120580,89483] 0 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:2/967: chown d0/db/d68/d9a/df2/d6a/lbd 30880595 1 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:2/968: chown d0/db/f16 366 1 2024-09-13T02:50:38.229 INFO:tasks.workunit.client.0.smithi100.stdout:5/920: truncate db/de/d1f/d2b/d9b/fb5 1204602 0 2024-09-13T02:50:38.230 INFO:tasks.workunit.client.0.smithi100.stdout:5/921: creat db/de/d3e/d7e/dd8/f13f x:0 0 0 2024-09-13T02:50:38.231 INFO:tasks.workunit.client.0.smithi100.stdout:5/922: creat db/de/ddc/d106/f140 x:0 0 0 2024-09-13T02:50:38.233 INFO:tasks.workunit.client.0.smithi100.stdout:5/923: link db/de/d3e/dfa/c134 db/d13a/c141 0 2024-09-13T02:50:38.236 INFO:tasks.workunit.client.0.smithi100.stdout:5/924: symlink db/de/d3e/dfa/l142 0 2024-09-13T02:50:38.240 INFO:tasks.workunit.client.0.smithi100.stdout:4/959: dread d3/dc/f23 [0,4194304] 0 2024-09-13T02:50:38.241 INFO:tasks.workunit.client.0.smithi100.stdout:4/960: unlink d3/d6/d21/d103/c123 0 2024-09-13T02:50:38.243 INFO:tasks.workunit.client.0.smithi100.stdout:8/926: sync 2024-09-13T02:50:38.245 INFO:tasks.workunit.client.0.smithi100.stdout:8/927: rmdir df/d13/d21 39 2024-09-13T02:50:38.245 INFO:tasks.workunit.client.0.smithi100.stdout:5/925: dread db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:38.246 INFO:tasks.workunit.client.0.smithi100.stdout:8/928: symlink df/d6f/d12d/l147 0 2024-09-13T02:50:38.247 INFO:tasks.workunit.client.0.smithi100.stdout:8/929: mknod df/d13/c148 0 2024-09-13T02:50:38.247 INFO:tasks.workunit.client.0.smithi100.stdout:8/930: chown df/d5d/d70/d2c/l3c 0 1 2024-09-13T02:50:38.247 INFO:tasks.workunit.client.0.smithi100.stdout:8/931: write df/d5d/d70/f9f [533749,38973] 0 2024-09-13T02:50:38.250 INFO:tasks.workunit.client.0.smithi100.stdout:8/932: creat df/d13/d21/d81/d12e/f149 x:0 0 0 2024-09-13T02:50:38.274 INFO:tasks.workunit.client.0.smithi100.stdout:4/961: dwrite d3/d63/d114/f130 [0,4194304] 0 2024-09-13T02:50:38.275 INFO:tasks.workunit.client.0.smithi100.stdout:5/926: dwrite db/de/d1f/fa8 [0,4194304] 0 2024-09-13T02:50:38.275 INFO:tasks.workunit.client.0.smithi100.stdout:8/933: dwrite df/f1a [0,4194304] 0 2024-09-13T02:50:38.275 INFO:tasks.workunit.client.0.smithi100.stdout:4/962: readlink d3/d3a/l10e 0 2024-09-13T02:50:38.275 INFO:tasks.workunit.client.0.smithi100.stdout:8/934: chown df/d13/db5/l113 193 1 2024-09-13T02:50:38.278 INFO:tasks.workunit.client.0.smithi100.stdout:5/927: creat db/de/d63/f143 x:0 0 0 2024-09-13T02:50:38.278 INFO:tasks.workunit.client.0.smithi100.stdout:8/935: rename df/dac/dd3/c118 to df/d5d/d70/d2c/de3/c14a 0 2024-09-13T02:50:38.280 INFO:tasks.workunit.client.0.smithi100.stdout:5/928: link db/de/l18 db/d13a/l144 0 2024-09-13T02:50:38.284 INFO:tasks.workunit.client.0.smithi100.stdout:4/963: dread d3/d6/d21/f76 [0,4194304] 0 2024-09-13T02:50:38.284 INFO:tasks.workunit.client.0.smithi100.stdout:4/964: stat d3/d6/d21/d46/lee 0 2024-09-13T02:50:38.289 INFO:tasks.workunit.client.0.smithi100.stdout:5/929: write db/de/d3e/d7e/d81/d85/f8b [1077525,91196] 0 2024-09-13T02:50:38.306 INFO:tasks.workunit.client.0.smithi100.stdout:5/930: dwrite db/de/d3e/dc3/fd2 [0,4194304] 0 2024-09-13T02:50:38.550 INFO:tasks.workunit.client.0.smithi100.stdout:5/931: creat db/de/d3e/f145 x:0 0 0 2024-09-13T02:50:38.552 INFO:tasks.workunit.client.0.smithi100.stdout:5/932: mkdir db/de/d146 0 2024-09-13T02:50:38.552 INFO:tasks.workunit.client.0.smithi100.stdout:5/933: readlink db/de/l1b 0 2024-09-13T02:50:38.553 INFO:tasks.workunit.client.0.smithi100.stdout:5/934: creat db/de/d3e/d7e/d81/f147 x:0 0 0 2024-09-13T02:50:38.562 INFO:tasks.workunit.client.0.smithi100.stdout:5/935: dread db/de/ddc/fed [0,4194304] 0 2024-09-13T02:50:38.562 INFO:tasks.workunit.client.0.smithi100.stdout:5/936: write db/faf [337913,122230] 0 2024-09-13T02:50:38.564 INFO:tasks.workunit.client.0.smithi100.stdout:5/937: unlink db/de/d1f/d2b/l3a 0 2024-09-13T02:50:38.564 INFO:tasks.workunit.client.0.smithi100.stdout:5/938: truncate db/de/d1f/d78/f94 4707615 0 2024-09-13T02:50:38.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/939: symlink db/de/d3e/d7e/dd8/l148 0 2024-09-13T02:50:38.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/940: stat db/de/d1f/d2b/f114 0 2024-09-13T02:50:38.565 INFO:tasks.workunit.client.0.smithi100.stdout:5/941: fdatasync db/de/d3e/f11f 0 2024-09-13T02:50:38.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/942: getdents db/de/d3e/d7e/dfb/d124 0 2024-09-13T02:50:38.566 INFO:tasks.workunit.client.0.smithi100.stdout:5/943: fsync db/de/d63/fb0 0 2024-09-13T02:50:38.567 INFO:tasks.workunit.client.0.smithi100.stdout:2/969: sync 2024-09-13T02:50:38.575 INFO:tasks.workunit.client.0.smithi100.stdout:8/936: sync 2024-09-13T02:50:38.575 INFO:tasks.workunit.client.0.smithi100.stdout:4/965: sync 2024-09-13T02:50:38.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/937: write df/d13/d20/d98/fdf [750552,110231] 0 2024-09-13T02:50:38.583 INFO:tasks.workunit.client.0.smithi100.stdout:8/938: read df/d13/d21/d81/d93/ffb [3540296,20672] 0 2024-09-13T02:50:38.584 INFO:tasks.workunit.client.0.smithi100.stdout:8/939: link df/d5d/d70/f91 df/d5d/d70/d2c/d38/d9e/d106/f14b 0 2024-09-13T02:50:38.584 INFO:tasks.workunit.client.0.smithi100.stdout:8/940: stat df/d5d/f69 0 2024-09-13T02:50:38.592 INFO:tasks.workunit.client.0.smithi100.stdout:5/944: dwrite db/de/d3e/d7e/d81/d85/fa9 [0,4194304] 0 2024-09-13T02:50:38.593 INFO:tasks.workunit.client.0.smithi100.stdout:2/970: dwrite d0/db/d68/d6b/da5/dcf/f124 [0,4194304] 0 2024-09-13T02:50:38.594 INFO:tasks.workunit.client.0.smithi100.stdout:5/945: mkdir db/de/d3e/da2/d149 0 2024-09-13T02:50:38.595 INFO:tasks.workunit.client.0.smithi100.stdout:2/971: getdents d0/db/d68/d6b/d71 0 2024-09-13T02:50:38.596 INFO:tasks.workunit.client.0.smithi100.stdout:8/941: write df/d5d/d70/d2c/de3/f12b [4150161,12152] 0 2024-09-13T02:50:38.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/972: rename d0/db/d68/d6b/d71/d73/f7e to d0/db/d68/d9a/df2/d6a/d7f/dcc/f125 0 2024-09-13T02:50:38.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/973: truncate d0/db/d68/d9a/df2/f102 506488 0 2024-09-13T02:50:38.597 INFO:tasks.workunit.client.0.smithi100.stdout:2/974: chown d0/db/d68/d9a/df2/d6a/dac 5 1 2024-09-13T02:50:38.598 INFO:tasks.workunit.client.0.smithi100.stdout:2/975: creat d0/db/d68/d6b/da5/dcf/f126 x:0 0 0 2024-09-13T02:50:38.600 INFO:tasks.workunit.client.0.smithi100.stdout:8/942: creat df/d5d/d70/d2c/d38/f14c x:0 0 0 2024-09-13T02:50:38.603 INFO:tasks.workunit.client.0.smithi100.stdout:2/976: mknod d0/db/d23/d110/c127 0 2024-09-13T02:50:38.618 INFO:tasks.workunit.client.0.smithi100.stdout:5/946: dwrite db/de/d3e/da2/dac/f112 [0,4194304] 0 2024-09-13T02:50:38.619 INFO:tasks.workunit.client.0.smithi100.stdout:2/977: dwrite d0/db/dbe/fd1 [0,4194304] 0 2024-09-13T02:50:38.631 INFO:tasks.workunit.client.0.smithi100.stdout:5/947: dread db/de/d3e/da2/fa4 [0,4194304] 0 2024-09-13T02:50:38.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/948: fdatasync db/de/d1f/f69 0 2024-09-13T02:50:38.632 INFO:tasks.workunit.client.0.smithi100.stdout:5/949: mkdir db/de/d3e/da2/dac/db1/d14a 0 2024-09-13T02:50:38.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/978: dwrite d0/db/d21/d88/fd4 [0,4194304] 0 2024-09-13T02:50:38.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/979: write d0/d36/f9d [112773,50696] 0 2024-09-13T02:50:38.633 INFO:tasks.workunit.client.0.smithi100.stdout:2/980: write d0/db/d68/d6b/d85/ff6 [917071,13768] 0 2024-09-13T02:50:38.633 INFO:tasks.workunit.client.0.smithi100.stdout:5/950: mkdir db/de/d3e/d71/dd9/d14b 0 2024-09-13T02:50:38.635 INFO:tasks.workunit.client.0.smithi100.stdout:2/981: truncate d0/db/d68/d9a/fc8 370388 0 2024-09-13T02:50:38.636 INFO:tasks.workunit.client.0.smithi100.stdout:2/982: creat d0/db/d21/d69/f128 x:0 0 0 2024-09-13T02:50:38.637 INFO:tasks.workunit.client.0.smithi100.stdout:2/983: rmdir d0/db/d68/d6b 39 2024-09-13T02:50:38.637 INFO:tasks.workunit.client.0.smithi100.stdout:2/984: fdatasync d0/f3d 0 2024-09-13T02:50:38.638 INFO:tasks.workunit.client.0.smithi100.stdout:5/951: read db/de/d63/f109 [573906,104799] 0 2024-09-13T02:50:38.638 INFO:tasks.workunit.client.0.smithi100.stdout:5/952: stat db/de/d3e/dc3/fd0 0 2024-09-13T02:50:38.639 INFO:tasks.workunit.client.0.smithi100.stdout:5/953: symlink db/de/ddc/d100/d103/l14c 0 2024-09-13T02:50:38.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/985: dread d0/db/d21/f30 [0,4194304] 0 2024-09-13T02:50:38.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/986: chown d0/d36/d8a/cdc 318060 1 2024-09-13T02:50:38.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/987: fsync d0/db/d68/d9a/df2/d6a/f11c 0 2024-09-13T02:50:38.644 INFO:tasks.workunit.client.0.smithi100.stdout:2/988: mknod d0/db/d21/d57/c129 0 2024-09-13T02:50:38.645 INFO:tasks.workunit.client.0.smithi100.stdout:2/989: symlink d0/db/d68/d6b/d71/d10d/l12a 0 2024-09-13T02:50:38.645 INFO:tasks.workunit.client.0.smithi100.stdout:2/990: fsync d0/db/d68/d9a/df2/d6a/db2/f11d 0 2024-09-13T02:50:38.646 INFO:tasks.workunit.client.0.smithi100.stdout:2/991: dread d0/db/d68/d9a/f107 [0,4194304] 0 2024-09-13T02:50:38.647 INFO:tasks.workunit.client.0.smithi100.stdout:2/992: creat d0/db/d68/d9a/df2/d6a/f12b x:0 0 0 2024-09-13T02:50:38.648 INFO:tasks.workunit.client.0.smithi100.stdout:2/993: creat d0/db/d68/d6b/d85/dfe/f12c x:0 0 0 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/994: symlink d0/db/d68/d6b/da5/dcf/l12d 0 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/995: chown d0/db/d68/d9a/df2/d6a/d7f/f10e 116481 1 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/954: write db/f8f [3252667,125457] 0 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/955: stat db/de/d3e/d71/dd9/d131 0 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:5/956: read - db/de/d3e/da2/ddb/f101 zero size 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/996: mknod d0/db/d68/d6b/c12e 0 2024-09-13T02:50:38.650 INFO:tasks.workunit.client.0.smithi100.stdout:2/997: fsync d0/db/d68/d6b/d71/fb0 0 2024-09-13T02:50:38.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/957: creat db/de/d63/d70/d115/f14d x:0 0 0 2024-09-13T02:50:38.651 INFO:tasks.workunit.client.0.smithi100.stdout:5/958: getdents db/de/d3e/da2/d149 0 2024-09-13T02:50:38.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/998: unlink d0/db/d68/d9a/fe4 0 2024-09-13T02:50:38.651 INFO:tasks.workunit.client.0.smithi100.stdout:2/999: fdatasync d0/db/d21/d88/faa 0 2024-09-13T02:50:38.652 INFO:tasks.workunit.client.0.smithi100.stdout:5/959: symlink db/de/d3e/d71/dd9/d131/l14e 0 2024-09-13T02:50:38.653 INFO:tasks.workunit.client.0.smithi100.stdout:5/960: rename db/de/d1f/c43 to db/de/d3e/d71/c14f 0 2024-09-13T02:50:38.654 INFO:tasks.workunit.client.0.smithi100.stdout:5/961: unlink db/de/d1f/f87 0 2024-09-13T02:50:38.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/966: sync 2024-09-13T02:50:38.723 INFO:tasks.workunit.client.0.smithi100.stdout:4/967: symlink d3/dc/d4b/d8a/l14e 0 2024-09-13T02:50:38.724 INFO:tasks.workunit.client.0.smithi100.stdout:4/968: getdents d3/dc/d4b/d7c 0 2024-09-13T02:50:38.732 INFO:tasks.workunit.client.0.smithi100.stdout:4/969: dread d3/d6/d21/d46/d2d/f82 [0,4194304] 0 2024-09-13T02:50:38.732 INFO:tasks.workunit.client.0.smithi100.stdout:4/970: creat d3/d6/d21/d67/f14f x:0 0 0 2024-09-13T02:50:38.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/971: read d3/d6/d21/d46/fa3 [2608945,74548] 0 2024-09-13T02:50:38.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/972: fsync d3/d6/d2f/f54 0 2024-09-13T02:50:38.741 INFO:tasks.workunit.client.0.smithi100.stdout:4/973: fdatasync d3/d63/d114/f130 0 2024-09-13T02:50:38.742 INFO:tasks.workunit.client.0.smithi100.stdout:4/974: mkdir d3/dc/d4b/d150 0 2024-09-13T02:50:38.742 INFO:tasks.workunit.client.0.smithi100.stdout:4/975: readlink d3/d63/dae/d10a/l129 0 2024-09-13T02:50:38.745 INFO:tasks.workunit.client.0.smithi100.stdout:4/976: read d3/dc/f6e [1758261,615] 0 2024-09-13T02:50:38.751 INFO:tasks.workunit.client.0.smithi100.stdout:4/977: dread d3/dc/d4b/f91 [0,4194304] 0 2024-09-13T02:50:38.751 INFO:tasks.workunit.client.0.smithi100.stdout:4/978: dread - d3/dc/d88/f14a zero size 2024-09-13T02:50:38.767 INFO:tasks.workunit.client.0.smithi100.stdout:4/979: dwrite d3/d6/d21/d46/d2d/d58/f84 [0,4194304] 0 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:8/943: sync 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/962: sync 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:8/944: fsync df/d13/d21/d81/db0/fdc 0 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:8/945: fdatasync df/d13/d21/d81/d93/ffb 0 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:4/980: rename d3/d63/f6a to d3/d6/d21/d67/dd2/dd8/f151 0 2024-09-13T02:50:38.797 INFO:tasks.workunit.client.0.smithi100.stdout:5/963: mkdir db/de/d1f/d2b/d9b/d150 0 2024-09-13T02:50:38.798 INFO:tasks.workunit.client.0.smithi100.stdout:5/964: creat db/de/d3e/da2/dac/db1/f151 x:0 0 0 2024-09-13T02:50:38.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/946: write fb [6197123,26502] 0 2024-09-13T02:50:38.806 INFO:tasks.workunit.client.0.smithi100.stdout:8/947: write df/dac/f140 [1002160,49947] 0 2024-09-13T02:50:38.806 INFO:tasks.workunit.client.0.smithi100.stdout:5/965: dread db/de/d1f/d2b/f35 [0,4194304] 0 2024-09-13T02:50:38.807 INFO:tasks.workunit.client.0.smithi100.stdout:5/966: dread - db/de/d1f/f117 zero size 2024-09-13T02:50:38.808 INFO:tasks.workunit.client.0.smithi100.stdout:8/948: symlink df/d85/l14d 0 2024-09-13T02:50:38.810 INFO:tasks.workunit.client.0.smithi100.stdout:8/949: dread df/d5d/d88/dc0/fc5 [0,4194304] 0 2024-09-13T02:50:38.826 INFO:tasks.workunit.client.0.smithi100.stdout:4/981: dwrite d3/d6/d21/f43 [0,4194304] 0 2024-09-13T02:50:38.827 INFO:tasks.workunit.client.0.smithi100.stdout:5/967: dwrite db/de/d3e/da2/dac/db1/fb7 [0,4194304] 0 2024-09-13T02:50:38.829 INFO:tasks.workunit.client.0.smithi100.stdout:5/968: creat db/de/ddc/f152 x:0 0 0 2024-09-13T02:50:38.835 INFO:tasks.workunit.client.0.smithi100.stdout:4/982: dread d3/d6/da6/f145 [0,4194304] 0 2024-09-13T02:50:38.836 INFO:tasks.workunit.client.0.smithi100.stdout:4/983: getdents d3/d6/d9 0 2024-09-13T02:50:38.838 INFO:tasks.workunit.client.0.smithi100.stdout:4/984: mkdir d3/d6/d21/d46/d2d/d58/d152 0 2024-09-13T02:50:38.841 INFO:tasks.workunit.client.0.smithi100.stdout:5/969: dread db/de/d3e/d7e/d81/d85/fa9 [0,4194304] 0 2024-09-13T02:50:38.841 INFO:tasks.workunit.client.0.smithi100.stdout:5/970: chown db/de/d63/fb0 150667223 1 2024-09-13T02:50:38.851 INFO:tasks.workunit.client.0.smithi100.stdout:5/971: write db/de/d63/fbb [3396842,120993] 0 2024-09-13T02:50:38.852 INFO:tasks.workunit.client.0.smithi100.stdout:5/972: creat db/de/d3e/d71/dd9/d14b/f153 x:0 0 0 2024-09-13T02:50:38.853 INFO:tasks.workunit.client.0.smithi100.stdout:5/973: creat db/de/d3e/da2/dac/db1/d14a/f154 x:0 0 0 2024-09-13T02:50:38.854 INFO:tasks.workunit.client.0.smithi100.stdout:5/974: truncate db/de/d3e/f66 105583 0 2024-09-13T02:50:38.854 INFO:tasks.workunit.client.0.smithi100.stdout:5/975: write db/de/d3e/d7e/fba [4896114,55126] 0 2024-09-13T02:50:38.855 INFO:tasks.workunit.client.0.smithi100.stdout:5/976: rename db/de/d3e/da2/lf5 to db/de/d3e/da2/d149/l155 0 2024-09-13T02:50:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:8/950: dwrite df/d13/d21/f57 [0,4194304] 0 2024-09-13T02:50:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:5/977: symlink db/de/d3e/da2/d149/l156 0 2024-09-13T02:50:38.856 INFO:tasks.workunit.client.0.smithi100.stdout:4/985: dwrite d3/dc/d88/db4/fcd [0,4194304] 0 2024-09-13T02:50:38.858 INFO:tasks.workunit.client.0.smithi100.stdout:5/978: mkdir db/de/d3e/da2/dac/d13e/d157 0 2024-09-13T02:50:38.859 INFO:tasks.workunit.client.0.smithi100.stdout:5/979: creat db/de/d1f/d2b/d9b/f158 x:0 0 0 2024-09-13T02:50:38.861 INFO:tasks.workunit.client.0.smithi100.stdout:5/980: mkdir db/de/d3e/dc3/d159 0 2024-09-13T02:50:38.861 INFO:tasks.workunit.client.0.smithi100.stdout:5/981: dread - db/de/d3e/d7e/dd8/f13f zero size 2024-09-13T02:50:38.861 INFO:tasks.workunit.client.0.smithi100.stdout:5/982: readlink db/de/d1f/d2b/d9b/lf2 0 2024-09-13T02:50:38.861 INFO:tasks.workunit.client.0.smithi100.stdout:5/983: mknod db/de/ddc/d106/c15a 0 2024-09-13T02:50:38.863 INFO:tasks.workunit.client.0.smithi100.stdout:5/984: symlink db/de/d3e/da2/dac/l15b 0 2024-09-13T02:50:38.864 INFO:tasks.workunit.client.0.smithi100.stdout:5/985: mknod db/de/d3e/d7e/dd8/c15c 0 2024-09-13T02:50:38.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/986: write d3/fb [1708632,26959] 0 2024-09-13T02:50:38.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/987: write d3/d6/d21/d46/f83 [2073457,1737] 0 2024-09-13T02:50:38.870 INFO:tasks.workunit.client.0.smithi100.stdout:4/988: write d3/d6/da6/f148 [619145,80635] 0 2024-09-13T02:50:38.872 INFO:tasks.workunit.client.0.smithi100.stdout:4/989: unlink d3/dc/d88/lb1 0 2024-09-13T02:50:38.872 INFO:tasks.workunit.client.0.smithi100.stdout:4/990: getdents d3/d63/dae/d14b 0 2024-09-13T02:50:38.886 INFO:tasks.workunit.client.0.smithi100.stdout:8/951: dwrite df/d5d/d70/d2c/d38/f7b [0,4194304] 0 2024-09-13T02:50:38.887 INFO:tasks.workunit.client.0.smithi100.stdout:5/986: dwrite db/de/d63/f143 [0,4194304] 0 2024-09-13T02:50:38.889 INFO:tasks.workunit.client.0.smithi100.stdout:5/987: creat db/de/d3e/d71/f15d x:0 0 0 2024-09-13T02:50:38.892 INFO:tasks.workunit.client.0.smithi100.stdout:4/991: dwrite d3/d3a/d56/fe2 [0,4194304] 0 2024-09-13T02:50:38.895 INFO:tasks.workunit.client.0.smithi100.stdout:4/992: fdatasync d3/d6/d21/d46/f83 0 2024-09-13T02:50:38.895 INFO:tasks.workunit.client.0.smithi100.stdout:4/993: dread - d3/dc/d4b/d8a/f109 zero size 2024-09-13T02:50:38.895 INFO:tasks.workunit.client.0.smithi100.stdout:4/994: fdatasync d3/daf/fe3 0 2024-09-13T02:50:38.895 INFO:tasks.workunit.client.0.smithi100.stdout:4/995: chown d3/d63/dae/l107 1 1 2024-09-13T02:50:38.898 INFO:tasks.workunit.client.0.smithi100.stdout:4/996: mkdir d3/d6/d21/d46/d2d/d58/d152/d153 0 2024-09-13T02:50:38.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/952: dread df/d13/f37 [0,4194304] 0 2024-09-13T02:50:38.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/953: read df/d13/d21/f57 [7968387,100219] 0 2024-09-13T02:50:38.898 INFO:tasks.workunit.client.0.smithi100.stdout:8/954: chown df/d13/d21/d81/d12e/f149 21 1 2024-09-13T02:50:38.898 INFO:tasks.workunit.client.0.smithi100.stdout:4/997: truncate d3/d63/fd3 3581149 0 2024-09-13T02:50:38.899 INFO:tasks.workunit.client.0.smithi100.stdout:5/988: write db/de/d1f/d2b/f34 [1772535,40231] 0 2024-09-13T02:50:38.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/955: mkdir df/d13/d20/da2/d14e 0 2024-09-13T02:50:38.899 INFO:tasks.workunit.client.0.smithi100.stdout:8/956: chown df/d13/d21/d81/db0/cc4 18707 1 2024-09-13T02:50:38.900 INFO:tasks.workunit.client.0.smithi100.stdout:4/998: truncate d3/d6/d2f/d7a/fc7 3909170 0 2024-09-13T02:50:38.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/989: symlink db/de/ddc/d100/d103/l15e 0 2024-09-13T02:50:38.902 INFO:tasks.workunit.client.0.smithi100.stdout:5/990: dread - db/de/fa3 zero size 2024-09-13T02:50:38.903 INFO:tasks.workunit.client.0.smithi100.stdout:5/991: mkdir db/de/d63/d70/d15f 0 2024-09-13T02:50:38.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/992: unlink db/de/d3e/da2/dac/db1/d14a/f154 0 2024-09-13T02:50:38.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/993: write db/de/d3e/d7e/d81/d85/f8b [1728466,55452] 0 2024-09-13T02:50:38.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/994: write db/de/d3e/d7e/fba [7319246,37431] 0 2024-09-13T02:50:38.905 INFO:tasks.workunit.client.0.smithi100.stdout:5/995: truncate db/de/d1f/d2b/d9b/fb5 2075181 0 2024-09-13T02:50:38.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/996: creat db/de/d3e/d71/dd9/f160 x:0 0 0 2024-09-13T02:50:38.906 INFO:tasks.workunit.client.0.smithi100.stdout:5/997: chown db/de/d3e/d7e/d81/d85/cda 26844593 1 2024-09-13T02:50:38.909 INFO:tasks.workunit.client.0.smithi100.stdout:5/998: rmdir db/de/d3e/d71/dd9/d131 39 2024-09-13T02:50:38.909 INFO:tasks.workunit.client.0.smithi100.stdout:4/999: write d3/d6/d21/d67/dd2/dd8/f151 [1453738,114497] 0 2024-09-13T02:50:38.911 INFO:tasks.workunit.client.0.smithi100.stdout:5/999: unlink db/de/cc1 0 2024-09-13T02:50:38.916 INFO:tasks.workunit.client.0.smithi100.stdout:8/957: dwrite df/d5d/d70/d2c/f7f [0,4194304] 0 2024-09-13T02:50:38.917 INFO:tasks.workunit.client.0.smithi100.stdout:8/958: rmdir df/d5d/d70/d2c/d38/d9e/dad 39 2024-09-13T02:50:38.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/959: dwrite df/d5d/d70/d2c/fc2 [4194304,4194304] 0 2024-09-13T02:50:38.944 INFO:tasks.workunit.client.0.smithi100.stdout:8/960: dread df/d13/d20/f4e [0,4194304] 0 2024-09-13T02:50:38.944 INFO:tasks.workunit.client.0.smithi100.stdout:8/961: readlink df/d13/d21/d81/db0/l94 0 2024-09-13T02:50:39.034 INFO:tasks.workunit.client.0.smithi100.stdout:8/962: mknod df/dac/c14f 0 2024-09-13T02:50:39.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/963: dread df/d13/d21/d81/db0/fd5 [0,4194304] 0 2024-09-13T02:50:39.035 INFO:tasks.workunit.client.0.smithi100.stdout:8/964: fsync df/d5d/d70/d2c/d38/f5b 0 2024-09-13T02:50:39.168 INFO:tasks.workunit.client.0.smithi100.stdout:8/965: symlink df/d13/d21/d81/d127/l150 0 2024-09-13T02:50:39.168 INFO:tasks.workunit.client.0.smithi100.stdout:8/966: chown df/d13/de1/f126 57471890 1 2024-09-13T02:50:39.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:38 smithi100 ceph-mon[27894]: pgmap v250: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 169 MiB/s rd, 223 MiB/s wr, 676 op/s 2024-09-13T02:50:39.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:38 smithi122 ceph-mon[34559]: pgmap v250: 65 pgs: 65 active+clean; 1.6 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 169 MiB/s rd, 223 MiB/s wr, 676 op/s 2024-09-13T02:50:39.378 INFO:tasks.workunit.client.0.smithi100.stdout:8/967: symlink df/d13/d21/d81/db0/da3/dc7/l151 0 2024-09-13T02:50:39.572 INFO:tasks.workunit.client.0.smithi100.stdout:8/968: truncate df/d13/d21/d81/f8d 1437593 0 2024-09-13T02:50:39.573 INFO:tasks.workunit.client.0.smithi100.stdout:8/969: truncate df/d13/d20/d98/f142 581456 0 2024-09-13T02:50:39.585 INFO:tasks.workunit.client.0.smithi100.stdout:8/970: write df/d13/d68/f9d [2333458,58083] 0 2024-09-13T02:50:39.594 INFO:tasks.workunit.client.0.smithi100.stdout:8/971: write df/d6f/f11a [3636305,68750] 0 2024-09-13T02:50:39.597 INFO:tasks.workunit.client.0.smithi100.stdout:8/972: mkdir df/d13/d21/d152 0 2024-09-13T02:50:39.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:39 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:50:40.077 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:39 smithi100 ceph-mon[27894]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:50:40.109 INFO:tasks.workunit.client.0.smithi100.stdout:8/973: sync 2024-09-13T02:50:40.109 INFO:tasks.workunit.client.0.smithi100.stdout:8/974: chown df/d13/d20/d98/d12f/l138 510074 1 2024-09-13T02:50:40.110 INFO:tasks.workunit.client.0.smithi100.stdout:8/975: unlink df/d13/d21/d81/db0/l104 0 2024-09-13T02:50:40.126 INFO:tasks.workunit.client.0.smithi100.stdout:8/976: dwrite df/d5d/fa8 [0,4194304] 0 2024-09-13T02:50:40.126 INFO:tasks.workunit.client.0.smithi100.stdout:8/977: write df/d5d/d70/f91 [807920,80786] 0 2024-09-13T02:50:40.127 INFO:tasks.workunit.client.0.smithi100.stdout:8/978: mkdir df/d5d/d70/d2c/d38/d153 0 2024-09-13T02:50:40.128 INFO:tasks.workunit.client.0.smithi100.stdout:8/979: creat df/d13/d5c/d10e/d11d/f154 x:0 0 0 2024-09-13T02:50:40.129 INFO:tasks.workunit.client.0.smithi100.stdout:8/980: mknod df/d5d/d70/c155 0 2024-09-13T02:50:40.132 INFO:tasks.workunit.client.0.smithi100.stdout:8/981: dread df/d13/d20/d98/fa6 [0,4194304] 0 2024-09-13T02:50:40.132 INFO:tasks.workunit.client.0.smithi100.stdout:8/982: symlink df/dac/dd3/l156 0 2024-09-13T02:50:40.136 INFO:tasks.workunit.client.0.smithi100.stdout:8/983: symlink df/d13/d5c/l157 0 2024-09-13T02:50:40.137 INFO:tasks.workunit.client.0.smithi100.stdout:8/984: mkdir df/d13/d5c/d10e/d158 0 2024-09-13T02:50:40.137 INFO:tasks.workunit.client.0.smithi100.stdout:8/985: truncate df/d13/d20/f42 1201503 0 2024-09-13T02:50:40.138 INFO:tasks.workunit.client.0.smithi100.stdout:8/986: rename df/d13/d20/d98/d12f/l13b to df/d5d/d88/l159 0 2024-09-13T02:50:40.139 INFO:tasks.workunit.client.0.smithi100.stdout:8/987: readlink df/d5d/d70/d2c/l5f 0 2024-09-13T02:50:40.159 INFO:tasks.workunit.client.0.smithi100.stdout:8/988: dwrite df/f6c [0,4194304] 0 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:8/10: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:0/27: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:1/9: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:9/97: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:2/46: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:6/92: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:9/98: chown f2 1697479 1 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:1/10: dread - f1 zero size 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:7/32: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:3/38: sync 2024-09-13T02:50:40.177 INFO:tasks.workunit.client.1.smithi122.stdout:4/78: sync 2024-09-13T02:50:40.178 INFO:tasks.workunit.client.1.smithi122.stdout:1/11: write f2 [668702,110390] 0 2024-09-13T02:50:40.178 INFO:tasks.workunit.client.1.smithi122.stdout:5/90: sync 2024-09-13T02:50:40.179 INFO:tasks.workunit.client.1.smithi122.stdout:5/91: dread d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:40.925 INFO:tasks.workunit.client.1.smithi122.stdout:2/47: mkdir d0/dd 0 2024-09-13T02:50:40.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/989: rmdir df/d13/d20/d98 39 2024-09-13T02:50:40.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/990: stat df/d13/d21/d81/db0/fbd 0 2024-09-13T02:50:40.937 INFO:tasks.workunit.client.0.smithi100.stdout:8/991: chown df/d13/d21/d81/d12e 653966140 1 2024-09-13T02:50:40.954 INFO:tasks.workunit.client.0.smithi100.stdout:8/992: dwrite df/d13/d21/d81/f8d [0,4194304] 0 2024-09-13T02:50:40.955 INFO:tasks.workunit.client.0.smithi100.stdout:8/993: creat df/d13/db5/dc3/df0/f15a x:0 0 0 2024-09-13T02:50:40.957 INFO:tasks.workunit.client.0.smithi100.stdout:8/994: rename df/d5d/d70/f63 to df/d5d/d70/d2c/d38/d9e/f15b 0 2024-09-13T02:50:40.957 INFO:tasks.workunit.client.0.smithi100.stdout:8/995: write df/d5d/fb1 [725157,20879] 0 2024-09-13T02:50:40.963 INFO:tasks.workunit.client.0.smithi100.stdout:8/996: dread df/d5d/d70/d2c/d38/d9e/d106/f14b [0,4194304] 0 2024-09-13T02:50:40.983 INFO:tasks.workunit.client.0.smithi100.stdout:8/997: dwrite df/d13/d21/d81/db0/f95 [0,4194304] 0 2024-09-13T02:50:40.984 INFO:tasks.workunit.client.0.smithi100.stdout:8/998: mknod df/d13/d21/d81/d127/d132/c15c 0 2024-09-13T02:50:40.984 INFO:tasks.workunit.client.0.smithi100.stdout:8/999: stat df/d5d/d70/d2c/d38/d9e/d106/c10a 0 2024-09-13T02:50:41.001 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:40 smithi122 ceph-mon[34559]: pgmap v251: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 239 MiB/s rd, 309 MiB/s wr, 740 op/s 2024-09-13T02:50:41.078 INFO:tasks.workunit.client.1.smithi122.stdout:8/11: rename f0 to f2 0 2024-09-13T02:50:41.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/12: write f1 [18200,48949] 0 2024-09-13T02:50:41.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/13: chown f1 13 1 2024-09-13T02:50:41.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/14: readlink - no filename 2024-09-13T02:50:41.082 INFO:tasks.workunit.client.1.smithi122.stdout:8/15: dread f1 [0,4194304] 0 2024-09-13T02:50:41.084 INFO:tasks.workunit.client.1.smithi122.stdout:8/16: read f2 [431756,17376] 0 2024-09-13T02:50:41.086 INFO:tasks.workunit.client.1.smithi122.stdout:8/17: dread f2 [0,4194304] 0 2024-09-13T02:50:41.089 INFO:tasks.workunit.client.1.smithi122.stdout:0/28: creat d1/d5/d9/da/ff x:0 0 0 2024-09-13T02:50:41.090 INFO:tasks.workunit.client.1.smithi122.stdout:0/29: write d1/d5/d9/da/ff [315238,41978] 0 2024-09-13T02:50:41.094 INFO:tasks.workunit.client.1.smithi122.stdout:0/30: dread d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:41.094 INFO:tasks.workunit.client.1.smithi122.stdout:0/31: chown d1/d5/d9/da/ff 1 1 2024-09-13T02:50:41.095 INFO:tasks.workunit.client.1.smithi122.stdout:6/93: mkdir d5/dd/d21 0 2024-09-13T02:50:41.097 INFO:tasks.workunit.client.1.smithi122.stdout:9/99: rename d8/la to d8/d16/l1e 0 2024-09-13T02:50:41.097 INFO:tasks.workunit.client.0.smithi100.stderr:+ rm -rf -- ./tmp.W5horMtAlU 2024-09-13T02:50:41.098 INFO:tasks.workunit.client.1.smithi122.stdout:7/33: symlink d4/d8/la 0 2024-09-13T02:50:41.098 INFO:tasks.workunit.client.1.smithi122.stdout:4/79: dread f10 [0,4194304] 0 2024-09-13T02:50:41.098 INFO:tasks.workunit.client.1.smithi122.stdout:1/12: symlink l3 0 2024-09-13T02:50:41.099 INFO:tasks.workunit.client.1.smithi122.stdout:5/92: mkdir d0/d1d 0 2024-09-13T02:50:41.099 INFO:tasks.workunit.client.1.smithi122.stdout:5/93: dread - d0/d2/f1b zero size 2024-09-13T02:50:41.101 INFO:tasks.workunit.client.1.smithi122.stdout:8/18: unlink f1 0 2024-09-13T02:50:41.102 INFO:tasks.workunit.client.1.smithi122.stdout:0/32: mkdir d1/d5/d10 0 2024-09-13T02:50:41.102 INFO:tasks.workunit.client.1.smithi122.stdout:0/33: truncate d1/d5/d9/da/fb 528943 0 2024-09-13T02:50:41.103 INFO:tasks.workunit.client.1.smithi122.stdout:6/94: fsync d5/db/f17 0 2024-09-13T02:50:41.104 INFO:tasks.workunit.client.1.smithi122.stdout:9/100: mkdir d8/d16/d1d/d1f 0 2024-09-13T02:50:41.106 INFO:tasks.workunit.client.1.smithi122.stdout:7/34: mkdir d4/d8/db 0 2024-09-13T02:50:41.107 INFO:tasks.workunit.client.1.smithi122.stdout:4/80: getdents d11/d13/d14 0 2024-09-13T02:50:41.108 INFO:tasks.workunit.client.1.smithi122.stdout:1/13: read f0 [9616,74926] 0 2024-09-13T02:50:41.113 INFO:tasks.workunit.client.1.smithi122.stdout:5/94: mknod d0/d1d/c1e 0 2024-09-13T02:50:41.113 INFO:tasks.workunit.client.1.smithi122.stdout:2/48: getdents d0 0 2024-09-13T02:50:41.113 INFO:tasks.workunit.client.1.smithi122.stdout:8/19: mkdir d3 0 2024-09-13T02:50:41.113 INFO:tasks.workunit.client.1.smithi122.stdout:0/34: dread f0 [0,4194304] 0 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:6/95: fsync d5/db/f14 0 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:1/14: dread f0 [0,4194304] 0 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:6/96: read - d5/db/dc/d1c/f1d zero size 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:6/97: stat d5/dd/df/c10 0 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:9/101: unlink d8/f14 0 2024-09-13T02:50:41.114 INFO:tasks.workunit.client.1.smithi122.stdout:9/102: chown d8/cc 15934 1 2024-09-13T02:50:41.115 INFO:tasks.workunit.client.1.smithi122.stdout:7/35: mkdir d4/d8/db/dc 0 2024-09-13T02:50:41.115 INFO:tasks.workunit.client.1.smithi122.stdout:3/39: sync 2024-09-13T02:50:41.115 INFO:tasks.workunit.client.1.smithi122.stdout:5/95: rmdir d0 39 2024-09-13T02:50:41.115 INFO:tasks.workunit.client.1.smithi122.stdout:5/96: stat d0/da/f19 0 2024-09-13T02:50:41.115 INFO:tasks.workunit.client.1.smithi122.stdout:8/20: creat d3/f4 x:0 0 0 2024-09-13T02:50:41.118 INFO:tasks.workunit.client.1.smithi122.stdout:1/15: link l3 l4 0 2024-09-13T02:50:41.118 INFO:tasks.workunit.client.1.smithi122.stdout:1/16: write f2 [974365,37720] 0 2024-09-13T02:50:41.118 INFO:tasks.workunit.client.1.smithi122.stdout:1/17: readlink l3 0 2024-09-13T02:50:41.119 INFO:tasks.workunit.client.1.smithi122.stdout:6/98: creat d5/dd/f22 x:0 0 0 2024-09-13T02:50:41.120 INFO:tasks.workunit.client.1.smithi122.stdout:2/49: dread d0/f4 [0,4194304] 0 2024-09-13T02:50:41.120 INFO:tasks.workunit.client.1.smithi122.stdout:2/50: write d0/fc [733412,28509] 0 2024-09-13T02:50:41.120 INFO:tasks.workunit.client.1.smithi122.stdout:9/103: truncate d8/d16/f1b 3523464 0 2024-09-13T02:50:41.121 INFO:tasks.workunit.client.1.smithi122.stdout:7/36: creat d4/fd x:0 0 0 2024-09-13T02:50:41.121 INFO:tasks.workunit.client.1.smithi122.stdout:7/37: chown d4/d8 346065909 1 2024-09-13T02:50:41.122 INFO:tasks.workunit.client.1.smithi122.stdout:7/38: chown d4 34001 1 2024-09-13T02:50:41.123 INFO:tasks.workunit.client.1.smithi122.stdout:5/97: creat d0/d1d/f1f x:0 0 0 2024-09-13T02:50:41.124 INFO:tasks.workunit.client.1.smithi122.stdout:8/21: mkdir d3/d5 0 2024-09-13T02:50:41.125 INFO:tasks.workunit.client.1.smithi122.stdout:0/35: rmdir d1/d5/d9/da 39 2024-09-13T02:50:41.127 INFO:tasks.workunit.client.1.smithi122.stdout:6/99: mknod d5/d11/c23 0 2024-09-13T02:50:41.127 INFO:tasks.workunit.client.1.smithi122.stdout:6/100: creat d5/dd/df/f24 x:0 0 0 2024-09-13T02:50:41.129 INFO:tasks.workunit.client.1.smithi122.stdout:9/104: mknod d8/d16/d1d/c20 0 2024-09-13T02:50:41.129 INFO:tasks.workunit.client.1.smithi122.stdout:9/105: readlink d8/l17 0 2024-09-13T02:50:41.130 INFO:tasks.workunit.client.1.smithi122.stdout:7/39: truncate d4/d8/f7 2974771 0 2024-09-13T02:50:41.130 INFO:tasks.workunit.client.1.smithi122.stdout:7/40: fdatasync d4/d8/f7 0 2024-09-13T02:50:41.135 INFO:tasks.workunit.client.1.smithi122.stdout:1/18: getdents . 0 2024-09-13T02:50:41.135 INFO:tasks.workunit.client.1.smithi122.stdout:1/19: dread - f1 zero size 2024-09-13T02:50:41.135 INFO:tasks.workunit.client.1.smithi122.stdout:1/20: chown f0 263943519 1 2024-09-13T02:50:41.135 INFO:tasks.workunit.client.1.smithi122.stdout:1/21: write f2 [1293845,65274] 0 2024-09-13T02:50:41.136 INFO:tasks.workunit.client.1.smithi122.stdout:6/101: truncate d5/db/f17 4014146 0 2024-09-13T02:50:41.138 INFO:tasks.workunit.client.1.smithi122.stdout:7/41: unlink d4/d8/la 0 2024-09-13T02:50:41.139 INFO:tasks.workunit.client.1.smithi122.stdout:8/22: rmdir d3 39 2024-09-13T02:50:41.139 INFO:tasks.workunit.client.1.smithi122.stdout:8/23: truncate d3/f4 759316 0 2024-09-13T02:50:41.139 INFO:tasks.workunit.client.1.smithi122.stdout:1/22: rename l4 to l5 0 2024-09-13T02:50:41.140 INFO:tasks.workunit.client.1.smithi122.stdout:9/106: dread d8/f9 [0,4194304] 0 2024-09-13T02:50:41.140 INFO:tasks.workunit.client.1.smithi122.stdout:9/107: read f1 [1218988,82522] 0 2024-09-13T02:50:41.140 INFO:tasks.workunit.client.1.smithi122.stdout:6/102: mkdir d5/db/dc/d25 0 2024-09-13T02:50:41.141 INFO:tasks.workunit.client.1.smithi122.stdout:7/42: mknod d4/d8/db/dc/ce 0 2024-09-13T02:50:41.141 INFO:tasks.workunit.client.1.smithi122.stdout:7/43: chown l2 2 1 2024-09-13T02:50:41.141 INFO:tasks.workunit.client.1.smithi122.stdout:8/24: mknod d3/d5/c6 0 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:7/44: creat d4/d8/db/ff x:0 0 0 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:7/45: truncate d4/d8/db/ff 568009 0 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:7/46: dread - d4/fd zero size 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:9/108: mknod d8/d16/d1d/d1f/c21 0 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/36: dwrite d1/d5/d9/da/fb [0,4194304] 0 2024-09-13T02:50:41.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/37: fdatasync d1/d5/fd 0 2024-09-13T02:50:41.147 INFO:tasks.workunit.client.1.smithi122.stdout:0/38: readlink d1/l7 0 2024-09-13T02:50:41.147 INFO:tasks.workunit.client.1.smithi122.stdout:1/23: rename l3 to l6 0 2024-09-13T02:50:41.148 INFO:tasks.workunit.client.1.smithi122.stdout:6/103: dread d5/f9 [0,4194304] 0 2024-09-13T02:50:41.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/47: symlink d4/d8/db/l10 0 2024-09-13T02:50:41.149 INFO:tasks.workunit.client.1.smithi122.stdout:7/48: readlink l2 0 2024-09-13T02:50:41.149 INFO:tasks.workunit.client.1.smithi122.stdout:7/49: creat d4/d8/db/f11 x:0 0 0 2024-09-13T02:50:41.149 INFO:tasks.workunit.client.1.smithi122.stdout:8/25: symlink d3/d5/l7 0 2024-09-13T02:50:41.151 INFO:tasks.workunit.client.1.smithi122.stdout:0/39: creat d1/d5/f11 x:0 0 0 2024-09-13T02:50:41.152 INFO:tasks.workunit.client.1.smithi122.stdout:0/40: fsync d1/d5/d9/da/fb 0 2024-09-13T02:50:41.152 INFO:tasks.workunit.client.1.smithi122.stdout:1/24: symlink l7 0 2024-09-13T02:50:41.154 INFO:tasks.workunit.client.1.smithi122.stdout:3/40: dwrite f3 [0,4194304] 0 2024-09-13T02:50:41.156 INFO:tasks.workunit.client.1.smithi122.stdout:6/104: mkdir d5/dd/df/d26 0 2024-09-13T02:50:41.156 INFO:tasks.workunit.client.1.smithi122.stdout:6/105: rename d5/dd to d5/dd/d27 22 2024-09-13T02:50:41.160 INFO:tasks.workunit.client.1.smithi122.stdout:1/25: mknod c8 0 2024-09-13T02:50:41.160 INFO:tasks.workunit.client.1.smithi122.stdout:1/26: dread - f1 zero size 2024-09-13T02:50:41.162 INFO:tasks.workunit.client.1.smithi122.stdout:3/41: creat d4/d5/fb x:0 0 0 2024-09-13T02:50:41.164 INFO:tasks.workunit.client.1.smithi122.stdout:6/106: symlink d5/dd/df/l28 0 2024-09-13T02:50:41.164 INFO:tasks.workunit.client.1.smithi122.stdout:6/107: write d5/f9 [744488,6866] 0 2024-09-13T02:50:41.165 INFO:tasks.workunit.client.1.smithi122.stdout:1/27: truncate f0 3170769 0 2024-09-13T02:50:41.167 INFO:tasks.workunit.client.1.smithi122.stdout:2/51: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T02:50:41.167 INFO:tasks.workunit.client.1.smithi122.stdout:2/52: truncate d0/fc 1192908 0 2024-09-13T02:50:41.168 INFO:tasks.workunit.client.1.smithi122.stdout:1/28: creat f9 x:0 0 0 2024-09-13T02:50:41.168 INFO:tasks.workunit.client.1.smithi122.stdout:1/29: chown l7 0 1 2024-09-13T02:50:41.168 INFO:tasks.workunit.client.1.smithi122.stdout:1/30: write f9 [863281,22629] 0 2024-09-13T02:50:41.170 INFO:tasks.workunit.client.1.smithi122.stdout:2/53: mknod d0/dd/ce 0 2024-09-13T02:50:41.170 INFO:tasks.workunit.client.1.smithi122.stdout:0/41: write d1/d5/fd [1415207,52557] 0 2024-09-13T02:50:41.172 INFO:tasks.workunit.client.1.smithi122.stdout:0/42: rename d1/ce to d1/d5/c12 0 2024-09-13T02:50:41.172 INFO:tasks.workunit.client.1.smithi122.stdout:0/43: chown d1/d5/d10 0 1 2024-09-13T02:50:41.172 INFO:tasks.workunit.client.1.smithi122.stdout:0/44: creat d1/d5/f13 x:0 0 0 2024-09-13T02:50:41.173 INFO:tasks.workunit.client.1.smithi122.stdout:0/45: creat d1/d5/d10/f14 x:0 0 0 2024-09-13T02:50:41.173 INFO:tasks.workunit.client.1.smithi122.stdout:0/46: dread - d1/d5/f13 zero size 2024-09-13T02:50:41.173 INFO:tasks.workunit.client.1.smithi122.stdout:0/47: write d1/d5/f13 [793206,101172] 0 2024-09-13T02:50:41.174 INFO:tasks.workunit.client.1.smithi122.stdout:0/48: rmdir d1/d5/d9 39 2024-09-13T02:50:41.175 INFO:tasks.workunit.client.1.smithi122.stdout:0/49: mkdir d1/d5/d15 0 2024-09-13T02:50:41.175 INFO:tasks.workunit.client.1.smithi122.stdout:0/50: stat d1/d5/d9/da/fb 0 2024-09-13T02:50:41.175 INFO:tasks.workunit.client.1.smithi122.stdout:9/109: dwrite d8/f10 [0,4194304] 0 2024-09-13T02:50:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:40 smithi100 ceph-mon[27894]: pgmap v251: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 239 MiB/s rd, 309 MiB/s wr, 740 op/s 2024-09-13T02:50:41.177 INFO:tasks.workunit.client.1.smithi122.stdout:9/110: mknod d8/c22 0 2024-09-13T02:50:41.177 INFO:tasks.workunit.client.1.smithi122.stdout:9/111: readlink d8/l18 0 2024-09-13T02:50:41.179 INFO:tasks.workunit.client.1.smithi122.stdout:9/112: rename d8/d16/d1d to d8/d16/d19/d23 0 2024-09-13T02:50:41.179 INFO:tasks.workunit.client.1.smithi122.stdout:9/113: readlink d8/l12 0 2024-09-13T02:50:41.181 INFO:tasks.workunit.client.1.smithi122.stdout:6/108: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:41.181 INFO:tasks.workunit.client.1.smithi122.stdout:9/114: mknod d8/d16/c24 0 2024-09-13T02:50:41.183 INFO:tasks.workunit.client.1.smithi122.stdout:2/54: write d0/f5 [3748771,18507] 0 2024-09-13T02:50:41.183 INFO:tasks.workunit.client.1.smithi122.stdout:8/26: dwrite f2 [0,4194304] 0 2024-09-13T02:50:41.183 INFO:tasks.workunit.client.1.smithi122.stdout:8/27: fdatasync f2 0 2024-09-13T02:50:41.183 INFO:tasks.workunit.client.1.smithi122.stdout:9/115: rename d8/ce to d8/d16/c25 0 2024-09-13T02:50:41.183 INFO:tasks.workunit.client.1.smithi122.stdout:8/28: dread d3/f4 [0,4194304] 0 2024-09-13T02:50:41.186 INFO:tasks.workunit.client.1.smithi122.stdout:2/55: rmdir d0 39 2024-09-13T02:50:41.187 INFO:tasks.workunit.client.1.smithi122.stdout:9/116: mknod d8/d16/c26 0 2024-09-13T02:50:41.188 INFO:tasks.workunit.client.1.smithi122.stdout:1/31: getdents . 0 2024-09-13T02:50:41.188 INFO:tasks.workunit.client.1.smithi122.stdout:1/32: getdents . 0 2024-09-13T02:50:41.188 INFO:tasks.workunit.client.1.smithi122.stdout:8/29: getdents d3 0 2024-09-13T02:50:41.189 INFO:tasks.workunit.client.1.smithi122.stdout:3/42: rename d4/d5 to d4/dc 0 2024-09-13T02:50:41.189 INFO:tasks.workunit.client.1.smithi122.stdout:3/43: write d4/dc/fb [476874,561] 0 2024-09-13T02:50:41.189 INFO:tasks.workunit.client.1.smithi122.stdout:3/44: chown d4/dc/fb 1 1 2024-09-13T02:50:41.191 INFO:tasks.workunit.client.1.smithi122.stdout:9/117: mknod d8/d16/c27 0 2024-09-13T02:50:41.191 INFO:tasks.workunit.client.1.smithi122.stdout:1/33: rename f9 to fa 0 2024-09-13T02:50:41.191 INFO:tasks.workunit.client.1.smithi122.stdout:3/45: mkdir d4/d9/dd 0 2024-09-13T02:50:41.193 INFO:tasks.workunit.client.1.smithi122.stdout:0/51: dwrite f0 [0,4194304] 0 2024-09-13T02:50:41.193 INFO:tasks.workunit.client.1.smithi122.stdout:0/52: chown d1/d5/d9/da/fb 5 1 2024-09-13T02:50:41.193 INFO:tasks.workunit.client.1.smithi122.stdout:0/53: read - d1/d5/d10/f14 zero size 2024-09-13T02:50:41.193 INFO:tasks.workunit.client.1.smithi122.stdout:1/34: creat fb x:0 0 0 2024-09-13T02:50:41.204 INFO:tasks.workunit.client.1.smithi122.stdout:0/54: dread d1/d5/d9/da/fb [0,4194304] 0 2024-09-13T02:50:41.204 INFO:tasks.workunit.client.1.smithi122.stdout:6/109: write d5/f8 [3096310,92325] 0 2024-09-13T02:50:41.205 INFO:tasks.workunit.client.1.smithi122.stdout:0/55: mknod d1/d5/d9/da/c16 0 2024-09-13T02:50:41.206 INFO:tasks.workunit.client.1.smithi122.stdout:1/35: dread f2 [0,4194304] 0 2024-09-13T02:50:41.207 INFO:tasks.workunit.client.1.smithi122.stdout:6/110: rename d5/db/dc/d1c to d5/db/d29 0 2024-09-13T02:50:41.208 INFO:tasks.workunit.client.1.smithi122.stdout:1/36: dread f2 [0,4194304] 0 2024-09-13T02:50:41.209 INFO:tasks.workunit.client.1.smithi122.stdout:6/111: unlink f3 0 2024-09-13T02:50:41.209 INFO:tasks.workunit.client.1.smithi122.stdout:6/112: truncate d5/dd/df/f24 554849 0 2024-09-13T02:50:41.211 INFO:tasks.workunit.client.1.smithi122.stdout:6/113: symlink d5/dd/l2a 0 2024-09-13T02:50:41.211 INFO:tasks.workunit.client.1.smithi122.stdout:6/114: chown d5/dd/df/d1a 0 1 2024-09-13T02:50:41.212 INFO:tasks.workunit.client.1.smithi122.stdout:6/115: mknod d5/dd/d21/c2b 0 2024-09-13T02:50:41.212 INFO:tasks.workunit.client.1.smithi122.stdout:6/116: readlink l2 0 2024-09-13T02:50:41.212 INFO:tasks.workunit.client.1.smithi122.stdout:6/117: stat d5/dd/d21/c2b 0 2024-09-13T02:50:41.215 INFO:tasks.workunit.client.1.smithi122.stdout:8/30: dwrite f2 [0,4194304] 0 2024-09-13T02:50:41.216 INFO:tasks.workunit.client.1.smithi122.stdout:8/31: dread d3/f4 [0,4194304] 0 2024-09-13T02:50:41.216 INFO:tasks.workunit.client.1.smithi122.stdout:8/32: truncate d3/f4 1576477 0 2024-09-13T02:50:41.218 INFO:tasks.workunit.client.1.smithi122.stdout:9/118: dwrite f6 [0,4194304] 0 2024-09-13T02:50:41.218 INFO:tasks.workunit.client.1.smithi122.stdout:8/33: creat d3/d5/f8 x:0 0 0 2024-09-13T02:50:41.218 INFO:tasks.workunit.client.1.smithi122.stdout:8/34: stat d3/f4 0 2024-09-13T02:50:41.220 INFO:tasks.workunit.client.1.smithi122.stdout:8/35: rename d3/f4 to d3/f9 0 2024-09-13T02:50:41.221 INFO:tasks.workunit.client.1.smithi122.stdout:0/56: write f0 [2253816,44620] 0 2024-09-13T02:50:41.237 INFO:tasks.workunit.client.1.smithi122.stdout:1/37: dwrite fb [0,4194304] 0 2024-09-13T02:50:41.237 INFO:tasks.workunit.client.1.smithi122.stdout:2/56: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:41.241 INFO:tasks.workunit.client.1.smithi122.stdout:0/57: dread f0 [0,4194304] 0 2024-09-13T02:50:41.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/58: unlink d1/l7 0 2024-09-13T02:50:41.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/59: readlink - no filename 2024-09-13T02:50:41.244 INFO:tasks.workunit.client.1.smithi122.stdout:6/118: dwrite d5/db/d29/f1d [0,4194304] 0 2024-09-13T02:50:41.244 INFO:tasks.workunit.client.1.smithi122.stdout:9/119: dwrite d8/f10 [4194304,4194304] 0 2024-09-13T02:50:41.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/119: write d5/db/f1b [219827,91230] 0 2024-09-13T02:50:41.246 INFO:tasks.workunit.client.1.smithi122.stdout:0/60: unlink d1/d5/d9/c6 0 2024-09-13T02:50:41.251 INFO:tasks.workunit.client.1.smithi122.stdout:6/120: mknod d5/db/dc/d25/c2c 0 2024-09-13T02:50:41.252 INFO:tasks.workunit.client.1.smithi122.stdout:8/36: rename d3/d5 to d3/da 0 2024-09-13T02:50:41.252 INFO:tasks.workunit.client.1.smithi122.stdout:0/61: dread f0 [0,4194304] 0 2024-09-13T02:50:41.253 INFO:tasks.workunit.client.1.smithi122.stdout:8/37: read d3/f9 [2262,33619] 0 2024-09-13T02:50:41.254 INFO:tasks.workunit.client.1.smithi122.stdout:0/62: mkdir d1/d5/d9/da/d17 0 2024-09-13T02:50:41.254 INFO:tasks.workunit.client.1.smithi122.stdout:0/63: truncate d1/d5/d9/da/ff 394965 0 2024-09-13T02:50:41.257 INFO:tasks.workunit.client.1.smithi122.stdout:0/64: link d1/d5/c12 d1/d5/c18 0 2024-09-13T02:50:41.257 INFO:tasks.workunit.client.1.smithi122.stdout:0/65: dread - d1/d5/f11 zero size 2024-09-13T02:50:41.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/66: link d1/d5/c18 d1/d5/d9/da/d17/c19 0 2024-09-13T02:50:41.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/67: write d1/d5/d9/da/ff [430662,55299] 0 2024-09-13T02:50:41.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/68: readlink - no filename 2024-09-13T02:50:41.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/69: fsync d1/d5/d9/da/fb 0 2024-09-13T02:50:41.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/70: creat d1/d5/f1a x:0 0 0 2024-09-13T02:50:41.260 INFO:tasks.workunit.client.1.smithi122.stdout:9/120: dwrite f6 [0,4194304] 0 2024-09-13T02:50:41.263 INFO:tasks.workunit.client.1.smithi122.stdout:6/121: getdents d5/db/dc/d25 0 2024-09-13T02:50:41.263 INFO:tasks.workunit.client.1.smithi122.stdout:6/122: chown d5/dd/l2a 283574506 1 2024-09-13T02:50:41.265 INFO:tasks.workunit.client.1.smithi122.stdout:9/121: creat d8/f28 x:0 0 0 2024-09-13T02:50:41.267 INFO:tasks.workunit.client.1.smithi122.stdout:9/122: mkdir d8/d16/d19/d29 0 2024-09-13T02:50:41.267 INFO:tasks.workunit.client.1.smithi122.stdout:9/123: write d8/f9 [5211453,128068] 0 2024-09-13T02:50:41.269 INFO:tasks.workunit.client.1.smithi122.stdout:9/124: link d8/f10 d8/d16/d19/d23/d1f/f2a 0 2024-09-13T02:50:41.270 INFO:tasks.workunit.client.1.smithi122.stdout:9/125: stat d8/d16/c27 0 2024-09-13T02:50:41.270 INFO:tasks.workunit.client.1.smithi122.stdout:9/126: creat d8/d16/f2b x:0 0 0 2024-09-13T02:50:41.270 INFO:tasks.workunit.client.1.smithi122.stdout:8/38: dwrite d3/da/f8 [0,4194304] 0 2024-09-13T02:50:41.274 INFO:tasks.workunit.client.1.smithi122.stdout:0/71: rmdir d1 39 2024-09-13T02:50:41.276 INFO:tasks.workunit.client.1.smithi122.stdout:8/39: rmdir d3 39 2024-09-13T02:50:41.276 INFO:tasks.workunit.client.1.smithi122.stdout:8/40: fdatasync d3/f9 0 2024-09-13T02:50:41.277 INFO:tasks.workunit.client.1.smithi122.stdout:8/41: mkdir d3/db 0 2024-09-13T02:50:41.277 INFO:tasks.workunit.client.1.smithi122.stdout:9/127: write d8/f9 [3742175,62549] 0 2024-09-13T02:50:41.277 INFO:tasks.workunit.client.1.smithi122.stdout:9/128: fdatasync d8/f10 0 2024-09-13T02:50:41.277 INFO:tasks.workunit.client.1.smithi122.stdout:8/42: write f2 [4930492,53937] 0 2024-09-13T02:50:41.277 INFO:tasks.workunit.client.1.smithi122.stdout:8/43: fdatasync d3/da/f8 0 2024-09-13T02:50:41.285 INFO:tasks.workunit.client.1.smithi122.stdout:6/123: dwrite d5/db/f17 [0,4194304] 0 2024-09-13T02:50:41.285 INFO:tasks.workunit.client.1.smithi122.stdout:9/129: write f6 [4863124,70761] 0 2024-09-13T02:50:41.285 INFO:tasks.workunit.client.1.smithi122.stdout:6/124: fdatasync d5/f8 0 2024-09-13T02:50:41.286 INFO:tasks.workunit.client.1.smithi122.stdout:9/130: getdents d8 0 2024-09-13T02:50:41.288 INFO:tasks.workunit.client.1.smithi122.stdout:9/131: getdents d8/d16 0 2024-09-13T02:50:41.288 INFO:tasks.workunit.client.1.smithi122.stdout:9/132: write d8/f1a [586270,99576] 0 2024-09-13T02:50:41.289 INFO:tasks.workunit.client.1.smithi122.stdout:9/133: unlink d8/d16/c25 0 2024-09-13T02:50:41.297 INFO:tasks.workunit.client.1.smithi122.stdout:9/134: read f6 [2648626,72568] 0 2024-09-13T02:50:41.299 INFO:tasks.workunit.client.1.smithi122.stdout:9/135: rename f2 to d8/d16/d19/f2c 0 2024-09-13T02:50:41.299 INFO:tasks.workunit.client.1.smithi122.stdout:8/44: write f2 [158603,31332] 0 2024-09-13T02:50:41.299 INFO:tasks.workunit.client.1.smithi122.stdout:0/72: dwrite d1/d5/f11 [0,4194304] 0 2024-09-13T02:50:41.300 INFO:tasks.workunit.client.1.smithi122.stdout:8/45: mkdir d3/da/dc 0 2024-09-13T02:50:41.301 INFO:tasks.workunit.client.1.smithi122.stdout:0/73: creat d1/d5/d9/da/d17/f1b x:0 0 0 2024-09-13T02:50:41.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/74: unlink d1/d5/f1a 0 2024-09-13T02:50:41.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/75: readlink - no filename 2024-09-13T02:50:41.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/76: chown d1/d5/d9/da/c16 86449 1 2024-09-13T02:50:41.311 INFO:tasks.workunit.client.1.smithi122.stdout:8/46: write d3/da/f8 [3593895,42441] 0 2024-09-13T02:50:41.312 INFO:tasks.workunit.client.1.smithi122.stdout:8/47: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:41.312 INFO:tasks.workunit.client.1.smithi122.stdout:8/48: stat f2 0 2024-09-13T02:50:41.316 INFO:tasks.workunit.client.1.smithi122.stdout:9/136: dwrite d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/125: dwrite d5/db/f1b [0,4194304] 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/126: readlink l2 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/127: unlink d5/dd/l2a 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/128: write d5/fe [3648463,124094] 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/129: chown d5/dd/df/f13 3676407 1 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/130: read d5/dd/df/f24 [158805,12221] 0 2024-09-13T02:50:41.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/131: fdatasync d5/db/f17 0 2024-09-13T02:50:41.323 INFO:tasks.workunit.client.1.smithi122.stdout:8/49: dread d3/da/f8 [0,4194304] 0 2024-09-13T02:50:41.323 INFO:tasks.workunit.client.1.smithi122.stdout:8/50: chown d3/da/dc 1610 1 2024-09-13T02:50:41.323 INFO:tasks.workunit.client.1.smithi122.stdout:8/51: write d3/f9 [1395538,6452] 0 2024-09-13T02:50:41.324 INFO:tasks.workunit.client.1.smithi122.stdout:8/52: rmdir d3/da/dc 0 2024-09-13T02:50:41.326 INFO:tasks.workunit.client.1.smithi122.stdout:0/77: dwrite d1/d5/fd [0,4194304] 0 2024-09-13T02:50:41.326 INFO:tasks.workunit.client.1.smithi122.stdout:0/78: truncate d1/d5/d9/da/d17/f1b 392053 0 2024-09-13T02:50:41.326 INFO:tasks.workunit.client.1.smithi122.stdout:8/53: rename d3/da/l7 to d3/ld 0 2024-09-13T02:50:41.331 INFO:tasks.workunit.client.1.smithi122.stdout:0/79: unlink d1/d5/d9/da/fb 0 2024-09-13T02:50:41.332 INFO:tasks.workunit.client.1.smithi122.stdout:9/137: dread f4 [0,4194304] 0 2024-09-13T02:50:41.334 INFO:tasks.workunit.client.1.smithi122.stdout:0/80: creat d1/d5/f1c x:0 0 0 2024-09-13T02:50:41.336 INFO:tasks.workunit.client.1.smithi122.stdout:0/81: read d1/d5/d9/da/ff [207235,102504] 0 2024-09-13T02:50:41.336 INFO:tasks.workunit.client.1.smithi122.stdout:0/82: stat d1/d5/d9/da/ff 0 2024-09-13T02:50:41.341 INFO:tasks.workunit.client.1.smithi122.stdout:0/83: mkdir d1/d5/d15/d1d 0 2024-09-13T02:50:41.341 INFO:tasks.workunit.client.1.smithi122.stdout:0/84: chown d1/d5/d9/da 1 1 2024-09-13T02:50:41.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/132: write d5/dd/df/f13 [1161305,81456] 0 2024-09-13T02:50:41.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/133: chown d5/fe 236 1 2024-09-13T02:50:41.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/134: fsync d5/fe 0 2024-09-13T02:50:41.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/135: fdatasync d5/dd/f22 0 2024-09-13T02:50:41.345 INFO:tasks.workunit.client.1.smithi122.stdout:0/85: link d1/d5/f1c d1/d5/f1e 0 2024-09-13T02:50:41.345 INFO:tasks.workunit.client.1.smithi122.stdout:0/86: write d1/d5/f13 [1004286,92651] 0 2024-09-13T02:50:41.346 INFO:tasks.workunit.client.1.smithi122.stdout:6/136: rmdir d5/dd/d21 39 2024-09-13T02:50:41.346 INFO:tasks.workunit.client.1.smithi122.stdout:6/137: readlink d5/la 0 2024-09-13T02:50:41.349 INFO:tasks.workunit.client.1.smithi122.stdout:8/54: dwrite f2 [0,4194304] 0 2024-09-13T02:50:41.349 INFO:tasks.workunit.client.1.smithi122.stdout:8/55: stat d3/da 0 2024-09-13T02:50:41.350 INFO:tasks.workunit.client.1.smithi122.stdout:8/56: fsync f2 0 2024-09-13T02:50:41.350 INFO:tasks.workunit.client.1.smithi122.stdout:8/57: getdents d3/db 0 2024-09-13T02:50:41.350 INFO:tasks.workunit.client.1.smithi122.stdout:8/58: chown d3/f9 53 1 2024-09-13T02:50:41.350 INFO:tasks.workunit.client.1.smithi122.stdout:8/59: chown d3 27752087 1 2024-09-13T02:50:41.351 INFO:tasks.workunit.client.1.smithi122.stdout:6/138: read d5/db/f14 [31293,127413] 0 2024-09-13T02:50:41.351 INFO:tasks.workunit.client.1.smithi122.stdout:6/139: readlink d5/d11/l1e 0 2024-09-13T02:50:41.351 INFO:tasks.workunit.client.1.smithi122.stdout:6/140: dread - d5/dd/f22 zero size 2024-09-13T02:50:41.352 INFO:tasks.workunit.client.1.smithi122.stdout:6/141: truncate d5/f8 3846382 0 2024-09-13T02:50:41.353 INFO:tasks.workunit.client.1.smithi122.stdout:6/142: write d5/dd/f22 [1045367,44845] 0 2024-09-13T02:50:41.355 INFO:tasks.workunit.client.1.smithi122.stdout:6/143: rename f4 to d5/dd/f2d 0 2024-09-13T02:50:41.361 INFO:tasks.workunit.client.1.smithi122.stdout:6/144: fsync d5/f8 0 2024-09-13T02:50:41.369 INFO:tasks.workunit.client.1.smithi122.stdout:0/87: dwrite d1/d5/f11 [0,4194304] 0 2024-09-13T02:50:41.371 INFO:tasks.workunit.client.1.smithi122.stdout:8/60: dwrite d3/da/f8 [4194304,4194304] 0 2024-09-13T02:50:41.385 INFO:tasks.workunit.client.1.smithi122.stdout:6/145: dwrite d5/db/f17 [0,4194304] 0 2024-09-13T02:50:41.385 INFO:tasks.workunit.client.1.smithi122.stdout:6/146: stat d5/d11/l1e 0 2024-09-13T02:50:41.386 INFO:tasks.workunit.client.1.smithi122.stdout:6/147: symlink d5/dd/df/d26/l2e 0 2024-09-13T02:50:41.387 INFO:tasks.workunit.client.1.smithi122.stdout:6/148: truncate d5/dd/df/f24 1558730 0 2024-09-13T02:50:41.387 INFO:tasks.workunit.client.1.smithi122.stdout:0/88: dwrite d1/d5/d9/da/d17/f1b [0,4194304] 0 2024-09-13T02:50:41.387 INFO:tasks.workunit.client.1.smithi122.stdout:0/89: dread - d1/d5/d10/f14 zero size 2024-09-13T02:50:41.388 INFO:tasks.workunit.client.1.smithi122.stdout:0/90: link d1/d5/f1c d1/d5/d15/d1d/f1f 0 2024-09-13T02:50:41.389 INFO:tasks.workunit.client.1.smithi122.stdout:0/91: dread - d1/d5/f1e zero size 2024-09-13T02:50:41.391 INFO:tasks.workunit.client.1.smithi122.stdout:6/149: write d5/fe [5848258,41432] 0 2024-09-13T02:50:41.393 INFO:tasks.workunit.client.1.smithi122.stdout:6/150: dread d5/f9 [0,4194304] 0 2024-09-13T02:50:41.395 INFO:tasks.workunit.client.1.smithi122.stdout:6/151: mkdir d5/d11/d2f 0 2024-09-13T02:50:41.396 INFO:tasks.workunit.client.1.smithi122.stdout:6/152: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:41.404 INFO:tasks.workunit.client.1.smithi122.stdout:6/153: read d5/db/f17 [2275343,50435] 0 2024-09-13T02:50:41.405 INFO:tasks.workunit.client.1.smithi122.stdout:6/154: mknod d5/c30 0 2024-09-13T02:50:41.406 INFO:tasks.workunit.client.1.smithi122.stdout:6/155: mknod d5/c31 0 2024-09-13T02:50:41.407 INFO:tasks.workunit.client.1.smithi122.stdout:6/156: write d5/dd/df/f13 [467050,107699] 0 2024-09-13T02:50:41.407 INFO:tasks.workunit.client.1.smithi122.stdout:6/157: readlink d5/dd/df/l28 0 2024-09-13T02:50:41.408 INFO:tasks.workunit.client.1.smithi122.stdout:6/158: creat d5/db/d29/f32 x:0 0 0 2024-09-13T02:50:41.409 INFO:tasks.workunit.client.1.smithi122.stdout:6/159: write d5/dd/df/f20 [402479,94959] 0 2024-09-13T02:50:41.410 INFO:tasks.workunit.client.1.smithi122.stdout:6/160: stat l2 0 2024-09-13T02:50:41.429 INFO:tasks.workunit.client.1.smithi122.stdout:6/161: dwrite d5/db/d29/f1d [0,4194304] 0 2024-09-13T02:50:41.429 INFO:tasks.workunit.client.1.smithi122.stdout:6/162: truncate d5/db/d29/f1d 5157778 0 2024-09-13T02:50:41.440 INFO:tasks.workunit.client.1.smithi122.stdout:6/163: read d5/db/d29/f1d [1875696,42399] 0 2024-09-13T02:50:41.462 INFO:tasks.workunit.client.1.smithi122.stdout:6/164: dwrite d5/db/d29/f1d [0,4194304] 0 2024-09-13T02:50:41.464 INFO:tasks.workunit.client.1.smithi122.stdout:6/165: rename d5/dd/df/d1a to d5/d11/d33 0 2024-09-13T02:50:41.465 INFO:tasks.workunit.client.1.smithi122.stdout:6/166: truncate d5/dd/f22 322883 0 2024-09-13T02:50:41.465 INFO:tasks.workunit.client.1.smithi122.stdout:6/167: stat d5/db/dc/d25 0 2024-09-13T02:50:41.465 INFO:tasks.workunit.client.1.smithi122.stdout:6/168: readlink d5/dd/df/l28 0 2024-09-13T02:50:41.466 INFO:tasks.workunit.client.1.smithi122.stdout:6/169: unlink d5/dd/df/l28 0 2024-09-13T02:50:42.273 INFO:tasks.workunit.client.1.smithi122.stdout:4/81: sync 2024-09-13T02:50:42.287 INFO:tasks.workunit.client.1.smithi122.stdout:4/82: dwrite d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:42.289 INFO:tasks.workunit.client.1.smithi122.stdout:4/83: creat d11/d13/d14/f19 x:0 0 0 2024-09-13T02:50:42.302 INFO:tasks.workunit.client.1.smithi122.stdout:4/84: dwrite d11/d13/d14/f19 [0,4194304] 0 2024-09-13T02:50:42.302 INFO:tasks.workunit.client.1.smithi122.stdout:4/85: stat d11 0 2024-09-13T02:50:42.303 INFO:tasks.workunit.client.1.smithi122.stdout:4/86: chown d11/d13/d14/f16 16 1 2024-09-13T02:50:42.320 INFO:tasks.workunit.client.1.smithi122.stdout:4/87: dwrite d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:42.321 INFO:tasks.workunit.client.1.smithi122.stdout:4/88: creat d11/d13/f1a x:0 0 0 2024-09-13T02:50:42.322 INFO:tasks.workunit.client.1.smithi122.stdout:4/89: mkdir d11/d1b 0 2024-09-13T02:50:42.322 INFO:tasks.workunit.client.1.smithi122.stdout:4/90: stat d11 0 2024-09-13T02:50:42.330 INFO:tasks.workunit.client.1.smithi122.stdout:4/91: write d11/d13/d14/f16 [1133339,56017] 0 2024-09-13T02:50:42.331 INFO:tasks.workunit.client.1.smithi122.stdout:4/92: creat d11/d1b/f1c x:0 0 0 2024-09-13T02:50:42.331 INFO:tasks.workunit.client.1.smithi122.stdout:4/93: symlink d11/d1b/l1d 0 2024-09-13T02:50:42.332 INFO:tasks.workunit.client.1.smithi122.stdout:4/94: symlink d11/l1e 0 2024-09-13T02:50:42.345 INFO:tasks.workunit.client.1.smithi122.stdout:4/95: dwrite d11/d13/d14/f19 [0,4194304] 0 2024-09-13T02:50:42.507 INFO:tasks.workunit.client.1.smithi122.stdout:7/50: sync 2024-09-13T02:50:42.507 INFO:tasks.workunit.client.1.smithi122.stdout:5/98: sync 2024-09-13T02:50:42.507 INFO:tasks.workunit.client.1.smithi122.stdout:5/99: chown d0/d17/f18 6797 1 2024-09-13T02:50:42.507 INFO:tasks.workunit.client.1.smithi122.stdout:7/51: write d4/d8/db/f11 [356686,32514] 0 2024-09-13T02:50:42.507 INFO:tasks.workunit.client.1.smithi122.stdout:5/100: creat d0/d2/f20 x:0 0 0 2024-09-13T02:50:42.509 INFO:tasks.workunit.client.1.smithi122.stdout:5/101: rename d0/d1c to d0/d2/d21 0 2024-09-13T02:50:42.509 INFO:tasks.workunit.client.1.smithi122.stdout:5/102: fsync d0/d2/f1b 0 2024-09-13T02:50:42.509 INFO:tasks.workunit.client.1.smithi122.stdout:5/103: creat d0/d17/f22 x:0 0 0 2024-09-13T02:50:42.510 INFO:tasks.workunit.client.1.smithi122.stdout:5/104: creat d0/da/f23 x:0 0 0 2024-09-13T02:50:42.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/105: creat d0/d2/d21/f24 x:0 0 0 2024-09-13T02:50:42.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/106: fsync d0/d2/f1b 0 2024-09-13T02:50:42.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/107: chown d0/da/f23 15079675 1 2024-09-13T02:50:42.533 INFO:tasks.workunit.client.1.smithi122.stdout:7/52: dwrite d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:42.533 INFO:tasks.workunit.client.1.smithi122.stdout:5/108: dwrite d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:42.535 INFO:tasks.workunit.client.1.smithi122.stdout:5/109: mkdir d0/d2/d21/d25 0 2024-09-13T02:50:42.535 INFO:tasks.workunit.client.1.smithi122.stdout:5/110: symlink d0/d2/d21/d25/l26 0 2024-09-13T02:50:42.536 INFO:tasks.workunit.client.1.smithi122.stdout:5/111: mkdir d0/d2/d27 0 2024-09-13T02:50:42.568 INFO:tasks.workunit.client.1.smithi122.stdout:5/112: dwrite d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:42.568 INFO:tasks.workunit.client.1.smithi122.stdout:7/53: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:42.570 INFO:tasks.workunit.client.1.smithi122.stdout:7/54: getdents d4/d8 0 2024-09-13T02:50:42.570 INFO:tasks.workunit.client.1.smithi122.stdout:7/55: mknod d4/d8/db/dc/c12 0 2024-09-13T02:50:42.572 INFO:tasks.workunit.client.1.smithi122.stdout:7/56: getdents d4/d8/db 0 2024-09-13T02:50:42.572 INFO:tasks.workunit.client.1.smithi122.stdout:7/57: write d4/fd [800182,54905] 0 2024-09-13T02:50:42.573 INFO:tasks.workunit.client.1.smithi122.stdout:7/58: mkdir d4/d8/db/dc/d13 0 2024-09-13T02:50:42.574 INFO:tasks.workunit.client.1.smithi122.stdout:7/59: rmdir d4/d8/db/dc/d13 0 2024-09-13T02:50:42.577 INFO:tasks.workunit.client.1.smithi122.stdout:5/113: write d0/d17/f22 [93192,96656] 0 2024-09-13T02:50:42.577 INFO:tasks.workunit.client.1.smithi122.stdout:5/114: write d0/f7 [401288,126980] 0 2024-09-13T02:50:42.578 INFO:tasks.workunit.client.1.smithi122.stdout:5/115: creat d0/d17/f28 x:0 0 0 2024-09-13T02:50:42.629 INFO:tasks.workunit.client.1.smithi122.stdout:1/38: sync 2024-09-13T02:50:42.629 INFO:tasks.workunit.client.1.smithi122.stdout:3/46: sync 2024-09-13T02:50:42.643 INFO:tasks.workunit.client.1.smithi122.stdout:1/39: unlink l6 0 2024-09-13T02:50:42.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/47: mkdir d4/d6/de 0 2024-09-13T02:50:42.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/48: fsync d4/d6/f8 0 2024-09-13T02:50:42.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/49: dread - d4/d6/fa zero size 2024-09-13T02:50:42.645 INFO:tasks.workunit.client.1.smithi122.stdout:1/40: mkdir dc 0 2024-09-13T02:50:42.678 INFO:tasks.workunit.client.1.smithi122.stdout:1/41: dwrite fb [0,4194304] 0 2024-09-13T02:50:42.681 INFO:tasks.workunit.client.1.smithi122.stdout:1/42: creat dc/fd x:0 0 0 2024-09-13T02:50:42.684 INFO:tasks.workunit.client.1.smithi122.stdout:1/43: mkdir dc/de 0 2024-09-13T02:50:42.684 INFO:tasks.workunit.client.1.smithi122.stdout:1/44: creat dc/ff x:0 0 0 2024-09-13T02:50:42.684 INFO:tasks.workunit.client.1.smithi122.stdout:1/45: creat dc/f10 x:0 0 0 2024-09-13T02:50:42.684 INFO:tasks.workunit.client.1.smithi122.stdout:1/46: dread - dc/f10 zero size 2024-09-13T02:50:42.688 INFO:tasks.workunit.client.1.smithi122.stdout:3/50: dwrite d4/dc/fb [0,4194304] 0 2024-09-13T02:50:42.688 INFO:tasks.workunit.client.1.smithi122.stdout:3/51: fsync d4/d6/f8 0 2024-09-13T02:50:42.689 INFO:tasks.workunit.client.1.smithi122.stdout:1/47: rename f1 to dc/de/f11 0 2024-09-13T02:50:42.693 INFO:tasks.workunit.client.1.smithi122.stdout:3/52: mkdir d4/d6/df 0 2024-09-13T02:50:42.695 INFO:tasks.workunit.client.1.smithi122.stdout:1/48: fsync fb 0 2024-09-13T02:50:42.696 INFO:tasks.workunit.client.1.smithi122.stdout:3/53: creat d4/dc/f10 x:0 0 0 2024-09-13T02:50:42.696 INFO:tasks.workunit.client.1.smithi122.stdout:3/54: write d4/dc/fb [4888088,28498] 0 2024-09-13T02:50:42.697 INFO:tasks.workunit.client.1.smithi122.stdout:1/49: creat dc/de/f12 x:0 0 0 2024-09-13T02:50:42.697 INFO:tasks.workunit.client.1.smithi122.stdout:1/50: write dc/de/f11 [215467,35021] 0 2024-09-13T02:50:42.698 INFO:tasks.workunit.client.1.smithi122.stdout:3/55: rename d4/d9 to d4/d11 0 2024-09-13T02:50:42.698 INFO:tasks.workunit.client.1.smithi122.stdout:3/56: chown d4/dc/fb 44096987 1 2024-09-13T02:50:42.698 INFO:tasks.workunit.client.1.smithi122.stdout:1/51: truncate fa 1069065 0 2024-09-13T02:50:42.699 INFO:tasks.workunit.client.1.smithi122.stdout:3/57: mkdir d4/d11/dd/d12 0 2024-09-13T02:50:42.699 INFO:tasks.workunit.client.1.smithi122.stdout:3/58: chown d4/d6/df 294179 1 2024-09-13T02:50:42.700 INFO:tasks.workunit.client.1.smithi122.stdout:3/59: rename d4/d6/fa to d4/d6/df/f13 0 2024-09-13T02:50:42.706 INFO:tasks.workunit.client.1.smithi122.stdout:1/52: rmdir dc 39 2024-09-13T02:50:42.709 INFO:tasks.workunit.client.1.smithi122.stdout:1/53: mkdir dc/de/d13 0 2024-09-13T02:50:42.712 INFO:tasks.workunit.client.1.smithi122.stdout:1/54: dread f0 [0,4194304] 0 2024-09-13T02:50:42.714 INFO:tasks.workunit.client.1.smithi122.stdout:1/55: link l5 dc/de/d13/l14 0 2024-09-13T02:50:42.714 INFO:tasks.workunit.client.1.smithi122.stdout:1/56: read f0 [2797952,73968] 0 2024-09-13T02:50:42.719 INFO:tasks.workunit.client.1.smithi122.stdout:3/60: dwrite f3 [4194304,4194304] 0 2024-09-13T02:50:42.720 INFO:tasks.workunit.client.1.smithi122.stdout:3/61: symlink d4/d11/dd/l14 0 2024-09-13T02:50:42.721 INFO:tasks.workunit.client.1.smithi122.stdout:3/62: rename d4/d11/dd/d12 to d4/d6/df/d15 0 2024-09-13T02:50:42.721 INFO:tasks.workunit.client.1.smithi122.stdout:3/63: creat d4/d6/f16 x:0 0 0 2024-09-13T02:50:42.725 INFO:tasks.workunit.client.1.smithi122.stdout:1/57: write fb [1339423,76309] 0 2024-09-13T02:50:42.726 INFO:tasks.workunit.client.1.smithi122.stdout:1/58: symlink dc/l15 0 2024-09-13T02:50:42.731 INFO:tasks.workunit.client.1.smithi122.stdout:1/59: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:42.734 INFO:tasks.workunit.client.1.smithi122.stdout:1/60: dread f0 [0,4194304] 0 2024-09-13T02:50:42.735 INFO:tasks.workunit.client.1.smithi122.stdout:1/61: creat dc/f16 x:0 0 0 2024-09-13T02:50:42.736 INFO:tasks.workunit.client.1.smithi122.stdout:1/62: mkdir dc/de/d13/d17 0 2024-09-13T02:50:42.742 INFO:tasks.workunit.client.1.smithi122.stdout:3/64: dwrite d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.742 INFO:tasks.workunit.client.1.smithi122.stdout:3/65: stat d4/d6/df 0 2024-09-13T02:50:42.742 INFO:tasks.workunit.client.1.smithi122.stdout:3/66: write d4/dc/f10 [401931,93594] 0 2024-09-13T02:50:42.747 INFO:tasks.workunit.client.1.smithi122.stdout:3/67: symlink d4/d11/l17 0 2024-09-13T02:50:42.749 INFO:tasks.workunit.client.1.smithi122.stdout:1/63: rmdir dc 39 2024-09-13T02:50:42.749 INFO:tasks.workunit.client.1.smithi122.stdout:1/64: write f0 [1001735,71552] 0 2024-09-13T02:50:42.749 INFO:tasks.workunit.client.1.smithi122.stdout:3/68: fsync d4/dc/f10 0 2024-09-13T02:50:42.776 INFO:tasks.workunit.client.1.smithi122.stdout:3/69: dwrite d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.778 INFO:tasks.workunit.client.1.smithi122.stdout:1/65: dwrite f0 [0,4194304] 0 2024-09-13T02:50:42.779 INFO:tasks.workunit.client.1.smithi122.stdout:1/66: getdents dc/de 0 2024-09-13T02:50:42.779 INFO:tasks.workunit.client.1.smithi122.stdout:1/67: readlink l5 0 2024-09-13T02:50:42.779 INFO:tasks.workunit.client.1.smithi122.stdout:1/68: mkdir dc/de/d18 0 2024-09-13T02:50:42.781 INFO:tasks.workunit.client.1.smithi122.stdout:1/69: unlink c8 0 2024-09-13T02:50:42.781 INFO:tasks.workunit.client.1.smithi122.stdout:1/70: dread - dc/f10 zero size 2024-09-13T02:50:42.782 INFO:tasks.workunit.client.1.smithi122.stdout:1/71: rename dc/l15 to dc/de/d13/l19 0 2024-09-13T02:50:42.782 INFO:tasks.workunit.client.1.smithi122.stdout:1/72: fdatasync dc/f16 0 2024-09-13T02:50:42.783 INFO:tasks.workunit.client.1.smithi122.stdout:1/73: creat dc/f1a x:0 0 0 2024-09-13T02:50:42.783 INFO:tasks.workunit.client.1.smithi122.stdout:1/74: write dc/de/f12 [702991,107933] 0 2024-09-13T02:50:42.784 INFO:tasks.workunit.client.1.smithi122.stdout:1/75: symlink dc/de/l1b 0 2024-09-13T02:50:42.784 INFO:tasks.workunit.client.1.smithi122.stdout:1/76: rmdir dc/de 39 2024-09-13T02:50:42.786 INFO:tasks.workunit.client.1.smithi122.stdout:1/77: mkdir dc/de/d13/d17/d1c 0 2024-09-13T02:50:42.786 INFO:tasks.workunit.client.1.smithi122.stdout:1/78: fsync dc/ff 0 2024-09-13T02:50:42.786 INFO:tasks.workunit.client.1.smithi122.stdout:1/79: mkdir dc/de/d18/d1d 0 2024-09-13T02:50:42.786 INFO:tasks.workunit.client.1.smithi122.stdout:1/80: rename dc to dc/de/d18/d1e 22 2024-09-13T02:50:42.787 INFO:tasks.workunit.client.1.smithi122.stdout:1/81: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:42.788 INFO:tasks.workunit.client.1.smithi122.stdout:3/70: dread d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.789 INFO:tasks.workunit.client.1.smithi122.stdout:3/71: link d4/dc/fb d4/d6/de/f18 0 2024-09-13T02:50:42.790 INFO:tasks.workunit.client.1.smithi122.stdout:3/72: symlink d4/d6/de/l19 0 2024-09-13T02:50:42.790 INFO:tasks.workunit.client.1.smithi122.stdout:3/73: getdents d4/d11/dd 0 2024-09-13T02:50:42.794 INFO:tasks.workunit.client.1.smithi122.stdout:1/82: truncate dc/de/f12 756671 0 2024-09-13T02:50:42.798 INFO:tasks.workunit.client.1.smithi122.stdout:3/74: dread d4/d6/f8 [4194304,4194304] 0 2024-09-13T02:50:42.820 INFO:tasks.workunit.client.1.smithi122.stdout:1/83: dwrite dc/de/f11 [0,4194304] 0 2024-09-13T02:50:42.820 INFO:tasks.workunit.client.1.smithi122.stdout:1/84: write dc/f1a [514322,35749] 0 2024-09-13T02:50:42.820 INFO:tasks.workunit.client.1.smithi122.stdout:1/85: stat dc/de/d13/d17 0 2024-09-13T02:50:42.820 INFO:tasks.workunit.client.1.smithi122.stdout:1/86: write fb [4847300,89546] 0 2024-09-13T02:50:42.821 INFO:tasks.workunit.client.1.smithi122.stdout:3/75: dwrite d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.822 INFO:tasks.workunit.client.1.smithi122.stdout:1/87: creat dc/de/d18/d1d/f1f x:0 0 0 2024-09-13T02:50:42.824 INFO:tasks.workunit.client.1.smithi122.stdout:3/76: mknod d4/dc/c1a 0 2024-09-13T02:50:42.825 INFO:tasks.workunit.client.1.smithi122.stdout:1/88: rename dc/de/f12 to dc/de/d13/d17/f20 0 2024-09-13T02:50:42.826 INFO:tasks.workunit.client.1.smithi122.stdout:1/89: truncate dc/de/f11 452010 0 2024-09-13T02:50:42.827 INFO:tasks.workunit.client.1.smithi122.stdout:1/90: mknod dc/de/d13/c21 0 2024-09-13T02:50:42.830 INFO:tasks.workunit.client.1.smithi122.stdout:2/57: sync 2024-09-13T02:50:42.830 INFO:tasks.workunit.client.1.smithi122.stdout:1/91: read fb [4429741,42305] 0 2024-09-13T02:50:42.830 INFO:tasks.workunit.client.1.smithi122.stdout:1/92: dread - dc/f16 zero size 2024-09-13T02:50:42.830 INFO:tasks.workunit.client.1.smithi122.stdout:2/58: truncate d0/f5 6477990 0 2024-09-13T02:50:42.831 INFO:tasks.workunit.client.1.smithi122.stdout:2/59: truncate d0/f4 3756376 0 2024-09-13T02:50:42.832 INFO:tasks.workunit.client.1.smithi122.stdout:2/60: chown d0/fc 258484 1 2024-09-13T02:50:42.835 INFO:tasks.workunit.client.1.smithi122.stdout:3/77: dwrite f3 [8388608,4194304] 0 2024-09-13T02:50:42.836 INFO:tasks.workunit.client.1.smithi122.stdout:1/93: rename dc/de/d13/d17 to dc/de/d18/d22 0 2024-09-13T02:50:42.837 INFO:tasks.workunit.client.1.smithi122.stdout:1/94: unlink dc/ff 0 2024-09-13T02:50:42.859 INFO:tasks.workunit.client.1.smithi122.stdout:3/78: dwrite d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.860 INFO:tasks.workunit.client.1.smithi122.stdout:2/61: dwrite d0/f5 [0,4194304] 0 2024-09-13T02:50:42.869 INFO:tasks.workunit.client.1.smithi122.stdout:3/79: dread d4/d6/f8 [0,4194304] 0 2024-09-13T02:50:42.877 INFO:tasks.workunit.client.1.smithi122.stdout:2/62: dwrite d0/f4 [0,4194304] 0 2024-09-13T02:50:42.877 INFO:tasks.workunit.client.1.smithi122.stdout:2/63: chown d0/c6 0 1 2024-09-13T02:50:42.881 INFO:tasks.workunit.client.1.smithi122.stdout:3/80: dread d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.882 INFO:tasks.workunit.client.1.smithi122.stdout:3/81: creat d4/d11/dd/f1b x:0 0 0 2024-09-13T02:50:42.883 INFO:tasks.workunit.client.1.smithi122.stdout:3/82: symlink d4/d11/dd/l1c 0 2024-09-13T02:50:42.884 INFO:tasks.workunit.client.1.smithi122.stdout:3/83: symlink d4/d11/l1d 0 2024-09-13T02:50:42.898 INFO:tasks.workunit.client.1.smithi122.stdout:3/84: dwrite d4/dc/fb [0,4194304] 0 2024-09-13T02:50:42.900 INFO:tasks.workunit.client.1.smithi122.stdout:3/85: unlink d4/dc/fb 0 2024-09-13T02:50:42.901 INFO:tasks.workunit.client.1.smithi122.stdout:3/86: read d4/dc/f10 [309723,29908] 0 2024-09-13T02:50:42.901 INFO:tasks.workunit.client.1.smithi122.stdout:3/87: creat d4/d11/dd/f1e x:0 0 0 2024-09-13T02:50:42.904 INFO:tasks.workunit.client.1.smithi122.stdout:3/88: read d4/d6/f8 [1772547,14976] 0 2024-09-13T02:50:42.905 INFO:tasks.workunit.client.1.smithi122.stdout:3/89: mkdir d4/d6/de/d1f 0 2024-09-13T02:50:42.905 INFO:tasks.workunit.client.1.smithi122.stdout:3/90: creat d4/dc/f20 x:0 0 0 2024-09-13T02:50:42.912 INFO:tasks.workunit.client.1.smithi122.stdout:3/91: write f3 [2593165,26409] 0 2024-09-13T02:50:42.912 INFO:tasks.workunit.client.1.smithi122.stdout:3/92: write d4/dc/f10 [200958,85024] 0 2024-09-13T02:50:42.912 INFO:tasks.workunit.client.1.smithi122.stdout:3/93: write d4/d6/f8 [8804486,100493] 0 2024-09-13T02:50:42.913 INFO:tasks.workunit.client.1.smithi122.stdout:3/94: mkdir d4/d11/dd/d21 0 2024-09-13T02:50:42.913 INFO:tasks.workunit.client.1.smithi122.stdout:3/95: symlink d4/d11/l22 0 2024-09-13T02:50:42.914 INFO:tasks.workunit.client.1.smithi122.stdout:3/96: mknod d4/d11/dd/c23 0 2024-09-13T02:50:42.914 INFO:tasks.workunit.client.1.smithi122.stdout:3/97: symlink d4/d6/df/l24 0 2024-09-13T02:50:42.915 INFO:tasks.workunit.client.1.smithi122.stdout:3/98: creat d4/d6/f25 x:0 0 0 2024-09-13T02:50:42.915 INFO:tasks.workunit.client.1.smithi122.stdout:3/99: stat d4/d11/dd/c23 0 2024-09-13T02:50:42.915 INFO:tasks.workunit.client.1.smithi122.stdout:3/100: symlink d4/dc/l26 0 2024-09-13T02:50:42.916 INFO:tasks.workunit.client.1.smithi122.stdout:3/101: write d4/dc/f20 [36568,20421] 0 2024-09-13T02:50:42.916 INFO:tasks.workunit.client.1.smithi122.stdout:3/102: mknod d4/d6/df/c27 0 2024-09-13T02:50:42.920 INFO:tasks.workunit.client.1.smithi122.stdout:3/103: dread d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.921 INFO:tasks.workunit.client.1.smithi122.stdout:3/104: unlink d4/d11/dd/f1e 0 2024-09-13T02:50:42.941 INFO:tasks.workunit.client.1.smithi122.stdout:3/105: dwrite d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:42.957 INFO:tasks.workunit.client.1.smithi122.stdout:3/106: dwrite d4/d6/f25 [0,4194304] 0 2024-09-13T02:50:42.957 INFO:tasks.workunit.client.1.smithi122.stdout:3/107: creat d4/d11/dd/d21/f28 x:0 0 0 2024-09-13T02:50:42.957 INFO:tasks.workunit.client.1.smithi122.stdout:3/108: mknod d4/c29 0 2024-09-13T02:50:42.959 INFO:tasks.workunit.client.1.smithi122.stdout:3/109: dread d4/d6/df/f13 [0,4194304] 0 2024-09-13T02:50:42.964 INFO:tasks.workunit.client.1.smithi122.stdout:3/110: dread d4/d6/f8 [0,4194304] 0 2024-09-13T02:50:42.965 INFO:tasks.workunit.client.1.smithi122.stdout:8/61: sync 2024-09-13T02:50:42.966 INFO:tasks.workunit.client.1.smithi122.stdout:9/138: sync 2024-09-13T02:50:42.966 INFO:tasks.workunit.client.1.smithi122.stdout:9/139: getdents d8/d16/d19 0 2024-09-13T02:50:42.966 INFO:tasks.workunit.client.1.smithi122.stdout:9/140: readlink d8/l18 0 2024-09-13T02:50:42.971 INFO:tasks.workunit.client.1.smithi122.stdout:9/141: dread f4 [0,4194304] 0 2024-09-13T02:50:42.971 INFO:tasks.workunit.client.1.smithi122.stdout:9/142: fdatasync d8/f9 0 2024-09-13T02:50:42.973 INFO:tasks.workunit.client.1.smithi122.stdout:9/143: unlink d8/c13 0 2024-09-13T02:50:42.973 INFO:tasks.workunit.client.1.smithi122.stdout:9/144: readlink d8/d16/l1e 0 2024-09-13T02:50:42.974 INFO:tasks.workunit.client.1.smithi122.stdout:3/111: write d4/d6/f25 [1568137,10363] 0 2024-09-13T02:50:42.974 INFO:tasks.workunit.client.1.smithi122.stdout:3/112: creat d4/dc/f2a x:0 0 0 2024-09-13T02:50:42.975 INFO:tasks.workunit.client.1.smithi122.stdout:8/62: dread f2 [0,4194304] 0 2024-09-13T02:50:42.975 INFO:tasks.workunit.client.1.smithi122.stdout:8/63: chown d3/da/f8 1004 1 2024-09-13T02:50:42.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/113: mkdir d4/d11/dd/d21/d2b 0 2024-09-13T02:50:42.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/114: dread - d4/d11/dd/d21/f28 zero size 2024-09-13T02:50:42.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/64: mknod d3/da/ce 0 2024-09-13T02:50:42.976 INFO:tasks.workunit.client.1.smithi122.stdout:3/115: unlink d4/dc/c1a 0 2024-09-13T02:50:42.981 INFO:tasks.workunit.client.1.smithi122.stdout:8/65: write f2 [391200,55520] 0 2024-09-13T02:50:42.981 INFO:tasks.workunit.client.1.smithi122.stdout:9/145: dread d8/d16/d19/f2c [0,4194304] 0 2024-09-13T02:50:42.983 INFO:tasks.workunit.client.1.smithi122.stdout:8/66: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:42.992 INFO:tasks.workunit.client.1.smithi122.stdout:8/67: dread d3/da/f8 [0,4194304] 0 2024-09-13T02:50:42.995 INFO:tasks.workunit.client.1.smithi122.stdout:9/146: dread d8/f9 [0,4194304] 0 2024-09-13T02:50:42.996 INFO:tasks.workunit.client.1.smithi122.stdout:9/147: creat d8/d16/d19/d23/d1f/f2d x:0 0 0 2024-09-13T02:50:43.001 INFO:tasks.workunit.client.1.smithi122.stdout:3/116: dwrite d4/d6/f16 [0,4194304] 0 2024-09-13T02:50:43.013 INFO:tasks.workunit.client.1.smithi122.stdout:3/117: dread f3 [8388608,4194304] 0 2024-09-13T02:50:43.016 INFO:tasks.workunit.client.1.smithi122.stdout:3/118: symlink d4/d6/de/d1f/l2c 0 2024-09-13T02:50:43.016 INFO:tasks.workunit.client.1.smithi122.stdout:8/68: dwrite d3/da/f8 [4194304,4194304] 0 2024-09-13T02:50:43.017 INFO:tasks.workunit.client.1.smithi122.stdout:8/69: write d3/f9 [1852168,30097] 0 2024-09-13T02:50:43.017 INFO:tasks.workunit.client.1.smithi122.stdout:3/119: rename d4/d6/df/f13 to d4/d11/f2d 0 2024-09-13T02:50:43.019 INFO:tasks.workunit.client.1.smithi122.stdout:3/120: creat d4/d11/f2e x:0 0 0 2024-09-13T02:50:43.019 INFO:tasks.workunit.client.1.smithi122.stdout:3/121: fsync f3 0 2024-09-13T02:50:43.019 INFO:tasks.workunit.client.1.smithi122.stdout:3/122: stat d4/d11/dd/d21/f28 0 2024-09-13T02:50:43.020 INFO:tasks.workunit.client.1.smithi122.stdout:9/148: dwrite d8/f9 [0,4194304] 0 2024-09-13T02:50:43.022 INFO:tasks.workunit.client.1.smithi122.stdout:3/123: creat d4/d11/dd/d21/d2b/f2f x:0 0 0 2024-09-13T02:50:43.029 INFO:tasks.workunit.client.1.smithi122.stdout:9/149: creat d8/f2e x:0 0 0 2024-09-13T02:50:43.029 INFO:tasks.workunit.client.1.smithi122.stdout:9/150: stat c7 0 2024-09-13T02:50:43.029 INFO:tasks.workunit.client.1.smithi122.stdout:9/151: truncate d8/f9 5897632 0 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:0/92: sync 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:5/116: sync 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:7/60: sync 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:4/96: sync 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:6/170: sync 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:6/171: readlink d5/dd/l18 0 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:4/97: chown d11/d1b/f1c 0 1 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:7/61: truncate d4/d8/f7 4268095 0 2024-09-13T02:50:43.037 INFO:tasks.workunit.client.1.smithi122.stdout:6/172: chown d5/d11 0 1 2024-09-13T02:50:43.038 INFO:tasks.workunit.client.1.smithi122.stdout:5/117: creat d0/d1d/f29 x:0 0 0 2024-09-13T02:50:43.039 INFO:tasks.workunit.client.1.smithi122.stdout:7/62: rmdir d4/d8/db/dc 39 2024-09-13T02:50:43.039 INFO:tasks.workunit.client.1.smithi122.stdout:5/118: rmdir d0/d2/d21/d25 39 2024-09-13T02:50:43.040 INFO:tasks.workunit.client.1.smithi122.stdout:5/119: getdents d0/d2/d27 0 2024-09-13T02:50:43.041 INFO:tasks.workunit.client.1.smithi122.stdout:7/63: creat d4/d8/f14 x:0 0 0 2024-09-13T02:50:43.043 INFO:tasks.workunit.client.1.smithi122.stdout:7/64: write d4/fd [106337,25950] 0 2024-09-13T02:50:43.043 INFO:tasks.workunit.client.1.smithi122.stdout:7/65: rename d4 to d4/d8/db/dc/d15 22 2024-09-13T02:50:43.043 INFO:tasks.workunit.client.1.smithi122.stdout:6/173: dread d5/dd/df/f20 [0,4194304] 0 2024-09-13T02:50:43.043 INFO:tasks.workunit.client.1.smithi122.stdout:6/174: fsync d5/dd/df/f24 0 2024-09-13T02:50:43.044 INFO:tasks.workunit.client.1.smithi122.stdout:6/175: fdatasync d5/dd/f22 0 2024-09-13T02:50:43.045 INFO:tasks.workunit.client.1.smithi122.stdout:3/124: dwrite d4/d11/f2e [0,4194304] 0 2024-09-13T02:50:43.045 INFO:tasks.workunit.client.1.smithi122.stdout:6/176: symlink d5/l34 0 2024-09-13T02:50:43.046 INFO:tasks.workunit.client.1.smithi122.stdout:0/93: read d1/d5/d9/da/d17/f1b [3905431,40948] 0 2024-09-13T02:50:43.046 INFO:tasks.workunit.client.1.smithi122.stdout:0/94: chown d1/d5/d9/da/c16 6201902 1 2024-09-13T02:50:43.048 INFO:tasks.workunit.client.1.smithi122.stdout:6/177: rmdir d5/db/dc/d25 39 2024-09-13T02:50:43.048 INFO:tasks.workunit.client.1.smithi122.stdout:6/178: write d5/db/d29/f32 [708003,86707] 0 2024-09-13T02:50:43.048 INFO:tasks.workunit.client.1.smithi122.stdout:6/179: write d5/dd/df/f20 [943110,62942] 0 2024-09-13T02:50:43.049 INFO:tasks.workunit.client.1.smithi122.stdout:3/125: mkdir d4/d11/dd/d21/d30 0 2024-09-13T02:50:43.052 INFO:tasks.workunit.client.1.smithi122.stdout:0/95: link d1/d5/d10/f14 d1/d5/d9/f20 0 2024-09-13T02:50:43.052 INFO:tasks.workunit.client.1.smithi122.stdout:6/180: creat d5/db/dc/d25/f35 x:0 0 0 2024-09-13T02:50:43.052 INFO:tasks.workunit.client.1.smithi122.stdout:6/181: fsync d5/db/f17 0 2024-09-13T02:50:43.053 INFO:tasks.workunit.client.1.smithi122.stdout:3/126: symlink d4/d6/l31 0 2024-09-13T02:50:43.054 INFO:tasks.workunit.client.1.smithi122.stdout:6/182: creat d5/f36 x:0 0 0 2024-09-13T02:50:43.056 INFO:tasks.workunit.client.1.smithi122.stdout:7/66: dread d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:43.056 INFO:tasks.workunit.client.1.smithi122.stdout:6/183: rename d5/db/l16 to d5/db/dc/d25/l37 0 2024-09-13T02:50:43.056 INFO:tasks.workunit.client.1.smithi122.stdout:3/127: dread d4/dc/f10 [0,4194304] 0 2024-09-13T02:50:43.056 INFO:tasks.workunit.client.1.smithi122.stdout:6/184: symlink d5/db/dc/l38 0 2024-09-13T02:50:43.057 INFO:tasks.workunit.client.1.smithi122.stdout:6/185: write d5/f9 [2192495,10321] 0 2024-09-13T02:50:43.057 INFO:tasks.workunit.client.1.smithi122.stdout:3/128: creat d4/d6/df/f32 x:0 0 0 2024-09-13T02:50:43.057 INFO:tasks.workunit.client.1.smithi122.stdout:3/129: chown d4/d11/dd 61 1 2024-09-13T02:50:43.057 INFO:tasks.workunit.client.1.smithi122.stdout:3/130: truncate d4/dc/f10 1091864 0 2024-09-13T02:50:43.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/186: creat d5/d11/d2f/f39 x:0 0 0 2024-09-13T02:50:43.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/187: write d5/f36 [464291,28056] 0 2024-09-13T02:50:43.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/188: write d5/dd/f22 [349985,11997] 0 2024-09-13T02:50:43.058 INFO:tasks.workunit.client.1.smithi122.stdout:3/131: mkdir d4/d6/de/d1f/d33 0 2024-09-13T02:50:43.059 INFO:tasks.workunit.client.1.smithi122.stdout:6/189: mkdir d5/d11/d3a 0 2024-09-13T02:50:43.060 INFO:tasks.workunit.client.1.smithi122.stdout:9/152: dwrite d8/ff [0,4194304] 0 2024-09-13T02:50:43.061 INFO:tasks.workunit.client.1.smithi122.stdout:3/132: creat d4/d6/de/f34 x:0 0 0 2024-09-13T02:50:43.062 INFO:tasks.workunit.client.1.smithi122.stdout:6/190: truncate d5/db/f17 6096 0 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/98: write f10 [40046,76476] 0 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/99: fdatasync d11/d1b/f1c 0 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/100: write d11/d13/f1a [1012516,4451] 0 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/101: chown fd 0 1 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/102: fdatasync fd 0 2024-09-13T02:50:43.064 INFO:tasks.workunit.client.1.smithi122.stdout:4/103: readlink d11/l1e 0 2024-09-13T02:50:43.065 INFO:tasks.workunit.client.1.smithi122.stdout:5/120: dwrite d0/d17/f28 [0,4194304] 0 2024-09-13T02:50:43.065 INFO:tasks.workunit.client.1.smithi122.stdout:5/121: creat d0/da/f2a x:0 0 0 2024-09-13T02:50:43.067 INFO:tasks.workunit.client.1.smithi122.stdout:3/133: mkdir d4/d11/dd/d21/d2b/d35 0 2024-09-13T02:50:43.068 INFO:tasks.workunit.client.1.smithi122.stdout:6/191: unlink d5/d11/l1e 0 2024-09-13T02:50:43.069 INFO:tasks.workunit.client.1.smithi122.stdout:6/192: creat d5/db/dc/d25/f3b x:0 0 0 2024-09-13T02:50:43.072 INFO:tasks.workunit.client.1.smithi122.stdout:3/134: mkdir d4/d11/dd/d21/d2b/d36 0 2024-09-13T02:50:43.075 INFO:tasks.workunit.client.1.smithi122.stdout:6/193: truncate d5/d11/f1f 787143 0 2024-09-13T02:50:43.075 INFO:tasks.workunit.client.1.smithi122.stdout:4/104: rmdir d11/d13/d14 39 2024-09-13T02:50:43.075 INFO:tasks.workunit.client.1.smithi122.stdout:4/105: chown d11/c12 1 1 2024-09-13T02:50:43.076 INFO:tasks.workunit.client.1.smithi122.stdout:4/106: write f3 [1366256,111989] 0 2024-09-13T02:50:43.076 INFO:tasks.workunit.client.1.smithi122.stdout:4/107: creat d11/d13/f1f x:0 0 0 2024-09-13T02:50:43.076 INFO:tasks.workunit.client.1.smithi122.stdout:7/67: dwrite d4/d8/f14 [0,4194304] 0 2024-09-13T02:50:43.077 INFO:tasks.workunit.client.1.smithi122.stdout:3/135: mknod d4/dc/c37 0 2024-09-13T02:50:43.079 INFO:tasks.workunit.client.1.smithi122.stdout:7/68: dread d4/fd [0,4194304] 0 2024-09-13T02:50:43.081 INFO:tasks.workunit.client.1.smithi122.stdout:4/108: link d11/l1e d11/l20 0 2024-09-13T02:50:43.085 INFO:tasks.workunit.client.1.smithi122.stdout:6/194: symlink d5/db/l3c 0 2024-09-13T02:50:43.086 INFO:tasks.workunit.client.1.smithi122.stdout:5/122: dwrite d0/d2/f1b [0,4194304] 0 2024-09-13T02:50:43.086 INFO:tasks.workunit.client.1.smithi122.stdout:5/123: dread - d0/d2/f20 zero size 2024-09-13T02:50:43.086 INFO:tasks.workunit.client.1.smithi122.stdout:5/124: truncate d0/d2/d21/f24 299622 0 2024-09-13T02:50:43.086 INFO:tasks.workunit.client.1.smithi122.stdout:5/125: read d0/da/f16 [45062,9161] 0 2024-09-13T02:50:43.086 INFO:tasks.workunit.client.1.smithi122.stdout:5/126: truncate d0/da/f23 1017659 0 2024-09-13T02:50:43.092 INFO:tasks.workunit.client.1.smithi122.stdout:7/69: unlink l1 0 2024-09-13T02:50:43.093 INFO:tasks.workunit.client.1.smithi122.stdout:3/136: dread d4/d6/f16 [0,4194304] 0 2024-09-13T02:50:43.099 INFO:tasks.workunit.client.1.smithi122.stdout:6/195: mkdir d5/d3d 0 2024-09-13T02:50:43.103 INFO:tasks.workunit.client.1.smithi122.stdout:5/127: rename d0/d2/d27 to d0/d2/d21/d25/d2b 0 2024-09-13T02:50:43.106 INFO:tasks.workunit.client.1.smithi122.stdout:7/70: unlink d4/d8/f14 0 2024-09-13T02:50:43.106 INFO:tasks.workunit.client.1.smithi122.stdout:7/71: truncate d4/d8/f7 4322725 0 2024-09-13T02:50:43.107 INFO:tasks.workunit.client.1.smithi122.stdout:6/196: mknod d5/db/d29/c3e 0 2024-09-13T02:50:43.112 INFO:tasks.workunit.client.1.smithi122.stdout:6/197: rename d5/db/dc/d25/f3b to d5/dd/d21/f3f 0 2024-09-13T02:50:43.112 INFO:tasks.workunit.client.1.smithi122.stdout:6/198: write d5/d11/d2f/f39 [109289,12854] 0 2024-09-13T02:50:43.113 INFO:tasks.workunit.client.1.smithi122.stdout:3/137: dwrite d4/d6/f25 [0,4194304] 0 2024-09-13T02:50:43.116 INFO:tasks.workunit.client.1.smithi122.stdout:3/138: mkdir d4/d11/d38 0 2024-09-13T02:50:43.116 INFO:tasks.workunit.client.1.smithi122.stdout:3/139: chown d4/c29 2626 1 2024-09-13T02:50:43.116 INFO:tasks.workunit.client.1.smithi122.stdout:3/140: chown d4/d6/de/f34 3629106 1 2024-09-13T02:50:43.118 INFO:tasks.workunit.client.1.smithi122.stdout:3/141: link d4/d6/f16 d4/d11/dd/d21/d2b/d35/f39 0 2024-09-13T02:50:43.121 INFO:tasks.workunit.client.1.smithi122.stdout:4/109: truncate f3 1346140 0 2024-09-13T02:50:43.131 INFO:tasks.workunit.client.1.smithi122.stdout:3/142: read d4/d11/dd/f1b [3015389,110592] 0 2024-09-13T02:50:43.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/143: symlink d4/d6/de/l3a 0 2024-09-13T02:50:43.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/144: stat d4/d11/dd/d21/f28 0 2024-09-13T02:50:43.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/145: getdents d4/d11/dd/d21/d2b/d36 0 2024-09-13T02:50:43.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/146: symlink d4/d6/df/d15/l3b 0 2024-09-13T02:50:43.136 INFO:tasks.workunit.client.1.smithi122.stdout:3/147: rename d4/dc to d4/d11/dd/d21/d2b/d36/d3c 0 2024-09-13T02:50:43.139 INFO:tasks.workunit.client.1.smithi122.stdout:5/128: dwrite d0/d1d/f1f [0,4194304] 0 2024-09-13T02:50:43.142 INFO:tasks.workunit.client.1.smithi122.stdout:4/110: dwrite f10 [0,4194304] 0 2024-09-13T02:50:43.142 INFO:tasks.workunit.client.1.smithi122.stdout:7/72: dwrite d4/fd [0,4194304] 0 2024-09-13T02:50:43.142 INFO:tasks.workunit.client.1.smithi122.stdout:7/73: fsync d4/d8/db/f11 0 2024-09-13T02:50:43.144 INFO:tasks.workunit.client.1.smithi122.stdout:3/148: dread d4/d6/f16 [0,4194304] 0 2024-09-13T02:50:43.144 INFO:tasks.workunit.client.1.smithi122.stdout:6/199: dwrite d5/dd/df/f20 [0,4194304] 0 2024-09-13T02:50:43.147 INFO:tasks.workunit.client.1.smithi122.stdout:4/111: unlink l1 0 2024-09-13T02:50:43.153 INFO:tasks.workunit.client.1.smithi122.stdout:3/149: link d4/d6/de/f34 d4/d6/de/d1f/f3d 0 2024-09-13T02:50:43.157 INFO:tasks.workunit.client.1.smithi122.stdout:4/112: creat d11/f21 x:0 0 0 2024-09-13T02:50:43.157 INFO:tasks.workunit.client.1.smithi122.stdout:4/113: stat le 0 2024-09-13T02:50:43.157 INFO:tasks.workunit.client.1.smithi122.stdout:4/114: write fa [803062,52737] 0 2024-09-13T02:50:43.157 INFO:tasks.workunit.client.1.smithi122.stdout:5/129: dwrite d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:43.159 INFO:tasks.workunit.client.1.smithi122.stdout:7/74: rmdir d4 39 2024-09-13T02:50:43.160 INFO:tasks.workunit.client.1.smithi122.stdout:3/150: mknod d4/d11/c3e 0 2024-09-13T02:50:43.165 INFO:tasks.workunit.client.1.smithi122.stdout:7/75: mknod d4/d8/db/dc/c16 0 2024-09-13T02:50:43.168 INFO:tasks.workunit.client.1.smithi122.stdout:3/151: creat d4/d11/d38/f3f x:0 0 0 2024-09-13T02:50:43.168 INFO:tasks.workunit.client.1.smithi122.stdout:6/200: rename d5/db/dc/d25 to d5/d40 0 2024-09-13T02:50:43.171 INFO:tasks.workunit.client.1.smithi122.stdout:3/152: mkdir d4/d11/dd/d21/d2b/d36/d3c/d40 0 2024-09-13T02:50:43.172 INFO:tasks.workunit.client.1.smithi122.stdout:6/201: mkdir d5/d11/d33/d41 0 2024-09-13T02:50:43.175 INFO:tasks.workunit.client.1.smithi122.stdout:6/202: symlink d5/db/dc/l42 0 2024-09-13T02:50:43.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:42 smithi100 ceph-mon[27894]: pgmap v252: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 231 MiB/s rd, 299 MiB/s wr, 414 op/s 2024-09-13T02:50:43.180 INFO:tasks.workunit.client.1.smithi122.stdout:5/130: dwrite d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:43.182 INFO:tasks.workunit.client.1.smithi122.stdout:5/131: creat d0/d2/d21/d25/d2b/f2c x:0 0 0 2024-09-13T02:50:43.182 INFO:tasks.workunit.client.1.smithi122.stdout:4/115: rmdir d11 39 2024-09-13T02:50:43.182 INFO:tasks.workunit.client.1.smithi122.stdout:4/116: readlink d11/d1b/l1d 0 2024-09-13T02:50:43.183 INFO:tasks.workunit.client.1.smithi122.stdout:5/132: chown d0/da/f2a 19594 1 2024-09-13T02:50:43.183 INFO:tasks.workunit.client.1.smithi122.stdout:5/133: creat d0/da/f2d x:0 0 0 2024-09-13T02:50:43.183 INFO:tasks.workunit.client.1.smithi122.stdout:7/76: dwrite d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:43.184 INFO:tasks.workunit.client.1.smithi122.stdout:4/117: getdents d11 0 2024-09-13T02:50:43.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:42 smithi122 ceph-mon[34559]: pgmap v252: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 231 MiB/s rd, 299 MiB/s wr, 414 op/s 2024-09-13T02:50:43.187 INFO:tasks.workunit.client.1.smithi122.stdout:7/77: creat d4/d8/db/dc/f17 x:0 0 0 2024-09-13T02:50:43.188 INFO:tasks.workunit.client.1.smithi122.stdout:4/118: symlink d11/d13/d14/l22 0 2024-09-13T02:50:43.189 INFO:tasks.workunit.client.1.smithi122.stdout:5/134: getdents d0/d2 0 2024-09-13T02:50:43.189 INFO:tasks.workunit.client.1.smithi122.stdout:5/135: creat d0/d1d/f2e x:0 0 0 2024-09-13T02:50:43.189 INFO:tasks.workunit.client.1.smithi122.stdout:7/78: mknod d4/d8/db/c18 0 2024-09-13T02:50:43.190 INFO:tasks.workunit.client.1.smithi122.stdout:4/119: creat d11/d1b/f23 x:0 0 0 2024-09-13T02:50:43.191 INFO:tasks.workunit.client.1.smithi122.stdout:5/136: symlink d0/da/l2f 0 2024-09-13T02:50:43.191 INFO:tasks.workunit.client.1.smithi122.stdout:5/137: chown d0/da/f23 671702 1 2024-09-13T02:50:43.191 INFO:tasks.workunit.client.1.smithi122.stdout:5/138: fdatasync d0/d2/f1b 0 2024-09-13T02:50:43.191 INFO:tasks.workunit.client.1.smithi122.stdout:5/139: dread - d0/da/f2a zero size 2024-09-13T02:50:43.192 INFO:tasks.workunit.client.1.smithi122.stdout:7/79: truncate d4/d8/db/f11 3387938 0 2024-09-13T02:50:43.192 INFO:tasks.workunit.client.1.smithi122.stdout:4/120: getdents d11/d13 0 2024-09-13T02:50:43.192 INFO:tasks.workunit.client.1.smithi122.stdout:4/121: chown cc 23205 1 2024-09-13T02:50:43.192 INFO:tasks.workunit.client.1.smithi122.stdout:4/122: getdents d11/d13 0 2024-09-13T02:50:43.192 INFO:tasks.workunit.client.1.smithi122.stdout:4/123: truncate f3 1477709 0 2024-09-13T02:50:43.193 INFO:tasks.workunit.client.1.smithi122.stdout:5/140: unlink d0/d2/d21/d25/l26 0 2024-09-13T02:50:43.193 INFO:tasks.workunit.client.1.smithi122.stdout:5/141: chown d0/da/c15 8709966 1 2024-09-13T02:50:43.193 INFO:tasks.workunit.client.1.smithi122.stdout:5/142: creat d0/d2/d21/d25/d2b/f30 x:0 0 0 2024-09-13T02:50:43.193 INFO:tasks.workunit.client.1.smithi122.stdout:7/80: creat d4/d8/f19 x:0 0 0 2024-09-13T02:50:43.193 INFO:tasks.workunit.client.1.smithi122.stdout:7/81: truncate d4/d8/db/dc/f17 118882 0 2024-09-13T02:50:43.194 INFO:tasks.workunit.client.1.smithi122.stdout:4/124: mknod d11/d1b/c24 0 2024-09-13T02:50:43.195 INFO:tasks.workunit.client.1.smithi122.stdout:7/82: symlink d4/l1a 0 2024-09-13T02:50:43.196 INFO:tasks.workunit.client.1.smithi122.stdout:4/125: creat d11/d13/d14/f25 x:0 0 0 2024-09-13T02:50:43.196 INFO:tasks.workunit.client.1.smithi122.stdout:7/83: mkdir d4/d8/db/dc/d1b 0 2024-09-13T02:50:43.198 INFO:tasks.workunit.client.1.smithi122.stdout:7/84: symlink d4/d8/l1c 0 2024-09-13T02:50:43.198 INFO:tasks.workunit.client.1.smithi122.stdout:7/85: creat d4/d8/db/dc/f1d x:0 0 0 2024-09-13T02:50:43.198 INFO:tasks.workunit.client.1.smithi122.stdout:7/86: creat d4/d8/db/dc/f1e x:0 0 0 2024-09-13T02:50:43.201 INFO:tasks.workunit.client.1.smithi122.stdout:6/203: dwrite d5/f8 [0,4194304] 0 2024-09-13T02:50:43.202 INFO:tasks.workunit.client.1.smithi122.stdout:3/153: dwrite d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:43.202 INFO:tasks.workunit.client.1.smithi122.stdout:3/154: write d4/d11/d38/f3f [58005,43057] 0 2024-09-13T02:50:43.203 INFO:tasks.workunit.client.1.smithi122.stdout:6/204: symlink d5/dd/d21/l43 0 2024-09-13T02:50:43.203 INFO:tasks.workunit.client.1.smithi122.stdout:6/205: chown d5/dd/d21/c2b 13903 1 2024-09-13T02:50:43.203 INFO:tasks.workunit.client.1.smithi122.stdout:6/206: fdatasync d5/dd/df/f13 0 2024-09-13T02:50:43.207 INFO:tasks.workunit.client.1.smithi122.stdout:3/155: mkdir d4/d6/de/d41 0 2024-09-13T02:50:43.210 INFO:tasks.workunit.client.1.smithi122.stdout:6/207: link d5/dd/f2d d5/db/f44 0 2024-09-13T02:50:43.210 INFO:tasks.workunit.client.1.smithi122.stdout:6/208: truncate d5/f36 694029 0 2024-09-13T02:50:43.210 INFO:tasks.workunit.client.1.smithi122.stdout:6/209: write d5/fe [639807,125387] 0 2024-09-13T02:50:43.212 INFO:tasks.workunit.client.1.smithi122.stdout:3/156: dread d4/d11/dd/d21/d2b/d35/f39 [0,4194304] 0 2024-09-13T02:50:43.216 INFO:tasks.workunit.client.1.smithi122.stdout:3/157: mknod d4/d11/dd/d21/d2b/d36/d3c/d40/c42 0 2024-09-13T02:50:43.217 INFO:tasks.workunit.client.1.smithi122.stdout:7/87: dwrite d4/d8/db/dc/f17 [0,4194304] 0 2024-09-13T02:50:43.224 INFO:tasks.workunit.client.1.smithi122.stdout:4/126: rmdir d11/d1b 39 2024-09-13T02:50:43.224 INFO:tasks.workunit.client.1.smithi122.stdout:4/127: write d11/d13/f1f [3257,69751] 0 2024-09-13T02:50:43.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/128: mknod d11/d1b/c26 0 2024-09-13T02:50:43.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/129: write f0 [1234318,5944] 0 2024-09-13T02:50:43.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/130: dread - d11/d1b/f23 zero size 2024-09-13T02:50:43.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/131: truncate d11/d13/f1f 313350 0 2024-09-13T02:50:43.226 INFO:tasks.workunit.client.1.smithi122.stdout:5/143: getdents d0/d2/d21/d25/d2b 0 2024-09-13T02:50:43.227 INFO:tasks.workunit.client.1.smithi122.stdout:5/144: truncate d0/da/f2d 753986 0 2024-09-13T02:50:43.227 INFO:tasks.workunit.client.1.smithi122.stdout:3/158: dread d4/d6/de/f18 [0,4194304] 0 2024-09-13T02:50:43.228 INFO:tasks.workunit.client.1.smithi122.stdout:3/159: stat d4/d11/l17 0 2024-09-13T02:50:43.230 INFO:tasks.workunit.client.1.smithi122.stdout:3/160: mkdir d4/d11/dd/d21/d2b/d36/d3c/d43 0 2024-09-13T02:50:43.230 INFO:tasks.workunit.client.1.smithi122.stdout:3/161: write d4/d6/f8 [5819069,58380] 0 2024-09-13T02:50:43.230 INFO:tasks.workunit.client.1.smithi122.stdout:3/162: chown d4/d11/f2d 45411110 1 2024-09-13T02:50:43.231 INFO:tasks.workunit.client.1.smithi122.stdout:5/145: rmdir d0/d1d 39 2024-09-13T02:50:43.238 INFO:tasks.workunit.client.1.smithi122.stdout:6/210: rename d5/dd to d5/d11/d45 0 2024-09-13T02:50:43.241 INFO:tasks.workunit.client.1.smithi122.stdout:6/211: mkdir d5/d11/d45/df/d46 0 2024-09-13T02:50:43.242 INFO:tasks.workunit.client.1.smithi122.stdout:3/163: write d4/d11/dd/f1b [2870442,86332] 0 2024-09-13T02:50:43.242 INFO:tasks.workunit.client.1.smithi122.stdout:7/88: rename d4/d8/db/dc/f17 to d4/d8/db/f1f 0 2024-09-13T02:50:43.244 INFO:tasks.workunit.client.1.smithi122.stdout:6/212: rename d5/d11/d45/df/f20 to d5/d11/d33/d41/f47 0 2024-09-13T02:50:43.245 INFO:tasks.workunit.client.1.smithi122.stdout:7/89: symlink d4/d8/db/dc/d1b/l20 0 2024-09-13T02:50:43.245 INFO:tasks.workunit.client.1.smithi122.stdout:7/90: readlink l2 0 2024-09-13T02:50:43.245 INFO:tasks.workunit.client.1.smithi122.stdout:7/91: fdatasync d4/d8/db/f11 0 2024-09-13T02:50:43.245 INFO:tasks.workunit.client.1.smithi122.stdout:7/92: readlink d4/d8/db/dc/d1b/l20 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/213: mkdir d5/d3d/d48 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/214: fsync d5/db/d29/f1d 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:5/146: dread d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/215: creat d5/d3d/f49 x:0 0 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/216: fdatasync d5/d11/f1f 0 2024-09-13T02:50:43.246 INFO:tasks.workunit.client.1.smithi122.stdout:6/217: write d5/d11/d2f/f39 [1073939,125159] 0 2024-09-13T02:50:43.247 INFO:tasks.workunit.client.1.smithi122.stdout:5/147: rename d0/da/ld to d0/d2/d21/d25/l31 0 2024-09-13T02:50:43.247 INFO:tasks.workunit.client.1.smithi122.stdout:5/148: dread - d0/d17/f18 zero size 2024-09-13T02:50:43.248 INFO:tasks.workunit.client.1.smithi122.stdout:6/218: creat d5/db/f4a x:0 0 0 2024-09-13T02:50:43.249 INFO:tasks.workunit.client.1.smithi122.stdout:6/219: mknod d5/d11/d2f/c4b 0 2024-09-13T02:50:43.250 INFO:tasks.workunit.client.1.smithi122.stdout:3/164: dread d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:43.252 INFO:tasks.workunit.client.1.smithi122.stdout:6/220: rename d5/db/l15 to d5/l4c 0 2024-09-13T02:50:43.252 INFO:tasks.workunit.client.1.smithi122.stdout:6/221: creat d5/d11/d2f/f4d x:0 0 0 2024-09-13T02:50:43.252 INFO:tasks.workunit.client.1.smithi122.stdout:6/222: write d5/d3d/f49 [956825,83093] 0 2024-09-13T02:50:43.252 INFO:tasks.workunit.client.1.smithi122.stdout:3/165: dread d4/d11/dd/d21/d2b/d36/d3c/f10 [0,4194304] 0 2024-09-13T02:50:43.253 INFO:tasks.workunit.client.1.smithi122.stdout:6/223: mkdir d5/d11/d33/d41/d4e 0 2024-09-13T02:50:43.253 INFO:tasks.workunit.client.1.smithi122.stdout:7/93: dread d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:43.254 INFO:tasks.workunit.client.1.smithi122.stdout:7/94: chown d4 7 1 2024-09-13T02:50:43.254 INFO:tasks.workunit.client.1.smithi122.stdout:3/166: unlink d4/d11/dd/l14 0 2024-09-13T02:50:43.254 INFO:tasks.workunit.client.1.smithi122.stdout:6/224: truncate d5/db/f1b 814156 0 2024-09-13T02:50:43.256 INFO:tasks.workunit.client.1.smithi122.stdout:7/95: creat d4/d8/db/f21 x:0 0 0 2024-09-13T02:50:43.256 INFO:tasks.workunit.client.1.smithi122.stdout:7/96: fsync d4/d8/f19 0 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:7/97: chown d4/d8/db/ff 1833 1 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:7/98: creat d4/d8/db/dc/f22 x:0 0 0 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:7/99: readlink d4/d8/db/dc/d1b/l20 0 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:7/100: read - d4/d8/db/f21 zero size 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:7/101: stat d4/d8/db/dc/ce 0 2024-09-13T02:50:43.257 INFO:tasks.workunit.client.1.smithi122.stdout:3/167: rename d4/d11/dd/d21/d2b/d36/d3c/d40 to d4/d11/dd/d21/d2b/d44 0 2024-09-13T02:50:43.258 INFO:tasks.workunit.client.1.smithi122.stdout:3/168: creat d4/d11/dd/d21/d2b/f45 x:0 0 0 2024-09-13T02:50:43.258 INFO:tasks.workunit.client.1.smithi122.stdout:3/169: read - d4/d6/de/f34 zero size 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/170: dread d4/d11/dd/d21/d2b/d36/d3c/f20 [0,4194304] 0 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/171: write d4/d6/df/f32 [210426,29641] 0 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/172: readlink d4/d11/l1d 0 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/173: truncate d4/d11/dd/d21/d2b/f45 922201 0 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/174: read - d4/d11/dd/d21/f28 zero size 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:6/225: unlink d5/d11/d45/df/d26/l2e 0 2024-09-13T02:50:43.259 INFO:tasks.workunit.client.1.smithi122.stdout:6/226: write d5/d11/d45/df/f24 [154754,88389] 0 2024-09-13T02:50:43.261 INFO:tasks.workunit.client.1.smithi122.stdout:7/102: symlink d4/d8/db/dc/l23 0 2024-09-13T02:50:43.262 INFO:tasks.workunit.client.1.smithi122.stdout:7/103: mkdir d4/d8/d24 0 2024-09-13T02:50:43.263 INFO:tasks.workunit.client.1.smithi122.stdout:7/104: chown d4/d8/db 174 1 2024-09-13T02:50:43.263 INFO:tasks.workunit.client.1.smithi122.stdout:7/105: symlink d4/d8/db/dc/l25 0 2024-09-13T02:50:43.266 INFO:tasks.workunit.client.1.smithi122.stdout:6/227: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:43.269 INFO:tasks.workunit.client.1.smithi122.stdout:6/228: rename d5/db/f4a to d5/d11/f4f 0 2024-09-13T02:50:43.269 INFO:tasks.workunit.client.1.smithi122.stdout:6/229: chown d5/db/dc/c19 31 1 2024-09-13T02:50:43.269 INFO:tasks.workunit.client.1.smithi122.stdout:6/230: write d5/d11/d45/d21/f3f [1004784,69393] 0 2024-09-13T02:50:43.271 INFO:tasks.workunit.client.1.smithi122.stdout:5/149: truncate d0/da/f2d 39310 0 2024-09-13T02:50:43.271 INFO:tasks.workunit.client.1.smithi122.stdout:5/150: fsync d0/d17/f28 0 2024-09-13T02:50:43.271 INFO:tasks.workunit.client.1.smithi122.stdout:5/151: mknod d0/d2/c32 0 2024-09-13T02:50:43.271 INFO:tasks.workunit.client.1.smithi122.stdout:5/152: readlink d0/da/l2f 0 2024-09-13T02:50:43.282 INFO:tasks.workunit.client.1.smithi122.stdout:7/106: dwrite d4/fd [0,4194304] 0 2024-09-13T02:50:43.283 INFO:tasks.workunit.client.1.smithi122.stdout:6/231: dread d5/d11/d45/df/f24 [0,4194304] 0 2024-09-13T02:50:43.284 INFO:tasks.workunit.client.1.smithi122.stdout:7/107: link d4/d8/db/dc/l23 d4/d8/db/dc/d1b/l26 0 2024-09-13T02:50:43.284 INFO:tasks.workunit.client.1.smithi122.stdout:5/153: dread d0/d1d/f1f [0,4194304] 0 2024-09-13T02:50:43.284 INFO:tasks.workunit.client.1.smithi122.stdout:3/175: dwrite d4/d6/de/f34 [0,4194304] 0 2024-09-13T02:50:43.287 INFO:tasks.workunit.client.1.smithi122.stdout:5/154: mkdir d0/d2/d33 0 2024-09-13T02:50:43.287 INFO:tasks.workunit.client.1.smithi122.stdout:5/155: rename d0/d2/d21/d25 to d0/d2/d21/d25/d34 22 2024-09-13T02:50:43.287 INFO:tasks.workunit.client.1.smithi122.stdout:6/232: dread d5/d11/d45/f2d [4194304,4194304] 0 2024-09-13T02:50:43.288 INFO:tasks.workunit.client.1.smithi122.stdout:3/176: dread d4/d11/f2d [0,4194304] 0 2024-09-13T02:50:43.289 INFO:tasks.workunit.client.1.smithi122.stdout:6/233: link d5/db/l3c d5/d11/d45/df/d46/l50 0 2024-09-13T02:50:43.291 INFO:tasks.workunit.client.1.smithi122.stdout:6/234: creat d5/db/f51 x:0 0 0 2024-09-13T02:50:43.294 INFO:tasks.workunit.client.1.smithi122.stdout:7/108: write d4/d8/db/f1f [213394,50109] 0 2024-09-13T02:50:43.295 INFO:tasks.workunit.client.1.smithi122.stdout:3/177: write d4/d6/de/d1f/f3d [5194314,62224] 0 2024-09-13T02:50:43.297 INFO:tasks.workunit.client.1.smithi122.stdout:7/109: rename d4/d8/db/f21 to d4/d8/f27 0 2024-09-13T02:50:43.297 INFO:tasks.workunit.client.1.smithi122.stdout:7/110: chown d4/l1a 272537 1 2024-09-13T02:50:43.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/111: creat d4/d8/db/dc/f28 x:0 0 0 2024-09-13T02:50:43.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/112: chown d4/d8/f27 1311 1 2024-09-13T02:50:43.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/113: write d4/d8/db/dc/f28 [430549,105062] 0 2024-09-13T02:50:43.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/114: dread - d4/d8/f27 zero size 2024-09-13T02:50:43.300 INFO:tasks.workunit.client.1.smithi122.stdout:3/178: link d4/d11/dd/d21/d2b/d44/c42 d4/d11/c46 0 2024-09-13T02:50:43.300 INFO:tasks.workunit.client.1.smithi122.stdout:3/179: creat d4/d6/f47 x:0 0 0 2024-09-13T02:50:43.311 INFO:tasks.workunit.client.1.smithi122.stdout:5/156: dwrite d0/da/f2a [0,4194304] 0 2024-09-13T02:50:43.312 INFO:tasks.workunit.client.1.smithi122.stdout:5/157: readlink d0/da/l2f 0 2024-09-13T02:50:43.312 INFO:tasks.workunit.client.1.smithi122.stdout:5/158: chown d0/d2/d33 800153 1 2024-09-13T02:50:43.330 INFO:tasks.workunit.client.1.smithi122.stdout:7/115: dwrite d4/d8/f27 [0,4194304] 0 2024-09-13T02:50:43.330 INFO:tasks.workunit.client.1.smithi122.stdout:3/180: dwrite d4/d6/f47 [0,4194304] 0 2024-09-13T02:50:43.336 INFO:tasks.workunit.client.1.smithi122.stdout:3/181: creat d4/d6/de/f48 x:0 0 0 2024-09-13T02:50:43.341 INFO:tasks.workunit.client.1.smithi122.stdout:6/235: dwrite d5/d11/d2f/f39 [0,4194304] 0 2024-09-13T02:50:43.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/236: stat l2 0 2024-09-13T02:50:43.342 INFO:tasks.workunit.client.1.smithi122.stdout:6/237: chown d5/d11/d2f/c4b 201457 1 2024-09-13T02:50:43.343 INFO:tasks.workunit.client.1.smithi122.stdout:6/238: truncate d5/db/d29/f32 624862 0 2024-09-13T02:50:43.343 INFO:tasks.workunit.client.1.smithi122.stdout:6/239: write d5/d11/d45/df/f24 [1727871,105943] 0 2024-09-13T02:50:43.343 INFO:tasks.workunit.client.1.smithi122.stdout:6/240: truncate d5/d40/f35 36938 0 2024-09-13T02:50:43.345 INFO:tasks.workunit.client.1.smithi122.stdout:6/241: creat d5/db/dc/f52 x:0 0 0 2024-09-13T02:50:43.345 INFO:tasks.workunit.client.1.smithi122.stdout:7/116: dwrite d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:43.346 INFO:tasks.workunit.client.1.smithi122.stdout:6/242: symlink d5/d11/d2f/l53 0 2024-09-13T02:50:43.349 INFO:tasks.workunit.client.1.smithi122.stdout:6/243: mknod d5/d11/d2f/c54 0 2024-09-13T02:50:43.349 INFO:tasks.workunit.client.1.smithi122.stdout:6/244: write d5/db/dc/f52 [1031265,3971] 0 2024-09-13T02:50:43.349 INFO:tasks.workunit.client.1.smithi122.stdout:6/245: fdatasync d5/db/f44 0 2024-09-13T02:50:43.349 INFO:tasks.workunit.client.1.smithi122.stdout:6/246: truncate d5/d3d/f49 2084589 0 2024-09-13T02:50:43.350 INFO:tasks.workunit.client.1.smithi122.stdout:7/117: rmdir d4/d8/db/dc 39 2024-09-13T02:50:43.350 INFO:tasks.workunit.client.1.smithi122.stdout:7/118: write d4/d8/f19 [365746,114346] 0 2024-09-13T02:50:43.352 INFO:tasks.workunit.client.1.smithi122.stdout:6/247: unlink d5/l34 0 2024-09-13T02:50:43.352 INFO:tasks.workunit.client.1.smithi122.stdout:6/248: stat d5/d11/d45/l18 0 2024-09-13T02:50:43.352 INFO:tasks.workunit.client.1.smithi122.stdout:6/249: read d5/d11/d45/df/f13 [136517,97084] 0 2024-09-13T02:50:43.353 INFO:tasks.workunit.client.1.smithi122.stdout:6/250: rename d5/d11/d2f/c4b to d5/db/dc/c55 0 2024-09-13T02:50:43.354 INFO:tasks.workunit.client.1.smithi122.stdout:6/251: write d5/d11/d33/d41/f47 [4272736,44250] 0 2024-09-13T02:50:43.354 INFO:tasks.workunit.client.1.smithi122.stdout:3/182: dwrite d4/d11/f2e [0,4194304] 0 2024-09-13T02:50:43.357 INFO:tasks.workunit.client.1.smithi122.stdout:7/119: dread d4/d8/db/f1f [0,4194304] 0 2024-09-13T02:50:43.357 INFO:tasks.workunit.client.1.smithi122.stdout:3/183: symlink d4/d6/df/l49 0 2024-09-13T02:50:43.357 INFO:tasks.workunit.client.1.smithi122.stdout:3/184: stat d4/d6/df 0 2024-09-13T02:50:43.358 INFO:tasks.workunit.client.1.smithi122.stdout:3/185: truncate d4/d11/dd/d21/d2b/d36/d3c/f20 1025449 0 2024-09-13T02:50:43.364 INFO:tasks.workunit.client.1.smithi122.stdout:6/252: dread d5/db/f1b [0,4194304] 0 2024-09-13T02:50:43.372 INFO:tasks.workunit.client.1.smithi122.stdout:6/253: write d5/db/d29/f1d [4661803,48749] 0 2024-09-13T02:50:43.374 INFO:tasks.workunit.client.1.smithi122.stdout:6/254: link d5/fe d5/d11/d45/f56 0 2024-09-13T02:50:43.383 INFO:tasks.workunit.client.1.smithi122.stdout:3/186: dwrite f3 [8388608,4194304] 0 2024-09-13T02:50:43.383 INFO:tasks.workunit.client.1.smithi122.stdout:7/120: dwrite d4/d8/f19 [0,4194304] 0 2024-09-13T02:50:43.385 INFO:tasks.workunit.client.1.smithi122.stdout:3/187: truncate d4/d11/f2e 3590832 0 2024-09-13T02:50:43.386 INFO:tasks.workunit.client.1.smithi122.stdout:7/121: creat d4/f29 x:0 0 0 2024-09-13T02:50:43.387 INFO:tasks.workunit.client.1.smithi122.stdout:7/122: write d4/d8/db/dc/f1e [286122,97467] 0 2024-09-13T02:50:43.387 INFO:tasks.workunit.client.1.smithi122.stdout:7/123: fdatasync d4/d8/db/dc/f28 0 2024-09-13T02:50:43.387 INFO:tasks.workunit.client.1.smithi122.stdout:7/124: write d4/d8/db/f1f [3199805,5149] 0 2024-09-13T02:50:43.387 INFO:tasks.workunit.client.1.smithi122.stdout:3/188: link d4/d11/dd/d21/d2b/f2f d4/d6/f4a 0 2024-09-13T02:50:43.388 INFO:tasks.workunit.client.1.smithi122.stdout:3/189: symlink d4/d11/dd/d21/d2b/d36/d3c/l4b 0 2024-09-13T02:50:43.389 INFO:tasks.workunit.client.1.smithi122.stdout:3/190: unlink d4/d6/de/d1f/f3d 0 2024-09-13T02:50:43.390 INFO:tasks.workunit.client.1.smithi122.stdout:3/191: rename d4/d11/dd/d21/d2b/d44 to d4/d4c 0 2024-09-13T02:50:43.391 INFO:tasks.workunit.client.1.smithi122.stdout:3/192: truncate d4/d11/dd/d21/d2b/d36/d3c/f20 2017832 0 2024-09-13T02:50:43.392 INFO:tasks.workunit.client.1.smithi122.stdout:3/193: rename d4/d6/de/f48 to d4/d11/dd/d21/f4d 0 2024-09-13T02:50:43.392 INFO:tasks.workunit.client.1.smithi122.stdout:3/194: dread - d4/d11/dd/d21/f28 zero size 2024-09-13T02:50:43.393 INFO:tasks.workunit.client.1.smithi122.stdout:3/195: mkdir d4/d11/dd/d21/d4e 0 2024-09-13T02:50:43.398 INFO:tasks.workunit.client.1.smithi122.stdout:6/255: dwrite d5/db/f1b [0,4194304] 0 2024-09-13T02:50:43.399 INFO:tasks.workunit.client.1.smithi122.stdout:7/125: read d4/d8/f19 [2784337,105871] 0 2024-09-13T02:50:43.400 INFO:tasks.workunit.client.1.smithi122.stdout:7/126: creat d4/d8/db/f2a x:0 0 0 2024-09-13T02:50:43.405 INFO:tasks.workunit.client.1.smithi122.stdout:3/196: truncate f3 3514738 0 2024-09-13T02:50:43.414 INFO:tasks.workunit.client.1.smithi122.stdout:6/256: truncate d5/d11/d45/f2d 3900699 0 2024-09-13T02:50:43.414 INFO:tasks.workunit.client.1.smithi122.stdout:6/257: write d5/d11/d2f/f4d [1005430,130420] 0 2024-09-13T02:50:43.415 INFO:tasks.workunit.client.1.smithi122.stdout:7/127: mknod d4/c2b 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:7/128: dread - d4/d8/db/dc/f22 zero size 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:7/129: chown d4/d8/db/dc/c16 322 1 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:7/130: creat d4/d8/db/f2c x:0 0 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:7/131: fdatasync d4/d8/db/dc/f1d 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:3/197: symlink d4/d11/dd/d21/d2b/d36/l4f 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:3/198: fsync d4/d6/df/f32 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:3/199: fsync d4/d11/dd/d21/d2b/d36/d3c/f10 0 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:3/200: chown d4/d11/dd/d21/d2b/d35/f39 10525 1 2024-09-13T02:50:43.416 INFO:tasks.workunit.client.1.smithi122.stdout:6/258: creat d5/d11/d45/d21/f57 x:0 0 0 2024-09-13T02:50:43.418 INFO:tasks.workunit.client.1.smithi122.stdout:7/132: rename d4/d8/db/dc/l23 to d4/d8/db/l2d 0 2024-09-13T02:50:43.418 INFO:tasks.workunit.client.1.smithi122.stdout:7/133: fdatasync d4/d8/db/f11 0 2024-09-13T02:50:43.418 INFO:tasks.workunit.client.1.smithi122.stdout:7/134: fdatasync d4/d8/db/ff 0 2024-09-13T02:50:43.418 INFO:tasks.workunit.client.1.smithi122.stdout:7/135: fsync d4/d8/f19 0 2024-09-13T02:50:43.419 INFO:tasks.workunit.client.1.smithi122.stdout:3/201: symlink d4/d6/df/l50 0 2024-09-13T02:50:43.419 INFO:tasks.workunit.client.1.smithi122.stdout:3/202: readlink d4/d11/dd/d21/d2b/d36/d3c/l4b 0 2024-09-13T02:50:43.419 INFO:tasks.workunit.client.1.smithi122.stdout:7/136: truncate d4/d8/db/ff 1118360 0 2024-09-13T02:50:43.419 INFO:tasks.workunit.client.1.smithi122.stdout:7/137: dread - d4/f29 zero size 2024-09-13T02:50:43.420 INFO:tasks.workunit.client.1.smithi122.stdout:7/138: readlink d4/d8/db/dc/l25 0 2024-09-13T02:50:43.420 INFO:tasks.workunit.client.1.smithi122.stdout:7/139: truncate d4/d8/db/f1f 4048014 0 2024-09-13T02:50:43.421 INFO:tasks.workunit.client.1.smithi122.stdout:7/140: mknod d4/d8/c2e 0 2024-09-13T02:50:43.423 INFO:tasks.workunit.client.1.smithi122.stdout:7/141: creat d4/d8/db/dc/d1b/f2f x:0 0 0 2024-09-13T02:50:43.423 INFO:tasks.workunit.client.1.smithi122.stdout:7/142: readlink d4/l1a 0 2024-09-13T02:50:43.425 INFO:tasks.workunit.client.1.smithi122.stdout:7/143: unlink d4/d8/db/dc/f1e 0 2024-09-13T02:50:43.426 INFO:tasks.workunit.client.1.smithi122.stdout:7/144: symlink d4/d8/db/dc/d1b/l30 0 2024-09-13T02:50:43.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/145: mknod d4/d8/db/dc/d1b/c31 0 2024-09-13T02:50:43.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/146: creat d4/d8/db/dc/d1b/f32 x:0 0 0 2024-09-13T02:50:43.431 INFO:tasks.workunit.client.1.smithi122.stdout:7/147: rename d4/d8/db/l2d to d4/d8/d24/l33 0 2024-09-13T02:50:43.434 INFO:tasks.workunit.client.1.smithi122.stdout:3/203: dwrite d4/d6/f47 [4194304,4194304] 0 2024-09-13T02:50:43.437 INFO:tasks.workunit.client.1.smithi122.stdout:3/204: creat d4/d4c/f51 x:0 0 0 2024-09-13T02:50:43.440 INFO:tasks.workunit.client.1.smithi122.stdout:3/205: rmdir d4/d6 39 2024-09-13T02:50:43.441 INFO:tasks.workunit.client.1.smithi122.stdout:3/206: symlink d4/d11/dd/d21/d30/l52 0 2024-09-13T02:50:43.441 INFO:tasks.workunit.client.1.smithi122.stdout:3/207: truncate d4/d11/f2d 5191786 0 2024-09-13T02:50:43.442 INFO:tasks.workunit.client.1.smithi122.stdout:3/208: stat d4/d6/de/f34 0 2024-09-13T02:50:43.443 INFO:tasks.workunit.client.1.smithi122.stdout:3/209: rmdir d4/d11/dd/d21/d2b/d36 39 2024-09-13T02:50:43.451 INFO:tasks.workunit.client.1.smithi122.stdout:7/148: dwrite d4/d8/db/dc/f28 [0,4194304] 0 2024-09-13T02:50:43.451 INFO:tasks.workunit.client.1.smithi122.stdout:7/149: creat d4/d8/db/dc/d1b/f34 x:0 0 0 2024-09-13T02:50:43.453 INFO:tasks.workunit.client.1.smithi122.stdout:1/95: sync 2024-09-13T02:50:43.455 INFO:tasks.workunit.client.1.smithi122.stdout:7/150: truncate d4/d8/db/f11 426398 0 2024-09-13T02:50:43.456 INFO:tasks.workunit.client.1.smithi122.stdout:6/259: dread d5/db/dc/f52 [0,4194304] 0 2024-09-13T02:50:43.457 INFO:tasks.workunit.client.1.smithi122.stdout:6/260: mknod d5/d40/c58 0 2024-09-13T02:50:43.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/96: dread f2 [0,4194304] 0 2024-09-13T02:50:43.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/97: dread - dc/f16 zero size 2024-09-13T02:50:43.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/98: dread - dc/fd zero size 2024-09-13T02:50:43.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/99: fdatasync fa 0 2024-09-13T02:50:43.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/100: creat dc/de/d18/d1d/f23 x:0 0 0 2024-09-13T02:50:43.462 INFO:tasks.workunit.client.1.smithi122.stdout:1/101: chown dc/f10 3 1 2024-09-13T02:50:43.462 INFO:tasks.workunit.client.1.smithi122.stdout:1/102: fsync dc/de/f11 0 2024-09-13T02:50:43.462 INFO:tasks.workunit.client.1.smithi122.stdout:3/210: dwrite d4/d6/f8 [4194304,4194304] 0 2024-09-13T02:50:43.462 INFO:tasks.workunit.client.1.smithi122.stdout:3/211: fsync f3 0 2024-09-13T02:50:43.465 INFO:tasks.workunit.client.1.smithi122.stdout:3/212: write d4/d11/f2d [2305233,32702] 0 2024-09-13T02:50:43.466 INFO:tasks.workunit.client.1.smithi122.stdout:3/213: mkdir d4/d11/dd/d21/d4e/d53 0 2024-09-13T02:50:43.467 INFO:tasks.workunit.client.1.smithi122.stdout:3/214: creat d4/d11/dd/d21/d2b/d36/f54 x:0 0 0 2024-09-13T02:50:43.468 INFO:tasks.workunit.client.1.smithi122.stdout:6/261: dread d5/d11/d33/d41/f47 [0,4194304] 0 2024-09-13T02:50:43.469 INFO:tasks.workunit.client.1.smithi122.stdout:6/262: mknod d5/d11/d3a/c59 0 2024-09-13T02:50:43.469 INFO:tasks.workunit.client.1.smithi122.stdout:6/263: creat d5/f5a x:0 0 0 2024-09-13T02:50:43.471 INFO:tasks.workunit.client.1.smithi122.stdout:6/264: mkdir d5/d11/d33/d41/d5b 0 2024-09-13T02:50:43.471 INFO:tasks.workunit.client.1.smithi122.stdout:6/265: readlink d5/la 0 2024-09-13T02:50:43.472 INFO:tasks.workunit.client.1.smithi122.stdout:6/266: truncate d5/db/f14 1000817 0 2024-09-13T02:50:43.472 INFO:tasks.workunit.client.1.smithi122.stdout:6/267: unlink d5/db/d29/c3e 0 2024-09-13T02:50:43.473 INFO:tasks.workunit.client.1.smithi122.stdout:6/268: creat d5/d11/d45/df/d26/f5c x:0 0 0 2024-09-13T02:50:43.475 INFO:tasks.workunit.client.1.smithi122.stdout:3/215: dread d4/d11/dd/d21/d2b/d35/f39 [0,4194304] 0 2024-09-13T02:50:43.475 INFO:tasks.workunit.client.1.smithi122.stdout:3/216: chown d4/d11/dd/d21/d2b/d36/d3c/f10 27796 1 2024-09-13T02:50:43.480 INFO:tasks.workunit.client.1.smithi122.stdout:1/103: dwrite dc/de/f11 [0,4194304] 0 2024-09-13T02:50:43.482 INFO:tasks.workunit.client.1.smithi122.stdout:6/269: getdents d5 0 2024-09-13T02:50:43.483 INFO:tasks.workunit.client.1.smithi122.stdout:6/270: rename d5/db/d29/f32 to d5/d11/d45/df/d46/f5d 0 2024-09-13T02:50:43.483 INFO:tasks.workunit.client.1.smithi122.stdout:6/271: fsync d5/db/f14 0 2024-09-13T02:50:43.484 INFO:tasks.workunit.client.1.smithi122.stdout:3/217: truncate d4/d11/f2d 2968667 0 2024-09-13T02:50:43.485 INFO:tasks.workunit.client.1.smithi122.stdout:3/218: write d4/d11/dd/d21/d2b/f45 [1390724,22554] 0 2024-09-13T02:50:43.485 INFO:tasks.workunit.client.1.smithi122.stdout:3/219: read - d4/d4c/f51 zero size 2024-09-13T02:50:43.492 INFO:tasks.workunit.client.1.smithi122.stdout:6/272: dread d5/db/f44 [0,4194304] 0 2024-09-13T02:50:43.505 INFO:tasks.workunit.client.1.smithi122.stdout:1/104: dwrite f0 [0,4194304] 0 2024-09-13T02:50:43.507 INFO:tasks.workunit.client.1.smithi122.stdout:1/105: write fa [515325,50079] 0 2024-09-13T02:50:43.507 INFO:tasks.workunit.client.1.smithi122.stdout:1/106: rmdir dc/de/d13 39 2024-09-13T02:50:43.508 INFO:tasks.workunit.client.1.smithi122.stdout:1/107: rmdir dc/de/d18 39 2024-09-13T02:50:43.508 INFO:tasks.workunit.client.1.smithi122.stdout:1/108: write fb [1510358,100247] 0 2024-09-13T02:50:43.508 INFO:tasks.workunit.client.1.smithi122.stdout:1/109: mknod dc/de/d13/c24 0 2024-09-13T02:50:43.510 INFO:tasks.workunit.client.1.smithi122.stdout:3/220: dwrite d4/d11/dd/d21/f4d [0,4194304] 0 2024-09-13T02:50:43.510 INFO:tasks.workunit.client.1.smithi122.stdout:3/221: fsync d4/d6/f4a 0 2024-09-13T02:50:43.511 INFO:tasks.workunit.client.1.smithi122.stdout:1/110: dread dc/f1a [0,4194304] 0 2024-09-13T02:50:43.511 INFO:tasks.workunit.client.1.smithi122.stdout:6/273: dwrite d5/d3d/f49 [0,4194304] 0 2024-09-13T02:50:43.512 INFO:tasks.workunit.client.1.smithi122.stdout:3/222: mkdir d4/d11/dd/d21/d2b/d55 0 2024-09-13T02:50:43.512 INFO:tasks.workunit.client.1.smithi122.stdout:1/111: rmdir dc/de 39 2024-09-13T02:50:43.514 INFO:tasks.workunit.client.1.smithi122.stdout:1/112: mknod dc/de/c25 0 2024-09-13T02:50:43.514 INFO:tasks.workunit.client.1.smithi122.stdout:1/113: fdatasync f0 0 2024-09-13T02:50:43.515 INFO:tasks.workunit.client.1.smithi122.stdout:1/114: mknod dc/de/c26 0 2024-09-13T02:50:43.515 INFO:tasks.workunit.client.1.smithi122.stdout:6/274: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:43.516 INFO:tasks.workunit.client.1.smithi122.stdout:1/115: creat dc/de/f27 x:0 0 0 2024-09-13T02:50:43.517 INFO:tasks.workunit.client.1.smithi122.stdout:6/275: unlink d5/d3d/f49 0 2024-09-13T02:50:43.518 INFO:tasks.workunit.client.1.smithi122.stdout:1/116: creat dc/de/d18/f28 x:0 0 0 2024-09-13T02:50:43.519 INFO:tasks.workunit.client.1.smithi122.stdout:6/276: symlink d5/d3d/d48/l5e 0 2024-09-13T02:50:43.520 INFO:tasks.workunit.client.1.smithi122.stdout:1/117: unlink dc/f1a 0 2024-09-13T02:50:43.520 INFO:tasks.workunit.client.1.smithi122.stdout:1/118: dread - dc/f16 zero size 2024-09-13T02:50:43.520 INFO:tasks.workunit.client.1.smithi122.stdout:1/119: chown f0 26677153 1 2024-09-13T02:50:43.521 INFO:tasks.workunit.client.1.smithi122.stdout:1/120: mknod dc/de/d18/c29 0 2024-09-13T02:50:43.528 INFO:tasks.workunit.client.1.smithi122.stdout:3/223: dwrite f3 [0,4194304] 0 2024-09-13T02:50:43.550 INFO:tasks.workunit.client.1.smithi122.stdout:1/121: dwrite f0 [0,4194304] 0 2024-09-13T02:50:43.550 INFO:tasks.workunit.client.1.smithi122.stdout:6/277: dwrite d5/d11/d45/df/f13 [0,4194304] 0 2024-09-13T02:50:43.550 INFO:tasks.workunit.client.1.smithi122.stdout:3/224: dwrite d4/d11/f2e [0,4194304] 0 2024-09-13T02:50:43.551 INFO:tasks.workunit.client.1.smithi122.stdout:1/122: mknod dc/de/d13/c2a 0 2024-09-13T02:50:43.551 INFO:tasks.workunit.client.1.smithi122.stdout:1/123: stat dc/f10 0 2024-09-13T02:50:43.551 INFO:tasks.workunit.client.1.smithi122.stdout:1/124: readlink dc/de/d13/l19 0 2024-09-13T02:50:43.553 INFO:tasks.workunit.client.1.smithi122.stdout:6/278: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:43.554 INFO:tasks.workunit.client.1.smithi122.stdout:6/279: mkdir d5/d11/d33/d41/d4e/d5f 0 2024-09-13T02:50:43.554 INFO:tasks.workunit.client.1.smithi122.stdout:6/280: getdents d5/d11/d33/d41/d5b 0 2024-09-13T02:50:43.556 INFO:tasks.workunit.client.1.smithi122.stdout:6/281: dread d5/f36 [0,4194304] 0 2024-09-13T02:50:43.556 INFO:tasks.workunit.client.1.smithi122.stdout:6/282: write d5/d11/d45/f2d [2646620,127788] 0 2024-09-13T02:50:43.556 INFO:tasks.workunit.client.1.smithi122.stdout:6/283: truncate d5/d11/f1f 1287850 0 2024-09-13T02:50:43.557 INFO:tasks.workunit.client.1.smithi122.stdout:6/284: mkdir d5/db/d29/d60 0 2024-09-13T02:50:43.557 INFO:tasks.workunit.client.1.smithi122.stdout:6/285: creat d5/d11/f61 x:0 0 0 2024-09-13T02:50:43.561 INFO:tasks.workunit.client.1.smithi122.stdout:1/125: rmdir dc/de/d18 39 2024-09-13T02:50:43.567 INFO:tasks.workunit.client.1.smithi122.stdout:3/225: dwrite d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:43.569 INFO:tasks.workunit.client.1.smithi122.stdout:3/226: creat d4/f56 x:0 0 0 2024-09-13T02:50:43.572 INFO:tasks.workunit.client.1.smithi122.stdout:6/286: dread d5/db/f44 [0,4194304] 0 2024-09-13T02:50:43.573 INFO:tasks.workunit.client.1.smithi122.stdout:1/126: dread f0 [0,4194304] 0 2024-09-13T02:50:43.573 INFO:tasks.workunit.client.1.smithi122.stdout:1/127: fdatasync dc/de/d18/d1d/f23 0 2024-09-13T02:50:43.574 INFO:tasks.workunit.client.1.smithi122.stdout:3/227: truncate d4/d11/f2d 865156 0 2024-09-13T02:50:43.574 INFO:tasks.workunit.client.1.smithi122.stdout:3/228: stat d4/d6/de 0 2024-09-13T02:50:43.575 INFO:tasks.workunit.client.1.smithi122.stdout:3/229: fsync d4/d11/dd/d21/d2b/d36/d3c/f10 0 2024-09-13T02:50:43.575 INFO:tasks.workunit.client.1.smithi122.stdout:3/230: fsync d4/d11/dd/d21/d2b/d36/f54 0 2024-09-13T02:50:43.575 INFO:tasks.workunit.client.1.smithi122.stdout:1/128: readlink l7 0 2024-09-13T02:50:43.575 INFO:tasks.workunit.client.1.smithi122.stdout:1/129: readlink l5 0 2024-09-13T02:50:43.576 INFO:tasks.workunit.client.1.smithi122.stdout:3/231: link d4/f56 d4/d6/de/d1f/f57 0 2024-09-13T02:50:43.576 INFO:tasks.workunit.client.1.smithi122.stdout:3/232: chown d4/d6/de 142 1 2024-09-13T02:50:43.576 INFO:tasks.workunit.client.1.smithi122.stdout:3/233: write d4/d6/de/d1f/f57 [332797,38168] 0 2024-09-13T02:50:43.577 INFO:tasks.workunit.client.1.smithi122.stdout:1/130: mknod dc/de/d18/d22/c2b 0 2024-09-13T02:50:43.577 INFO:tasks.workunit.client.1.smithi122.stdout:1/131: truncate fa 2030264 0 2024-09-13T02:50:43.577 INFO:tasks.workunit.client.1.smithi122.stdout:6/287: dread d5/fe [0,4194304] 0 2024-09-13T02:50:43.577 INFO:tasks.workunit.client.1.smithi122.stdout:6/288: getdents d5 0 2024-09-13T02:50:43.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/234: symlink d4/d6/de/d1f/d33/l58 0 2024-09-13T02:50:43.578 INFO:tasks.workunit.client.1.smithi122.stdout:1/132: creat dc/de/d18/f2c x:0 0 0 2024-09-13T02:50:43.586 INFO:tasks.workunit.client.1.smithi122.stdout:3/235: dread d4/d11/f2e [0,4194304] 0 2024-09-13T02:50:43.588 INFO:tasks.workunit.client.1.smithi122.stdout:3/236: link d4/d11/dd/d21/d2b/d36/d3c/l26 d4/d6/de/d1f/l59 0 2024-09-13T02:50:43.589 INFO:tasks.workunit.client.1.smithi122.stdout:3/237: mknod d4/d11/dd/d21/d2b/d36/d3c/c5a 0 2024-09-13T02:50:43.590 INFO:tasks.workunit.client.1.smithi122.stdout:6/289: dwrite d5/f5a [0,4194304] 0 2024-09-13T02:50:43.593 INFO:tasks.workunit.client.1.smithi122.stdout:6/290: mknod d5/d11/d33/d41/c62 0 2024-09-13T02:50:43.596 INFO:tasks.workunit.client.1.smithi122.stdout:6/291: getdents d5/d11/d45/df/d26 0 2024-09-13T02:50:43.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/292: mknod d5/d11/d45/c63 0 2024-09-13T02:50:43.597 INFO:tasks.workunit.client.1.smithi122.stdout:6/293: fsync d5/d11/d45/df/f24 0 2024-09-13T02:50:43.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/294: readlink d5/d11/d45/df/d46/l50 0 2024-09-13T02:50:43.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/295: mkdir d5/d11/d64 0 2024-09-13T02:50:43.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/296: write d5/d11/d45/df/d26/f5c [334255,51412] 0 2024-09-13T02:50:43.599 INFO:tasks.workunit.client.1.smithi122.stdout:6/297: dread d5/d11/d45/df/d46/f5d [0,4194304] 0 2024-09-13T02:50:43.604 INFO:tasks.workunit.client.1.smithi122.stdout:6/298: dread d5/d11/d45/f56 [0,4194304] 0 2024-09-13T02:50:43.604 INFO:tasks.workunit.client.1.smithi122.stdout:6/299: fdatasync d5/d40/f35 0 2024-09-13T02:50:43.604 INFO:tasks.workunit.client.1.smithi122.stdout:6/300: read d5/db/f44 [903722,88588] 0 2024-09-13T02:50:43.605 INFO:tasks.workunit.client.1.smithi122.stdout:6/301: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:43.606 INFO:tasks.workunit.client.1.smithi122.stdout:6/302: dread d5/d40/f35 [0,4194304] 0 2024-09-13T02:50:43.607 INFO:tasks.workunit.client.1.smithi122.stdout:6/303: creat d5/d11/d33/d41/d5b/f65 x:0 0 0 2024-09-13T02:50:43.607 INFO:tasks.workunit.client.1.smithi122.stdout:6/304: chown d5/db/l3c 2280 1 2024-09-13T02:50:43.607 INFO:tasks.workunit.client.1.smithi122.stdout:3/238: dwrite d4/d11/dd/d21/d2b/d35/f39 [4194304,4194304] 0 2024-09-13T02:50:43.608 INFO:tasks.workunit.client.1.smithi122.stdout:3/239: readlink d4/d11/dd/d21/d30/l52 0 2024-09-13T02:50:43.608 INFO:tasks.workunit.client.1.smithi122.stdout:3/240: stat d4/d6/df/l49 0 2024-09-13T02:50:43.609 INFO:tasks.workunit.client.1.smithi122.stdout:6/305: symlink d5/db/l66 0 2024-09-13T02:50:43.610 INFO:tasks.workunit.client.1.smithi122.stdout:6/306: rmdir d5/d11/d64 0 2024-09-13T02:50:43.611 INFO:tasks.workunit.client.1.smithi122.stdout:6/307: creat d5/d40/f67 x:0 0 0 2024-09-13T02:50:43.611 INFO:tasks.workunit.client.1.smithi122.stdout:6/308: truncate d5/d11/d45/d21/f3f 1673824 0 2024-09-13T02:50:43.611 INFO:tasks.workunit.client.1.smithi122.stdout:6/309: chown d5/db/dc/l42 30908471 1 2024-09-13T02:50:43.612 INFO:tasks.workunit.client.1.smithi122.stdout:3/241: read d4/d11/dd/d21/d2b/d35/f39 [2770175,59295] 0 2024-09-13T02:50:43.613 INFO:tasks.workunit.client.1.smithi122.stdout:6/310: mknod d5/d11/d3a/c68 0 2024-09-13T02:50:43.613 INFO:tasks.workunit.client.1.smithi122.stdout:3/242: rmdir d4/d11/dd/d21/d4e 39 2024-09-13T02:50:43.613 INFO:tasks.workunit.client.1.smithi122.stdout:6/311: read d5/f9 [1615420,98479] 0 2024-09-13T02:50:43.613 INFO:tasks.workunit.client.1.smithi122.stdout:6/312: chown d5/d11/d45/f22 3381 1 2024-09-13T02:50:43.614 INFO:tasks.workunit.client.1.smithi122.stdout:6/313: chown d5/c30 2453 1 2024-09-13T02:50:43.621 INFO:tasks.workunit.client.1.smithi122.stdout:3/243: dread d4/d6/f8 [4194304,4194304] 0 2024-09-13T02:50:43.621 INFO:tasks.workunit.client.1.smithi122.stdout:3/244: rename d4/d11 to d4/d11/dd/d5b 22 2024-09-13T02:50:43.622 INFO:tasks.workunit.client.1.smithi122.stdout:3/245: symlink d4/d11/dd/d21/d2b/d55/l5c 0 2024-09-13T02:50:43.624 INFO:tasks.workunit.client.1.smithi122.stdout:3/246: write d4/d6/de/f34 [4706822,21798] 0 2024-09-13T02:50:43.624 INFO:tasks.workunit.client.1.smithi122.stdout:3/247: dread - d4/d4c/f51 zero size 2024-09-13T02:50:43.629 INFO:tasks.workunit.client.1.smithi122.stdout:6/314: dwrite d5/d11/d2f/f4d [0,4194304] 0 2024-09-13T02:50:43.636 INFO:tasks.workunit.client.1.smithi122.stdout:3/248: dread d4/d6/f47 [4194304,4194304] 0 2024-09-13T02:50:43.636 INFO:tasks.workunit.client.1.smithi122.stdout:3/249: chown d4/d11/l1d 260 1 2024-09-13T02:50:43.641 INFO:tasks.workunit.client.1.smithi122.stdout:3/250: dread d4/d11/dd/d21/d2b/f45 [0,4194304] 0 2024-09-13T02:50:43.641 INFO:tasks.workunit.client.1.smithi122.stdout:3/251: write d4/d6/df/f32 [441365,61982] 0 2024-09-13T02:50:43.641 INFO:tasks.workunit.client.1.smithi122.stdout:3/252: fdatasync d4/d11/d38/f3f 0 2024-09-13T02:50:43.647 INFO:tasks.workunit.client.1.smithi122.stdout:6/315: dwrite d5/db/f44 [0,4194304] 0 2024-09-13T02:50:43.647 INFO:tasks.workunit.client.1.smithi122.stdout:6/316: truncate d5/d11/d33/d41/d5b/f65 888413 0 2024-09-13T02:50:43.649 INFO:tasks.workunit.client.1.smithi122.stdout:3/253: dread d4/d6/df/f32 [0,4194304] 0 2024-09-13T02:50:43.650 INFO:tasks.workunit.client.1.smithi122.stdout:3/254: dread d4/d6/df/f32 [0,4194304] 0 2024-09-13T02:50:43.661 INFO:tasks.workunit.client.1.smithi122.stdout:6/317: dwrite d5/f36 [0,4194304] 0 2024-09-13T02:50:43.661 INFO:tasks.workunit.client.1.smithi122.stdout:6/318: chown d5/d11/f4f 12 1 2024-09-13T02:50:43.665 INFO:tasks.workunit.client.1.smithi122.stdout:3/255: dread d4/d6/f25 [0,4194304] 0 2024-09-13T02:50:43.667 INFO:tasks.workunit.client.1.smithi122.stdout:3/256: rename d4/d11/dd/d21/d2b/d36/d3c/f2a to d4/f5d 0 2024-09-13T02:50:43.668 INFO:tasks.workunit.client.1.smithi122.stdout:3/257: read d4/d11/d38/f3f [31340,2253] 0 2024-09-13T02:50:43.669 INFO:tasks.workunit.client.1.smithi122.stdout:3/258: mknod d4/d11/dd/d21/d2b/d36/c5e 0 2024-09-13T02:50:43.687 INFO:tasks.workunit.client.1.smithi122.stdout:6/319: dwrite d5/d11/d33/d41/f47 [4194304,4194304] 0 2024-09-13T02:50:43.688 INFO:tasks.workunit.client.1.smithi122.stdout:6/320: chown d5/fe 106970255 1 2024-09-13T02:50:43.688 INFO:tasks.workunit.client.1.smithi122.stdout:6/321: fdatasync d5/db/dc/f52 0 2024-09-13T02:50:43.691 INFO:tasks.workunit.client.1.smithi122.stdout:3/259: dwrite d4/d11/dd/d21/d2b/d36/d3c/f20 [0,4194304] 0 2024-09-13T02:50:43.701 INFO:tasks.workunit.client.1.smithi122.stdout:6/322: write d5/d11/d45/f2d [1813319,46570] 0 2024-09-13T02:50:43.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/260: dwrite d4/d11/dd/d21/f4d [4194304,4194304] 0 2024-09-13T02:50:43.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/261: dread - d4/f5d zero size 2024-09-13T02:50:43.716 INFO:tasks.workunit.client.1.smithi122.stdout:2/64: sync 2024-09-13T02:50:43.717 INFO:tasks.workunit.client.1.smithi122.stdout:3/262: rmdir d4/d11 39 2024-09-13T02:50:43.718 INFO:tasks.workunit.client.1.smithi122.stdout:2/65: creat d0/dd/ff x:0 0 0 2024-09-13T02:50:43.718 INFO:tasks.workunit.client.1.smithi122.stdout:2/66: chown d0/dd/ce 848228 1 2024-09-13T02:50:43.719 INFO:tasks.workunit.client.1.smithi122.stdout:3/263: mkdir d4/d6/d5f 0 2024-09-13T02:50:43.719 INFO:tasks.workunit.client.1.smithi122.stdout:3/264: write d4/d11/dd/d21/d2b/d36/f54 [323774,62163] 0 2024-09-13T02:50:43.719 INFO:tasks.workunit.client.1.smithi122.stdout:2/67: unlink d0/c6 0 2024-09-13T02:50:43.720 INFO:tasks.workunit.client.1.smithi122.stdout:2/68: creat d0/f10 x:0 0 0 2024-09-13T02:50:43.721 INFO:tasks.workunit.client.1.smithi122.stdout:2/69: fsync d0/f5 0 2024-09-13T02:50:43.721 INFO:tasks.workunit.client.1.smithi122.stdout:2/70: write d0/f10 [851072,125892] 0 2024-09-13T02:50:43.721 INFO:tasks.workunit.client.1.smithi122.stdout:2/71: write d0/f10 [2002371,40157] 0 2024-09-13T02:50:43.721 INFO:tasks.workunit.client.1.smithi122.stdout:2/72: rename d0/c9 to d0/c11 0 2024-09-13T02:50:43.723 INFO:tasks.workunit.client.1.smithi122.stdout:6/323: dwrite d5/d11/d45/f2d [0,4194304] 0 2024-09-13T02:50:43.724 INFO:tasks.workunit.client.1.smithi122.stdout:2/73: getdents d0/dd 0 2024-09-13T02:50:43.737 INFO:tasks.workunit.client.1.smithi122.stdout:6/324: write d5/db/d29/f1d [3694647,45282] 0 2024-09-13T02:50:43.744 INFO:tasks.workunit.client.1.smithi122.stdout:2/74: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T02:50:43.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/325: dread d5/d11/d2f/f4d [0,4194304] 0 2024-09-13T02:50:43.746 INFO:tasks.workunit.client.1.smithi122.stdout:6/326: truncate d5/d11/d45/df/f24 1424486 0 2024-09-13T02:50:43.746 INFO:tasks.workunit.client.1.smithi122.stdout:2/75: rmdir d0/dd 39 2024-09-13T02:50:43.747 INFO:tasks.workunit.client.1.smithi122.stdout:6/327: creat d5/f69 x:0 0 0 2024-09-13T02:50:43.748 INFO:tasks.workunit.client.1.smithi122.stdout:6/328: unlink d5/c31 0 2024-09-13T02:50:43.749 INFO:tasks.workunit.client.1.smithi122.stdout:6/329: rename d5/db/dc/f52 to d5/d11/d33/f6a 0 2024-09-13T02:50:43.758 INFO:tasks.workunit.client.1.smithi122.stdout:2/76: write d0/f5 [668552,38448] 0 2024-09-13T02:50:43.758 INFO:tasks.workunit.client.1.smithi122.stdout:2/77: write d0/dd/ff [400972,77943] 0 2024-09-13T02:50:43.771 INFO:tasks.workunit.client.1.smithi122.stdout:6/330: dwrite d5/f36 [0,4194304] 0 2024-09-13T02:50:43.771 INFO:tasks.workunit.client.1.smithi122.stdout:2/78: dwrite d0/fc [0,4194304] 0 2024-09-13T02:50:43.771 INFO:tasks.workunit.client.1.smithi122.stdout:2/79: chown d0/f5 354752 1 2024-09-13T02:50:43.772 INFO:tasks.workunit.client.1.smithi122.stdout:6/331: creat d5/d3d/d48/f6b x:0 0 0 2024-09-13T02:50:43.774 INFO:tasks.workunit.client.1.smithi122.stdout:2/80: mknod d0/dd/c12 0 2024-09-13T02:50:43.781 INFO:tasks.workunit.client.1.smithi122.stdout:2/81: chown d0/c7 868 1 2024-09-13T02:50:43.781 INFO:tasks.workunit.client.1.smithi122.stdout:6/332: getdents d5/d11 0 2024-09-13T02:50:43.781 INFO:tasks.workunit.client.1.smithi122.stdout:2/82: symlink d0/l13 0 2024-09-13T02:50:43.781 INFO:tasks.workunit.client.1.smithi122.stdout:6/333: rename d5/d11/d33 to d5/d3d/d6c 0 2024-09-13T02:50:43.782 INFO:tasks.workunit.client.1.smithi122.stdout:2/83: write d0/f10 [2248188,33062] 0 2024-09-13T02:50:43.784 INFO:tasks.workunit.client.1.smithi122.stdout:2/84: mknod d0/c14 0 2024-09-13T02:50:43.785 INFO:tasks.workunit.client.1.smithi122.stdout:6/334: rename d5/d11/d45/d21/c2b to d5/db/c6d 0 2024-09-13T02:50:43.786 INFO:tasks.workunit.client.1.smithi122.stdout:6/335: mknod d5/d3d/d48/c6e 0 2024-09-13T02:50:43.789 INFO:tasks.workunit.client.1.smithi122.stdout:6/336: write d5/f8 [3624971,68996] 0 2024-09-13T02:50:43.790 INFO:tasks.workunit.client.1.smithi122.stdout:2/85: write d0/f5 [4980825,27672] 0 2024-09-13T02:50:43.790 INFO:tasks.workunit.client.1.smithi122.stdout:6/337: symlink d5/d40/l6f 0 2024-09-13T02:50:43.790 INFO:tasks.workunit.client.1.smithi122.stdout:6/338: chown d5/d11/d45/df/d26/f5c 214 1 2024-09-13T02:50:43.790 INFO:tasks.workunit.client.1.smithi122.stdout:2/86: fdatasync d0/f4 0 2024-09-13T02:50:43.790 INFO:tasks.workunit.client.1.smithi122.stdout:2/87: write d0/f5 [5943954,94564] 0 2024-09-13T02:50:43.792 INFO:tasks.workunit.client.1.smithi122.stdout:6/339: unlink d5/d11/f1f 0 2024-09-13T02:50:43.792 INFO:tasks.workunit.client.1.smithi122.stdout:6/340: rename d5/d3d/d6c to d5/d3d/d6c/d41/d4e/d5f/d70 22 2024-09-13T02:50:43.793 INFO:tasks.workunit.client.1.smithi122.stdout:6/341: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:43.793 INFO:tasks.workunit.client.1.smithi122.stdout:6/342: getdents d5/d11/d45/df 0 2024-09-13T02:50:43.798 INFO:tasks.workunit.client.1.smithi122.stdout:2/88: dread d0/fc [0,4194304] 0 2024-09-13T02:50:43.801 INFO:tasks.workunit.client.1.smithi122.stdout:2/89: rename d0/dd/c12 to d0/c15 0 2024-09-13T02:50:43.801 INFO:tasks.workunit.client.1.smithi122.stdout:2/90: chown d0/c14 118 1 2024-09-13T02:50:43.821 INFO:tasks.workunit.client.1.smithi122.stdout:6/343: dwrite d5/db/d29/f1d [0,4194304] 0 2024-09-13T02:50:43.821 INFO:tasks.workunit.client.1.smithi122.stdout:2/91: dwrite d0/f10 [0,4194304] 0 2024-09-13T02:50:43.822 INFO:tasks.workunit.client.1.smithi122.stdout:6/344: link d5/d11/d45/df/d46/l50 d5/d11/d45/df/l71 0 2024-09-13T02:50:43.822 INFO:tasks.workunit.client.1.smithi122.stdout:6/345: fdatasync d5/d11/d45/d21/f3f 0 2024-09-13T02:50:43.823 INFO:tasks.workunit.client.1.smithi122.stdout:6/346: write d5/d11/d45/df/f24 [993483,45602] 0 2024-09-13T02:50:43.824 INFO:tasks.workunit.client.1.smithi122.stdout:2/92: rmdir d0/dd 39 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:8/70: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:0/96: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:7/151: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:4/132: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:5/159: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:4/133: readlink l7 0 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:7/152: chown d4/d8/db/dc/f22 9593 1 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:1/133: sync 2024-09-13T02:50:43.837 INFO:tasks.workunit.client.1.smithi122.stdout:3/265: sync 2024-09-13T02:50:43.838 INFO:tasks.workunit.client.1.smithi122.stdout:9/153: sync 2024-09-13T02:50:43.838 INFO:tasks.workunit.client.1.smithi122.stdout:4/134: write d11/d13/d14/f19 [4779408,110913] 0 2024-09-13T02:50:43.838 INFO:tasks.workunit.client.1.smithi122.stdout:9/154: chown d8/d16/d19/d23/d1f 431 1 2024-09-13T02:50:43.838 INFO:tasks.workunit.client.1.smithi122.stdout:6/347: dread d5/db/f1b [0,4194304] 0 2024-09-13T02:50:43.838 INFO:tasks.workunit.client.1.smithi122.stdout:7/153: link d4/d8/f19 d4/f35 0 2024-09-13T02:50:43.839 INFO:tasks.workunit.client.1.smithi122.stdout:0/97: symlink d1/d5/l21 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:0/98: creat d1/d5/d9/da/d17/f22 x:0 0 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:0/99: write d1/d5/f1c [1024278,126352] 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:4/135: symlink d11/d13/d14/l27 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:4/136: stat fa 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:4/137: fdatasync fa 0 2024-09-13T02:50:43.840 INFO:tasks.workunit.client.1.smithi122.stdout:4/138: creat d11/d13/d14/f28 x:0 0 0 2024-09-13T02:50:43.841 INFO:tasks.workunit.client.1.smithi122.stdout:2/93: dwrite d0/dd/ff [0,4194304] 0 2024-09-13T02:50:43.841 INFO:tasks.workunit.client.1.smithi122.stdout:9/155: truncate f6 650956 0 2024-09-13T02:50:43.842 INFO:tasks.workunit.client.1.smithi122.stdout:6/348: fdatasync d5/f8 0 2024-09-13T02:50:43.842 INFO:tasks.workunit.client.1.smithi122.stdout:7/154: mkdir d4/d8/db/dc/d36 0 2024-09-13T02:50:43.842 INFO:tasks.workunit.client.1.smithi122.stdout:7/155: write d4/d8/db/ff [1544717,125973] 0 2024-09-13T02:50:43.843 INFO:tasks.workunit.client.1.smithi122.stdout:4/139: rmdir d11 39 2024-09-13T02:50:43.844 INFO:tasks.workunit.client.1.smithi122.stdout:2/94: creat d0/f16 x:0 0 0 2024-09-13T02:50:43.845 INFO:tasks.workunit.client.1.smithi122.stdout:1/134: dread fb [0,4194304] 0 2024-09-13T02:50:43.847 INFO:tasks.workunit.client.1.smithi122.stdout:8/71: rmdir d3/db 0 2024-09-13T02:50:43.849 INFO:tasks.workunit.client.1.smithi122.stdout:7/156: creat d4/d8/d24/f37 x:0 0 0 2024-09-13T02:50:43.850 INFO:tasks.workunit.client.1.smithi122.stdout:4/140: mknod d11/c29 0 2024-09-13T02:50:43.852 INFO:tasks.workunit.client.1.smithi122.stdout:5/160: dwrite d0/f1a [0,4194304] 0 2024-09-13T02:50:43.855 INFO:tasks.workunit.client.1.smithi122.stdout:1/135: symlink dc/de/d18/d1d/l2d 0 2024-09-13T02:50:43.855 INFO:tasks.workunit.client.1.smithi122.stdout:0/100: dread d1/d5/fd [0,4194304] 0 2024-09-13T02:50:43.855 INFO:tasks.workunit.client.1.smithi122.stdout:0/101: creat d1/d5/f23 x:0 0 0 2024-09-13T02:50:43.855 INFO:tasks.workunit.client.1.smithi122.stdout:0/102: stat d1/d5/d10/f14 0 2024-09-13T02:50:43.856 INFO:tasks.workunit.client.1.smithi122.stdout:8/72: truncate d3/da/f8 8136046 0 2024-09-13T02:50:43.857 INFO:tasks.workunit.client.1.smithi122.stdout:6/349: mknod d5/d11/d3a/c72 0 2024-09-13T02:50:43.857 INFO:tasks.workunit.client.1.smithi122.stdout:6/350: creat d5/d11/d45/d21/f73 x:0 0 0 2024-09-13T02:50:43.858 INFO:tasks.workunit.client.1.smithi122.stdout:1/136: dread dc/de/d18/d22/f20 [0,4194304] 0 2024-09-13T02:50:43.858 INFO:tasks.workunit.client.1.smithi122.stdout:1/137: fdatasync dc/de/d18/d22/f20 0 2024-09-13T02:50:43.858 INFO:tasks.workunit.client.1.smithi122.stdout:1/138: dread - dc/de/f27 zero size 2024-09-13T02:50:43.858 INFO:tasks.workunit.client.1.smithi122.stdout:7/157: link d4/d8/f27 d4/d8/db/f38 0 2024-09-13T02:50:43.859 INFO:tasks.workunit.client.1.smithi122.stdout:4/141: mkdir d11/d13/d14/d2a 0 2024-09-13T02:50:43.859 INFO:tasks.workunit.client.1.smithi122.stdout:4/142: write d11/d1b/f1c [227416,25128] 0 2024-09-13T02:50:43.864 INFO:tasks.workunit.client.1.smithi122.stdout:2/95: dwrite d0/dd/ff [0,4194304] 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:5/161: mkdir d0/d17/d35 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:9/156: rename f6 to d8/d16/d19/d23/f2f 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:9/157: write d8/f28 [229318,69690] 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:0/103: getdents d1/d5/d10 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:9/158: chown d8/d16/d19/d23/d1f/f2d 76919782 1 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:0/104: fsync d1/d5/d10/f14 0 2024-09-13T02:50:43.865 INFO:tasks.workunit.client.1.smithi122.stdout:8/73: mkdir d3/df 0 2024-09-13T02:50:43.866 INFO:tasks.workunit.client.1.smithi122.stdout:6/351: truncate d5/f5a 2512637 0 2024-09-13T02:50:43.867 INFO:tasks.workunit.client.1.smithi122.stdout:4/143: creat d11/d13/d14/d2a/f2b x:0 0 0 2024-09-13T02:50:43.871 INFO:tasks.workunit.client.1.smithi122.stdout:5/162: truncate d0/da/f19 1310641 0 2024-09-13T02:50:43.871 INFO:tasks.workunit.client.1.smithi122.stdout:5/163: chown d0/d2/d21/d25 3316 1 2024-09-13T02:50:43.873 INFO:tasks.workunit.client.1.smithi122.stdout:0/105: mknod d1/d5/d9/da/d17/c24 0 2024-09-13T02:50:43.874 INFO:tasks.workunit.client.1.smithi122.stdout:8/74: creat d3/da/f10 x:0 0 0 2024-09-13T02:50:43.876 INFO:tasks.workunit.client.1.smithi122.stdout:4/144: getdents d11 0 2024-09-13T02:50:43.876 INFO:tasks.workunit.client.1.smithi122.stdout:4/145: fsync d11/d13/d14/f19 0 2024-09-13T02:50:43.879 INFO:tasks.workunit.client.1.smithi122.stdout:8/75: creat d3/df/f11 x:0 0 0 2024-09-13T02:50:43.879 INFO:tasks.workunit.client.1.smithi122.stdout:2/96: dread d0/f10 [0,4194304] 0 2024-09-13T02:50:43.880 INFO:tasks.workunit.client.1.smithi122.stdout:6/352: truncate d5/d11/d2f/f4d 1225715 0 2024-09-13T02:50:43.881 INFO:tasks.workunit.client.1.smithi122.stdout:5/164: rename d0/d2/d21 to d0/d17/d36 0 2024-09-13T02:50:43.881 INFO:tasks.workunit.client.1.smithi122.stdout:5/165: write d0/da/f16 [786066,96751] 0 2024-09-13T02:50:43.883 INFO:tasks.workunit.client.1.smithi122.stdout:8/76: mknod d3/c12 0 2024-09-13T02:50:43.885 INFO:tasks.workunit.client.1.smithi122.stdout:0/106: rename d1/d5/f1c to d1/d5/d9/f25 0 2024-09-13T02:50:43.885 INFO:tasks.workunit.client.1.smithi122.stdout:0/107: chown d1/d5 1 1 2024-09-13T02:50:43.886 INFO:tasks.workunit.client.1.smithi122.stdout:2/97: rename d0/dd to d0/d17 0 2024-09-13T02:50:43.886 INFO:tasks.workunit.client.1.smithi122.stdout:2/98: fsync d0/f16 0 2024-09-13T02:50:43.887 INFO:tasks.workunit.client.1.smithi122.stdout:0/108: creat d1/f26 x:0 0 0 2024-09-13T02:50:43.887 INFO:tasks.workunit.client.1.smithi122.stdout:0/109: readlink d1/d5/l21 0 2024-09-13T02:50:43.888 INFO:tasks.workunit.client.1.smithi122.stdout:9/159: dwrite d8/f28 [0,4194304] 0 2024-09-13T02:50:43.889 INFO:tasks.workunit.client.1.smithi122.stdout:0/110: write d1/d5/d9/f25 [178067,64898] 0 2024-09-13T02:50:43.889 INFO:tasks.workunit.client.1.smithi122.stdout:0/111: write d1/d5/d9/da/d17/f1b [2004488,123338] 0 2024-09-13T02:50:43.890 INFO:tasks.workunit.client.1.smithi122.stdout:9/160: symlink d8/l30 0 2024-09-13T02:50:43.891 INFO:tasks.workunit.client.1.smithi122.stdout:8/77: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:43.891 INFO:tasks.workunit.client.1.smithi122.stdout:8/78: chown d3/df 1346 1 2024-09-13T02:50:43.892 INFO:tasks.workunit.client.1.smithi122.stdout:8/79: creat d3/df/f13 x:0 0 0 2024-09-13T02:50:43.892 INFO:tasks.workunit.client.1.smithi122.stdout:8/80: write d3/da/f8 [2598189,20466] 0 2024-09-13T02:50:43.892 INFO:tasks.workunit.client.1.smithi122.stdout:0/112: symlink d1/d5/d9/l27 0 2024-09-13T02:50:43.893 INFO:tasks.workunit.client.1.smithi122.stdout:9/161: truncate d8/f1a 337744 0 2024-09-13T02:50:43.897 INFO:tasks.workunit.client.1.smithi122.stdout:4/146: dwrite d11/d1b/f23 [0,4194304] 0 2024-09-13T02:50:43.901 INFO:tasks.workunit.client.1.smithi122.stdout:9/162: write d8/d16/d19/f2c [195782,118148] 0 2024-09-13T02:50:43.901 INFO:tasks.workunit.client.1.smithi122.stdout:9/163: fsync f4 0 2024-09-13T02:50:43.901 INFO:tasks.workunit.client.1.smithi122.stdout:4/147: dread d11/d13/f1a [0,4194304] 0 2024-09-13T02:50:43.901 INFO:tasks.workunit.client.1.smithi122.stdout:4/148: readlink le 0 2024-09-13T02:50:43.902 INFO:tasks.workunit.client.1.smithi122.stdout:4/149: chown cc 6428 1 2024-09-13T02:50:43.907 INFO:tasks.workunit.client.1.smithi122.stdout:4/150: creat d11/d13/f2c x:0 0 0 2024-09-13T02:50:43.907 INFO:tasks.workunit.client.1.smithi122.stdout:4/151: readlink d11/d1b/l1d 0 2024-09-13T02:50:43.907 INFO:tasks.workunit.client.1.smithi122.stdout:4/152: getdents d11 0 2024-09-13T02:50:43.907 INFO:tasks.workunit.client.1.smithi122.stdout:4/153: read - d11/d13/d14/f25 zero size 2024-09-13T02:50:43.909 INFO:tasks.workunit.client.1.smithi122.stdout:9/164: getdents d8 0 2024-09-13T02:50:43.910 INFO:tasks.workunit.client.1.smithi122.stdout:9/165: stat d8/f28 0 2024-09-13T02:50:43.910 INFO:tasks.workunit.client.1.smithi122.stdout:9/166: rename d8/d16 to d8/d16/d19/d29/d31 22 2024-09-13T02:50:43.912 INFO:tasks.workunit.client.1.smithi122.stdout:9/167: creat d8/d16/d19/d23/f32 x:0 0 0 2024-09-13T02:50:43.913 INFO:tasks.workunit.client.1.smithi122.stdout:9/168: creat d8/f33 x:0 0 0 2024-09-13T02:50:43.914 INFO:tasks.workunit.client.1.smithi122.stdout:9/169: rename d8/d16/d19/d23/f2f to d8/d16/d19/d23/f34 0 2024-09-13T02:50:43.915 INFO:tasks.workunit.client.1.smithi122.stdout:9/170: rename d8/l30 to d8/d16/d19/d29/l35 0 2024-09-13T02:50:43.925 INFO:tasks.workunit.client.1.smithi122.stdout:6/353: dwrite d5/f9 [0,4194304] 0 2024-09-13T02:50:43.925 INFO:tasks.workunit.client.1.smithi122.stdout:8/81: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:43.925 INFO:tasks.workunit.client.1.smithi122.stdout:8/82: creat d3/df/f14 x:0 0 0 2024-09-13T02:50:43.926 INFO:tasks.workunit.client.1.smithi122.stdout:2/99: dwrite d0/f5 [0,4194304] 0 2024-09-13T02:50:43.926 INFO:tasks.workunit.client.1.smithi122.stdout:5/166: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-13T02:50:43.926 INFO:tasks.workunit.client.1.smithi122.stdout:5/167: chown d0/d17/d36/d25/d2b/f30 33 1 2024-09-13T02:50:43.926 INFO:tasks.workunit.client.1.smithi122.stdout:5/168: write d0/d2/f20 [903040,22224] 0 2024-09-13T02:50:43.930 INFO:tasks.workunit.client.1.smithi122.stdout:8/83: symlink d3/l15 0 2024-09-13T02:50:43.932 INFO:tasks.workunit.client.1.smithi122.stdout:4/154: rmdir d11/d13 39 2024-09-13T02:50:43.932 INFO:tasks.workunit.client.1.smithi122.stdout:4/155: stat d11/d13/d14/d2a 0 2024-09-13T02:50:43.934 INFO:tasks.workunit.client.1.smithi122.stdout:4/156: unlink d11/l20 0 2024-09-13T02:50:43.934 INFO:tasks.workunit.client.1.smithi122.stdout:2/100: dread d0/f4 [0,4194304] 0 2024-09-13T02:50:43.940 INFO:tasks.workunit.client.1.smithi122.stdout:9/171: getdents d8/d16/d19/d23 0 2024-09-13T02:50:43.940 INFO:tasks.workunit.client.1.smithi122.stdout:2/101: getdents d0 0 2024-09-13T02:50:43.940 INFO:tasks.workunit.client.1.smithi122.stdout:2/102: chown d0/c8 15 1 2024-09-13T02:50:43.942 INFO:tasks.workunit.client.1.smithi122.stdout:9/172: mkdir d8/d16/d19/d23/d1f/d36 0 2024-09-13T02:50:43.942 INFO:tasks.workunit.client.1.smithi122.stdout:9/173: chown d8/d16/d19/d23/c20 3 1 2024-09-13T02:50:43.942 INFO:tasks.workunit.client.1.smithi122.stdout:9/174: stat d8/d16/c1c 0 2024-09-13T02:50:43.942 INFO:tasks.workunit.client.1.smithi122.stdout:8/84: dread d3/da/f8 [0,4194304] 0 2024-09-13T02:50:43.943 INFO:tasks.workunit.client.1.smithi122.stdout:8/85: stat d3 0 2024-09-13T02:50:43.944 INFO:tasks.workunit.client.1.smithi122.stdout:2/103: creat d0/f18 x:0 0 0 2024-09-13T02:50:43.944 INFO:tasks.workunit.client.1.smithi122.stdout:2/104: fdatasync d0/f10 0 2024-09-13T02:50:43.944 INFO:tasks.workunit.client.1.smithi122.stdout:2/105: creat d0/f19 x:0 0 0 2024-09-13T02:50:43.946 INFO:tasks.workunit.client.1.smithi122.stdout:2/106: symlink d0/l1a 0 2024-09-13T02:50:43.946 INFO:tasks.workunit.client.1.smithi122.stdout:2/107: creat d0/f1b x:0 0 0 2024-09-13T02:50:43.946 INFO:tasks.workunit.client.1.smithi122.stdout:2/108: readlink d0/l1a 0 2024-09-13T02:50:43.947 INFO:tasks.workunit.client.1.smithi122.stdout:2/109: write d0/f10 [5140105,2770] 0 2024-09-13T02:50:43.947 INFO:tasks.workunit.client.1.smithi122.stdout:9/175: dread d8/d16/d19/d23/f34 [0,4194304] 0 2024-09-13T02:50:43.947 INFO:tasks.workunit.client.1.smithi122.stdout:9/176: creat d8/d16/d19/d23/d1f/f37 x:0 0 0 2024-09-13T02:50:43.950 INFO:tasks.workunit.client.1.smithi122.stdout:9/177: creat d8/d16/d19/d29/f38 x:0 0 0 2024-09-13T02:50:43.952 INFO:tasks.workunit.client.1.smithi122.stdout:9/178: symlink d8/d16/d19/d23/d1f/l39 0 2024-09-13T02:50:43.953 INFO:tasks.workunit.client.1.smithi122.stdout:9/179: creat d8/d16/d19/d23/d1f/d36/f3a x:0 0 0 2024-09-13T02:50:43.957 INFO:tasks.workunit.client.1.smithi122.stdout:4/157: dwrite f10 [0,4194304] 0 2024-09-13T02:50:43.963 INFO:tasks.workunit.client.1.smithi122.stdout:6/354: dwrite d5/db/f17 [0,4194304] 0 2024-09-13T02:50:43.963 INFO:tasks.workunit.client.1.smithi122.stdout:6/355: creat d5/d11/d2f/f74 x:0 0 0 2024-09-13T02:50:43.964 INFO:tasks.workunit.client.1.smithi122.stdout:6/356: chown d5/d11/d45/c63 81784 1 2024-09-13T02:50:43.964 INFO:tasks.workunit.client.1.smithi122.stdout:6/357: write d5/d11/d45/f2d [4819602,127501] 0 2024-09-13T02:50:43.964 INFO:tasks.workunit.client.1.smithi122.stdout:9/180: dread d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:43.964 INFO:tasks.workunit.client.1.smithi122.stdout:9/181: dread - d8/f33 zero size 2024-09-13T02:50:43.965 INFO:tasks.workunit.client.1.smithi122.stdout:5/169: dwrite d0/d17/f28 [0,4194304] 0 2024-09-13T02:50:43.965 INFO:tasks.workunit.client.1.smithi122.stdout:6/358: creat d5/d11/f75 x:0 0 0 2024-09-13T02:50:43.965 INFO:tasks.workunit.client.1.smithi122.stdout:6/359: truncate d5/db/f51 823915 0 2024-09-13T02:50:43.965 INFO:tasks.workunit.client.1.smithi122.stdout:6/360: chown d5/fe 89447 1 2024-09-13T02:50:43.965 INFO:tasks.workunit.client.1.smithi122.stdout:6/361: readlink d5/db/dc/l38 0 2024-09-13T02:50:43.966 INFO:tasks.workunit.client.1.smithi122.stdout:6/362: fdatasync d5/d3d/d6c/d41/d5b/f65 0 2024-09-13T02:50:43.970 INFO:tasks.workunit.client.1.smithi122.stdout:4/158: dread f10 [0,4194304] 0 2024-09-13T02:50:43.974 INFO:tasks.workunit.client.1.smithi122.stdout:8/86: dwrite d3/da/f8 [4194304,4194304] 0 2024-09-13T02:50:43.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/87: mkdir d3/da/d16 0 2024-09-13T02:50:43.977 INFO:tasks.workunit.client.1.smithi122.stdout:6/363: dread d5/d11/d45/f2d [4194304,4194304] 0 2024-09-13T02:50:43.977 INFO:tasks.workunit.client.1.smithi122.stdout:6/364: dread - d5/d11/d2f/f74 zero size 2024-09-13T02:50:43.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/88: rmdir d3/da/d16 0 2024-09-13T02:50:43.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/89: chown d3/da 417 1 2024-09-13T02:50:43.979 INFO:tasks.workunit.client.1.smithi122.stdout:2/110: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:43.979 INFO:tasks.workunit.client.1.smithi122.stdout:2/111: write d0/f10 [5549426,33548] 0 2024-09-13T02:50:43.980 INFO:tasks.workunit.client.1.smithi122.stdout:8/90: creat d3/f17 x:0 0 0 2024-09-13T02:50:43.980 INFO:tasks.workunit.client.1.smithi122.stdout:8/91: write d3/df/f13 [266270,17625] 0 2024-09-13T02:50:43.985 INFO:tasks.workunit.client.1.smithi122.stdout:2/112: mkdir d0/d1c 0 2024-09-13T02:50:43.985 INFO:tasks.workunit.client.1.smithi122.stdout:2/113: chown d0/l13 211621 1 2024-09-13T02:50:43.985 INFO:tasks.workunit.client.1.smithi122.stdout:8/92: rename d3/ld to d3/l18 0 2024-09-13T02:50:43.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/93: rename d3/da/f8 to d3/df/f19 0 2024-09-13T02:50:43.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/94: creat d3/df/f1a x:0 0 0 2024-09-13T02:50:43.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/95: write f2 [3421783,118793] 0 2024-09-13T02:50:43.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/96: truncate d3/da/f10 679930 0 2024-09-13T02:50:43.987 INFO:tasks.workunit.client.1.smithi122.stdout:8/97: creat d3/da/f1b x:0 0 0 2024-09-13T02:50:43.988 INFO:tasks.workunit.client.1.smithi122.stdout:6/365: write d5/f5a [1230793,70060] 0 2024-09-13T02:50:43.988 INFO:tasks.workunit.client.1.smithi122.stdout:8/98: mkdir d3/df/d1c 0 2024-09-13T02:50:43.989 INFO:tasks.workunit.client.1.smithi122.stdout:8/99: creat d3/df/d1c/f1d x:0 0 0 2024-09-13T02:50:43.989 INFO:tasks.workunit.client.1.smithi122.stdout:8/100: readlink d3/l15 0 2024-09-13T02:50:43.990 INFO:tasks.workunit.client.1.smithi122.stdout:8/101: mkdir d3/da/d1e 0 2024-09-13T02:50:43.993 INFO:tasks.workunit.client.1.smithi122.stdout:9/182: dwrite d8/ff [0,4194304] 0 2024-09-13T02:50:43.993 INFO:tasks.workunit.client.1.smithi122.stdout:9/183: stat d8/d16/c1c 0 2024-09-13T02:50:43.995 INFO:tasks.workunit.client.1.smithi122.stdout:4/159: dwrite d11/d13/f1f [0,4194304] 0 2024-09-13T02:50:43.997 INFO:tasks.workunit.client.1.smithi122.stdout:4/160: dread d11/d1b/f1c [0,4194304] 0 2024-09-13T02:50:44.004 INFO:tasks.workunit.client.1.smithi122.stdout:4/161: rename d11/l1e to d11/l2d 0 2024-09-13T02:50:44.006 INFO:tasks.workunit.client.1.smithi122.stdout:6/366: truncate d5/db/f17 721026 0 2024-09-13T02:50:44.008 INFO:tasks.workunit.client.1.smithi122.stdout:8/102: rename d3/df to d3/da/d1f 0 2024-09-13T02:50:44.008 INFO:tasks.workunit.client.1.smithi122.stdout:8/103: write d3/da/f10 [1107188,31200] 0 2024-09-13T02:50:44.008 INFO:tasks.workunit.client.1.smithi122.stdout:6/367: truncate d5/d11/d45/df/f13 206831 0 2024-09-13T02:50:44.009 INFO:tasks.workunit.client.1.smithi122.stdout:9/184: dwrite d8/d16/d19/d23/d1f/f2a [4194304,4194304] 0 2024-09-13T02:50:44.013 INFO:tasks.workunit.client.1.smithi122.stdout:8/104: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:44.016 INFO:tasks.workunit.client.1.smithi122.stdout:4/162: dread d11/d13/f1f [0,4194304] 0 2024-09-13T02:50:44.017 INFO:tasks.workunit.client.1.smithi122.stdout:4/163: truncate f3 1459753 0 2024-09-13T02:50:44.018 INFO:tasks.workunit.client.1.smithi122.stdout:4/164: mkdir d11/d1b/d2e 0 2024-09-13T02:50:44.019 INFO:tasks.workunit.client.1.smithi122.stdout:4/165: symlink d11/d1b/l2f 0 2024-09-13T02:50:44.021 INFO:tasks.workunit.client.1.smithi122.stdout:4/166: mkdir d11/d30 0 2024-09-13T02:50:44.021 INFO:tasks.workunit.client.1.smithi122.stdout:4/167: chown d11/d1b/c24 208 1 2024-09-13T02:50:44.021 INFO:tasks.workunit.client.1.smithi122.stdout:6/368: dread d5/db/f17 [0,4194304] 0 2024-09-13T02:50:44.021 INFO:tasks.workunit.client.1.smithi122.stdout:6/369: write d5/d11/d45/df/f13 [1205326,129565] 0 2024-09-13T02:50:44.021 INFO:tasks.workunit.client.1.smithi122.stdout:4/168: getdents d11/d13 0 2024-09-13T02:50:44.022 INFO:tasks.workunit.client.1.smithi122.stdout:9/185: write d8/f10 [5967312,45145] 0 2024-09-13T02:50:44.023 INFO:tasks.workunit.client.1.smithi122.stdout:4/169: creat d11/d1b/f31 x:0 0 0 2024-09-13T02:50:44.023 INFO:tasks.workunit.client.1.smithi122.stdout:9/186: rename d8/d16/c1c to d8/d16/c3b 0 2024-09-13T02:50:44.024 INFO:tasks.workunit.client.1.smithi122.stdout:9/187: truncate f4 1760344 0 2024-09-13T02:50:44.024 INFO:tasks.workunit.client.1.smithi122.stdout:4/170: dread d11/d13/f1a [0,4194304] 0 2024-09-13T02:50:44.026 INFO:tasks.workunit.client.1.smithi122.stdout:4/171: unlink d11/f21 0 2024-09-13T02:50:44.026 INFO:tasks.workunit.client.1.smithi122.stdout:9/188: write d8/d16/d19/f2c [4836726,75917] 0 2024-09-13T02:50:44.028 INFO:tasks.workunit.client.1.smithi122.stdout:4/172: mkdir d11/d1b/d32 0 2024-09-13T02:50:44.028 INFO:tasks.workunit.client.1.smithi122.stdout:4/173: fsync d11/d1b/f23 0 2024-09-13T02:50:44.029 INFO:tasks.workunit.client.1.smithi122.stdout:8/105: dwrite d3/da/d1f/f11 [0,4194304] 0 2024-09-13T02:50:44.029 INFO:tasks.workunit.client.1.smithi122.stdout:8/106: read - d3/f17 zero size 2024-09-13T02:50:44.030 INFO:tasks.workunit.client.1.smithi122.stdout:8/107: mkdir d3/da/d1f/d20 0 2024-09-13T02:50:44.030 INFO:tasks.workunit.client.1.smithi122.stdout:8/108: read - d3/da/f1b zero size 2024-09-13T02:50:44.034 INFO:tasks.workunit.client.1.smithi122.stdout:4/174: dread f0 [0,4194304] 0 2024-09-13T02:50:44.034 INFO:tasks.workunit.client.1.smithi122.stdout:4/175: fsync d11/d13/d14/f19 0 2024-09-13T02:50:44.036 INFO:tasks.workunit.client.1.smithi122.stdout:6/370: dwrite d5/d11/d45/df/d46/f5d [0,4194304] 0 2024-09-13T02:50:44.038 INFO:tasks.workunit.client.1.smithi122.stdout:4/176: write f10 [1462270,66171] 0 2024-09-13T02:50:44.041 INFO:tasks.workunit.client.1.smithi122.stdout:4/177: mknod d11/d1b/d32/c33 0 2024-09-13T02:50:44.042 INFO:tasks.workunit.client.1.smithi122.stdout:4/178: creat d11/d1b/d2e/f34 x:0 0 0 2024-09-13T02:50:44.042 INFO:tasks.workunit.client.1.smithi122.stdout:4/179: truncate d11/d1b/f1c 1091728 0 2024-09-13T02:50:44.043 INFO:tasks.workunit.client.1.smithi122.stdout:4/180: dread d11/d1b/f1c [0,4194304] 0 2024-09-13T02:50:44.054 INFO:tasks.workunit.client.1.smithi122.stdout:8/109: dwrite d3/da/f1b [0,4194304] 0 2024-09-13T02:50:44.057 INFO:tasks.workunit.client.1.smithi122.stdout:3/266: sync 2024-09-13T02:50:44.058 INFO:tasks.workunit.client.1.smithi122.stdout:3/267: rename d4/d6/d5f to d4/d11/dd/d21/d2b/d36/d3c/d43/d60 0 2024-09-13T02:50:44.059 INFO:tasks.workunit.client.1.smithi122.stdout:3/268: read d4/d6/de/d1f/f57 [11441,38005] 0 2024-09-13T02:50:44.059 INFO:tasks.workunit.client.1.smithi122.stdout:3/269: stat d4/d11/dd/d21/d2b/d35/f39 0 2024-09-13T02:50:44.060 INFO:tasks.workunit.client.1.smithi122.stdout:3/270: creat d4/d6/df/d15/f61 x:0 0 0 2024-09-13T02:50:44.061 INFO:tasks.workunit.client.1.smithi122.stdout:4/181: dwrite d11/d13/d14/f19 [0,4194304] 0 2024-09-13T02:50:44.061 INFO:tasks.workunit.client.1.smithi122.stdout:9/189: dwrite f4 [0,4194304] 0 2024-09-13T02:50:44.062 INFO:tasks.workunit.client.1.smithi122.stdout:8/110: dread f2 [0,4194304] 0 2024-09-13T02:50:44.064 INFO:tasks.workunit.client.1.smithi122.stdout:9/190: rename d8/f10 to d8/d16/d19/d23/f3c 0 2024-09-13T02:50:44.064 INFO:tasks.workunit.client.1.smithi122.stdout:9/191: chown d8/d16/d19/d23/f3c 295 1 2024-09-13T02:50:44.064 INFO:tasks.workunit.client.1.smithi122.stdout:9/192: dread - d8/d16/d19/d23/d1f/f2d zero size 2024-09-13T02:50:44.064 INFO:tasks.workunit.client.1.smithi122.stdout:3/271: creat d4/d11/dd/d21/d2b/d55/f62 x:0 0 0 2024-09-13T02:50:44.067 INFO:tasks.workunit.client.1.smithi122.stdout:8/111: rename d3/da/d1f/d1c to d3/da/d1f/d20/d21 0 2024-09-13T02:50:44.072 INFO:tasks.workunit.client.1.smithi122.stdout:3/272: truncate d4/d6/f4a 1720336 0 2024-09-13T02:50:44.075 INFO:tasks.workunit.client.1.smithi122.stdout:9/193: write d8/f9 [362944,111707] 0 2024-09-13T02:50:44.075 INFO:tasks.workunit.client.1.smithi122.stdout:9/194: dread - d8/d16/d19/d23/d1f/d36/f3a zero size 2024-09-13T02:50:44.080 INFO:tasks.workunit.client.1.smithi122.stdout:3/273: write d4/d6/de/f18 [1271458,23937] 0 2024-09-13T02:50:44.081 INFO:tasks.workunit.client.1.smithi122.stdout:3/274: truncate d4/d6/f47 2001106 0 2024-09-13T02:50:44.083 INFO:tasks.workunit.client.1.smithi122.stdout:3/275: mknod d4/d11/d38/c63 0 2024-09-13T02:50:44.084 INFO:tasks.workunit.client.1.smithi122.stdout:3/276: symlink d4/d11/dd/d21/d30/l64 0 2024-09-13T02:50:44.086 INFO:tasks.workunit.client.1.smithi122.stdout:4/182: dwrite d11/d13/f2c [0,4194304] 0 2024-09-13T02:50:44.086 INFO:tasks.workunit.client.1.smithi122.stdout:3/277: creat d4/d11/dd/f65 x:0 0 0 2024-09-13T02:50:44.086 INFO:tasks.workunit.client.1.smithi122.stdout:8/112: dwrite d3/da/d1f/d20/d21/f1d [0,4194304] 0 2024-09-13T02:50:44.090 INFO:tasks.workunit.client.1.smithi122.stdout:4/183: symlink d11/d13/d14/l35 0 2024-09-13T02:50:44.090 INFO:tasks.workunit.client.1.smithi122.stdout:4/184: stat d11/c12 0 2024-09-13T02:50:44.091 INFO:tasks.workunit.client.1.smithi122.stdout:3/278: unlink d4/d11/dd/d21/d2b/d36/f54 0 2024-09-13T02:50:44.091 INFO:tasks.workunit.client.1.smithi122.stdout:3/279: read d4/d6/f8 [3565912,47871] 0 2024-09-13T02:50:44.097 INFO:tasks.workunit.client.1.smithi122.stdout:9/195: dwrite f4 [0,4194304] 0 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/185: creat d11/d13/d14/d2a/f36 x:0 0 0 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/186: fdatasync d11/d13/f1a 0 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/187: read - d11/d13/d14/f25 zero size 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/188: write f10 [885522,64054] 0 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/189: rename d11/d30 to d11/d30/d37 22 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:4/190: fsync d11/d1b/f31 0 2024-09-13T02:50:44.099 INFO:tasks.workunit.client.1.smithi122.stdout:3/280: creat d4/d11/dd/d21/d2b/d36/f66 x:0 0 0 2024-09-13T02:50:44.102 INFO:tasks.workunit.client.1.smithi122.stdout:9/196: mkdir d8/d16/d3d 0 2024-09-13T02:50:44.103 INFO:tasks.workunit.client.1.smithi122.stdout:4/191: mknod d11/d13/d14/c38 0 2024-09-13T02:50:44.104 INFO:tasks.workunit.client.1.smithi122.stdout:3/281: mknod d4/d11/dd/d21/d2b/c67 0 2024-09-13T02:50:44.104 INFO:tasks.workunit.client.1.smithi122.stdout:3/282: chown d4/d11/dd/d21/d2b/d36 5078 1 2024-09-13T02:50:44.105 INFO:tasks.workunit.client.1.smithi122.stdout:8/113: dwrite d3/f17 [0,4194304] 0 2024-09-13T02:50:44.105 INFO:tasks.workunit.client.1.smithi122.stdout:4/192: dread f0 [0,4194304] 0 2024-09-13T02:50:44.105 INFO:tasks.workunit.client.1.smithi122.stdout:4/193: fsync fd 0 2024-09-13T02:50:44.109 INFO:tasks.workunit.client.1.smithi122.stdout:8/114: truncate d3/da/f1b 2188810 0 2024-09-13T02:50:44.109 INFO:tasks.workunit.client.1.smithi122.stdout:8/115: fsync d3/da/d1f/f14 0 2024-09-13T02:50:44.110 INFO:tasks.workunit.client.1.smithi122.stdout:4/194: rename d11/c29 to d11/c39 0 2024-09-13T02:50:44.110 INFO:tasks.workunit.client.1.smithi122.stdout:4/195: write d11/d13/d14/d2a/f2b [510991,73630] 0 2024-09-13T02:50:44.112 INFO:tasks.workunit.client.1.smithi122.stdout:8/116: creat d3/da/d1f/f22 x:0 0 0 2024-09-13T02:50:44.112 INFO:tasks.workunit.client.1.smithi122.stdout:8/117: stat d3/da/d1f/f14 0 2024-09-13T02:50:44.113 INFO:tasks.workunit.client.1.smithi122.stdout:4/196: mknod d11/d13/c3a 0 2024-09-13T02:50:44.115 INFO:tasks.workunit.client.1.smithi122.stdout:8/118: mknod d3/da/d1e/c23 0 2024-09-13T02:50:44.115 INFO:tasks.workunit.client.1.smithi122.stdout:8/119: chown d3/da/d1f/f19 4 1 2024-09-13T02:50:44.115 INFO:tasks.workunit.client.1.smithi122.stdout:8/120: fdatasync d3/da/f10 0 2024-09-13T02:50:44.115 INFO:tasks.workunit.client.1.smithi122.stdout:8/121: fdatasync d3/da/d1f/f22 0 2024-09-13T02:50:44.115 INFO:tasks.workunit.client.1.smithi122.stdout:4/197: creat d11/d30/f3b x:0 0 0 2024-09-13T02:50:44.117 INFO:tasks.workunit.client.1.smithi122.stdout:8/122: write d3/da/f10 [1012196,56716] 0 2024-09-13T02:50:44.118 INFO:tasks.workunit.client.1.smithi122.stdout:4/198: getdents d11/d1b/d2e 0 2024-09-13T02:50:44.120 INFO:tasks.workunit.client.1.smithi122.stdout:8/123: truncate d3/da/d1f/d20/d21/f1d 1635974 0 2024-09-13T02:50:44.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/124: stat d3/da/d1f/f1a 0 2024-09-13T02:50:44.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/125: chown d3/f9 47385 1 2024-09-13T02:50:44.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/126: chown d3/f9 1161 1 2024-09-13T02:50:44.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/127: fdatasync d3/f17 0 2024-09-13T02:50:44.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/128: creat d3/da/d1f/f24 x:0 0 0 2024-09-13T02:50:44.123 INFO:tasks.workunit.client.1.smithi122.stdout:9/197: dwrite d8/ff [0,4194304] 0 2024-09-13T02:50:44.126 INFO:tasks.workunit.client.1.smithi122.stdout:9/198: mkdir d8/d16/d3e 0 2024-09-13T02:50:44.130 INFO:tasks.workunit.client.1.smithi122.stdout:9/199: symlink d8/d16/l3f 0 2024-09-13T02:50:44.130 INFO:tasks.workunit.client.1.smithi122.stdout:9/200: readlink d8/d16/d19/d29/l35 0 2024-09-13T02:50:44.131 INFO:tasks.workunit.client.1.smithi122.stdout:9/201: symlink d8/l40 0 2024-09-13T02:50:44.135 INFO:tasks.workunit.client.1.smithi122.stdout:3/283: truncate d4/d6/f47 1680623 0 2024-09-13T02:50:44.135 INFO:tasks.workunit.client.1.smithi122.stdout:3/284: readlink d4/d6/df/l24 0 2024-09-13T02:50:44.137 INFO:tasks.workunit.client.1.smithi122.stdout:3/285: getdents d4/d11/dd/d21/d2b 0 2024-09-13T02:50:44.137 INFO:tasks.workunit.client.1.smithi122.stdout:3/286: truncate d4/d11/dd/d21/d2b/d36/f66 185285 0 2024-09-13T02:50:44.139 INFO:tasks.workunit.client.1.smithi122.stdout:4/199: dwrite d11/d13/f1f [4194304,4194304] 0 2024-09-13T02:50:44.142 INFO:tasks.workunit.client.1.smithi122.stdout:4/200: dread d11/d13/f1a [0,4194304] 0 2024-09-13T02:50:44.142 INFO:tasks.workunit.client.1.smithi122.stdout:9/202: write d8/d16/f1b [4297660,99963] 0 2024-09-13T02:50:44.143 INFO:tasks.workunit.client.1.smithi122.stdout:9/203: chown d8/f33 1689 1 2024-09-13T02:50:44.144 INFO:tasks.workunit.client.1.smithi122.stdout:9/204: symlink d8/d16/d19/d23/d1f/d36/l41 0 2024-09-13T02:50:44.152 INFO:tasks.workunit.client.1.smithi122.stdout:4/201: read d11/d13/d14/f19 [1025306,120017] 0 2024-09-13T02:50:44.152 INFO:tasks.workunit.client.1.smithi122.stdout:4/202: fdatasync d11/d1b/f1c 0 2024-09-13T02:50:44.152 INFO:tasks.workunit.client.1.smithi122.stdout:4/203: dread - d11/d13/d14/f25 zero size 2024-09-13T02:50:44.153 INFO:tasks.workunit.client.1.smithi122.stdout:4/204: creat d11/f3c x:0 0 0 2024-09-13T02:50:44.153 INFO:tasks.workunit.client.1.smithi122.stdout:4/205: read - d11/d1b/f31 zero size 2024-09-13T02:50:44.153 INFO:tasks.workunit.client.1.smithi122.stdout:4/206: chown fd 36354 1 2024-09-13T02:50:44.155 INFO:tasks.workunit.client.1.smithi122.stdout:4/207: mkdir d11/d3d 0 2024-09-13T02:50:44.157 INFO:tasks.workunit.client.1.smithi122.stdout:4/208: rename d11/d13/f1a to d11/f3e 0 2024-09-13T02:50:44.158 INFO:tasks.workunit.client.1.smithi122.stdout:4/209: rename fd to d11/f3f 0 2024-09-13T02:50:44.159 INFO:tasks.workunit.client.1.smithi122.stdout:4/210: mkdir d11/d13/d14/d2a/d40 0 2024-09-13T02:50:44.160 INFO:tasks.workunit.client.1.smithi122.stdout:4/211: rename d11/d1b/f23 to d11/d1b/f41 0 2024-09-13T02:50:44.161 INFO:tasks.workunit.client.1.smithi122.stdout:4/212: creat d11/d13/d14/f42 x:0 0 0 2024-09-13T02:50:44.161 INFO:tasks.workunit.client.1.smithi122.stdout:4/213: creat d11/f43 x:0 0 0 2024-09-13T02:50:44.162 INFO:tasks.workunit.client.1.smithi122.stdout:4/214: symlink d11/d13/d14/d2a/l44 0 2024-09-13T02:50:44.163 INFO:tasks.workunit.client.1.smithi122.stdout:4/215: rename d11/d13/d14/f28 to d11/d1b/f45 0 2024-09-13T02:50:44.168 INFO:tasks.workunit.client.1.smithi122.stdout:3/287: dwrite d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:44.177 INFO:tasks.workunit.client.1.smithi122.stdout:3/288: read d4/d11/f2e [2918989,89265] 0 2024-09-13T02:50:44.177 INFO:tasks.workunit.client.1.smithi122.stdout:3/289: chown d4/d6/df/f32 24098 1 2024-09-13T02:50:44.178 INFO:tasks.workunit.client.1.smithi122.stdout:3/290: mkdir d4/d6/df/d15/d68 0 2024-09-13T02:50:44.181 INFO:tasks.workunit.client.1.smithi122.stdout:0/113: sync 2024-09-13T02:50:44.182 INFO:tasks.workunit.client.1.smithi122.stdout:7/158: sync 2024-09-13T02:50:44.182 INFO:tasks.workunit.client.1.smithi122.stdout:1/139: sync 2024-09-13T02:50:44.184 INFO:tasks.workunit.client.1.smithi122.stdout:7/159: mknod d4/c39 0 2024-09-13T02:50:44.189 INFO:tasks.workunit.client.1.smithi122.stdout:7/160: rename c3 to d4/d8/db/dc/d1b/c3a 0 2024-09-13T02:50:44.192 INFO:tasks.workunit.client.1.smithi122.stdout:0/114: write d1/d5/fd [3181744,54845] 0 2024-09-13T02:50:44.193 INFO:tasks.workunit.client.1.smithi122.stdout:3/291: dread d4/d11/dd/d21/d2b/d35/f39 [0,4194304] 0 2024-09-13T02:50:44.193 INFO:tasks.workunit.client.1.smithi122.stdout:3/292: chown d4/d6/df/l50 52041 1 2024-09-13T02:50:44.195 INFO:tasks.workunit.client.1.smithi122.stdout:3/293: mknod d4/d11/dd/d21/d2b/d36/d3c/c69 0 2024-09-13T02:50:44.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/115: rmdir d1/d5 39 2024-09-13T02:50:44.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/116: chown d1 357 1 2024-09-13T02:50:44.198 INFO:tasks.workunit.client.1.smithi122.stdout:3/294: mknod d4/d11/dd/d21/d2b/d35/c6a 0 2024-09-13T02:50:44.199 INFO:tasks.workunit.client.1.smithi122.stdout:3/295: creat d4/d11/dd/d21/d4e/d53/f6b x:0 0 0 2024-09-13T02:50:44.203 INFO:tasks.workunit.client.1.smithi122.stdout:0/117: dread d1/d5/f13 [0,4194304] 0 2024-09-13T02:50:44.208 INFO:tasks.workunit.client.1.smithi122.stdout:1/140: dwrite fb [0,4194304] 0 2024-09-13T02:50:44.208 INFO:tasks.workunit.client.1.smithi122.stdout:1/141: dread - dc/de/f27 zero size 2024-09-13T02:50:44.208 INFO:tasks.workunit.client.1.smithi122.stdout:1/142: chown l7 247412788 1 2024-09-13T02:50:44.208 INFO:tasks.workunit.client.1.smithi122.stdout:1/143: fdatasync dc/f10 0 2024-09-13T02:50:44.209 INFO:tasks.workunit.client.1.smithi122.stdout:7/161: dwrite d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:44.212 INFO:tasks.workunit.client.1.smithi122.stdout:7/162: creat d4/d8/db/dc/f3b x:0 0 0 2024-09-13T02:50:44.214 INFO:tasks.workunit.client.1.smithi122.stdout:0/118: rename d1/d5/d9/da to d1/d5/d9/da/d17/d28 22 2024-09-13T02:50:44.214 INFO:tasks.workunit.client.1.smithi122.stdout:3/296: rename d4/d11/dd/d21/d2b/d35 to d4/d11/dd/d21/d6c 0 2024-09-13T02:50:44.215 INFO:tasks.workunit.client.1.smithi122.stdout:7/163: link l2 d4/d8/db/dc/d1b/l3c 0 2024-09-13T02:50:44.216 INFO:tasks.workunit.client.1.smithi122.stdout:0/119: mkdir d1/d5/d10/d29 0 2024-09-13T02:50:44.219 INFO:tasks.workunit.client.1.smithi122.stdout:3/297: symlink d4/d11/dd/d21/d2b/d36/l6d 0 2024-09-13T02:50:44.219 INFO:tasks.workunit.client.1.smithi122.stdout:7/164: mkdir d4/d8/d3d 0 2024-09-13T02:50:44.219 INFO:tasks.workunit.client.1.smithi122.stdout:7/165: fsync d4/f35 0 2024-09-13T02:50:44.219 INFO:tasks.workunit.client.1.smithi122.stdout:0/120: rmdir d1/d5/d10 39 2024-09-13T02:50:44.219 INFO:tasks.workunit.client.1.smithi122.stdout:0/121: stat d1/d5/d9/da/d17/f1b 0 2024-09-13T02:50:44.221 INFO:tasks.workunit.client.1.smithi122.stdout:1/144: rename dc/fd to dc/de/f2e 0 2024-09-13T02:50:44.223 INFO:tasks.workunit.client.1.smithi122.stdout:0/122: rename d1/d5/f23 to d1/d5/d9/da/d17/f2a 0 2024-09-13T02:50:44.224 INFO:tasks.workunit.client.1.smithi122.stdout:1/145: mkdir dc/de/d18/d1d/d2f 0 2024-09-13T02:50:44.225 INFO:tasks.workunit.client.1.smithi122.stdout:0/123: creat d1/d5/d9/da/f2b x:0 0 0 2024-09-13T02:50:44.227 INFO:tasks.workunit.client.1.smithi122.stdout:3/298: dread d4/d11/dd/d21/d2b/f2f [0,4194304] 0 2024-09-13T02:50:44.227 INFO:tasks.workunit.client.1.smithi122.stdout:1/146: dread dc/de/d18/d22/f20 [0,4194304] 0 2024-09-13T02:50:44.227 INFO:tasks.workunit.client.1.smithi122.stdout:1/147: write dc/de/f2e [284983,28445] 0 2024-09-13T02:50:44.227 INFO:tasks.workunit.client.1.smithi122.stdout:1/148: creat dc/de/d18/f30 x:0 0 0 2024-09-13T02:50:44.229 INFO:tasks.workunit.client.1.smithi122.stdout:1/149: creat dc/de/d18/d22/f31 x:0 0 0 2024-09-13T02:50:44.230 INFO:tasks.workunit.client.1.smithi122.stdout:1/150: write fb [4967636,130596] 0 2024-09-13T02:50:44.230 INFO:tasks.workunit.client.1.smithi122.stdout:1/151: creat dc/f32 x:0 0 0 2024-09-13T02:50:44.230 INFO:tasks.workunit.client.1.smithi122.stdout:1/152: dread - dc/f32 zero size 2024-09-13T02:50:44.236 INFO:tasks.workunit.client.1.smithi122.stdout:3/299: dread f3 [0,4194304] 0 2024-09-13T02:50:44.242 INFO:tasks.workunit.client.1.smithi122.stdout:0/124: dwrite d1/d5/d9/da/d17/f2a [0,4194304] 0 2024-09-13T02:50:44.244 INFO:tasks.workunit.client.1.smithi122.stdout:0/125: creat d1/d5/d15/d1d/f2c x:0 0 0 2024-09-13T02:50:44.245 INFO:tasks.workunit.client.1.smithi122.stdout:0/126: rmdir d1/d5/d9 39 2024-09-13T02:50:44.245 INFO:tasks.workunit.client.1.smithi122.stdout:0/127: mkdir d1/d5/d2d 0 2024-09-13T02:50:44.246 INFO:tasks.workunit.client.1.smithi122.stdout:0/128: mknod d1/d5/d15/d1d/c2e 0 2024-09-13T02:50:44.246 INFO:tasks.workunit.client.1.smithi122.stdout:0/129: chown d1/d5/d15/d1d/f1f 5 1 2024-09-13T02:50:44.246 INFO:tasks.workunit.client.1.smithi122.stdout:0/130: write d1/d5/f1e [1691574,10214] 0 2024-09-13T02:50:44.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/131: mknod d1/d5/d9/da/d17/c2f 0 2024-09-13T02:50:44.248 INFO:tasks.workunit.client.1.smithi122.stdout:0/132: rename d1/d5/f11 to d1/f30 0 2024-09-13T02:50:44.248 INFO:tasks.workunit.client.1.smithi122.stdout:0/133: creat d1/d5/d15/d1d/f31 x:0 0 0 2024-09-13T02:50:44.251 INFO:tasks.workunit.client.1.smithi122.stdout:1/153: dwrite dc/de/f2e [0,4194304] 0 2024-09-13T02:50:44.253 INFO:tasks.workunit.client.1.smithi122.stdout:1/154: symlink dc/de/d13/l33 0 2024-09-13T02:50:44.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/155: rmdir dc/de/d18/d22 39 2024-09-13T02:50:44.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/156: truncate dc/f32 670112 0 2024-09-13T02:50:44.263 INFO:tasks.workunit.client.1.smithi122.stdout:0/134: dwrite d1/d5/f13 [0,4194304] 0 2024-09-13T02:50:44.265 INFO:tasks.workunit.client.1.smithi122.stdout:0/135: unlink d1/d5/d10/f14 0 2024-09-13T02:50:44.266 INFO:tasks.workunit.client.1.smithi122.stdout:0/136: readlink d1/d5/d9/l27 0 2024-09-13T02:50:44.266 INFO:tasks.workunit.client.1.smithi122.stdout:0/137: mkdir d1/d5/d10/d29/d32 0 2024-09-13T02:50:44.267 INFO:tasks.workunit.client.1.smithi122.stdout:0/138: creat d1/d5/d10/d29/f33 x:0 0 0 2024-09-13T02:50:44.267 INFO:tasks.workunit.client.1.smithi122.stdout:0/139: stat d1/d5/d9/da/ff 0 2024-09-13T02:50:44.267 INFO:tasks.workunit.client.1.smithi122.stdout:0/140: write d1/d5/d9/da/ff [503151,68185] 0 2024-09-13T02:50:44.267 INFO:tasks.workunit.client.1.smithi122.stdout:0/141: creat d1/d5/d10/d29/f34 x:0 0 0 2024-09-13T02:50:44.268 INFO:tasks.workunit.client.1.smithi122.stdout:0/142: readlink d1/d5/l21 0 2024-09-13T02:50:44.268 INFO:tasks.workunit.client.1.smithi122.stdout:1/157: dwrite dc/de/d18/d22/f31 [0,4194304] 0 2024-09-13T02:50:44.270 INFO:tasks.workunit.client.1.smithi122.stdout:1/158: creat dc/de/d18/d1d/f34 x:0 0 0 2024-09-13T02:50:44.270 INFO:tasks.workunit.client.1.smithi122.stdout:1/159: chown dc/de/d13/l14 2051737391 1 2024-09-13T02:50:44.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/143: write d1/d5/d9/da/d17/f2a [2658534,91442] 0 2024-09-13T02:50:44.278 INFO:tasks.workunit.client.1.smithi122.stdout:0/144: mkdir d1/d5/d15/d35 0 2024-09-13T02:50:44.278 INFO:tasks.workunit.client.1.smithi122.stdout:0/145: creat d1/d5/d10/d29/f36 x:0 0 0 2024-09-13T02:50:44.281 INFO:tasks.workunit.client.1.smithi122.stdout:0/146: link d1/d5/d9/l27 d1/d5/d15/d1d/l37 0 2024-09-13T02:50:44.287 INFO:tasks.workunit.client.1.smithi122.stdout:1/160: dwrite f0 [0,4194304] 0 2024-09-13T02:50:44.287 INFO:tasks.workunit.client.1.smithi122.stdout:1/161: creat dc/f35 x:0 0 0 2024-09-13T02:50:44.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/162: truncate dc/f16 1044561 0 2024-09-13T02:50:44.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/163: write dc/f10 [246714,30985] 0 2024-09-13T02:50:44.298 INFO:tasks.workunit.client.1.smithi122.stdout:1/164: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:44.299 INFO:tasks.workunit.client.1.smithi122.stdout:1/165: fdatasync dc/f32 0 2024-09-13T02:50:44.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/147: dwrite d1/d5/fd [0,4194304] 0 2024-09-13T02:50:44.374 INFO:tasks.workunit.client.1.smithi122.stdout:1/166: dwrite dc/de/d18/d1d/f1f [0,4194304] 0 2024-09-13T02:50:44.374 INFO:tasks.workunit.client.1.smithi122.stdout:1/167: write dc/de/f27 [226267,17306] 0 2024-09-13T02:50:44.383 INFO:tasks.workunit.client.1.smithi122.stdout:6/371: sync 2024-09-13T02:50:44.383 INFO:tasks.workunit.client.1.smithi122.stdout:5/170: sync 2024-09-13T02:50:44.383 INFO:tasks.workunit.client.1.smithi122.stdout:5/171: truncate d0/d17/d36/f24 1165346 0 2024-09-13T02:50:44.383 INFO:tasks.workunit.client.1.smithi122.stdout:5/172: stat d0/da/ce 0 2024-09-13T02:50:44.384 INFO:tasks.workunit.client.1.smithi122.stdout:2/114: sync 2024-09-13T02:50:44.384 INFO:tasks.workunit.client.1.smithi122.stdout:2/115: chown d0/l1a 2 1 2024-09-13T02:50:44.387 INFO:tasks.workunit.client.1.smithi122.stdout:2/116: creat d0/d1c/f1d x:0 0 0 2024-09-13T02:50:44.396 INFO:tasks.workunit.client.1.smithi122.stdout:6/372: write d5/d11/d45/f56 [3581055,124462] 0 2024-09-13T02:50:44.397 INFO:tasks.workunit.client.1.smithi122.stdout:6/373: chown d5/d40/l37 162 1 2024-09-13T02:50:44.398 INFO:tasks.workunit.client.1.smithi122.stdout:6/374: rmdir d5/d3d/d48 39 2024-09-13T02:50:44.402 INFO:tasks.workunit.client.1.smithi122.stdout:0/148: dwrite d1/d5/d15/d1d/f31 [0,4194304] 0 2024-09-13T02:50:44.403 INFO:tasks.workunit.client.1.smithi122.stdout:1/168: dwrite dc/de/d18/d1d/f1f [0,4194304] 0 2024-09-13T02:50:44.403 INFO:tasks.workunit.client.1.smithi122.stdout:5/173: dwrite d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:44.405 INFO:tasks.workunit.client.1.smithi122.stdout:2/117: fsync d0/d1c/f1d 0 2024-09-13T02:50:44.405 INFO:tasks.workunit.client.1.smithi122.stdout:2/118: dread - d0/f16 zero size 2024-09-13T02:50:44.407 INFO:tasks.workunit.client.1.smithi122.stdout:0/149: dread f0 [0,4194304] 0 2024-09-13T02:50:44.408 INFO:tasks.workunit.client.1.smithi122.stdout:0/150: dread - d1/d5/d9/da/d17/f22 zero size 2024-09-13T02:50:44.408 INFO:tasks.workunit.client.1.smithi122.stdout:0/151: readlink d1/d5/d9/l27 0 2024-09-13T02:50:44.444 INFO:tasks.workunit.client.1.smithi122.stdout:6/375: dwrite d5/db/f1b [0,4194304] 0 2024-09-13T02:50:44.444 INFO:tasks.workunit.client.1.smithi122.stdout:6/376: fsync d5/d11/d45/df/f24 0 2024-09-13T02:50:44.444 INFO:tasks.workunit.client.1.smithi122.stdout:6/377: chown d5/d3d/d48/f6b 60246462 1 2024-09-13T02:50:44.444 INFO:tasks.workunit.client.1.smithi122.stdout:2/119: dwrite d0/d17/ff [0,4194304] 0 2024-09-13T02:50:44.444 INFO:tasks.workunit.client.1.smithi122.stdout:1/169: dwrite f0 [0,4194304] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:1/170: chown f2 1 1 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:1/171: fdatasync dc/de/d18/d22/f20 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:1/172: stat dc/de/f27 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/174: dwrite d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:0/152: dwrite d1/d5/d9/da/d17/f1b [0,4194304] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/175: dread - d0/d17/f18 zero size 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/176: chown d0/d17/d36/f24 26148 1 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/177: fdatasync d0/d17/f22 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:0/153: creat d1/f38 x:0 0 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/178: write d0/d17/f18 [660560,52559] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/179: write d0/d17/f18 [1746449,104202] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/180: write d0/da/f2d [835689,3428] 0 2024-09-13T02:50:44.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/181: fsync d0/f1a 0 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:6/378: mknod d5/d3d/d6c/c76 0 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:6/379: chown d5/d11/d45/df/c10 4 1 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:6/380: chown d5/f9 140536 1 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:6/381: truncate d5/d11/d45/df/d46/f5d 4714031 0 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:2/120: rename d0/d17 to d0/d1e 0 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/173: rename dc/de/d13/l19 to dc/l36 0 2024-09-13T02:50:44.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/174: stat dc/de/d18/d1d/f23 0 2024-09-13T02:50:44.447 INFO:tasks.workunit.client.1.smithi122.stdout:0/154: link d1/d5/d9/da/d17/c24 d1/c39 0 2024-09-13T02:50:44.448 INFO:tasks.workunit.client.1.smithi122.stdout:6/382: truncate d5/db/d29/f1d 4369793 0 2024-09-13T02:50:44.448 INFO:tasks.workunit.client.1.smithi122.stdout:6/383: creat d5/d3d/f77 x:0 0 0 2024-09-13T02:50:44.451 INFO:tasks.workunit.client.1.smithi122.stdout:6/384: truncate d5/f9 1260882 0 2024-09-13T02:50:44.451 INFO:tasks.workunit.client.1.smithi122.stdout:6/385: dread - d5/f69 zero size 2024-09-13T02:50:44.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/155: link d1/d5/d9/f25 d1/f3a 0 2024-09-13T02:50:44.455 INFO:tasks.workunit.client.1.smithi122.stdout:2/121: dread d0/f10 [0,4194304] 0 2024-09-13T02:50:44.455 INFO:tasks.workunit.client.1.smithi122.stdout:2/122: read - d0/f1b zero size 2024-09-13T02:50:44.455 INFO:tasks.workunit.client.1.smithi122.stdout:2/123: symlink d0/d1e/l1f 0 2024-09-13T02:50:44.455 INFO:tasks.workunit.client.1.smithi122.stdout:2/124: creat d0/f20 x:0 0 0 2024-09-13T02:50:44.455 INFO:tasks.workunit.client.1.smithi122.stdout:2/125: chown d0/ca 27510 1 2024-09-13T02:50:44.458 INFO:tasks.workunit.client.1.smithi122.stdout:2/126: rename d0/c8 to d0/d1c/c21 0 2024-09-13T02:50:44.459 INFO:tasks.workunit.client.1.smithi122.stdout:6/386: getdents d5/d3d 0 2024-09-13T02:50:44.476 INFO:tasks.workunit.client.1.smithi122.stdout:0/156: dwrite d1/d5/d10/d29/f33 [0,4194304] 0 2024-09-13T02:50:44.477 INFO:tasks.workunit.client.1.smithi122.stdout:6/387: dwrite d5/d3d/d6c/f6a [0,4194304] 0 2024-09-13T02:50:44.477 INFO:tasks.workunit.client.1.smithi122.stdout:6/388: write d5/d11/d45/d21/f73 [752822,87949] 0 2024-09-13T02:50:44.481 INFO:tasks.workunit.client.1.smithi122.stdout:6/389: unlink d5/db/dc/c55 0 2024-09-13T02:50:44.482 INFO:tasks.workunit.client.1.smithi122.stdout:6/390: truncate d5/d11/d2f/f39 3179546 0 2024-09-13T02:50:44.482 INFO:tasks.workunit.client.1.smithi122.stdout:6/391: chown d5/d11/d2f/c54 1549 1 2024-09-13T02:50:44.486 INFO:tasks.workunit.client.1.smithi122.stdout:0/157: write d1/d5/fd [3080951,107377] 0 2024-09-13T02:50:44.486 INFO:tasks.workunit.client.1.smithi122.stdout:0/158: chown d1/d5 247473907 1 2024-09-13T02:50:44.486 INFO:tasks.workunit.client.1.smithi122.stdout:0/159: fsync d1/d5/d9/da/ff 0 2024-09-13T02:50:44.507 INFO:tasks.workunit.client.1.smithi122.stdout:6/392: dwrite d5/d11/f61 [0,4194304] 0 2024-09-13T02:50:44.507 INFO:tasks.workunit.client.1.smithi122.stdout:0/160: dwrite d1/f3a [0,4194304] 0 2024-09-13T02:50:44.507 INFO:tasks.workunit.client.1.smithi122.stdout:0/161: chown d1/d5 512875 1 2024-09-13T02:50:44.509 INFO:tasks.workunit.client.1.smithi122.stdout:0/162: mknod d1/d5/d15/c3b 0 2024-09-13T02:50:44.510 INFO:tasks.workunit.client.1.smithi122.stdout:0/163: mknod d1/d5/d10/c3c 0 2024-09-13T02:50:44.511 INFO:tasks.workunit.client.1.smithi122.stdout:0/164: dread - d1/d5/d15/d1d/f2c zero size 2024-09-13T02:50:44.515 INFO:tasks.workunit.client.1.smithi122.stdout:6/393: dread d5/db/f1b [0,4194304] 0 2024-09-13T02:50:44.535 INFO:tasks.workunit.client.1.smithi122.stdout:0/165: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:50:44.535 INFO:tasks.workunit.client.1.smithi122.stdout:0/166: chown d1/d5/d9/f25 3 1 2024-09-13T02:50:44.535 INFO:tasks.workunit.client.1.smithi122.stdout:6/394: dwrite d5/d11/d45/df/f13 [0,4194304] 0 2024-09-13T02:50:44.536 INFO:tasks.workunit.client.1.smithi122.stdout:0/167: link d1/d5/d15/c3b d1/d5/d10/c3d 0 2024-09-13T02:50:44.536 INFO:tasks.workunit.client.1.smithi122.stdout:6/395: creat d5/d11/d45/f78 x:0 0 0 2024-09-13T02:50:44.537 INFO:tasks.workunit.client.1.smithi122.stdout:0/168: unlink d1/d5/c12 0 2024-09-13T02:50:44.539 INFO:tasks.workunit.client.1.smithi122.stdout:0/169: link d1/d5/d9/da/d17/c2f d1/d5/d2d/c3e 0 2024-09-13T02:50:44.541 INFO:tasks.workunit.client.1.smithi122.stdout:0/170: symlink d1/d5/d15/d35/l3f 0 2024-09-13T02:50:44.541 INFO:tasks.workunit.client.1.smithi122.stdout:0/171: write d1/d5/d9/da/ff [196625,90158] 0 2024-09-13T02:50:44.542 INFO:tasks.workunit.client.1.smithi122.stdout:0/172: getdents d1/d5/d9 0 2024-09-13T02:50:44.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/173: dwrite d1/d5/d9/da/d17/f1b [0,4194304] 0 2024-09-13T02:50:44.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/174: creat d1/d5/d10/d29/f40 x:0 0 0 2024-09-13T02:50:44.566 INFO:tasks.workunit.client.1.smithi122.stdout:6/396: dwrite d5/d3d/d6c/d41/f47 [8388608,4194304] 0 2024-09-13T02:50:44.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/175: write d1/d5/d9/da/d17/f22 [279209,113303] 0 2024-09-13T02:50:44.567 INFO:tasks.workunit.client.1.smithi122.stdout:6/397: creat d5/d3d/d6c/d41/d4e/d5f/f79 x:0 0 0 2024-09-13T02:50:44.567 INFO:tasks.workunit.client.1.smithi122.stdout:6/398: write d5/d11/d2f/f74 [989344,89634] 0 2024-09-13T02:50:44.569 INFO:tasks.workunit.client.1.smithi122.stdout:0/176: mkdir d1/d5/d15/d41 0 2024-09-13T02:50:44.569 INFO:tasks.workunit.client.1.smithi122.stdout:0/177: creat d1/d5/d10/d29/f42 x:0 0 0 2024-09-13T02:50:44.569 INFO:tasks.workunit.client.1.smithi122.stdout:0/178: creat d1/d5/d9/da/d17/f43 x:0 0 0 2024-09-13T02:50:44.569 INFO:tasks.workunit.client.1.smithi122.stdout:0/179: chown d1/d5/d9/da/d17 11300 1 2024-09-13T02:50:44.575 INFO:tasks.workunit.client.1.smithi122.stdout:6/399: dread d5/d11/f61 [0,4194304] 0 2024-09-13T02:50:44.576 INFO:tasks.workunit.client.1.smithi122.stdout:6/400: unlink d5/d11/f61 0 2024-09-13T02:50:44.576 INFO:tasks.workunit.client.1.smithi122.stdout:6/401: write d5/d11/d45/f2d [3936790,116200] 0 2024-09-13T02:50:44.577 INFO:tasks.workunit.client.1.smithi122.stdout:0/180: write d1/d5/d10/d29/f33 [3127135,67307] 0 2024-09-13T02:50:44.577 INFO:tasks.workunit.client.1.smithi122.stdout:6/402: mkdir d5/d3d/d6c/d41/d5b/d7a 0 2024-09-13T02:50:44.577 INFO:tasks.workunit.client.1.smithi122.stdout:0/181: creat d1/d5/d2d/f44 x:0 0 0 2024-09-13T02:50:44.578 INFO:tasks.workunit.client.1.smithi122.stdout:6/403: symlink d5/db/dc/l7b 0 2024-09-13T02:50:44.578 INFO:tasks.workunit.client.1.smithi122.stdout:0/182: symlink d1/d5/d9/da/d17/l45 0 2024-09-13T02:50:44.579 INFO:tasks.workunit.client.1.smithi122.stdout:6/404: unlink d5/d11/d45/f56 0 2024-09-13T02:50:44.579 INFO:tasks.workunit.client.1.smithi122.stdout:6/405: creat d5/db/d29/f7c x:0 0 0 2024-09-13T02:50:44.581 INFO:tasks.workunit.client.1.smithi122.stdout:6/406: mkdir d5/d3d/d6c/d41/d5b/d7d 0 2024-09-13T02:50:44.581 INFO:tasks.workunit.client.1.smithi122.stdout:6/407: chown d5/d11/d45/df/f24 771645272 1 2024-09-13T02:50:44.581 INFO:tasks.workunit.client.1.smithi122.stdout:6/408: write d5/d3d/d48/f6b [889155,66475] 0 2024-09-13T02:50:44.582 INFO:tasks.workunit.client.1.smithi122.stdout:6/409: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:44.583 INFO:tasks.workunit.client.1.smithi122.stdout:6/410: symlink d5/d3d/d6c/d41/d4e/l7e 0 2024-09-13T02:50:44.583 INFO:tasks.workunit.client.1.smithi122.stdout:6/411: readlink d5/db/dc/l42 0 2024-09-13T02:50:44.583 INFO:tasks.workunit.client.1.smithi122.stdout:6/412: fsync d5/d11/f75 0 2024-09-13T02:50:44.583 INFO:tasks.workunit.client.1.smithi122.stdout:6/413: rename d5/db/f51 to d5/d3d/d6c/f7f 0 2024-09-13T02:50:44.584 INFO:tasks.workunit.client.1.smithi122.stdout:6/414: fdatasync d5/d3d/d6c/d41/d4e/d5f/f79 0 2024-09-13T02:50:44.584 INFO:tasks.workunit.client.1.smithi122.stdout:6/415: symlink d5/d3d/d6c/d41/l80 0 2024-09-13T02:50:44.586 INFO:tasks.workunit.client.1.smithi122.stdout:0/183: write d1/d5/d9/da/d17/f1b [397477,126592] 0 2024-09-13T02:50:44.586 INFO:tasks.workunit.client.1.smithi122.stdout:0/184: write d1/d5/d9/f25 [4738315,78323] 0 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/185: fdatasync d1/f3a 0 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/186: chown d1/d5/fd 1398795 1 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/187: chown d1/d5/d9/da/d17/f1b 9489155 1 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/188: chown d1/d5/d9 17 1 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/189: read - d1/f38 zero size 2024-09-13T02:50:44.588 INFO:tasks.workunit.client.1.smithi122.stdout:0/190: write d1/d5/d10/d29/f33 [3447943,129423] 0 2024-09-13T02:50:44.589 INFO:tasks.workunit.client.1.smithi122.stdout:0/191: link d1/d5/d10/d29/f36 d1/d5/d9/da/f46 0 2024-09-13T02:50:44.591 INFO:tasks.workunit.client.1.smithi122.stdout:0/192: rmdir d1/d5/d15/d41 0 2024-09-13T02:50:44.592 INFO:tasks.workunit.client.1.smithi122.stdout:0/193: getdents d1 0 2024-09-13T02:50:44.593 INFO:tasks.workunit.client.1.smithi122.stdout:0/194: mknod d1/d5/d10/c47 0 2024-09-13T02:50:44.593 INFO:tasks.workunit.client.1.smithi122.stdout:0/195: fdatasync d1/d5/d9/da/f46 0 2024-09-13T02:50:44.593 INFO:tasks.workunit.client.1.smithi122.stdout:0/196: chown d1/d5/d10/d29/f36 2084 1 2024-09-13T02:50:44.593 INFO:tasks.workunit.client.1.smithi122.stdout:6/416: dread d5/d3d/d6c/d41/f47 [8388608,4194304] 0 2024-09-13T02:50:44.594 INFO:tasks.workunit.client.1.smithi122.stdout:0/197: creat d1/d5/d15/f48 x:0 0 0 2024-09-13T02:50:44.595 INFO:tasks.workunit.client.1.smithi122.stdout:0/198: symlink d1/d5/d10/d29/l49 0 2024-09-13T02:50:44.597 INFO:tasks.workunit.client.1.smithi122.stdout:0/199: symlink d1/d5/d10/l4a 0 2024-09-13T02:50:44.600 INFO:tasks.workunit.client.1.smithi122.stdout:0/200: write d1/f26 [457934,92221] 0 2024-09-13T02:50:44.607 INFO:tasks.workunit.client.1.smithi122.stdout:0/201: dread d1/d5/d15/d1d/f1f [0,4194304] 0 2024-09-13T02:50:44.653 INFO:tasks.workunit.client.1.smithi122.stdout:9/205: sync 2024-09-13T02:50:44.654 INFO:tasks.workunit.client.1.smithi122.stdout:8/129: sync 2024-09-13T02:50:44.654 INFO:tasks.workunit.client.1.smithi122.stdout:9/206: readlink d8/l40 0 2024-09-13T02:50:44.654 INFO:tasks.workunit.client.1.smithi122.stdout:9/207: fsync d8/f9 0 2024-09-13T02:50:44.655 INFO:tasks.workunit.client.1.smithi122.stdout:8/130: mkdir d3/da/d1f/d25 0 2024-09-13T02:50:44.656 INFO:tasks.workunit.client.1.smithi122.stdout:9/208: creat d8/d16/d19/d23/f42 x:0 0 0 2024-09-13T02:50:44.657 INFO:tasks.workunit.client.1.smithi122.stdout:9/209: getdents d8/d16/d19/d29 0 2024-09-13T02:50:44.657 INFO:tasks.workunit.client.1.smithi122.stdout:9/210: rename d8/d16 to d8/d16/d19/d23/d43 22 2024-09-13T02:50:44.658 INFO:tasks.workunit.client.1.smithi122.stdout:9/211: mkdir d8/d16/d19/d23/d1f/d36/d44 0 2024-09-13T02:50:44.659 INFO:tasks.workunit.client.1.smithi122.stdout:9/212: read - d8/d16/d19/d29/f38 zero size 2024-09-13T02:50:44.660 INFO:tasks.workunit.client.1.smithi122.stdout:9/213: mkdir d8/d16/d45 0 2024-09-13T02:50:44.660 INFO:tasks.workunit.client.1.smithi122.stdout:9/214: write f1 [3165236,89024] 0 2024-09-13T02:50:44.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/215: link c7 d8/d16/d19/d23/d1f/d36/d44/c46 0 2024-09-13T02:50:44.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/216: stat d8/d16/d3d 0 2024-09-13T02:50:44.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/217: stat d8/d16/d19/d29 0 2024-09-13T02:50:44.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/218: chown d8/l17 5 1 2024-09-13T02:50:44.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/219: mknod d8/d16/d19/d23/c47 0 2024-09-13T02:50:44.671 INFO:tasks.workunit.client.1.smithi122.stdout:8/131: dwrite d3/da/d1f/f24 [0,4194304] 0 2024-09-13T02:50:44.676 INFO:tasks.workunit.client.1.smithi122.stdout:9/220: dread d8/f28 [0,4194304] 0 2024-09-13T02:50:44.677 INFO:tasks.workunit.client.1.smithi122.stdout:9/221: unlink d8/d16/d19/d23/d1f/d36/f3a 0 2024-09-13T02:50:44.679 INFO:tasks.workunit.client.1.smithi122.stdout:9/222: unlink d8/d16/d19/d23/f42 0 2024-09-13T02:50:44.679 INFO:tasks.workunit.client.1.smithi122.stdout:9/223: write d8/d16/d19/d23/f32 [747407,80311] 0 2024-09-13T02:50:44.694 INFO:tasks.workunit.client.1.smithi122.stdout:9/224: dwrite d8/f1a [0,4194304] 0 2024-09-13T02:50:44.695 INFO:tasks.workunit.client.1.smithi122.stdout:9/225: write d8/d16/d19/d23/d1f/f2a [8856404,95763] 0 2024-09-13T02:50:44.695 INFO:tasks.workunit.client.1.smithi122.stdout:9/226: chown d8/d16/d19/d23/d1f/f2d 101 1 2024-09-13T02:50:44.695 INFO:tasks.workunit.client.1.smithi122.stdout:9/227: stat d8/d16/d19/d23/f3c 0 2024-09-13T02:50:44.695 INFO:tasks.workunit.client.1.smithi122.stdout:9/228: fsync d8/d16/d19/d29/f38 0 2024-09-13T02:50:44.706 INFO:tasks.workunit.client.1.smithi122.stdout:9/229: dwrite d8/d16/d19/d29/f38 [0,4194304] 0 2024-09-13T02:50:44.722 INFO:tasks.workunit.client.1.smithi122.stdout:9/230: dwrite f1 [0,4194304] 0 2024-09-13T02:50:44.738 INFO:tasks.workunit.client.1.smithi122.stdout:9/231: dwrite f1 [0,4194304] 0 2024-09-13T02:50:44.739 INFO:tasks.workunit.client.1.smithi122.stdout:9/232: symlink d8/d16/d19/l48 0 2024-09-13T02:50:44.760 INFO:tasks.workunit.client.1.smithi122.stdout:9/233: dwrite d8/ff [0,4194304] 0 2024-09-13T02:50:44.760 INFO:tasks.workunit.client.1.smithi122.stdout:9/234: getdents d8/d16/d3d 0 2024-09-13T02:50:44.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/235: mkdir d8/d16/d19/d49 0 2024-09-13T02:50:44.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/236: readlink d8/d16/l3f 0 2024-09-13T02:50:44.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/237: mkdir d8/d4a 0 2024-09-13T02:50:44.762 INFO:tasks.workunit.client.1.smithi122.stdout:9/238: truncate d8/d16/d19/d23/f3c 4305547 0 2024-09-13T02:50:44.763 INFO:tasks.workunit.client.1.smithi122.stdout:9/239: mknod d8/d16/d19/c4b 0 2024-09-13T02:50:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:44 smithi100 ceph-mon[27894]: pgmap v253: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 214 MiB/s rd, 278 MiB/s wr, 398 op/s 2024-09-13T02:50:44.940 INFO:tasks.workunit.client.1.smithi122.stdout:4/216: sync 2024-09-13T02:50:44.940 INFO:tasks.workunit.client.1.smithi122.stdout:7/166: sync 2024-09-13T02:50:44.942 INFO:tasks.workunit.client.1.smithi122.stdout:7/167: rename d4/d8/f27 to d4/d8/d24/f3e 0 2024-09-13T02:50:44.942 INFO:tasks.workunit.client.1.smithi122.stdout:7/168: mknod d4/d8/d24/c3f 0 2024-09-13T02:50:44.950 INFO:tasks.workunit.client.1.smithi122.stdout:7/169: dread d4/d8/db/f38 [0,4194304] 0 2024-09-13T02:50:44.959 INFO:tasks.workunit.client.1.smithi122.stdout:7/170: read d4/d8/f7 [1460189,90863] 0 2024-09-13T02:50:44.959 INFO:tasks.workunit.client.1.smithi122.stdout:7/171: fdatasync d4/d8/db/f2c 0 2024-09-13T02:50:44.959 INFO:tasks.workunit.client.1.smithi122.stdout:7/172: write d4/d8/db/dc/d1b/f34 [582267,98000] 0 2024-09-13T02:50:44.959 INFO:tasks.workunit.client.1.smithi122.stdout:7/173: write d4/d8/db/dc/d1b/f34 [968791,77072] 0 2024-09-13T02:50:44.972 INFO:tasks.workunit.client.1.smithi122.stdout:7/174: dwrite d4/f29 [0,4194304] 0 2024-09-13T02:50:44.974 INFO:tasks.workunit.client.1.smithi122.stdout:7/175: link d4/d8/d24/c3f d4/d8/db/dc/d36/c40 0 2024-09-13T02:50:44.975 INFO:tasks.workunit.client.1.smithi122.stdout:7/176: truncate d4/d8/db/ff 1397361 0 2024-09-13T02:50:44.990 INFO:tasks.workunit.client.1.smithi122.stdout:7/177: dwrite d4/fd [0,4194304] 0 2024-09-13T02:50:44.991 INFO:tasks.workunit.client.1.smithi122.stdout:7/178: creat d4/d8/db/dc/d36/f41 x:0 0 0 2024-09-13T02:50:45.009 INFO:tasks.workunit.client.1.smithi122.stdout:7/179: dwrite d4/d8/db/f38 [4194304,4194304] 0 2024-09-13T02:50:45.009 INFO:tasks.workunit.client.1.smithi122.stdout:7/180: link d4/d8/db/f11 d4/d8/db/f42 0 2024-09-13T02:50:45.009 INFO:tasks.workunit.client.1.smithi122.stdout:7/181: symlink d4/d8/db/dc/d36/l43 0 2024-09-13T02:50:45.010 INFO:tasks.workunit.client.1.smithi122.stdout:7/182: write d4/d8/db/f11 [216910,117518] 0 2024-09-13T02:50:45.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/183: getdents d4/d8/db/dc/d36 0 2024-09-13T02:50:45.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/184: dread - d4/d8/db/f2c zero size 2024-09-13T02:50:45.021 INFO:tasks.workunit.client.1.smithi122.stdout:7/185: write d4/fd [4169950,46893] 0 2024-09-13T02:50:45.022 INFO:tasks.workunit.client.1.smithi122.stdout:7/186: creat d4/d8/d3d/f44 x:0 0 0 2024-09-13T02:50:45.022 INFO:tasks.workunit.client.1.smithi122.stdout:7/187: chown d4/fd 1531 1 2024-09-13T02:50:45.022 INFO:tasks.workunit.client.1.smithi122.stdout:7/188: truncate d4/d8/f19 5235316 0 2024-09-13T02:50:45.022 INFO:tasks.workunit.client.1.smithi122.stdout:7/189: chown d4/d8/db/dc/d1b/c3a 8 1 2024-09-13T02:50:45.023 INFO:tasks.workunit.client.1.smithi122.stdout:7/190: rmdir d4/d8/db/dc/d36 39 2024-09-13T02:50:45.045 INFO:tasks.workunit.client.1.smithi122.stdout:7/191: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:45.045 INFO:tasks.workunit.client.1.smithi122.stdout:7/192: chown d4/d8/db/dc/d36 7 1 2024-09-13T02:50:45.045 INFO:tasks.workunit.client.1.smithi122.stdout:7/193: write d4/d8/db/f2a [412779,110294] 0 2024-09-13T02:50:45.045 INFO:tasks.workunit.client.1.smithi122.stdout:7/194: dread - d4/d8/db/dc/d1b/f32 zero size 2024-09-13T02:50:45.046 INFO:tasks.workunit.client.1.smithi122.stdout:7/195: symlink d4/d8/db/l45 0 2024-09-13T02:50:45.061 INFO:tasks.workunit.client.1.smithi122.stdout:7/196: dwrite d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:45.062 INFO:tasks.workunit.client.1.smithi122.stdout:7/197: getdents d4 0 2024-09-13T02:50:45.084 INFO:tasks.workunit.client.1.smithi122.stdout:7/198: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:45.085 INFO:tasks.workunit.client.1.smithi122.stdout:7/199: mkdir d4/d8/db/dc/d46 0 2024-09-13T02:50:45.086 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:44 smithi122 ceph-mon[34559]: pgmap v253: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 214 MiB/s rd, 278 MiB/s wr, 398 op/s 2024-09-13T02:50:45.086 INFO:tasks.workunit.client.1.smithi122.stdout:7/200: mkdir d4/d8/d24/d47 0 2024-09-13T02:50:45.087 INFO:tasks.workunit.client.1.smithi122.stdout:7/201: symlink d4/d8/db/dc/d36/l48 0 2024-09-13T02:50:45.098 INFO:tasks.workunit.client.1.smithi122.stdout:7/202: dwrite d4/f29 [0,4194304] 0 2024-09-13T02:50:45.111 INFO:tasks.workunit.client.1.smithi122.stdout:7/203: dwrite d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:45.120 INFO:tasks.workunit.client.1.smithi122.stdout:7/204: read d4/d8/f7 [1636316,39689] 0 2024-09-13T02:50:45.123 INFO:tasks.workunit.client.1.smithi122.stdout:7/205: getdents d4/d8/db/dc/d36 0 2024-09-13T02:50:45.125 INFO:tasks.workunit.client.1.smithi122.stdout:7/206: mkdir d4/d8/db/dc/d1b/d49 0 2024-09-13T02:50:45.125 INFO:tasks.workunit.client.1.smithi122.stdout:7/207: write d4/d8/db/f1f [3300672,13164] 0 2024-09-13T02:50:45.125 INFO:tasks.workunit.client.1.smithi122.stdout:7/208: rename d4/d8/db to d4/d8/db/dc/d4a 22 2024-09-13T02:50:45.138 INFO:tasks.workunit.client.1.smithi122.stdout:7/209: dwrite d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:45.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/210: mknod d4/d8/c4b 0 2024-09-13T02:50:45.141 INFO:tasks.workunit.client.1.smithi122.stdout:7/211: rmdir d4/d8/d24 39 2024-09-13T02:50:45.154 INFO:tasks.workunit.client.1.smithi122.stdout:7/212: dread d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:45.155 INFO:tasks.workunit.client.1.smithi122.stdout:7/213: symlink d4/d8/db/dc/d46/l4c 0 2024-09-13T02:50:45.155 INFO:tasks.workunit.client.1.smithi122.stdout:7/214: chown d4/d8/db/dc/c16 1360 1 2024-09-13T02:50:45.155 INFO:tasks.workunit.client.1.smithi122.stdout:7/215: chown d4/d8/db/l45 377 1 2024-09-13T02:50:45.157 INFO:tasks.workunit.client.1.smithi122.stdout:5/182: sync 2024-09-13T02:50:45.158 INFO:tasks.workunit.client.1.smithi122.stdout:1/175: sync 2024-09-13T02:50:45.158 INFO:tasks.workunit.client.1.smithi122.stdout:3/300: sync 2024-09-13T02:50:45.162 INFO:tasks.workunit.client.1.smithi122.stdout:1/176: rename dc/de/d13/l14 to dc/de/d18/d1d/l37 0 2024-09-13T02:50:45.190 INFO:tasks.workunit.client.1.smithi122.stdout:7/216: dwrite d4/d8/db/dc/f1d [0,4194304] 0 2024-09-13T02:50:45.190 INFO:tasks.workunit.client.1.smithi122.stdout:7/217: stat d4 0 2024-09-13T02:50:45.190 INFO:tasks.workunit.client.1.smithi122.stdout:3/301: dwrite f3 [0,4194304] 0 2024-09-13T02:50:45.191 INFO:tasks.workunit.client.1.smithi122.stdout:3/302: chown d4/d6/df/c27 46246092 1 2024-09-13T02:50:45.191 INFO:tasks.workunit.client.1.smithi122.stdout:1/177: dwrite dc/de/d18/f2c [0,4194304] 0 2024-09-13T02:50:45.195 INFO:tasks.workunit.client.1.smithi122.stdout:7/218: rmdir d4/d8/db/dc/d1b 39 2024-09-13T02:50:45.197 INFO:tasks.workunit.client.1.smithi122.stdout:7/219: link d4/d8/db/l45 d4/d8/db/dc/d36/l4d 0 2024-09-13T02:50:45.197 INFO:tasks.workunit.client.1.smithi122.stdout:7/220: fdatasync d4/d8/db/dc/d1b/f32 0 2024-09-13T02:50:45.197 INFO:tasks.workunit.client.1.smithi122.stdout:7/221: chown d4/d8/db/dc/d46 38 1 2024-09-13T02:50:45.199 INFO:tasks.workunit.client.1.smithi122.stdout:7/222: mkdir d4/d4e 0 2024-09-13T02:50:45.199 INFO:tasks.workunit.client.1.smithi122.stdout:7/223: stat d4/d8/l1c 0 2024-09-13T02:50:45.199 INFO:tasks.workunit.client.1.smithi122.stdout:5/183: dwrite d0/f7 [0,4194304] 0 2024-09-13T02:50:45.199 INFO:tasks.workunit.client.1.smithi122.stdout:5/184: chown d0/da/c14 13137003 1 2024-09-13T02:50:45.199 INFO:tasks.workunit.client.1.smithi122.stdout:5/185: rename d0/d1d to d0/d1d/d37 22 2024-09-13T02:50:45.200 INFO:tasks.workunit.client.1.smithi122.stdout:7/224: creat d4/d8/db/dc/d46/f4f x:0 0 0 2024-09-13T02:50:45.200 INFO:tasks.workunit.client.1.smithi122.stdout:7/225: chown d4/d8/db/dc/d1b 1189409 1 2024-09-13T02:50:45.201 INFO:tasks.workunit.client.1.smithi122.stdout:5/186: mknod d0/d17/d36/c38 0 2024-09-13T02:50:45.202 INFO:tasks.workunit.client.1.smithi122.stdout:7/226: symlink d4/d8/db/dc/d36/l50 0 2024-09-13T02:50:45.203 INFO:tasks.workunit.client.1.smithi122.stdout:5/187: mknod d0/d17/d36/d25/d2b/c39 0 2024-09-13T02:50:45.203 INFO:tasks.workunit.client.1.smithi122.stdout:5/188: write d0/da/f2d [1204493,19191] 0 2024-09-13T02:50:45.203 INFO:tasks.workunit.client.1.smithi122.stdout:5/189: getdents d0/d17/d35 0 2024-09-13T02:50:45.203 INFO:tasks.workunit.client.1.smithi122.stdout:5/190: fsync d0/f7 0 2024-09-13T02:50:45.204 INFO:tasks.workunit.client.1.smithi122.stdout:5/191: truncate d0/d17/d36/f24 497067 0 2024-09-13T02:50:45.206 INFO:tasks.workunit.client.1.smithi122.stdout:5/192: mkdir d0/d17/d3a 0 2024-09-13T02:50:45.207 INFO:tasks.workunit.client.1.smithi122.stdout:5/193: mknod d0/d17/d3a/c3b 0 2024-09-13T02:50:45.219 INFO:tasks.workunit.client.1.smithi122.stdout:1/178: dwrite fb [0,4194304] 0 2024-09-13T02:50:45.220 INFO:tasks.workunit.client.1.smithi122.stdout:1/179: fsync dc/de/d18/d1d/f34 0 2024-09-13T02:50:45.220 INFO:tasks.workunit.client.1.smithi122.stdout:3/303: dwrite d4/d11/dd/d21/f4d [0,4194304] 0 2024-09-13T02:50:45.221 INFO:tasks.workunit.client.1.smithi122.stdout:3/304: dread - d4/d11/dd/d21/d2b/d55/f62 zero size 2024-09-13T02:50:45.221 INFO:tasks.workunit.client.1.smithi122.stdout:6/417: sync 2024-09-13T02:50:45.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/127: sync 2024-09-13T02:50:45.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/128: fdatasync d0/d1c/f1d 0 2024-09-13T02:50:45.224 INFO:tasks.workunit.client.1.smithi122.stdout:3/305: rename d4/d6/de/l3a to d4/d11/dd/d21/d4e/l6e 0 2024-09-13T02:50:45.225 INFO:tasks.workunit.client.1.smithi122.stdout:6/418: link d5/db/f44 d5/d11/d45/f81 0 2024-09-13T02:50:45.225 INFO:tasks.workunit.client.1.smithi122.stdout:6/419: chown d5/d11/d3a/c68 233455859 1 2024-09-13T02:50:45.227 INFO:tasks.workunit.client.1.smithi122.stdout:3/306: read d4/d11/dd/d21/d2b/f45 [150312,45069] 0 2024-09-13T02:50:45.229 INFO:tasks.workunit.client.1.smithi122.stdout:5/194: dwrite d0/d1d/f1f [4194304,4194304] 0 2024-09-13T02:50:45.229 INFO:tasks.workunit.client.1.smithi122.stdout:3/307: mkdir d4/d6f 0 2024-09-13T02:50:45.231 INFO:tasks.workunit.client.1.smithi122.stdout:2/129: rmdir d0/d1c 39 2024-09-13T02:50:45.231 INFO:tasks.workunit.client.1.smithi122.stdout:2/130: chown d0/l1a 289 1 2024-09-13T02:50:45.231 INFO:tasks.workunit.client.1.smithi122.stdout:2/131: chown d0/l1a 22701678 1 2024-09-13T02:50:45.232 INFO:tasks.workunit.client.1.smithi122.stdout:2/132: mkdir d0/d1e/d22 0 2024-09-13T02:50:45.240 INFO:tasks.workunit.client.1.smithi122.stdout:1/180: dwrite dc/de/d18/f28 [0,4194304] 0 2024-09-13T02:50:45.245 INFO:tasks.workunit.client.1.smithi122.stdout:1/181: mkdir dc/d38 0 2024-09-13T02:50:45.247 INFO:tasks.workunit.client.1.smithi122.stdout:1/182: link f0 dc/de/d18/f39 0 2024-09-13T02:50:45.267 INFO:tasks.workunit.client.1.smithi122.stdout:6/420: dwrite d5/d11/d45/f2d [0,4194304] 0 2024-09-13T02:50:45.267 INFO:tasks.workunit.client.1.smithi122.stdout:6/421: truncate d5/d40/f67 114926 0 2024-09-13T02:50:45.267 INFO:tasks.workunit.client.1.smithi122.stdout:5/195: dwrite d0/d17/f18 [0,4194304] 0 2024-09-13T02:50:45.267 INFO:tasks.workunit.client.1.smithi122.stdout:1/183: dwrite fa [0,4194304] 0 2024-09-13T02:50:45.269 INFO:tasks.workunit.client.1.smithi122.stdout:2/133: dwrite d0/d1c/f1d [0,4194304] 0 2024-09-13T02:50:45.269 INFO:tasks.workunit.client.1.smithi122.stdout:5/196: link d0/d17/d36/d25/d2b/f2c d0/d17/d3a/f3c 0 2024-09-13T02:50:45.273 INFO:tasks.workunit.client.1.smithi122.stdout:5/197: mknod d0/d17/d35/c3d 0 2024-09-13T02:50:45.273 INFO:tasks.workunit.client.1.smithi122.stdout:5/198: dread - d0/d17/d36/d25/d2b/f30 zero size 2024-09-13T02:50:45.275 INFO:tasks.workunit.client.1.smithi122.stdout:2/134: write d0/f4 [2856239,57122] 0 2024-09-13T02:50:45.276 INFO:tasks.workunit.client.1.smithi122.stdout:2/135: symlink d0/d1e/d22/l23 0 2024-09-13T02:50:45.276 INFO:tasks.workunit.client.1.smithi122.stdout:2/136: read - d0/f20 zero size 2024-09-13T02:50:45.278 INFO:tasks.workunit.client.1.smithi122.stdout:2/137: truncate d0/f18 2645948 0 2024-09-13T02:50:45.279 INFO:tasks.workunit.client.1.smithi122.stdout:2/138: creat d0/d1e/d22/f24 x:0 0 0 2024-09-13T02:50:45.280 INFO:tasks.workunit.client.1.smithi122.stdout:2/139: creat d0/d1e/f25 x:0 0 0 2024-09-13T02:50:45.281 INFO:tasks.workunit.client.1.smithi122.stdout:2/140: unlink d0/c7 0 2024-09-13T02:50:45.282 INFO:tasks.workunit.client.1.smithi122.stdout:2/141: read - d0/d1e/f25 zero size 2024-09-13T02:50:45.283 INFO:tasks.workunit.client.1.smithi122.stdout:2/142: unlink d0/f20 0 2024-09-13T02:50:45.285 INFO:tasks.workunit.client.1.smithi122.stdout:2/143: mkdir d0/d1e/d26 0 2024-09-13T02:50:45.285 INFO:tasks.workunit.client.1.smithi122.stdout:2/144: dread - d0/f19 zero size 2024-09-13T02:50:45.285 INFO:tasks.workunit.client.1.smithi122.stdout:2/145: creat d0/f27 x:0 0 0 2024-09-13T02:50:45.292 INFO:tasks.workunit.client.1.smithi122.stdout:6/422: dwrite d5/db/d29/f1d [4194304,4194304] 0 2024-09-13T02:50:45.294 INFO:tasks.workunit.client.1.smithi122.stdout:1/184: dwrite dc/f16 [0,4194304] 0 2024-09-13T02:50:45.303 INFO:tasks.workunit.client.1.smithi122.stdout:1/185: mknod dc/de/d13/c3a 0 2024-09-13T02:50:45.303 INFO:tasks.workunit.client.1.smithi122.stdout:1/186: dread - dc/de/d18/d1d/f23 zero size 2024-09-13T02:50:45.304 INFO:tasks.workunit.client.1.smithi122.stdout:1/187: symlink dc/de/d13/l3b 0 2024-09-13T02:50:45.304 INFO:tasks.workunit.client.1.smithi122.stdout:1/188: truncate dc/de/d18/d22/f20 983547 0 2024-09-13T02:50:45.305 INFO:tasks.workunit.client.1.smithi122.stdout:1/189: creat dc/de/d18/d22/d1c/f3c x:0 0 0 2024-09-13T02:50:45.312 INFO:tasks.workunit.client.1.smithi122.stdout:0/202: sync 2024-09-13T02:50:45.312 INFO:tasks.workunit.client.1.smithi122.stdout:9/240: sync 2024-09-13T02:50:45.312 INFO:tasks.workunit.client.1.smithi122.stdout:4/217: sync 2024-09-13T02:50:45.313 INFO:tasks.workunit.client.1.smithi122.stdout:4/218: dread - d11/f43 zero size 2024-09-13T02:50:45.313 INFO:tasks.workunit.client.1.smithi122.stdout:8/132: sync 2024-09-13T02:50:45.313 INFO:tasks.workunit.client.1.smithi122.stdout:6/423: dwrite d5/d11/d45/df/d46/f5d [0,4194304] 0 2024-09-13T02:50:45.313 INFO:tasks.workunit.client.1.smithi122.stdout:9/241: rmdir d8/d16/d19/d23/d1f/d36/d44 39 2024-09-13T02:50:45.315 INFO:tasks.workunit.client.1.smithi122.stdout:0/203: mkdir d1/d4b 0 2024-09-13T02:50:45.317 INFO:tasks.workunit.client.1.smithi122.stdout:4/219: unlink d11/d13/d14/l27 0 2024-09-13T02:50:45.320 INFO:tasks.workunit.client.1.smithi122.stdout:8/133: rename d3/da/d1f/f22 to d3/da/d1f/d20/d21/f26 0 2024-09-13T02:50:45.320 INFO:tasks.workunit.client.1.smithi122.stdout:1/190: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:45.320 INFO:tasks.workunit.client.1.smithi122.stdout:1/191: dread - dc/de/d18/d1d/f23 zero size 2024-09-13T02:50:45.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/424: mkdir d5/d3d/d82 0 2024-09-13T02:50:45.321 INFO:tasks.workunit.client.1.smithi122.stdout:6/425: dread - d5/d11/d45/f78 zero size 2024-09-13T02:50:45.322 INFO:tasks.workunit.client.1.smithi122.stdout:0/204: link d1/d5/d9/l27 d1/d5/d10/l4c 0 2024-09-13T02:50:45.323 INFO:tasks.workunit.client.1.smithi122.stdout:0/205: truncate d1/d5/d2d/f44 667830 0 2024-09-13T02:50:45.324 INFO:tasks.workunit.client.1.smithi122.stdout:4/220: creat d11/d1b/d32/f46 x:0 0 0 2024-09-13T02:50:45.324 INFO:tasks.workunit.client.1.smithi122.stdout:4/221: creat d11/f47 x:0 0 0 2024-09-13T02:50:45.326 INFO:tasks.workunit.client.1.smithi122.stdout:8/134: rename d3/da/d1f/f14 to d3/da/d1f/f27 0 2024-09-13T02:50:45.326 INFO:tasks.workunit.client.1.smithi122.stdout:8/135: fsync d3/da/f1b 0 2024-09-13T02:50:45.328 INFO:tasks.workunit.client.1.smithi122.stdout:4/222: unlink f0 0 2024-09-13T02:50:45.328 INFO:tasks.workunit.client.1.smithi122.stdout:4/223: creat d11/d13/d14/f48 x:0 0 0 2024-09-13T02:50:45.328 INFO:tasks.workunit.client.1.smithi122.stdout:4/224: write d11/d13/d14/f48 [474831,115019] 0 2024-09-13T02:50:45.329 INFO:tasks.workunit.client.1.smithi122.stdout:4/225: dread - d11/d1b/f45 zero size 2024-09-13T02:50:45.329 INFO:tasks.workunit.client.1.smithi122.stdout:4/226: read f10 [155542,18608] 0 2024-09-13T02:50:45.329 INFO:tasks.workunit.client.1.smithi122.stdout:4/227: chown d11/d1b/d32/f46 2754 1 2024-09-13T02:50:45.329 INFO:tasks.workunit.client.1.smithi122.stdout:8/136: mkdir d3/da/d28 0 2024-09-13T02:50:45.329 INFO:tasks.workunit.client.1.smithi122.stdout:8/137: creat d3/da/d1f/f29 x:0 0 0 2024-09-13T02:50:45.331 INFO:tasks.workunit.client.1.smithi122.stdout:9/242: dwrite d8/d16/d19/d23/d1f/f37 [0,4194304] 0 2024-09-13T02:50:45.333 INFO:tasks.workunit.client.1.smithi122.stdout:9/243: dread d8/d16/d19/d23/f34 [0,4194304] 0 2024-09-13T02:50:45.334 INFO:tasks.workunit.client.1.smithi122.stdout:9/244: truncate d8/d16/f1b 3652871 0 2024-09-13T02:50:45.340 INFO:tasks.workunit.client.1.smithi122.stdout:4/228: dread d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:45.341 INFO:tasks.workunit.client.1.smithi122.stdout:9/245: dread d8/d16/d19/d23/f32 [0,4194304] 0 2024-09-13T02:50:45.341 INFO:tasks.workunit.client.1.smithi122.stdout:9/246: creat d8/d16/d19/d23/d1f/d36/f4c x:0 0 0 2024-09-13T02:50:45.342 INFO:tasks.workunit.client.1.smithi122.stdout:1/192: dwrite fb [0,4194304] 0 2024-09-13T02:50:45.343 INFO:tasks.workunit.client.1.smithi122.stdout:9/247: creat d8/d16/d19/f4d x:0 0 0 2024-09-13T02:50:45.343 INFO:tasks.workunit.client.1.smithi122.stdout:9/248: dread - d8/f2e zero size 2024-09-13T02:50:45.346 INFO:tasks.workunit.client.1.smithi122.stdout:0/206: dwrite d1/d5/d9/f20 [0,4194304] 0 2024-09-13T02:50:45.351 INFO:tasks.workunit.client.1.smithi122.stdout:0/207: truncate d1/d5/d9/da/d17/f22 384515 0 2024-09-13T02:50:45.352 INFO:tasks.workunit.client.1.smithi122.stdout:0/208: stat d1/d5/d15/d1d/f2c 0 2024-09-13T02:50:45.353 INFO:tasks.workunit.client.1.smithi122.stdout:4/229: rmdir d11/d1b/d32 39 2024-09-13T02:50:45.353 INFO:tasks.workunit.client.1.smithi122.stdout:4/230: write d11/d1b/f31 [267936,39127] 0 2024-09-13T02:50:45.353 INFO:tasks.workunit.client.1.smithi122.stdout:4/231: creat d11/f49 x:0 0 0 2024-09-13T02:50:45.356 INFO:tasks.workunit.client.1.smithi122.stdout:0/209: unlink d1/d5/d10/d29/f33 0 2024-09-13T02:50:45.358 INFO:tasks.workunit.client.1.smithi122.stdout:4/232: symlink d11/d1b/d32/l4a 0 2024-09-13T02:50:45.359 INFO:tasks.workunit.client.1.smithi122.stdout:4/233: creat d11/d30/f4b x:0 0 0 2024-09-13T02:50:45.361 INFO:tasks.workunit.client.1.smithi122.stdout:4/234: mknod d11/d13/d14/d2a/d40/c4c 0 2024-09-13T02:50:45.362 INFO:tasks.workunit.client.1.smithi122.stdout:4/235: creat d11/d13/d14/d2a/d40/f4d x:0 0 0 2024-09-13T02:50:45.363 INFO:tasks.workunit.client.1.smithi122.stdout:4/236: fdatasync d11/d13/d14/d2a/d40/f4d 0 2024-09-13T02:50:45.368 INFO:tasks.workunit.client.1.smithi122.stdout:4/237: dread fa [0,4194304] 0 2024-09-13T02:50:45.369 INFO:tasks.workunit.client.1.smithi122.stdout:1/193: dwrite f2 [0,4194304] 0 2024-09-13T02:50:45.369 INFO:tasks.workunit.client.1.smithi122.stdout:4/238: mknod d11/d13/c4e 0 2024-09-13T02:50:45.372 INFO:tasks.workunit.client.1.smithi122.stdout:1/194: unlink dc/l36 0 2024-09-13T02:50:45.374 INFO:tasks.workunit.client.1.smithi122.stdout:1/195: getdents dc/de 0 2024-09-13T02:50:45.374 INFO:tasks.workunit.client.1.smithi122.stdout:1/196: chown dc/de/f11 8736922 1 2024-09-13T02:50:45.376 INFO:tasks.workunit.client.1.smithi122.stdout:9/249: dwrite d8/d16/d19/d23/f3c [0,4194304] 0 2024-09-13T02:50:45.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/250: creat d8/d16/d19/f4e x:0 0 0 2024-09-13T02:50:45.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/251: truncate d8/d16/d19/f4e 96792 0 2024-09-13T02:50:45.378 INFO:tasks.workunit.client.1.smithi122.stdout:0/210: dwrite d1/d5/d10/d29/f34 [0,4194304] 0 2024-09-13T02:50:45.379 INFO:tasks.workunit.client.1.smithi122.stdout:0/211: write d1/d5/d9/da/f2b [174482,15231] 0 2024-09-13T02:50:45.379 INFO:tasks.workunit.client.1.smithi122.stdout:0/212: chown d1/d5/d15/f48 7362 1 2024-09-13T02:50:45.379 INFO:tasks.workunit.client.1.smithi122.stdout:9/252: mknod d8/d16/d19/d49/c4f 0 2024-09-13T02:50:45.381 INFO:tasks.workunit.client.1.smithi122.stdout:9/253: mknod d8/d16/d45/c50 0 2024-09-13T02:50:45.390 INFO:tasks.workunit.client.1.smithi122.stdout:4/239: dwrite d11/d13/d14/d2a/d40/f4d [0,4194304] 0 2024-09-13T02:50:45.395 INFO:tasks.workunit.client.1.smithi122.stdout:4/240: creat d11/d1b/d32/f4f x:0 0 0 2024-09-13T02:50:45.396 INFO:tasks.workunit.client.1.smithi122.stdout:9/254: dread f4 [0,4194304] 0 2024-09-13T02:50:45.396 INFO:tasks.workunit.client.1.smithi122.stdout:9/255: chown d8/l18 5 1 2024-09-13T02:50:45.397 INFO:tasks.workunit.client.1.smithi122.stdout:4/241: dread fa [0,4194304] 0 2024-09-13T02:50:45.397 INFO:tasks.workunit.client.1.smithi122.stdout:4/242: write d11/d1b/d32/f4f [627155,49201] 0 2024-09-13T02:50:45.397 INFO:tasks.workunit.client.1.smithi122.stdout:4/243: creat d11/d13/d14/d2a/f50 x:0 0 0 2024-09-13T02:50:45.399 INFO:tasks.workunit.client.1.smithi122.stdout:4/244: write d11/d13/d14/d2a/f2b [322179,63738] 0 2024-09-13T02:50:45.402 INFO:tasks.workunit.client.1.smithi122.stdout:4/245: rename d11/d13/d14/d2a/f36 to d11/d13/d14/d2a/d40/f51 0 2024-09-13T02:50:45.402 INFO:tasks.workunit.client.1.smithi122.stdout:4/246: truncate d11/d1b/d32/f46 177668 0 2024-09-13T02:50:45.402 INFO:tasks.workunit.client.1.smithi122.stdout:4/247: write d11/f49 [624570,80712] 0 2024-09-13T02:50:45.406 INFO:tasks.workunit.client.1.smithi122.stdout:9/256: write d8/d16/f2b [1434497,97311] 0 2024-09-13T02:50:45.427 INFO:tasks.workunit.client.1.smithi122.stdout:4/248: dwrite d11/d13/d14/f25 [0,4194304] 0 2024-09-13T02:50:45.427 INFO:tasks.workunit.client.1.smithi122.stdout:9/257: dwrite d8/d16/d19/f4d [0,4194304] 0 2024-09-13T02:50:45.430 INFO:tasks.workunit.client.1.smithi122.stdout:4/249: symlink d11/d13/d14/d2a/l52 0 2024-09-13T02:50:45.432 INFO:tasks.workunit.client.1.smithi122.stdout:4/250: link d11/d13/c4e d11/d13/d14/c53 0 2024-09-13T02:50:45.432 INFO:tasks.workunit.client.1.smithi122.stdout:4/251: chown le 25539739 1 2024-09-13T02:50:45.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/252: rename d11/d1b/f41 to d11/d30/f54 0 2024-09-13T02:50:45.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/253: truncate d11/d1b/f31 1163129 0 2024-09-13T02:50:45.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/254: mkdir d11/d1b/d2e/d55 0 2024-09-13T02:50:45.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/255: chown d11/d13/d14/f42 537633659 1 2024-09-13T02:50:45.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/256: rename d11/f3f to d11/f56 0 2024-09-13T02:50:45.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/257: write d11/d13/d14/d2a/d40/f4d [4606541,49287] 0 2024-09-13T02:50:45.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/258: fdatasync d11/f47 0 2024-09-13T02:50:45.440 INFO:tasks.workunit.client.1.smithi122.stdout:4/259: rename d11/d1b/l2f to d11/d13/d14/l57 0 2024-09-13T02:50:45.449 INFO:tasks.workunit.client.1.smithi122.stdout:9/258: dwrite d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:45.450 INFO:tasks.workunit.client.1.smithi122.stdout:9/259: symlink d8/d16/d45/l51 0 2024-09-13T02:50:45.450 INFO:tasks.workunit.client.1.smithi122.stdout:9/260: chown d8/cc 3 1 2024-09-13T02:50:45.452 INFO:tasks.workunit.client.1.smithi122.stdout:9/261: link d8/d16/d19/d23/f32 d8/d16/d19/d23/d1f/d36/f52 0 2024-09-13T02:50:45.453 INFO:tasks.workunit.client.1.smithi122.stdout:9/262: rename d8/d16/c27 to d8/d16/d3e/c53 0 2024-09-13T02:50:45.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/260: write d11/d13/f2c [1191351,84052] 0 2024-09-13T02:50:45.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/261: dread d11/d30/f54 [0,4194304] 0 2024-09-13T02:50:45.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/262: write d11/d13/d14/d2a/d40/f51 [317095,92319] 0 2024-09-13T02:50:45.477 INFO:tasks.workunit.client.1.smithi122.stdout:9/263: dwrite d8/d16/d19/d29/f38 [0,4194304] 0 2024-09-13T02:50:45.477 INFO:tasks.workunit.client.1.smithi122.stdout:9/264: write d8/f33 [558919,24729] 0 2024-09-13T02:50:45.477 INFO:tasks.workunit.client.1.smithi122.stdout:9/265: write d8/f2e [604679,24496] 0 2024-09-13T02:50:45.481 INFO:tasks.workunit.client.1.smithi122.stdout:4/263: dread d11/d13/d14/f25 [0,4194304] 0 2024-09-13T02:50:45.483 INFO:tasks.workunit.client.1.smithi122.stdout:4/264: creat d11/d1b/d2e/d55/f58 x:0 0 0 2024-09-13T02:50:45.485 INFO:tasks.workunit.client.1.smithi122.stdout:4/265: mkdir d11/d30/d59 0 2024-09-13T02:50:45.485 INFO:tasks.workunit.client.1.smithi122.stdout:4/266: creat d11/d13/d14/d2a/d40/f5a x:0 0 0 2024-09-13T02:50:45.489 INFO:tasks.workunit.client.1.smithi122.stdout:4/267: creat d11/d3d/f5b x:0 0 0 2024-09-13T02:50:45.489 INFO:tasks.workunit.client.1.smithi122.stdout:4/268: dread - d11/f43 zero size 2024-09-13T02:50:45.490 INFO:tasks.workunit.client.1.smithi122.stdout:4/269: chown d11/d1b/d2e/f34 374056391 1 2024-09-13T02:50:45.490 INFO:tasks.workunit.client.1.smithi122.stdout:4/270: write d11/d1b/d32/f4f [1446466,19337] 0 2024-09-13T02:50:45.491 INFO:tasks.workunit.client.1.smithi122.stdout:9/266: read d8/ff [4187075,120091] 0 2024-09-13T02:50:45.492 INFO:tasks.workunit.client.1.smithi122.stdout:4/271: mknod d11/d1b/c5c 0 2024-09-13T02:50:45.493 INFO:tasks.workunit.client.1.smithi122.stdout:9/267: rename d8/d16/d19/f2c to d8/d16/d19/d23/d1f/f54 0 2024-09-13T02:50:45.494 INFO:tasks.workunit.client.1.smithi122.stdout:9/268: mknod d8/d16/d19/d23/d1f/c55 0 2024-09-13T02:50:45.495 INFO:tasks.workunit.client.1.smithi122.stdout:9/269: mknod d8/d16/d3d/c56 0 2024-09-13T02:50:45.495 INFO:tasks.workunit.client.1.smithi122.stdout:9/270: readlink d8/d16/d19/l48 0 2024-09-13T02:50:45.497 INFO:tasks.workunit.client.1.smithi122.stdout:9/271: mkdir d8/d16/d3e/d57 0 2024-09-13T02:50:45.517 INFO:tasks.workunit.client.1.smithi122.stdout:4/272: dwrite fa [0,4194304] 0 2024-09-13T02:50:45.517 INFO:tasks.workunit.client.1.smithi122.stdout:4/273: chown d11/d1b/d2e 2750 1 2024-09-13T02:50:45.518 INFO:tasks.workunit.client.1.smithi122.stdout:9/272: dwrite d8/d16/d19/f4d [4194304,4194304] 0 2024-09-13T02:50:45.520 INFO:tasks.workunit.client.1.smithi122.stdout:9/273: rmdir d8/d16/d19/d29 39 2024-09-13T02:50:45.520 INFO:tasks.workunit.client.1.smithi122.stdout:9/274: readlink d8/l17 0 2024-09-13T02:50:45.521 INFO:tasks.workunit.client.1.smithi122.stdout:9/275: unlink d8/cc 0 2024-09-13T02:50:45.522 INFO:tasks.workunit.client.1.smithi122.stdout:9/276: chown d8/d16/d19/d23/d1f/c55 1 1 2024-09-13T02:50:45.522 INFO:tasks.workunit.client.1.smithi122.stdout:9/277: write d8/d16/d19/d29/f38 [4930033,60728] 0 2024-09-13T02:50:45.522 INFO:tasks.workunit.client.1.smithi122.stdout:9/278: chown d8/d16/l3f 2696386 1 2024-09-13T02:50:45.534 INFO:tasks.workunit.client.1.smithi122.stdout:9/279: dread d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:45.535 INFO:tasks.workunit.client.1.smithi122.stdout:9/280: rename d8/d16/d19/d23/c20 to d8/d16/c58 0 2024-09-13T02:50:45.550 INFO:tasks.workunit.client.1.smithi122.stdout:9/281: dwrite d8/f2e [0,4194304] 0 2024-09-13T02:50:45.554 INFO:tasks.workunit.client.1.smithi122.stdout:9/282: dread f4 [0,4194304] 0 2024-09-13T02:50:45.573 INFO:tasks.workunit.client.1.smithi122.stdout:9/283: dwrite d8/d16/d19/d23/f3c [0,4194304] 0 2024-09-13T02:50:45.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/284: dwrite d8/d16/d19/d23/d1f/d36/f52 [0,4194304] 0 2024-09-13T02:50:45.591 INFO:tasks.workunit.client.1.smithi122.stdout:9/285: unlink d8/d16/l3f 0 2024-09-13T02:50:45.591 INFO:tasks.workunit.client.1.smithi122.stdout:9/286: truncate d8/f28 4361080 0 2024-09-13T02:50:45.607 INFO:tasks.workunit.client.1.smithi122.stdout:9/287: dwrite f4 [0,4194304] 0 2024-09-13T02:50:45.608 INFO:tasks.workunit.client.1.smithi122.stdout:9/288: stat d8/d16/d19/d23/d1f/c21 0 2024-09-13T02:50:45.608 INFO:tasks.workunit.client.1.smithi122.stdout:9/289: chown d8/d16/l1e 107412434 1 2024-09-13T02:50:45.614 INFO:tasks.workunit.client.1.smithi122.stdout:9/290: rename d8/d16/d19 to d8/d16/d3d/d59 0 2024-09-13T02:50:45.614 INFO:tasks.workunit.client.1.smithi122.stdout:9/291: readlink d8/d16/d3d/d59/d29/l35 0 2024-09-13T02:50:45.614 INFO:tasks.workunit.client.1.smithi122.stdout:9/292: readlink d8/l17 0 2024-09-13T02:50:45.615 INFO:tasks.workunit.client.1.smithi122.stdout:9/293: chown d8/d16/d3d/d59/d49/c4f 117 1 2024-09-13T02:50:45.615 INFO:tasks.workunit.client.1.smithi122.stdout:9/294: mkdir d8/d16/d3d/d59/d5a 0 2024-09-13T02:50:45.616 INFO:tasks.workunit.client.1.smithi122.stdout:9/295: mknod d8/d16/d3d/d59/d29/c5b 0 2024-09-13T02:50:45.617 INFO:tasks.workunit.client.1.smithi122.stdout:9/296: unlink d8/d16/d3d/d59/d23/f34 0 2024-09-13T02:50:45.619 INFO:tasks.workunit.client.1.smithi122.stdout:9/297: unlink d8/d16/c58 0 2024-09-13T02:50:45.620 INFO:tasks.workunit.client.1.smithi122.stdout:9/298: creat d8/d4a/f5c x:0 0 0 2024-09-13T02:50:45.621 INFO:tasks.workunit.client.1.smithi122.stdout:9/299: mknod d8/d16/c5d 0 2024-09-13T02:50:45.621 INFO:tasks.workunit.client.1.smithi122.stdout:9/300: fsync d8/d16/f2b 0 2024-09-13T02:50:45.629 INFO:tasks.workunit.client.1.smithi122.stdout:9/301: dread d8/d16/d3d/d59/d23/d1f/d36/f52 [0,4194304] 0 2024-09-13T02:50:45.629 INFO:tasks.workunit.client.1.smithi122.stdout:9/302: fsync d8/d16/d3d/d59/f4d 0 2024-09-13T02:50:45.630 INFO:tasks.workunit.client.1.smithi122.stdout:9/303: link c0 d8/c5e 0 2024-09-13T02:50:45.630 INFO:tasks.workunit.client.1.smithi122.stdout:9/304: chown d8/d16/d3e/d57 881772687 1 2024-09-13T02:50:45.645 INFO:tasks.workunit.client.1.smithi122.stdout:9/305: dwrite d8/d16/d3d/d59/d23/d1f/d36/f4c [0,4194304] 0 2024-09-13T02:50:45.647 INFO:tasks.workunit.client.1.smithi122.stdout:9/306: mknod d8/d16/d3d/d59/d23/d1f/c5f 0 2024-09-13T02:50:45.649 INFO:tasks.workunit.client.1.smithi122.stdout:9/307: rename d8/l18 to d8/d16/d3d/d59/l60 0 2024-09-13T02:50:45.649 INFO:tasks.workunit.client.1.smithi122.stdout:9/308: chown d8/d16/d3d/d59/d23/d1f/f2d 29533 1 2024-09-13T02:50:45.662 INFO:tasks.workunit.client.1.smithi122.stdout:9/309: dwrite d8/d16/d3d/d59/d29/f38 [0,4194304] 0 2024-09-13T02:50:45.663 INFO:tasks.workunit.client.1.smithi122.stdout:9/310: mknod d8/d16/d3d/d59/d5a/c61 0 2024-09-13T02:50:45.664 INFO:tasks.workunit.client.1.smithi122.stdout:9/311: unlink f4 0 2024-09-13T02:50:45.668 INFO:tasks.workunit.client.1.smithi122.stdout:9/312: dread d8/f33 [0,4194304] 0 2024-09-13T02:50:45.674 INFO:tasks.workunit.client.1.smithi122.stdout:9/313: write d8/d16/f1b [403617,105970] 0 2024-09-13T02:50:45.676 INFO:tasks.workunit.client.1.smithi122.stdout:9/314: unlink d8/d16/d3e/c53 0 2024-09-13T02:50:45.689 INFO:tasks.workunit.client.1.smithi122.stdout:9/315: dwrite d8/d16/d3d/d59/d29/f38 [0,4194304] 0 2024-09-13T02:50:45.701 INFO:tasks.workunit.client.1.smithi122.stdout:9/316: dread d8/d16/d3d/d59/d23/d1f/f2a [0,4194304] 0 2024-09-13T02:50:45.707 INFO:tasks.workunit.client.1.smithi122.stdout:9/317: read d8/f2e [1959374,46771] 0 2024-09-13T02:50:45.708 INFO:tasks.workunit.client.1.smithi122.stdout:9/318: creat d8/d16/f62 x:0 0 0 2024-09-13T02:50:45.709 INFO:tasks.workunit.client.1.smithi122.stdout:9/319: creat d8/d16/d45/f63 x:0 0 0 2024-09-13T02:50:45.709 INFO:tasks.workunit.client.1.smithi122.stdout:9/320: fdatasync d8/d16/d3d/d59/d29/f38 0 2024-09-13T02:50:45.709 INFO:tasks.workunit.client.1.smithi122.stdout:9/321: mkdir d8/d4a/d64 0 2024-09-13T02:50:45.710 INFO:tasks.workunit.client.1.smithi122.stdout:9/322: mkdir d8/d16/d3d/d59/d23/d1f/d36/d44/d65 0 2024-09-13T02:50:45.710 INFO:tasks.workunit.client.1.smithi122.stdout:9/323: chown c7 13423641 1 2024-09-13T02:50:45.713 INFO:tasks.workunit.client.1.smithi122.stdout:9/324: dread d8/f28 [0,4194304] 0 2024-09-13T02:50:45.715 INFO:tasks.workunit.client.1.smithi122.stdout:9/325: creat d8/d16/d3d/d59/d23/f66 x:0 0 0 2024-09-13T02:50:45.721 INFO:tasks.workunit.client.1.smithi122.stdout:7/227: sync 2024-09-13T02:50:45.726 INFO:tasks.workunit.client.1.smithi122.stdout:9/326: dwrite d8/d16/d45/f63 [0,4194304] 0 2024-09-13T02:50:45.728 INFO:tasks.workunit.client.1.smithi122.stdout:9/327: mknod d8/d16/d3d/d59/d23/c67 0 2024-09-13T02:50:45.728 INFO:tasks.workunit.client.1.smithi122.stdout:9/328: truncate d8/d16/d3d/d59/f4e 868390 0 2024-09-13T02:50:45.737 INFO:tasks.workunit.client.1.smithi122.stdout:9/329: dread d8/d16/d3d/d59/f4d [4194304,4194304] 0 2024-09-13T02:50:45.753 INFO:tasks.workunit.client.1.smithi122.stdout:9/330: dwrite d8/d16/f62 [0,4194304] 0 2024-09-13T02:50:45.754 INFO:tasks.workunit.client.1.smithi122.stdout:9/331: chown d8/d16/d3d/d59/d23/d1f/f2d 4975800 1 2024-09-13T02:50:45.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/332: write d8/d16/d3d/d59/d29/f38 [966126,124054] 0 2024-09-13T02:50:45.778 INFO:tasks.workunit.client.1.smithi122.stdout:9/333: dwrite d8/d16/d3d/d59/d23/f32 [0,4194304] 0 2024-09-13T02:50:45.778 INFO:tasks.workunit.client.1.smithi122.stdout:9/334: readlink d8/d16/l1e 0 2024-09-13T02:50:45.788 INFO:tasks.workunit.client.1.smithi122.stdout:9/335: write d8/d16/d45/f63 [2849998,50237] 0 2024-09-13T02:50:45.788 INFO:tasks.workunit.client.1.smithi122.stdout:9/336: truncate d8/f28 5312948 0 2024-09-13T02:50:45.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/337: creat d8/d16/d3d/d59/d23/d1f/d36/d44/f68 x:0 0 0 2024-09-13T02:50:45.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/338: symlink d8/d16/d3d/d59/d23/d1f/l69 0 2024-09-13T02:50:45.790 INFO:tasks.workunit.client.1.smithi122.stdout:9/339: getdents d8/d16/d3d/d59 0 2024-09-13T02:50:45.790 INFO:tasks.workunit.client.1.smithi122.stdout:9/340: mknod d8/d16/c6a 0 2024-09-13T02:50:45.791 INFO:tasks.workunit.client.1.smithi122.stdout:9/341: creat d8/d16/d3e/f6b x:0 0 0 2024-09-13T02:50:45.803 INFO:tasks.workunit.client.1.smithi122.stdout:9/342: dwrite d8/d16/d3d/d59/d23/d1f/d36/d44/f68 [0,4194304] 0 2024-09-13T02:50:45.822 INFO:tasks.workunit.client.1.smithi122.stdout:9/343: dwrite d8/d16/d45/f63 [0,4194304] 0 2024-09-13T02:50:45.824 INFO:tasks.workunit.client.1.smithi122.stdout:9/344: link d8/d16/l1e d8/d16/d3e/l6c 0 2024-09-13T02:50:45.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/199: sync 2024-09-13T02:50:45.854 INFO:tasks.workunit.client.1.smithi122.stdout:3/308: sync 2024-09-13T02:50:45.855 INFO:tasks.workunit.client.1.smithi122.stdout:5/200: truncate d0/d17/d36/f24 1004256 0 2024-09-13T02:50:45.855 INFO:tasks.workunit.client.1.smithi122.stdout:3/309: link d4/d11/dd/d21/d2b/f2f d4/d11/d38/f70 0 2024-09-13T02:50:45.856 INFO:tasks.workunit.client.1.smithi122.stdout:3/310: truncate d4/f5d 213664 0 2024-09-13T02:50:45.856 INFO:tasks.workunit.client.1.smithi122.stdout:3/311: mknod d4/d6/de/c71 0 2024-09-13T02:50:45.863 INFO:tasks.workunit.client.1.smithi122.stdout:5/201: dread d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:45.863 INFO:tasks.workunit.client.1.smithi122.stdout:5/202: write d0/da/f16 [1424786,102657] 0 2024-09-13T02:50:45.863 INFO:tasks.workunit.client.1.smithi122.stdout:5/203: truncate d0/da/f16 2289890 0 2024-09-13T02:50:45.877 INFO:tasks.workunit.client.1.smithi122.stdout:5/204: dwrite d0/da/f23 [0,4194304] 0 2024-09-13T02:50:45.887 INFO:tasks.workunit.client.1.smithi122.stdout:5/205: read d0/da/f2a [2774139,35910] 0 2024-09-13T02:50:45.900 INFO:tasks.workunit.client.1.smithi122.stdout:5/206: dwrite d0/d17/d36/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:50:45.901 INFO:tasks.workunit.client.1.smithi122.stdout:5/207: getdents d0/d17/d36/d25 0 2024-09-13T02:50:45.901 INFO:tasks.workunit.client.1.smithi122.stdout:5/208: truncate d0/d17/d36/d25/d2b/f2c 4254949 0 2024-09-13T02:50:45.901 INFO:tasks.workunit.client.1.smithi122.stdout:5/209: creat d0/d17/f3e x:0 0 0 2024-09-13T02:50:45.902 INFO:tasks.workunit.client.1.smithi122.stdout:5/210: truncate d0/da/f2a 4744594 0 2024-09-13T02:50:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 -- 172.21.15.100:0/2423081464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 msgr2=0x7f7fac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/2423081464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac0fcb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f940048d0 tx=0x7f7f94009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 -- 172.21.15.100:0/2423081464 shutdown_connections 2024-09-13T02:50:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/2423081464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac0fcb70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/2423081464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 0x7f7fac0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 -- 172.21.15.100:0/2423081464 >> 172.21.15.100:0/2423081464 conn(0x7f7fac0f6c10 msgr2=0x7f7fac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 -- 172.21.15.100:0/2423081464 shutdown_connections 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.904+0000 7f7fb1b34640 1 -- 172.21.15.100:0/2423081464 wait complete. 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 Processor -- start 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 -- start start 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 0x7f7fac10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac065c60 con 0x7f7fac0fc700 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fb1b34640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac065dd0 con 0x7f7fac0fb430 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39864/0 (socket says 172.21.15.100:39864) 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 -- 172.21.15.100:0/3864014932 learned_addr learned my addr 172.21.15.100:0/3864014932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:45.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fab7fe640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 0x7f7fac10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 -- 172.21.15.100:0/3864014932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 msgr2=0x7f7fac10fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 0x7f7fac10fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 -- 172.21.15.100:0/3864014932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94005040 con 0x7f7fac0fc700 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.905+0000 7f7fa3fff640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f940043d0 tx=0x7f7f94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.906+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f94038070 con 0x7f7fac0fc700 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.906+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f9402ae90 con 0x7f7fac0fc700 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.906+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac112810 con 0x7f7fac0fc700 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.906+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac112d00 con 0x7f7fac0fc700 2024-09-13T02:50:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.906+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9403e670 con 0x7f7fac0fc700 2024-09-13T02:50:45.910 INFO:tasks.workunit.client.1.smithi122.stdout:5/211: write d0/d17/d36/d25/d2b/f2c [933517,129563] 0 2024-09-13T02:50:45.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.907+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac0fa890 con 0x7f7fac0fc700 2024-09-13T02:50:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.907+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f7f94030020 con 0x7f7fac0fc700 2024-09-13T02:50:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.908+0000 7f7fa8ff9640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 0x7f7f98070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.908+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7f940adc50 con 0x7f7fac0fc700 2024-09-13T02:50:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.908+0000 7f7fab7fe640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 0x7f7f98070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.909+0000 7f7fab7fe640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 0x7f7f98070a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fac065950 tx=0x7f7f9c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:45.911 INFO:tasks.workunit.client.1.smithi122.stdout:5/212: unlink d0/f1a 0 2024-09-13T02:50:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:45.913+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7f9407ae50 con 0x7f7fac0fc700 2024-09-13T02:50:45.930 INFO:tasks.workunit.client.1.smithi122.stdout:5/213: dwrite d0/d17/d36/d25/d2b/f2c [4194304,4194304] 0 2024-09-13T02:50:45.930 INFO:tasks.workunit.client.1.smithi122.stdout:5/214: stat d0/d1d/f2e 0 2024-09-13T02:50:45.930 INFO:tasks.workunit.client.1.smithi122.stdout:5/215: fdatasync d0/da/f2a 0 2024-09-13T02:50:45.935 INFO:tasks.workunit.client.1.smithi122.stdout:5/216: dread d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:45.948 INFO:tasks.workunit.client.1.smithi122.stdout:5/217: dwrite d0/d17/d36/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:50:45.953 INFO:tasks.workunit.client.1.smithi122.stdout:5/218: dread d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:45.954 INFO:tasks.workunit.client.1.smithi122.stdout:5/219: mkdir d0/d17/d36/d3f 0 2024-09-13T02:50:45.954 INFO:tasks.workunit.client.1.smithi122.stdout:2/146: sync 2024-09-13T02:50:45.955 INFO:tasks.workunit.client.1.smithi122.stdout:2/147: mkdir d0/d28 0 2024-09-13T02:50:45.955 INFO:tasks.workunit.client.1.smithi122.stdout:2/148: truncate d0/f16 865307 0 2024-09-13T02:50:45.957 INFO:tasks.workunit.client.1.smithi122.stdout:2/149: unlink d0/f4 0 2024-09-13T02:50:45.957 INFO:tasks.workunit.client.1.smithi122.stdout:2/150: getdents d0/d1e/d26 0 2024-09-13T02:50:45.958 INFO:tasks.workunit.client.1.smithi122.stdout:2/151: mkdir d0/d1e/d22/d29 0 2024-09-13T02:50:45.959 INFO:tasks.workunit.client.1.smithi122.stdout:2/152: symlink d0/d1e/d22/l2a 0 2024-09-13T02:50:45.961 INFO:tasks.workunit.client.1.smithi122.stdout:2/153: truncate d0/fc 4160822 0 2024-09-13T02:50:45.963 INFO:tasks.workunit.client.1.smithi122.stdout:5/220: dread d0/d1d/f2e [0,4194304] 0 2024-09-13T02:50:45.963 INFO:tasks.workunit.client.1.smithi122.stdout:2/154: creat d0/d1e/d22/d29/f2b x:0 0 0 2024-09-13T02:50:45.963 INFO:tasks.workunit.client.1.smithi122.stdout:2/155: write d0/d1e/d22/d29/f2b [425258,60479] 0 2024-09-13T02:50:45.963 INFO:tasks.workunit.client.1.smithi122.stdout:2/156: truncate d0/f27 980461 0 2024-09-13T02:50:45.981 INFO:tasks.workunit.client.1.smithi122.stdout:5/221: dwrite d0/da/f19 [0,4194304] 0 2024-09-13T02:50:45.982 INFO:tasks.workunit.client.1.smithi122.stdout:5/222: getdents d0/da 0 2024-09-13T02:50:45.986 INFO:tasks.workunit.client.1.smithi122.stdout:5/223: dread d0/da/f16 [0,4194304] 0 2024-09-13T02:50:45.986 INFO:tasks.workunit.client.1.smithi122.stdout:5/224: stat d0/da/c14 0 2024-09-13T02:50:45.987 INFO:tasks.workunit.client.1.smithi122.stdout:5/225: mknod d0/d2/d33/c40 0 2024-09-13T02:50:45.995 INFO:tasks.workunit.client.1.smithi122.stdout:5/226: dread d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:45.997 INFO:tasks.workunit.client.1.smithi122.stdout:5/227: link d0/d1d/f29 d0/d1d/f41 0 2024-09-13T02:50:46.003 INFO:tasks.workunit.client.1.smithi122.stdout:5/228: write d0/da/f19 [2633959,96263] 0 2024-09-13T02:50:46.004 INFO:tasks.workunit.client.1.smithi122.stdout:5/229: write d0/da/f2a [3842829,22370] 0 2024-09-13T02:50:46.005 INFO:tasks.workunit.client.1.smithi122.stdout:5/230: link d0/da/c15 d0/da/c42 0 2024-09-13T02:50:46.005 INFO:tasks.workunit.client.1.smithi122.stdout:5/231: write d0/d17/d3a/f3c [8478350,55098] 0 2024-09-13T02:50:46.016 INFO:tasks.workunit.client.1.smithi122.stdout:5/232: read d0/d17/f28 [2092374,24256] 0 2024-09-13T02:50:46.016 INFO:tasks.workunit.client.1.smithi122.stdout:5/233: dread - d0/d17/d36/d25/d2b/f30 zero size 2024-09-13T02:50:46.016 INFO:tasks.workunit.client.1.smithi122.stdout:5/234: chown d0/d17/f18 5688805 1 2024-09-13T02:50:46.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/235: chown d0/da/l2f 11733 1 2024-09-13T02:50:46.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/236: mknod d0/d17/d35/c43 0 2024-09-13T02:50:46.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/237: symlink d0/d2/d33/l44 0 2024-09-13T02:50:46.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/238: chown d0/d17/d3a/f3c 308 1 2024-09-13T02:50:46.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/239: dread d0/d17/d36/f24 [0,4194304] 0 2024-09-13T02:50:46.019 INFO:tasks.workunit.client.1.smithi122.stdout:5/240: creat d0/d17/d35/f45 x:0 0 0 2024-09-13T02:50:46.020 INFO:tasks.workunit.client.1.smithi122.stdout:5/241: fdatasync d0/d17/f28 0 2024-09-13T02:50:46.021 INFO:tasks.workunit.client.1.smithi122.stdout:5/242: dread d0/da/f2d [0,4194304] 0 2024-09-13T02:50:46.038 INFO:tasks.workunit.client.1.smithi122.stdout:5/243: dwrite d0/da/f2a [4194304,4194304] 0 2024-09-13T02:50:46.039 INFO:tasks.workunit.client.1.smithi122.stdout:5/244: mkdir d0/d1d/d46 0 2024-09-13T02:50:46.039 INFO:tasks.workunit.client.1.smithi122.stdout:5/245: creat d0/d17/d35/f47 x:0 0 0 2024-09-13T02:50:46.039 INFO:tasks.workunit.client.1.smithi122.stdout:5/246: chown d0/d2/f1b 176209262 1 2024-09-13T02:50:46.044 INFO:tasks.workunit.client.1.smithi122.stdout:5/247: rename d0/d17/d35 to d0/da/d48 0 2024-09-13T02:50:46.044 INFO:tasks.workunit.client.1.smithi122.stdout:5/248: truncate d0/d2/f1b 4772250 0 2024-09-13T02:50:46.044 INFO:tasks.workunit.client.1.smithi122.stdout:5/249: creat d0/da/d48/f49 x:0 0 0 2024-09-13T02:50:46.045 INFO:tasks.workunit.client.1.smithi122.stdout:5/250: symlink d0/d17/d36/d3f/l4a 0 2024-09-13T02:50:46.045 INFO:tasks.workunit.client.1.smithi122.stdout:5/251: write d0/d1d/f41 [800434,35029] 0 2024-09-13T02:50:46.046 INFO:tasks.workunit.client.1.smithi122.stdout:5/252: mknod d0/d17/d3a/c4b 0 2024-09-13T02:50:46.046 INFO:tasks.workunit.client.1.smithi122.stdout:5/253: mkdir d0/d17/d36/d3f/d4c 0 2024-09-13T02:50:46.054 INFO:tasks.workunit.client.1.smithi122.stdout:5/254: write d0/d17/d36/d25/d2b/f2c [563804,102182] 0 2024-09-13T02:50:46.054 INFO:tasks.workunit.client.1.smithi122.stdout:5/255: write d0/d17/f3e [461006,116954] 0 2024-09-13T02:50:46.056 INFO:tasks.workunit.client.1.smithi122.stdout:5/256: rename d0/d17/d3a/f3c to d0/f4d 0 2024-09-13T02:50:46.066 INFO:tasks.workunit.client.1.smithi122.stdout:5/257: dread d0/da/f2a [4194304,4194304] 0 2024-09-13T02:50:46.089 INFO:tasks.workunit.client.1.smithi122.stdout:5/258: dwrite d0/d17/f22 [0,4194304] 0 2024-09-13T02:50:46.100 INFO:tasks.workunit.client.1.smithi122.stdout:5/259: getdents d0 0 2024-09-13T02:50:46.121 INFO:tasks.workunit.client.1.smithi122.stdout:5/260: dwrite d0/da/f2a [0,4194304] 0 2024-09-13T02:50:46.122 INFO:tasks.workunit.client.1.smithi122.stdout:5/261: symlink d0/da/d48/l4e 0 2024-09-13T02:50:46.137 INFO:tasks.workunit.client.1.smithi122.stdout:5/262: write d0/f7 [654932,104518] 0 2024-09-13T02:50:46.138 INFO:tasks.workunit.client.1.smithi122.stdout:5/263: creat d0/d17/d3a/f4f x:0 0 0 2024-09-13T02:50:46.140 INFO:tasks.workunit.client.1.smithi122.stdout:5/264: rename d0/d1d/f41 to d0/d17/d36/f50 0 2024-09-13T02:50:46.142 INFO:tasks.workunit.client.1.smithi122.stdout:5/265: creat d0/da/d48/f51 x:0 0 0 2024-09-13T02:50:46.157 INFO:tasks.workunit.client.1.smithi122.stdout:6/426: sync 2024-09-13T02:50:46.158 INFO:tasks.workunit.client.1.smithi122.stdout:6/427: mkdir d5/d11/d45/d21/d83 0 2024-09-13T02:50:46.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/428: creat d5/d11/d45/df/d26/f84 x:0 0 0 2024-09-13T02:50:46.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/429: chown d5/db/dc/c19 1942 1 2024-09-13T02:50:46.161 INFO:tasks.workunit.client.1.smithi122.stdout:6/430: creat d5/d11/f85 x:0 0 0 2024-09-13T02:50:46.161 INFO:tasks.workunit.client.1.smithi122.stdout:6/431: chown d5/d3d/d6c/d41/d4e/d5f 11 1 2024-09-13T02:50:46.161 INFO:tasks.workunit.client.1.smithi122.stdout:6/432: fdatasync d5/d3d/d6c/f7f 0 2024-09-13T02:50:46.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.162+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fac100bb0 con 0x7f7f9806e5c0 2024-09-13T02:50:46.164 INFO:tasks.workunit.client.1.smithi122.stdout:5/266: dwrite d0/da/f23 [4194304,4194304] 0 2024-09-13T02:50:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.164+0000 7f7fa8ff9640 1 -- 172.21.15.100:0/3864014932 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f7fac100bb0 con 0x7f7f9806e5c0 2024-09-13T02:50:46.166 INFO:tasks.workunit.client.1.smithi122.stdout:5/267: creat d0/d2/d33/f52 x:0 0 0 2024-09-13T02:50:46.168 INFO:tasks.workunit.client.1.smithi122.stdout:5/268: creat d0/f53 x:0 0 0 2024-09-13T02:50:46.168 INFO:tasks.workunit.client.1.smithi122.stdout:5/269: creat d0/d17/f54 x:0 0 0 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 msgr2=0x7f7f98070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 0x7f7f98070a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7fac065950 tx=0x7f7f9c00b040 comp rx=0 tx=0).stop 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 msgr2=0x7f7fac1122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f940043d0 tx=0x7f7f94009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 shutdown_connections 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f7f9806e5c0 0x7f7f98070a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fac0fc700 0x7f7fac1122d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 --2- 172.21.15.100:0/3864014932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7fac0fb430 0x7f7fac10fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.167+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 >> 172.21.15.100:0/3864014932 conn(0x7f7fac0f6c10 msgr2=0x7f7fac0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.168+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 shutdown_connections 2024-09-13T02:50:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.168+0000 7f7fb1b34640 1 -- 172.21.15.100:0/3864014932 wait complete. 2024-09-13T02:50:46.170 INFO:tasks.workunit.client.1.smithi122.stdout:5/270: mknod d0/c55 0 2024-09-13T02:50:46.170 INFO:tasks.workunit.client.1.smithi122.stdout:5/271: fdatasync d0/da/d48/f49 0 2024-09-13T02:50:46.170 INFO:tasks.workunit.client.1.smithi122.stdout:5/272: chown d0/d17/d36 0 1 2024-09-13T02:50:46.178 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:50:46.180 INFO:tasks.workunit.client.1.smithi122.stdout:6/433: dwrite d5/d11/d45/df/d26/f84 [0,4194304] 0 2024-09-13T02:50:46.180 INFO:tasks.workunit.client.1.smithi122.stdout:6/434: creat d5/d3d/d6c/d41/d4e/d5f/f86 x:0 0 0 2024-09-13T02:50:46.180 INFO:tasks.workunit.client.1.smithi122.stdout:6/435: write d5/d3d/f77 [646637,112485] 0 2024-09-13T02:50:46.180 INFO:tasks.workunit.client.1.smithi122.stdout:6/436: dread - d5/d11/d45/f78 zero size 2024-09-13T02:50:46.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 -- 172.21.15.100:0/1620500310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fd820 msgr2=0x7f50dc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 --2- 172.21.15.100:0/1620500310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fd820 0x7f50dc0fdc90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50d00048d0 tx=0x7f50d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 -- 172.21.15.100:0/1620500310 shutdown_connections 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 --2- 172.21.15.100:0/1620500310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fd820 0x7f50dc0fdc90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 --2- 172.21.15.100:0/1620500310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50dc0fc550 0x7f50dc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 -- 172.21.15.100:0/1620500310 >> 172.21.15.100:0/1620500310 conn(0x7f50dc0f7d30 msgr2=0x7f50dc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 -- 172.21.15.100:0/1620500310 shutdown_connections 2024-09-13T02:50:46.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.250+0000 7f50e2618640 1 -- 172.21.15.100:0/1620500310 wait complete. 2024-09-13T02:50:46.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 Processor -- start 2024-09-13T02:50:46.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 -- start start 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50dc0fd820 0x7f50dc10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc10e490 con 0x7f50dc0fc550 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50e2618640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc10e600 con 0x7f50dc0fd820 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.251+0000 7f50dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39882/0 (socket says 172.21.15.100:39882) 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 -- 172.21.15.100:0/2788825360 learned_addr learned my addr 172.21.15.100:0/2788825360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:46.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 -- 172.21.15.100:0/2788825360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50dc0fd820 msgr2=0x7f50dc10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50dc0fd820 0x7f50dc10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 -- 172.21.15.100:0/2788825360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0005040 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50dbfff640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b790 tx=0x7f50cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.252+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50cc00c700 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.253+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50cc00cd00 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.253+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc10e8e0 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.253+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc10ee00 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.253+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50cc00c700 con 0x7f50dc0fc550 2024-09-13T02:50:46.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.254+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c8005240 con 0x7f50dc0fc550 2024-09-13T02:50:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.255+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f50cc012070 con 0x7f50dc0fc550 2024-09-13T02:50:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.256+0000 7f50d8ff9640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 0x7f50c4070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.256+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f50cc08d410 con 0x7f50dc0fc550 2024-09-13T02:50:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.256+0000 7f50db7fe640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 0x7f50c4070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:46.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.257+0000 7f50db7fe640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 0x7f50c4070ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50d002a530 tx=0x7f50d0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:46.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.261+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f50cc05a4e0 con 0x7f50dc0fc550 2024-09-13T02:50:46.264 INFO:tasks.workunit.client.1.smithi122.stdout:6/437: dwrite d5/d11/d45/f2d [4194304,4194304] 0 2024-09-13T02:50:46.266 INFO:tasks.workunit.client.1.smithi122.stdout:6/438: read d5/d11/d45/df/d26/f5c [304149,24583] 0 2024-09-13T02:50:46.266 INFO:tasks.workunit.client.1.smithi122.stdout:6/439: readlink d5/d3d/d6c/d41/l80 0 2024-09-13T02:50:46.266 INFO:tasks.workunit.client.1.smithi122.stdout:6/440: creat d5/d11/d45/d21/f87 x:0 0 0 2024-09-13T02:50:46.270 INFO:tasks.workunit.client.1.smithi122.stdout:6/441: creat d5/d3d/d6c/d41/d4e/f88 x:0 0 0 2024-09-13T02:50:46.270 INFO:tasks.workunit.client.1.smithi122.stdout:6/442: truncate d5/d11/d2f/f4d 1468187 0 2024-09-13T02:50:46.270 INFO:tasks.workunit.client.1.smithi122.stdout:6/443: chown d5/d3d/d6c/d41/f47 144 1 2024-09-13T02:50:46.271 INFO:tasks.workunit.client.1.smithi122.stdout:6/444: mknod d5/d3d/d82/c89 0 2024-09-13T02:50:46.289 INFO:tasks.workunit.client.1.smithi122.stdout:6/445: dwrite d5/d3d/d6c/d41/d5b/f65 [0,4194304] 0 2024-09-13T02:50:46.292 INFO:tasks.workunit.client.1.smithi122.stdout:6/446: mkdir d5/d11/d45/d21/d8a 0 2024-09-13T02:50:46.292 INFO:tasks.workunit.client.1.smithi122.stdout:6/447: fdatasync d5/f69 0 2024-09-13T02:50:46.297 INFO:tasks.workunit.client.1.smithi122.stdout:6/448: rmdir d5/d11/d45 39 2024-09-13T02:50:46.298 INFO:tasks.workunit.client.1.smithi122.stdout:6/449: chown d5/d11/d2f 983905 1 2024-09-13T02:50:46.298 INFO:tasks.workunit.client.1.smithi122.stdout:6/450: write d5/f36 [5012511,93930] 0 2024-09-13T02:50:46.299 INFO:tasks.workunit.client.1.smithi122.stdout:8/138: sync 2024-09-13T02:50:46.299 INFO:tasks.workunit.client.1.smithi122.stdout:1/197: sync 2024-09-13T02:50:46.302 INFO:tasks.workunit.client.1.smithi122.stdout:1/198: symlink dc/de/d13/l3d 0 2024-09-13T02:50:46.304 INFO:tasks.workunit.client.1.smithi122.stdout:1/199: mknod dc/de/d18/d22/d1c/c3e 0 2024-09-13T02:50:46.306 INFO:tasks.workunit.client.1.smithi122.stdout:1/200: mkdir dc/de/d13/d3f 0 2024-09-13T02:50:46.317 INFO:tasks.workunit.client.1.smithi122.stdout:1/201: write fa [3352641,76773] 0 2024-09-13T02:50:46.318 INFO:tasks.workunit.client.1.smithi122.stdout:1/202: mknod dc/de/d18/c40 0 2024-09-13T02:50:46.319 INFO:tasks.workunit.client.1.smithi122.stdout:1/203: symlink dc/de/d13/d3f/l41 0 2024-09-13T02:50:46.328 INFO:tasks.workunit.client.1.smithi122.stdout:6/451: dwrite d5/d11/d2f/f74 [0,4194304] 0 2024-09-13T02:50:46.328 INFO:tasks.workunit.client.1.smithi122.stdout:8/139: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-09-13T02:50:46.330 INFO:tasks.workunit.client.1.smithi122.stdout:1/204: dread dc/f16 [0,4194304] 0 2024-09-13T02:50:46.330 INFO:tasks.workunit.client.1.smithi122.stdout:6/452: mkdir d5/d11/d45/d21/d8b 0 2024-09-13T02:50:46.331 INFO:tasks.workunit.client.1.smithi122.stdout:6/453: read d5/d40/f35 [15213,14133] 0 2024-09-13T02:50:46.331 INFO:tasks.workunit.client.1.smithi122.stdout:6/454: readlink d5/db/dc/l38 0 2024-09-13T02:50:46.331 INFO:tasks.workunit.client.1.smithi122.stdout:6/455: write d5/d40/f67 [856004,91570] 0 2024-09-13T02:50:46.334 INFO:tasks.workunit.client.1.smithi122.stdout:8/140: rmdir d3/da/d1f/d20 39 2024-09-13T02:50:46.334 INFO:tasks.workunit.client.1.smithi122.stdout:8/141: write f2 [2316225,86803] 0 2024-09-13T02:50:46.335 INFO:tasks.workunit.client.1.smithi122.stdout:8/142: stat d3/l18 0 2024-09-13T02:50:46.346 INFO:tasks.workunit.client.1.smithi122.stdout:8/143: dread d3/f17 [0,4194304] 0 2024-09-13T02:50:46.347 INFO:tasks.workunit.client.1.smithi122.stdout:8/144: mknod d3/da/d1f/c2a 0 2024-09-13T02:50:46.347 INFO:tasks.workunit.client.1.smithi122.stdout:8/145: chown d3/da/d1f/f27 10893177 1 2024-09-13T02:50:46.355 INFO:tasks.workunit.client.1.smithi122.stdout:6/456: dwrite d5/d11/f85 [0,4194304] 0 2024-09-13T02:50:46.355 INFO:tasks.workunit.client.1.smithi122.stdout:6/457: readlink d5/db/l3c 0 2024-09-13T02:50:46.355 INFO:tasks.workunit.client.1.smithi122.stdout:6/458: truncate d5/db/f14 1932465 0 2024-09-13T02:50:46.355 INFO:tasks.workunit.client.1.smithi122.stdout:1/205: dwrite dc/de/d18/f2c [0,4194304] 0 2024-09-13T02:50:46.356 INFO:tasks.workunit.client.1.smithi122.stdout:6/459: rename d5/c30 to d5/d11/d45/df/c8c 0 2024-09-13T02:50:46.356 INFO:tasks.workunit.client.1.smithi122.stdout:6/460: fsync d5/d3d/d6c/f6a 0 2024-09-13T02:50:46.357 INFO:tasks.workunit.client.1.smithi122.stdout:1/206: creat dc/de/f42 x:0 0 0 2024-09-13T02:50:46.358 INFO:tasks.workunit.client.1.smithi122.stdout:7/228: sync 2024-09-13T02:50:46.358 INFO:tasks.workunit.client.1.smithi122.stdout:3/312: sync 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:2/157: sync 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:3/313: creat d4/d11/dd/d21/d2b/d36/f72 x:0 0 0 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:2/158: creat d0/f2c x:0 0 0 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:3/314: chown d4/d11/dd/d21/d2b/d36/c5e 29159152 1 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:3/315: creat d4/f73 x:0 0 0 2024-09-13T02:50:46.359 INFO:tasks.workunit.client.1.smithi122.stdout:4/274: sync 2024-09-13T02:50:46.360 INFO:tasks.workunit.client.1.smithi122.stdout:0/213: sync 2024-09-13T02:50:46.360 INFO:tasks.workunit.client.1.smithi122.stdout:9/345: sync 2024-09-13T02:50:46.360 INFO:tasks.workunit.client.1.smithi122.stdout:1/207: creat dc/de/d18/d22/f43 x:0 0 0 2024-09-13T02:50:46.361 INFO:tasks.workunit.client.1.smithi122.stdout:8/146: read d3/f9 [3937155,76717] 0 2024-09-13T02:50:46.361 INFO:tasks.workunit.client.1.smithi122.stdout:8/147: readlink d3/l15 0 2024-09-13T02:50:46.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/148: chown f2 574537947 1 2024-09-13T02:50:46.363 INFO:tasks.workunit.client.1.smithi122.stdout:3/316: rename d4/d6f to d4/d11/dd/d21/d74 0 2024-09-13T02:50:46.364 INFO:tasks.workunit.client.1.smithi122.stdout:3/317: write d4/d11/dd/d21/d2b/d36/f72 [850163,90892] 0 2024-09-13T02:50:46.364 INFO:tasks.workunit.client.1.smithi122.stdout:3/318: chown d4/d11/dd/d21/d30 1389971 1 2024-09-13T02:50:46.366 INFO:tasks.workunit.client.1.smithi122.stdout:0/214: rename d1/d5/d10/l4a to d1/d4b/l4d 0 2024-09-13T02:50:46.366 INFO:tasks.workunit.client.1.smithi122.stdout:0/215: fsync d1/d5/d15/f48 0 2024-09-13T02:50:46.367 INFO:tasks.workunit.client.1.smithi122.stdout:3/319: link d4/d11/d38/f70 d4/d11/dd/d21/f75 0 2024-09-13T02:50:46.367 INFO:tasks.workunit.client.1.smithi122.stdout:3/320: chown d4/d6/df/f32 122056 1 2024-09-13T02:50:46.368 INFO:tasks.workunit.client.1.smithi122.stdout:8/149: dread d3/f17 [0,4194304] 0 2024-09-13T02:50:46.369 INFO:tasks.workunit.client.1.smithi122.stdout:1/208: rename dc/de/d18/d22/f20 to dc/f44 0 2024-09-13T02:50:46.370 INFO:tasks.workunit.client.1.smithi122.stdout:1/209: write dc/de/d18/d22/d1c/f3c [373814,113936] 0 2024-09-13T02:50:46.370 INFO:tasks.workunit.client.1.smithi122.stdout:1/210: dread - dc/f35 zero size 2024-09-13T02:50:46.371 INFO:tasks.workunit.client.1.smithi122.stdout:3/321: creat d4/d6/f76 x:0 0 0 2024-09-13T02:50:46.372 INFO:tasks.workunit.client.1.smithi122.stdout:0/216: rename d1/f26 to d1/d5/d2d/f4e 0 2024-09-13T02:50:46.373 INFO:tasks.workunit.client.1.smithi122.stdout:3/322: mknod d4/d11/dd/d21/d2b/c77 0 2024-09-13T02:50:46.374 INFO:tasks.workunit.client.1.smithi122.stdout:3/323: mknod d4/d6/de/d1f/c78 0 2024-09-13T02:50:46.376 INFO:tasks.workunit.client.1.smithi122.stdout:7/229: write d4/d8/db/f11 [3712791,56233] 0 2024-09-13T02:50:46.376 INFO:tasks.workunit.client.1.smithi122.stdout:3/324: rename d4/d6/df/f32 to d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f79 0 2024-09-13T02:50:46.380 INFO:tasks.workunit.client.1.smithi122.stdout:7/230: rename d4/d8/db/dc/d36/c40 to d4/c51 0 2024-09-13T02:50:46.382 INFO:tasks.workunit.client.1.smithi122.stdout:7/231: symlink d4/d8/d24/d47/l52 0 2024-09-13T02:50:46.382 INFO:tasks.workunit.client.1.smithi122.stdout:7/232: chown d4/d8/d24/l33 6971 1 2024-09-13T02:50:46.383 INFO:tasks.workunit.client.1.smithi122.stdout:7/233: creat d4/d8/d24/f53 x:0 0 0 2024-09-13T02:50:46.384 INFO:tasks.workunit.client.1.smithi122.stdout:8/150: dread f2 [0,4194304] 0 2024-09-13T02:50:46.384 INFO:tasks.workunit.client.1.smithi122.stdout:7/234: mknod d4/d8/db/dc/d36/c54 0 2024-09-13T02:50:46.385 INFO:tasks.workunit.client.1.smithi122.stdout:8/151: creat d3/da/d1e/f2b x:0 0 0 2024-09-13T02:50:46.386 INFO:tasks.workunit.client.1.smithi122.stdout:7/235: creat d4/d8/d24/d47/f55 x:0 0 0 2024-09-13T02:50:46.387 INFO:tasks.workunit.client.1.smithi122.stdout:8/152: creat d3/da/d1f/d20/f2c x:0 0 0 2024-09-13T02:50:46.387 INFO:tasks.workunit.client.1.smithi122.stdout:8/153: readlink d3/l18 0 2024-09-13T02:50:46.388 INFO:tasks.workunit.client.1.smithi122.stdout:7/236: mknod d4/d8/db/dc/d1b/d49/c56 0 2024-09-13T02:50:46.388 INFO:tasks.workunit.client.1.smithi122.stdout:8/154: mknod d3/da/c2d 0 2024-09-13T02:50:46.389 INFO:tasks.workunit.client.1.smithi122.stdout:7/237: creat d4/d8/db/dc/d1b/f57 x:0 0 0 2024-09-13T02:50:46.389 INFO:tasks.workunit.client.1.smithi122.stdout:7/238: chown d4/d8/d24/f3e 244748017 1 2024-09-13T02:50:46.390 INFO:tasks.workunit.client.1.smithi122.stdout:7/239: symlink d4/d8/l58 0 2024-09-13T02:50:46.390 INFO:tasks.workunit.client.1.smithi122.stdout:7/240: write d4/d8/d24/f3e [9150549,102402] 0 2024-09-13T02:50:46.392 INFO:tasks.workunit.client.1.smithi122.stdout:3/325: read d4/d11/dd/d21/d2b/d36/d3c/f20 [1273859,95552] 0 2024-09-13T02:50:46.392 INFO:tasks.workunit.client.1.smithi122.stdout:3/326: chown d4/d11/dd/l1c 61 1 2024-09-13T02:50:46.394 INFO:tasks.workunit.client.1.smithi122.stdout:3/327: dread d4/d11/dd/d21/d2b/d36/d3c/f20 [0,4194304] 0 2024-09-13T02:50:46.399 INFO:tasks.workunit.client.1.smithi122.stdout:2/159: dwrite d0/f1b [0,4194304] 0 2024-09-13T02:50:46.402 INFO:tasks.workunit.client.1.smithi122.stdout:2/160: mknod d0/d1c/c2d 0 2024-09-13T02:50:46.402 INFO:tasks.workunit.client.1.smithi122.stdout:2/161: chown d0/f19 1 1 2024-09-13T02:50:46.403 INFO:tasks.workunit.client.1.smithi122.stdout:2/162: mkdir d0/d1e/d2e 0 2024-09-13T02:50:46.403 INFO:tasks.workunit.client.1.smithi122.stdout:4/275: dwrite d11/d1b/d32/f4f [0,4194304] 0 2024-09-13T02:50:46.404 INFO:tasks.workunit.client.1.smithi122.stdout:0/217: dwrite d1/d5/d2d/f44 [0,4194304] 0 2024-09-13T02:50:46.414 INFO:tasks.workunit.client.1.smithi122.stdout:0/218: symlink d1/d4b/l4f 0 2024-09-13T02:50:46.414 INFO:tasks.workunit.client.1.smithi122.stdout:2/163: write d0/d1c/f1d [3786077,88108] 0 2024-09-13T02:50:46.414 INFO:tasks.workunit.client.1.smithi122.stdout:9/346: dwrite d8/f33 [0,4194304] 0 2024-09-13T02:50:46.417 INFO:tasks.workunit.client.1.smithi122.stdout:0/219: dread d1/f3a [0,4194304] 0 2024-09-13T02:50:46.418 INFO:tasks.workunit.client.1.smithi122.stdout:0/220: truncate d1/d5/d10/d29/f42 471725 0 2024-09-13T02:50:46.418 INFO:tasks.workunit.client.1.smithi122.stdout:0/221: write d1/d5/d10/d29/f36 [383903,67035] 0 2024-09-13T02:50:46.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/328: dwrite d4/d11/dd/d21/d6c/f39 [4194304,4194304] 0 2024-09-13T02:50:46.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/329: chown d4/d11/dd/d21/d30/l64 12 1 2024-09-13T02:50:46.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/330: read - d4/d4c/f51 zero size 2024-09-13T02:50:46.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/331: stat d4/d11/c3e 0 2024-09-13T02:50:46.421 INFO:tasks.workunit.client.1.smithi122.stdout:0/222: link d1/d5/fd d1/d5/d15/f50 0 2024-09-13T02:50:46.421 INFO:tasks.workunit.client.1.smithi122.stdout:4/276: dwrite d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:46.425 INFO:tasks.workunit.client.1.smithi122.stdout:4/277: creat d11/d1b/d2e/f5d x:0 0 0 2024-09-13T02:50:46.427 INFO:tasks.workunit.client.1.smithi122.stdout:0/223: getdents d1/d5/d2d 0 2024-09-13T02:50:46.427 INFO:tasks.workunit.client.1.smithi122.stdout:0/224: write d1/d5/d15/d1d/f2c [197934,26000] 0 2024-09-13T02:50:46.428 INFO:tasks.workunit.client.1.smithi122.stdout:8/155: fsync d3/da/d1f/d20/f2c 0 2024-09-13T02:50:46.434 INFO:tasks.workunit.client.1.smithi122.stdout:2/164: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T02:50:46.436 INFO:tasks.workunit.client.1.smithi122.stdout:2/165: mknod d0/d1e/d22/c2f 0 2024-09-13T02:50:46.445 INFO:tasks.workunit.client.1.smithi122.stdout:3/332: dwrite d4/d11/dd/d21/d2b/f2f [0,4194304] 0 2024-09-13T02:50:46.445 INFO:tasks.workunit.client.1.smithi122.stdout:0/225: dread d1/d5/d9/da/d17/f2a [0,4194304] 0 2024-09-13T02:50:46.445 INFO:tasks.workunit.client.1.smithi122.stdout:3/333: rename d4/d11/dd/d21/d2b/d36/d3c/l26 to d4/d11/d38/l7a 0 2024-09-13T02:50:46.445 INFO:tasks.workunit.client.1.smithi122.stdout:3/334: write d4/d11/d38/f70 [4985305,1280] 0 2024-09-13T02:50:46.445 INFO:tasks.workunit.client.1.smithi122.stdout:3/335: dread d4/d6/de/d1f/f57 [0,4194304] 0 2024-09-13T02:50:46.446 INFO:tasks.workunit.client.1.smithi122.stdout:2/166: write d0/fc [1758822,99715] 0 2024-09-13T02:50:46.447 INFO:tasks.workunit.client.1.smithi122.stdout:3/336: creat d4/d6/df/f7b x:0 0 0 2024-09-13T02:50:46.448 INFO:tasks.workunit.client.1.smithi122.stdout:2/167: creat d0/d1e/d26/f30 x:0 0 0 2024-09-13T02:50:46.455 INFO:tasks.workunit.client.1.smithi122.stdout:3/337: write d4/d6/f8 [6180298,1929] 0 2024-09-13T02:50:46.455 INFO:tasks.workunit.client.1.smithi122.stdout:3/338: dread - d4/d4c/f51 zero size 2024-09-13T02:50:46.456 INFO:tasks.workunit.client.1.smithi122.stdout:3/339: fsync d4/d6/f47 0 2024-09-13T02:50:46.469 INFO:tasks.workunit.client.1.smithi122.stdout:4/278: dwrite d11/d30/f54 [0,4194304] 0 2024-09-13T02:50:46.477 INFO:tasks.workunit.client.1.smithi122.stdout:4/279: dread d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:46.479 INFO:tasks.workunit.client.1.smithi122.stdout:4/280: rename d11/d1b/c24 to d11/d1b/d32/c5e 0 2024-09-13T02:50:46.480 INFO:tasks.workunit.client.1.smithi122.stdout:4/281: stat d11/f56 0 2024-09-13T02:50:46.480 INFO:tasks.workunit.client.1.smithi122.stdout:4/282: creat d11/d3d/f5f x:0 0 0 2024-09-13T02:50:46.481 INFO:tasks.workunit.client.1.smithi122.stdout:8/156: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-09-13T02:50:46.481 INFO:tasks.workunit.client.1.smithi122.stdout:2/168: fsync d0/fc 0 2024-09-13T02:50:46.481 INFO:tasks.workunit.client.1.smithi122.stdout:2/169: stat d0/l3 0 2024-09-13T02:50:46.481 INFO:tasks.workunit.client.1.smithi122.stdout:0/226: dwrite d1/d5/d15/f48 [0,4194304] 0 2024-09-13T02:50:46.482 INFO:tasks.workunit.client.1.smithi122.stdout:4/283: mknod d11/d13/d14/c60 0 2024-09-13T02:50:46.482 INFO:tasks.workunit.client.1.smithi122.stdout:3/340: dwrite d4/d11/dd/d21/f28 [0,4194304] 0 2024-09-13T02:50:46.485 INFO:tasks.workunit.client.1.smithi122.stdout:2/170: creat d0/d1c/f31 x:0 0 0 2024-09-13T02:50:46.485 INFO:tasks.workunit.client.1.smithi122.stdout:2/171: readlink d0/d1e/d22/l23 0 2024-09-13T02:50:46.485 INFO:tasks.workunit.client.1.smithi122.stdout:2/172: creat d0/d1e/d22/f32 x:0 0 0 2024-09-13T02:50:46.485 INFO:tasks.workunit.client.1.smithi122.stdout:0/227: mknod d1/d4b/c51 0 2024-09-13T02:50:46.486 INFO:tasks.workunit.client.1.smithi122.stdout:4/284: link d11/d3d/f5f d11/d13/d14/d2a/f61 0 2024-09-13T02:50:46.487 INFO:tasks.workunit.client.1.smithi122.stdout:4/285: read - d11/d1b/d2e/d55/f58 zero size 2024-09-13T02:50:46.487 INFO:tasks.workunit.client.1.smithi122.stdout:4/286: dread - d11/d13/d14/d2a/f61 zero size 2024-09-13T02:50:46.499 INFO:tasks.workunit.client.1.smithi122.stdout:8/157: rmdir d3/da/d1f 39 2024-09-13T02:50:46.501 INFO:tasks.workunit.client.1.smithi122.stdout:2/173: mkdir d0/d1e/d2e/d33 0 2024-09-13T02:50:46.502 INFO:tasks.workunit.client.1.smithi122.stdout:2/174: unlink d0/f19 0 2024-09-13T02:50:46.503 INFO:tasks.workunit.client.1.smithi122.stdout:2/175: mknod d0/d1e/d22/c34 0 2024-09-13T02:50:46.504 INFO:tasks.workunit.client.1.smithi122.stdout:2/176: getdents d0/d1e/d22/d29 0 2024-09-13T02:50:46.514 INFO:tasks.workunit.client.1.smithi122.stdout:8/158: dread d3/da/d1f/f24 [0,4194304] 0 2024-09-13T02:50:46.517 INFO:tasks.workunit.client.1.smithi122.stdout:8/159: rename d3/da/d1f/f13 to d3/da/d1f/d25/f2e 0 2024-09-13T02:50:46.520 INFO:tasks.workunit.client.1.smithi122.stdout:8/160: read d3/da/d1f/f24 [1094840,41946] 0 2024-09-13T02:50:46.520 INFO:tasks.workunit.client.1.smithi122.stdout:8/161: chown d3/da/d1f/c2a 187 1 2024-09-13T02:50:46.523 INFO:tasks.workunit.client.1.smithi122.stdout:8/162: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:46.523 INFO:tasks.workunit.client.1.smithi122.stdout:8/163: chown d3/da/d1e/c23 28796252 1 2024-09-13T02:50:46.523 INFO:tasks.workunit.client.1.smithi122.stdout:3/341: dwrite d4/d11/dd/d21/f4d [4194304,4194304] 0 2024-09-13T02:50:46.525 INFO:tasks.workunit.client.1.smithi122.stdout:3/342: unlink d4/d11/c46 0 2024-09-13T02:50:46.526 INFO:tasks.workunit.client.1.smithi122.stdout:3/343: mknod d4/d11/dd/d21/d2b/d36/d3c/c7c 0 2024-09-13T02:50:46.528 INFO:tasks.workunit.client.1.smithi122.stdout:3/344: dread d4/d6/de/d1f/f57 [0,4194304] 0 2024-09-13T02:50:46.528 INFO:tasks.workunit.client.1.smithi122.stdout:3/345: write d4/d6/de/f18 [403948,18017] 0 2024-09-13T02:50:46.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.537+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50c8000bf0 con 0x7f50c406e630 2024-09-13T02:50:46.538 INFO:tasks.workunit.client.1.smithi122.stdout:8/164: dread d3/da/d1f/f19 [4194304,4194304] 0 2024-09-13T02:50:46.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.538+0000 7f50d8ff9640 1 -- 172.21.15.100:0/2788825360 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f50c8000bf0 con 0x7f50c406e630 2024-09-13T02:50:46.541 INFO:tasks.workunit.client.1.smithi122.stdout:4/287: dwrite d11/d13/d14/f19 [4194304,4194304] 0 2024-09-13T02:50:46.542 INFO:tasks.workunit.client.1.smithi122.stdout:4/288: dread - d11/f56 zero size 2024-09-13T02:50:46.542 INFO:tasks.workunit.client.1.smithi122.stdout:0/228: dwrite d1/d5/d15/d1d/f2c [0,4194304] 0 2024-09-13T02:50:46.542 INFO:tasks.workunit.client.1.smithi122.stdout:0/229: rename d1/d5/d10/d29/d32 to d1/d5/d10/d29/d32/d52 22 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 msgr2=0x7f50c4070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 0x7f50c4070ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50d002a530 tx=0x7f50d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 msgr2=0x7f50dc10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b790 tx=0x7f50cc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 shutdown_connections 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f50c406e630 0x7f50c4070ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f50dc0fd820 0x7f50dc10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 --2- 172.21.15.100:0/2788825360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50dc0fc550 0x7f50dc10d0e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.540+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 >> 172.21.15.100:0/2788825360 conn(0x7f50dc0f7d30 msgr2=0x7f50dc0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.541+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 shutdown_connections 2024-09-13T02:50:46.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.541+0000 7f50e2618640 1 -- 172.21.15.100:0/2788825360 wait complete. 2024-09-13T02:50:46.544 INFO:tasks.workunit.client.1.smithi122.stdout:0/230: write d1/d5/d10/d29/f36 [214415,101272] 0 2024-09-13T02:50:46.544 INFO:tasks.workunit.client.1.smithi122.stdout:4/289: mkdir d11/d62 0 2024-09-13T02:50:46.544 INFO:tasks.workunit.client.1.smithi122.stdout:4/290: dread - d11/f47 zero size 2024-09-13T02:50:46.548 INFO:tasks.workunit.client.1.smithi122.stdout:4/291: dread d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:46.550 INFO:tasks.workunit.client.1.smithi122.stdout:2/177: dwrite d0/d1e/d26/f30 [0,4194304] 0 2024-09-13T02:50:46.550 INFO:tasks.workunit.client.1.smithi122.stdout:2/178: fsync d0/f10 0 2024-09-13T02:50:46.550 INFO:tasks.workunit.client.1.smithi122.stdout:2/179: chown d0/d1e/d22/d29 0 1 2024-09-13T02:50:46.550 INFO:tasks.workunit.client.1.smithi122.stdout:2/180: fdatasync d0/f1b 0 2024-09-13T02:50:46.563 INFO:tasks.workunit.client.1.smithi122.stdout:3/346: dwrite d4/d11/f2d [0,4194304] 0 2024-09-13T02:50:46.563 INFO:tasks.workunit.client.1.smithi122.stdout:3/347: fsync d4/f73 0 2024-09-13T02:50:46.564 INFO:tasks.workunit.client.1.smithi122.stdout:2/181: write d0/d1e/ff [2889499,83525] 0 2024-09-13T02:50:46.568 INFO:tasks.workunit.client.1.smithi122.stdout:3/348: dread d4/d11/dd/d21/d2b/d36/d3c/f10 [0,4194304] 0 2024-09-13T02:50:46.570 INFO:tasks.workunit.client.1.smithi122.stdout:3/349: creat d4/d6/de/d41/f7d x:0 0 0 2024-09-13T02:50:46.570 INFO:tasks.workunit.client.1.smithi122.stdout:3/350: chown d4/d11/dd/d21/d4e/l6e 4 1 2024-09-13T02:50:46.571 INFO:tasks.workunit.client.1.smithi122.stdout:3/351: unlink d4/c29 0 2024-09-13T02:50:46.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/165: dwrite f2 [0,4194304] 0 2024-09-13T02:50:46.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/166: chown d3/da/d1e 1968265047 1 2024-09-13T02:50:46.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/167: fdatasync d3/da/d1e/f2b 0 2024-09-13T02:50:46.595 INFO:tasks.workunit.client.1.smithi122.stdout:4/292: dwrite d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:46.596 INFO:tasks.workunit.client.1.smithi122.stdout:8/168: unlink d3/da/d1f/d25/f2e 0 2024-09-13T02:50:46.596 INFO:tasks.workunit.client.1.smithi122.stdout:8/169: stat d3/da/d1f/d20 0 2024-09-13T02:50:46.597 INFO:tasks.workunit.client.1.smithi122.stdout:4/293: symlink d11/l63 0 2024-09-13T02:50:46.597 INFO:tasks.workunit.client.1.smithi122.stdout:4/294: write d11/f47 [59334,25856] 0 2024-09-13T02:50:46.597 INFO:tasks.workunit.client.1.smithi122.stdout:4/295: getdents d11/d30/d59 0 2024-09-13T02:50:46.598 INFO:tasks.workunit.client.1.smithi122.stdout:4/296: getdents d11/d13/d14 0 2024-09-13T02:50:46.599 INFO:tasks.workunit.client.1.smithi122.stdout:4/297: link d11/d13/d14/d2a/l44 d11/d1b/l64 0 2024-09-13T02:50:46.601 INFO:tasks.workunit.client.1.smithi122.stdout:4/298: rmdir d11/d3d 39 2024-09-13T02:50:46.602 INFO:tasks.workunit.client.1.smithi122.stdout:4/299: rename d11/d13/c4e to d11/d13/d14/c65 0 2024-09-13T02:50:46.603 INFO:tasks.workunit.client.1.smithi122.stdout:4/300: creat d11/d13/f66 x:0 0 0 2024-09-13T02:50:46.603 INFO:tasks.workunit.client.1.smithi122.stdout:4/301: creat d11/d1b/d2e/d55/f67 x:0 0 0 2024-09-13T02:50:46.603 INFO:tasks.workunit.client.1.smithi122.stdout:4/302: fdatasync d11/d13/f1f 0 2024-09-13T02:50:46.603 INFO:tasks.workunit.client.1.smithi122.stdout:4/303: readlink l7 0 2024-09-13T02:50:46.605 INFO:tasks.workunit.client.1.smithi122.stdout:0/231: dwrite d1/d5/d2d/f44 [0,4194304] 0 2024-09-13T02:50:46.605 INFO:tasks.workunit.client.1.smithi122.stdout:2/182: dwrite d0/f2c [0,4194304] 0 2024-09-13T02:50:46.605 INFO:tasks.workunit.client.1.smithi122.stdout:2/183: write d0/f16 [1893540,16919] 0 2024-09-13T02:50:46.605 INFO:tasks.workunit.client.1.smithi122.stdout:3/352: dwrite d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:46.606 INFO:tasks.workunit.client.1.smithi122.stdout:4/304: rename d11/d13/d14/d2a/f50 to d11/d13/f68 0 2024-09-13T02:50:46.606 INFO:tasks.workunit.client.1.smithi122.stdout:4/305: fsync d11/d1b/f45 0 2024-09-13T02:50:46.612 INFO:tasks.workunit.client.1.smithi122.stdout:0/232: unlink d1/d5/d10/d29/l49 0 2024-09-13T02:50:46.612 INFO:tasks.workunit.client.1.smithi122.stdout:0/233: chown d1/d5/d9/da/f46 12477934 1 2024-09-13T02:50:46.613 INFO:tasks.workunit.client.1.smithi122.stdout:2/184: symlink d0/d1c/l35 0 2024-09-13T02:50:46.613 INFO:tasks.workunit.client.1.smithi122.stdout:8/170: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:46.614 INFO:tasks.workunit.client.1.smithi122.stdout:3/353: symlink d4/d11/l7e 0 2024-09-13T02:50:46.615 INFO:tasks.workunit.client.1.smithi122.stdout:0/234: mknod d1/d5/d10/d29/c53 0 2024-09-13T02:50:46.616 INFO:tasks.workunit.client.1.smithi122.stdout:6/461: sync 2024-09-13T02:50:46.616 INFO:tasks.workunit.client.1.smithi122.stdout:5/273: sync 2024-09-13T02:50:46.616 INFO:tasks.workunit.client.1.smithi122.stdout:2/185: truncate d0/f1b 1518590 0 2024-09-13T02:50:46.616 INFO:tasks.workunit.client.1.smithi122.stdout:2/186: readlink d0/l1a 0 2024-09-13T02:50:46.619 INFO:tasks.workunit.client.1.smithi122.stdout:2/187: fsync d0/f16 0 2024-09-13T02:50:46.619 INFO:tasks.workunit.client.1.smithi122.stdout:2/188: write d0/d1e/d22/f32 [431072,62177] 0 2024-09-13T02:50:46.619 INFO:tasks.workunit.client.1.smithi122.stdout:3/354: mknod d4/d11/dd/d21/d2b/d55/c7f 0 2024-09-13T02:50:46.619 INFO:tasks.workunit.client.1.smithi122.stdout:3/355: dread - d4/d11/dd/d21/d2b/d55/f62 zero size 2024-09-13T02:50:46.619 INFO:tasks.workunit.client.1.smithi122.stdout:3/356: write d4/f5d [902960,106865] 0 2024-09-13T02:50:46.621 INFO:tasks.workunit.client.1.smithi122.stdout:5/274: link d0/d1d/f29 d0/d17/d3a/f56 0 2024-09-13T02:50:46.621 INFO:tasks.workunit.client.1.smithi122.stdout:6/462: mknod d5/d3d/d82/c8d 0 2024-09-13T02:50:46.622 INFO:tasks.workunit.client.1.smithi122.stdout:4/306: dread d11/d13/d14/f25 [0,4194304] 0 2024-09-13T02:50:46.622 INFO:tasks.workunit.client.1.smithi122.stdout:6/463: read d5/d11/d45/f22 [118658,48432] 0 2024-09-13T02:50:46.626 INFO:tasks.workunit.client.1.smithi122.stdout:8/171: rmdir d3 39 2024-09-13T02:50:46.626 INFO:tasks.workunit.client.1.smithi122.stdout:8/172: readlink d3/l15 0 2024-09-13T02:50:46.626 INFO:tasks.workunit.client.1.smithi122.stdout:1/211: sync 2024-09-13T02:50:46.626 INFO:tasks.workunit.client.1.smithi122.stdout:7/241: sync 2024-09-13T02:50:46.627 INFO:tasks.workunit.client.1.smithi122.stdout:9/347: sync 2024-09-13T02:50:46.627 INFO:tasks.workunit.client.1.smithi122.stdout:9/348: write d8/d16/d3d/d59/d23/d1f/f2a [4298767,17068] 0 2024-09-13T02:50:46.630 INFO:tasks.workunit.client.1.smithi122.stdout:2/189: link d0/d1e/d22/l2a d0/d1e/d2e/l36 0 2024-09-13T02:50:46.632 INFO:tasks.workunit.client.1.smithi122.stdout:3/357: rename d4/d11/l17 to d4/d11/dd/d21/d2b/d55/l80 0 2024-09-13T02:50:46.633 INFO:tasks.workunit.client.1.smithi122.stdout:3/358: creat d4/d11/dd/d21/d4e/d53/f81 x:0 0 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:0/235: dwrite d1/d5/d9/da/f2b [0,4194304] 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:0/236: write d1/d5/d9/da/ff [213526,82918] 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:0/237: chown d1/d5/d10/d29/d32 0 1 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:4/307: link fa d11/f69 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:4/308: readlink d11/d1b/l1d 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:4/309: creat d11/d1b/d2e/d55/f6a x:0 0 0 2024-09-13T02:50:46.635 INFO:tasks.workunit.client.1.smithi122.stdout:5/275: read d0/d17/f22 [3884010,116494] 0 2024-09-13T02:50:46.637 INFO:tasks.workunit.client.1.smithi122.stdout:8/173: rename d3/da/d1f/d20/d21/f1d to d3/da/d1f/d20/d21/f2f 0 2024-09-13T02:50:46.638 INFO:tasks.workunit.client.1.smithi122.stdout:8/174: chown d3/l15 66 1 2024-09-13T02:50:46.638 INFO:tasks.workunit.client.1.smithi122.stdout:8/175: readlink d3/l15 0 2024-09-13T02:50:46.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/276: write d0/da/f16 [1199121,120038] 0 2024-09-13T02:50:46.639 INFO:tasks.workunit.client.1.smithi122.stdout:1/212: mknod dc/de/c45 0 2024-09-13T02:50:46.639 INFO:tasks.workunit.client.1.smithi122.stdout:1/213: chown dc/de/f42 985640 1 2024-09-13T02:50:46.641 INFO:tasks.workunit.client.1.smithi122.stdout:9/349: symlink d8/d16/d3d/d59/d5a/l6d 0 2024-09-13T02:50:46.641 INFO:tasks.workunit.client.1.smithi122.stdout:9/350: write d8/d16/d3d/d59/d23/d1f/f2d [610996,8855] 0 2024-09-13T02:50:46.641 INFO:tasks.workunit.client.1.smithi122.stdout:9/351: readlink d8/d16/d3d/d59/l48 0 2024-09-13T02:50:46.642 INFO:tasks.workunit.client.1.smithi122.stdout:2/190: rmdir d0/d1e/d22/d29 39 2024-09-13T02:50:46.642 INFO:tasks.workunit.client.1.smithi122.stdout:2/191: fdatasync d0/f2c 0 2024-09-13T02:50:46.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/359: mkdir d4/d11/dd/d21/d2b/d36/d3c/d43/d82 0 2024-09-13T02:50:46.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/360: dread - d4/d6/df/f7b zero size 2024-09-13T02:50:46.646 INFO:tasks.workunit.client.1.smithi122.stdout:3/361: write d4/d11/d38/f70 [4731870,39127] 0 2024-09-13T02:50:46.649 INFO:tasks.workunit.client.1.smithi122.stdout:8/176: rmdir d3/da/d28 0 2024-09-13T02:50:46.649 INFO:tasks.workunit.client.1.smithi122.stdout:8/177: fsync d3/f9 0 2024-09-13T02:50:46.650 INFO:tasks.workunit.client.1.smithi122.stdout:5/277: dread d0/da/f19 [0,4194304] 0 2024-09-13T02:50:46.650 INFO:tasks.workunit.client.1.smithi122.stdout:1/214: mkdir dc/de/d13/d46 0 2024-09-13T02:50:46.650 INFO:tasks.workunit.client.1.smithi122.stdout:5/278: write d0/d17/d36/f24 [410139,89310] 0 2024-09-13T02:50:46.651 INFO:tasks.workunit.client.1.smithi122.stdout:9/352: mknod d8/d16/d3d/d59/d23/d1f/d36/d44/c6e 0 2024-09-13T02:50:46.651 INFO:tasks.workunit.client.1.smithi122.stdout:9/353: chown d8/d16/d3d/d59/l60 155514294 1 2024-09-13T02:50:46.652 INFO:tasks.workunit.client.1.smithi122.stdout:3/362: creat d4/d11/dd/d21/d74/f83 x:0 0 0 2024-09-13T02:50:46.653 INFO:tasks.workunit.client.1.smithi122.stdout:8/178: creat d3/da/f30 x:0 0 0 2024-09-13T02:50:46.653 INFO:tasks.workunit.client.1.smithi122.stdout:1/215: mkdir dc/de/d18/d22/d1c/d47 0 2024-09-13T02:50:46.655 INFO:tasks.workunit.client.1.smithi122.stdout:3/363: rename d4/d11/l22 to d4/d4c/l84 0 2024-09-13T02:50:46.655 INFO:tasks.workunit.client.1.smithi122.stdout:3/364: creat d4/d6/f85 x:0 0 0 2024-09-13T02:50:46.656 INFO:tasks.workunit.client.1.smithi122.stdout:3/365: dread d4/d11/dd/d21/d2b/d36/f66 [0,4194304] 0 2024-09-13T02:50:46.658 INFO:tasks.workunit.client.1.smithi122.stdout:3/366: creat d4/d11/dd/d21/d2b/d36/d3c/f86 x:0 0 0 2024-09-13T02:50:46.661 INFO:tasks.workunit.client.1.smithi122.stdout:3/367: mknod d4/d6/de/d1f/d33/c87 0 2024-09-13T02:50:46.661 INFO:tasks.workunit.client.1.smithi122.stdout:6/464: dwrite d5/d11/d45/df/f13 [0,4194304] 0 2024-09-13T02:50:46.667 INFO:tasks.workunit.client.1.smithi122.stdout:3/368: creat d4/d11/dd/d21/d2b/f88 x:0 0 0 2024-09-13T02:50:46.667 INFO:tasks.workunit.client.1.smithi122.stdout:3/369: creat d4/d11/dd/d21/d4e/d53/f89 x:0 0 0 2024-09-13T02:50:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.666+0000 7fdecf7fe640 1 -- 172.21.15.100:0/3680684429 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec0032610 con 0x7fded0065ba0 2024-09-13T02:50:46.668 INFO:tasks.workunit.client.1.smithi122.stdout:7/242: dwrite d4/f35 [4194304,4194304] 0 2024-09-13T02:50:46.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/310: dwrite d11/d1b/f45 [0,4194304] 0 2024-09-13T02:50:46.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/311: dread - d11/d3d/f5f zero size 2024-09-13T02:50:46.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/312: creat d11/d1b/d2e/f6b x:0 0 0 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 -- 172.21.15.100:0/3680684429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0065ba0 msgr2=0x7fded00ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 --2- 172.21.15.100:0/3680684429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0065ba0 0x7fded00ff1e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdec00048d0 tx=0x7fdec0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 -- 172.21.15.100:0/3680684429 shutdown_connections 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 --2- 172.21.15.100:0/3680684429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 --2- 172.21.15.100:0/3680684429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded0065ba0 0x7fded00ff1e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 -- 172.21.15.100:0/3680684429 >> 172.21.15.100:0/3680684429 conn(0x7fded00f6c10 msgr2=0x7fded00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 -- 172.21.15.100:0/3680684429 shutdown_connections 2024-09-13T02:50:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.667+0000 7fded685b640 1 -- 172.21.15.100:0/3680684429 wait complete. 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 Processor -- start 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 -- start start 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded010fa50 0x7fded0110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded010ffa0 con 0x7fded00ff720 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.668+0000 7fded685b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded01100e0 con 0x7fded010fa50 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39910/0 (socket says 172.21.15.100:39910) 2024-09-13T02:50:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 -- 172.21.15.100:0/1729847552 learned_addr learned my addr 172.21.15.100:0/1729847552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:46.672 INFO:tasks.workunit.client.1.smithi122.stdout:6/465: getdents d5/d3d 0 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdecffff640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded010fa50 0x7fded0110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 -- 172.21.15.100:0/1729847552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded010fa50 msgr2=0x7fded0110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded010fa50 0x7fded0110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.669+0000 7fdec7fff640 1 -- 172.21.15.100:0/1729847552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0005040 con 0x7fded00ff720 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fdec7fff640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdec00048a0 tx=0x7fdec0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec0038070 con 0x7fded00ff720 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded0110ea0 con 0x7fded00ff720 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdec0009800 con 0x7fded00ff720 2024-09-13T02:50:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdec003d420 con 0x7fded00ff720 2024-09-13T02:50:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.670+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded0111360 con 0x7fded00ff720 2024-09-13T02:50:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.671+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0005240 con 0x7fded00ff720 2024-09-13T02:50:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.672+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fdec0030020 con 0x7fded00ff720 2024-09-13T02:50:46.674 INFO:tasks.workunit.client.1.smithi122.stdout:3/370: creat d4/d6/de/d1f/f8a x:0 0 0 2024-09-13T02:50:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.674+0000 7fdecd7fa640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 0x7fdebc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.674+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdec00ae100 con 0x7fded00ff720 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/192: dwrite d0/d1e/d26/f30 [4194304,4194304] 0 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/193: chown d0/d1e/d22/d29 41 1 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/194: fsync d0/f16 0 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/195: readlink d0/l3 0 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/196: creat d0/d1e/d22/f37 x:0 0 0 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/197: chown d0/c11 1203955 1 2024-09-13T02:50:46.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/198: creat d0/d1e/f38 x:0 0 0 2024-09-13T02:50:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.674+0000 7fdecffff640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 0x7fdebc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.675+0000 7fdecffff640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 0x7fdebc070a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8006fd0 tx=0x7fdeb8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:46.680 INFO:tasks.workunit.client.1.smithi122.stdout:4/313: creat d11/d3d/f6c x:0 0 0 2024-09-13T02:50:46.681 INFO:tasks.workunit.client.1.smithi122.stdout:3/371: creat d4/d11/dd/d21/d4e/f8b x:0 0 0 2024-09-13T02:50:46.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.681+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdec007b250 con 0x7fded00ff720 2024-09-13T02:50:46.686 INFO:tasks.workunit.client.1.smithi122.stdout:2/199: write d0/f18 [1775202,968] 0 2024-09-13T02:50:46.688 INFO:tasks.workunit.client.1.smithi122.stdout:2/200: mkdir d0/d1e/d22/d39 0 2024-09-13T02:50:46.688 INFO:tasks.workunit.client.1.smithi122.stdout:2/201: dread - d0/d1c/f31 zero size 2024-09-13T02:50:46.690 INFO:tasks.workunit.client.1.smithi122.stdout:1/216: dwrite dc/de/d18/f28 [0,4194304] 0 2024-09-13T02:50:46.690 INFO:tasks.workunit.client.1.smithi122.stdout:9/354: dwrite d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:46.690 INFO:tasks.workunit.client.1.smithi122.stdout:1/217: getdents dc/de/d18/d22/d1c/d47 0 2024-09-13T02:50:46.690 INFO:tasks.workunit.client.1.smithi122.stdout:1/218: fsync f0 0 2024-09-13T02:50:46.690 INFO:tasks.workunit.client.1.smithi122.stdout:5/279: dwrite d0/d1d/f1f [0,4194304] 0 2024-09-13T02:50:46.691 INFO:tasks.workunit.client.1.smithi122.stdout:5/280: write d0/d2/f13 [2164741,4931] 0 2024-09-13T02:50:46.691 INFO:tasks.workunit.client.1.smithi122.stdout:4/314: dread d11/f49 [0,4194304] 0 2024-09-13T02:50:46.692 INFO:tasks.workunit.client.1.smithi122.stdout:9/355: mknod d8/d16/d3d/d59/d23/d1f/d36/d44/c6f 0 2024-09-13T02:50:46.692 INFO:tasks.workunit.client.1.smithi122.stdout:6/466: dwrite d5/db/f44 [4194304,4194304] 0 2024-09-13T02:50:46.696 INFO:tasks.workunit.client.1.smithi122.stdout:6/467: mkdir d5/d40/d8e 0 2024-09-13T02:50:46.696 INFO:tasks.workunit.client.1.smithi122.stdout:6/468: chown d5/d11/d2f/f4d 83 1 2024-09-13T02:50:46.701 INFO:tasks.workunit.client.1.smithi122.stdout:5/281: dread d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:46.701 INFO:tasks.workunit.client.1.smithi122.stdout:5/282: chown d0/d17/f28 1203673 1 2024-09-13T02:50:46.702 INFO:tasks.workunit.client.1.smithi122.stdout:1/219: write dc/de/d18/d1d/f1f [892960,10124] 0 2024-09-13T02:50:46.702 INFO:tasks.workunit.client.1.smithi122.stdout:5/283: symlink d0/d17/d36/d25/l57 0 2024-09-13T02:50:46.704 INFO:tasks.workunit.client.1.smithi122.stdout:1/220: creat dc/de/d13/f48 x:0 0 0 2024-09-13T02:50:46.705 INFO:tasks.workunit.client.1.smithi122.stdout:1/221: truncate dc/f16 1493484 0 2024-09-13T02:50:46.706 INFO:tasks.workunit.client.1.smithi122.stdout:4/315: dread d11/f69 [0,4194304] 0 2024-09-13T02:50:46.706 INFO:tasks.workunit.client.1.smithi122.stdout:4/316: creat d11/d13/d14/d2a/d40/f6d x:0 0 0 2024-09-13T02:50:46.706 INFO:tasks.workunit.client.1.smithi122.stdout:4/317: fsync d11/f3e 0 2024-09-13T02:50:46.706 INFO:tasks.workunit.client.1.smithi122.stdout:4/318: fsync d11/d3d/f5f 0 2024-09-13T02:50:46.707 INFO:tasks.workunit.client.1.smithi122.stdout:1/222: rename dc/de/d18/d1d/l37 to dc/de/d18/d1d/l49 0 2024-09-13T02:50:46.708 INFO:tasks.workunit.client.1.smithi122.stdout:1/223: stat dc/de/d18/d1d/f1f 0 2024-09-13T02:50:46.708 INFO:tasks.workunit.client.1.smithi122.stdout:1/224: creat dc/f4a x:0 0 0 2024-09-13T02:50:46.709 INFO:tasks.workunit.client.1.smithi122.stdout:4/319: unlink d11/d13/d14/l35 0 2024-09-13T02:50:46.709 INFO:tasks.workunit.client.1.smithi122.stdout:4/320: write d11/d13/d14/d2a/d40/f6d [727351,49555] 0 2024-09-13T02:50:46.711 INFO:tasks.workunit.client.1.smithi122.stdout:1/225: creat dc/de/d18/d1d/d2f/f4b x:0 0 0 2024-09-13T02:50:46.711 INFO:tasks.workunit.client.1.smithi122.stdout:1/226: dread - dc/f4a zero size 2024-09-13T02:50:46.711 INFO:tasks.workunit.client.1.smithi122.stdout:4/321: mkdir d11/d30/d59/d6e 0 2024-09-13T02:50:46.713 INFO:tasks.workunit.client.1.smithi122.stdout:4/322: rename d11/d1b/d32/f4f to d11/d13/d14/d2a/f6f 0 2024-09-13T02:50:46.713 INFO:tasks.workunit.client.1.smithi122.stdout:1/227: getdents dc/de/d18/d22 0 2024-09-13T02:50:46.714 INFO:tasks.workunit.client.1.smithi122.stdout:2/202: dwrite d0/d1c/f1d [0,4194304] 0 2024-09-13T02:50:46.714 INFO:tasks.workunit.client.1.smithi122.stdout:4/323: symlink d11/l70 0 2024-09-13T02:50:46.715 INFO:tasks.workunit.client.1.smithi122.stdout:2/203: rename d0/d28 to d0/d1e/d26/d3a 0 2024-09-13T02:50:46.734 INFO:tasks.workunit.client.1.smithi122.stdout:4/324: write d11/d1b/f45 [1288155,47237] 0 2024-09-13T02:50:46.745 INFO:tasks.workunit.client.1.smithi122.stdout:6/469: dwrite d5/d3d/d6c/d41/d4e/d5f/f79 [0,4194304] 0 2024-09-13T02:50:46.746 INFO:tasks.workunit.client.1.smithi122.stdout:5/284: dwrite d0/d17/f3e [0,4194304] 0 2024-09-13T02:50:46.746 INFO:tasks.workunit.client.1.smithi122.stdout:1/228: dwrite dc/de/d18/f39 [0,4194304] 0 2024-09-13T02:50:46.746 INFO:tasks.workunit.client.1.smithi122.stdout:4/325: dread d11/d13/d14/d2a/f2b [0,4194304] 0 2024-09-13T02:50:46.747 INFO:tasks.workunit.client.1.smithi122.stdout:2/204: dwrite d0/f2c [0,4194304] 0 2024-09-13T02:50:46.747 INFO:tasks.workunit.client.1.smithi122.stdout:6/470: rmdir d5/d11/d45/df/d46 39 2024-09-13T02:50:46.750 INFO:tasks.workunit.client.1.smithi122.stdout:5/285: mknod d0/da/c58 0 2024-09-13T02:50:46.750 INFO:tasks.workunit.client.1.smithi122.stdout:5/286: stat d0/da/f19 0 2024-09-13T02:50:46.750 INFO:tasks.workunit.client.1.smithi122.stdout:5/287: chown d0/d2/d33/c40 5266915 1 2024-09-13T02:50:46.751 INFO:tasks.workunit.client.1.smithi122.stdout:1/229: mknod dc/de/d13/d3f/c4c 0 2024-09-13T02:50:46.761 INFO:tasks.workunit.client.1.smithi122.stdout:2/205: dwrite d0/f16 [0,4194304] 0 2024-09-13T02:50:46.762 INFO:tasks.workunit.client.1.smithi122.stdout:4/326: symlink d11/d30/d59/l71 0 2024-09-13T02:50:46.762 INFO:tasks.workunit.client.1.smithi122.stdout:4/327: chown d11/d13/d14/d2a/d40/f5a 116853665 1 2024-09-13T02:50:46.763 INFO:tasks.workunit.client.1.smithi122.stdout:6/471: rename d5/d11/f85 to d5/d11/d45/df/d46/f8f 0 2024-09-13T02:50:46.765 INFO:tasks.workunit.client.1.smithi122.stdout:5/288: link d0/d17/d36/d3f/l4a d0/d2/l59 0 2024-09-13T02:50:46.766 INFO:tasks.workunit.client.1.smithi122.stdout:1/230: creat dc/de/d18/d22/d1c/d47/f4d x:0 0 0 2024-09-13T02:50:46.767 INFO:tasks.workunit.client.1.smithi122.stdout:2/206: dread d0/d1e/ff [0,4194304] 0 2024-09-13T02:50:46.768 INFO:tasks.workunit.client.1.smithi122.stdout:4/328: mkdir d11/d13/d72 0 2024-09-13T02:50:46.768 INFO:tasks.workunit.client.1.smithi122.stdout:4/329: creat d11/d1b/d32/f73 x:0 0 0 2024-09-13T02:50:46.769 INFO:tasks.workunit.client.1.smithi122.stdout:6/472: creat d5/d11/d45/d21/f90 x:0 0 0 2024-09-13T02:50:46.769 INFO:tasks.workunit.client.1.smithi122.stdout:6/473: fsync d5/db/d29/f1d 0 2024-09-13T02:50:46.770 INFO:tasks.workunit.client.1.smithi122.stdout:1/231: rename fb to dc/de/d18/d1d/f4e 0 2024-09-13T02:50:46.772 INFO:tasks.workunit.client.1.smithi122.stdout:2/207: mkdir d0/d1c/d3b 0 2024-09-13T02:50:46.772 INFO:tasks.workunit.client.1.smithi122.stdout:2/208: fdatasync d0/f2c 0 2024-09-13T02:50:46.775 INFO:tasks.workunit.client.1.smithi122.stdout:6/474: symlink d5/d3d/l91 0 2024-09-13T02:50:46.776 INFO:tasks.workunit.client.1.smithi122.stdout:1/232: link dc/de/d13/l3d dc/de/d13/d46/l4f 0 2024-09-13T02:50:46.777 INFO:tasks.workunit.client.1.smithi122.stdout:2/209: truncate d0/f18 492283 0 2024-09-13T02:50:46.778 INFO:tasks.workunit.client.1.smithi122.stdout:4/330: rmdir d11/d13/d14/d2a/d40 39 2024-09-13T02:50:46.779 INFO:tasks.workunit.client.1.smithi122.stdout:6/475: mknod d5/c92 0 2024-09-13T02:50:46.780 INFO:tasks.workunit.client.1.smithi122.stdout:1/233: mknod dc/c50 0 2024-09-13T02:50:46.781 INFO:tasks.workunit.client.1.smithi122.stdout:2/210: mknod d0/d1e/d22/d39/c3c 0 2024-09-13T02:50:46.783 INFO:tasks.workunit.client.1.smithi122.stdout:4/331: symlink d11/d3d/l74 0 2024-09-13T02:50:46.783 INFO:tasks.workunit.client.1.smithi122.stdout:4/332: truncate d11/d13/f66 359042 0 2024-09-13T02:50:46.784 INFO:tasks.workunit.client.1.smithi122.stdout:1/234: dread dc/de/d18/d22/d1c/f3c [0,4194304] 0 2024-09-13T02:50:46.784 INFO:tasks.workunit.client.1.smithi122.stdout:1/235: truncate dc/de/d18/d22/d1c/f3c 656448 0 2024-09-13T02:50:46.784 INFO:tasks.workunit.client.1.smithi122.stdout:1/236: chown dc/de/d13/c24 22 1 2024-09-13T02:50:46.785 INFO:tasks.workunit.client.1.smithi122.stdout:6/476: mkdir d5/d3d/d6c/d41/d4e/d93 0 2024-09-13T02:50:46.785 INFO:tasks.workunit.client.1.smithi122.stdout:6/477: write d5/d3d/d6c/f7f [1828308,82777] 0 2024-09-13T02:50:46.787 INFO:tasks.workunit.client.1.smithi122.stdout:1/237: mkdir dc/d38/d51 0 2024-09-13T02:50:46.787 INFO:tasks.workunit.client.1.smithi122.stdout:5/289: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-13T02:50:46.788 INFO:tasks.workunit.client.1.smithi122.stdout:6/478: symlink d5/d3d/l94 0 2024-09-13T02:50:46.792 INFO:tasks.workunit.client.1.smithi122.stdout:2/211: fsync d0/f18 0 2024-09-13T02:50:46.795 INFO:tasks.workunit.client.1.smithi122.stdout:2/212: mkdir d0/d1e/d26/d3d 0 2024-09-13T02:50:46.795 INFO:tasks.workunit.client.1.smithi122.stdout:2/213: fdatasync d0/d1e/ff 0 2024-09-13T02:50:46.795 INFO:tasks.workunit.client.1.smithi122.stdout:2/214: chown d0/d1e/l1f 594753782 1 2024-09-13T02:50:46.795 INFO:tasks.workunit.client.1.smithi122.stdout:2/215: write d0/d1e/d22/d29/f2b [631592,67275] 0 2024-09-13T02:50:46.797 INFO:tasks.workunit.client.1.smithi122.stdout:2/216: mkdir d0/d1e/d2e/d3e 0 2024-09-13T02:50:46.798 INFO:tasks.workunit.client.1.smithi122.stdout:2/217: chown d0 17741 1 2024-09-13T02:50:46.809 INFO:tasks.workunit.client.1.smithi122.stdout:4/333: dwrite d11/f3c [0,4194304] 0 2024-09-13T02:50:46.809 INFO:tasks.workunit.client.1.smithi122.stdout:4/334: fdatasync d11/f3c 0 2024-09-13T02:50:46.809 INFO:tasks.workunit.client.1.smithi122.stdout:4/335: chown d11/d13/d14/c65 59 1 2024-09-13T02:50:46.811 INFO:tasks.workunit.client.1.smithi122.stdout:4/336: truncate d11/d1b/d32/f46 1560974 0 2024-09-13T02:50:46.812 INFO:tasks.workunit.client.1.smithi122.stdout:4/337: truncate d11/d13/f2c 5149407 0 2024-09-13T02:50:46.812 INFO:tasks.workunit.client.1.smithi122.stdout:4/338: chown d11/d1b/d2e 281 1 2024-09-13T02:50:46.812 INFO:tasks.workunit.client.1.smithi122.stdout:4/339: write d11/d1b/d2e/f6b [686654,39889] 0 2024-09-13T02:50:46.812 INFO:tasks.workunit.client.1.smithi122.stdout:1/238: dwrite dc/f32 [0,4194304] 0 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:1/239: write dc/f35 [400747,29909] 0 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:1/240: chown dc/de/d18/d1d/d2f 175887895 1 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:1/241: chown dc/de/d13/c21 3306 1 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:2/218: dread d0/d1e/d22/d29/f2b [0,4194304] 0 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:2/219: readlink d0/d1c/l35 0 2024-09-13T02:50:46.813 INFO:tasks.workunit.client.1.smithi122.stdout:6/479: dwrite d5/d40/f67 [0,4194304] 0 2024-09-13T02:50:46.815 INFO:tasks.workunit.client.1.smithi122.stdout:1/242: read dc/f10 [13746,80796] 0 2024-09-13T02:50:46.815 INFO:tasks.workunit.client.1.smithi122.stdout:1/243: chown dc/de/d13/d46/l4f 7898091 1 2024-09-13T02:50:46.815 INFO:tasks.workunit.client.1.smithi122.stdout:1/244: creat dc/de/d18/d1d/f52 x:0 0 0 2024-09-13T02:50:46.816 INFO:tasks.workunit.client.1.smithi122.stdout:1/245: write dc/f35 [1243303,67049] 0 2024-09-13T02:50:46.819 INFO:tasks.workunit.client.1.smithi122.stdout:6/480: symlink d5/d11/d45/l95 0 2024-09-13T02:50:46.819 INFO:tasks.workunit.client.1.smithi122.stdout:6/481: creat d5/db/dc/f96 x:0 0 0 2024-09-13T02:50:46.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/246: dread dc/de/d18/f39 [0,4194304] 0 2024-09-13T02:50:46.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/247: creat dc/de/d18/d1d/f53 x:0 0 0 2024-09-13T02:50:46.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/248: chown dc/de/d18/d1d/f23 36 1 2024-09-13T02:50:46.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/249: fdatasync dc/de/d18/d1d/f34 0 2024-09-13T02:50:46.825 INFO:tasks.workunit.client.1.smithi122.stdout:1/250: mknod dc/de/c54 0 2024-09-13T02:50:46.826 INFO:tasks.workunit.client.1.smithi122.stdout:1/251: creat dc/de/d18/d22/f55 x:0 0 0 2024-09-13T02:50:46.826 INFO:tasks.workunit.client.1.smithi122.stdout:1/252: symlink dc/de/d18/d22/d1c/d47/l56 0 2024-09-13T02:50:46.827 INFO:tasks.workunit.client.1.smithi122.stdout:1/253: mkdir dc/de/d18/d22/d1c/d57 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:4/340: dwrite d11/d13/d14/f16 [0,4194304] 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:4/341: readlink d11/d13/d14/d2a/l44 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:4/342: stat d11/f43 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:1/254: rename dc/de/d13/d3f/c4c to dc/d38/d51/c58 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:1/255: fsync dc/de/f2e 0 2024-09-13T02:50:46.829 INFO:tasks.workunit.client.1.smithi122.stdout:1/256: chown dc/de/d18/d1d/d2f 26 1 2024-09-13T02:50:46.830 INFO:tasks.workunit.client.1.smithi122.stdout:1/257: creat dc/de/d18/d22/d1c/d57/f59 x:0 0 0 2024-09-13T02:50:46.830 INFO:tasks.workunit.client.1.smithi122.stdout:1/258: chown f0 1 1 2024-09-13T02:50:46.831 INFO:tasks.workunit.client.1.smithi122.stdout:6/482: write d5/d11/d2f/f39 [1038232,113996] 0 2024-09-13T02:50:46.831 INFO:tasks.workunit.client.1.smithi122.stdout:6/483: fsync d5/d11/d45/df/d46/f5d 0 2024-09-13T02:50:46.831 INFO:tasks.workunit.client.1.smithi122.stdout:1/259: rename dc/de/d13/l33 to dc/d38/d51/l5a 0 2024-09-13T02:50:46.832 INFO:tasks.workunit.client.1.smithi122.stdout:1/260: creat dc/de/d18/d22/f5b x:0 0 0 2024-09-13T02:50:46.832 INFO:tasks.workunit.client.1.smithi122.stdout:6/484: rmdir d5/d11/d45 39 2024-09-13T02:50:46.832 INFO:tasks.workunit.client.1.smithi122.stdout:6/485: chown d5/d3d/d6c/d41 283372963 1 2024-09-13T02:50:46.834 INFO:tasks.workunit.client.1.smithi122.stdout:1/261: mknod dc/d38/d51/c5c 0 2024-09-13T02:50:46.834 INFO:tasks.workunit.client.1.smithi122.stdout:1/262: read - dc/de/d18/d22/f5b zero size 2024-09-13T02:50:46.836 INFO:tasks.workunit.client.1.smithi122.stdout:1/263: symlink dc/de/d18/d22/d1c/d57/l5d 0 2024-09-13T02:50:46.849 INFO:tasks.workunit.client.1.smithi122.stdout:4/343: dwrite d11/d13/f66 [0,4194304] 0 2024-09-13T02:50:46.864 INFO:tasks.workunit.client.1.smithi122.stdout:4/344: dwrite f10 [0,4194304] 0 2024-09-13T02:50:46.865 INFO:tasks.workunit.client.1.smithi122.stdout:4/345: getdents d11/d1b 0 2024-09-13T02:50:46.866 INFO:tasks.workunit.client.1.smithi122.stdout:4/346: rmdir d11/d1b 39 2024-09-13T02:50:46.867 INFO:tasks.workunit.client.1.smithi122.stdout:4/347: mknod d11/d13/d14/c75 0 2024-09-13T02:50:46.868 INFO:tasks.workunit.client.1.smithi122.stdout:4/348: dread d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:46.881 INFO:tasks.workunit.client.1.smithi122.stdout:4/349: dwrite d11/d13/d14/f19 [4194304,4194304] 0 2024-09-13T02:50:46.881 INFO:tasks.workunit.client.1.smithi122.stdout:4/350: truncate d11/f56 422130 0 2024-09-13T02:50:46.882 INFO:tasks.workunit.client.1.smithi122.stdout:4/351: truncate d11/d13/f66 3922376 0 2024-09-13T02:50:46.882 INFO:tasks.workunit.client.1.smithi122.stdout:4/352: truncate d11/d1b/d2e/f5d 310818 0 2024-09-13T02:50:46.882 INFO:tasks.workunit.client.1.smithi122.stdout:4/353: fdatasync d11/d13/d14/d2a/f61 0 2024-09-13T02:50:46.882 INFO:tasks.workunit.client.1.smithi122.stdout:4/354: rmdir d11/d30/d59 39 2024-09-13T02:50:46.882 INFO:tasks.workunit.client.1.smithi122.stdout:4/355: stat d11/d30 0 2024-09-13T02:50:46.896 INFO:tasks.workunit.client.1.smithi122.stdout:4/356: dwrite fa [0,4194304] 0 2024-09-13T02:50:46.897 INFO:tasks.workunit.client.1.smithi122.stdout:4/357: symlink d11/d1b/d2e/l76 0 2024-09-13T02:50:46.898 INFO:tasks.workunit.client.1.smithi122.stdout:4/358: chown cc 0 1 2024-09-13T02:50:46.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.909+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdeb0000bf0 con 0x7fdebc06e5c0 2024-09-13T02:50:46.911 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:46 smithi100 ceph-mon[27894]: pgmap v254: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 220 MiB/s wr, 304 op/s 2024-09-13T02:50:46.911 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:46 smithi100 ceph-mon[27894]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:46.912 INFO:tasks.workunit.client.1.smithi122.stdout:4/359: dwrite d11/d13/f2c [0,4194304] 0 2024-09-13T02:50:46.913 INFO:tasks.workunit.client.1.smithi122.stdout:4/360: dread d11/f56 [0,4194304] 0 2024-09-13T02:50:46.913 INFO:tasks.workunit.client.1.smithi122.stdout:4/361: read - d11/d1b/d2e/f34 zero size 2024-09-13T02:50:46.914 INFO:tasks.workunit.client.1.smithi122.stdout:4/362: creat d11/d1b/d2e/f77 x:0 0 0 2024-09-13T02:50:46.915 INFO:tasks.workunit.client.1.smithi122.stdout:4/363: getdents d11 0 2024-09-13T02:50:46.916 INFO:tasks.workunit.client.1.smithi122.stdout:4/364: mkdir d11/d13/d14/d2a/d78 0 2024-09-13T02:50:46.916 INFO:tasks.workunit.client.1.smithi122.stdout:4/365: write d11/d3d/f5f [904961,9262] 0 2024-09-13T02:50:46.917 INFO:tasks.workunit.client.1.smithi122.stdout:4/366: creat d11/d13/d14/f79 x:0 0 0 2024-09-13T02:50:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.920+0000 7fdecd7fa640 1 -- 172.21.15.100:0/1729847552 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdeb0000bf0 con 0x7fdebc06e5c0 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (6m) 2m ago 7m 25.7M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (8m) 2m ago 8m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (7m) 26s ago 7m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (6m) 2m ago 7m 85.9M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (2m) 2m ago 2m 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (2m) 2m ago 2m 10.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (2m) 26s ago 2m 14.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (2m) 26s ago 2m 44.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (41s) 26s ago 7m 64.0M - 19.1.1-322-g7741f7f9 19dc8d659727 35f358ab59e1 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (9m) 2m ago 9m 45.3M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:50:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (6m) 26s ago 6m 37.4M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (8m) 2m ago 8m 15.1M - 1.5.0 0da6a335fe13 0d6356dae8e0 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (7m) 26s ago 7m 16.1M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 2m ago 6m 45.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (5m) 2m ago 5m 44.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (5m) 2m ago 5m 44.6M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (4m) 26s ago 4m 84.1M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (4m) 26s ago 4m 80.5M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (4m) 26s ago 4m 83.5M 5311M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:50:46.923 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (6m) 2m ago 7m 54.4M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 msgr2=0x7fdebc070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 0x7fdebc070a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8006fd0 tx=0x7fdeb8008040 comp rx=0 tx=0).stop 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 msgr2=0x7fded010f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdec00048a0 tx=0x7fdec0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 shutdown_connections 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fdebc06e5c0 0x7fdebc070a70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fded010fa50 0x7fded0110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 --2- 172.21.15.100:0/1729847552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fded00ff720 0x7fded010f510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 >> 172.21.15.100:0/1729847552 conn(0x7fded00f6c10 msgr2=0x7fded00f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 shutdown_connections 2024-09-13T02:50:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:46.922+0000 7fded685b640 1 -- 172.21.15.100:0/1729847552 wait complete. 2024-09-13T02:50:46.931 INFO:tasks.workunit.client.1.smithi122.stdout:4/367: dwrite d11/d30/f54 [0,4194304] 0 2024-09-13T02:50:46.940 INFO:tasks.workunit.client.1.smithi122.stdout:4/368: write d11/d30/f54 [865477,41900] 0 2024-09-13T02:50:46.940 INFO:tasks.workunit.client.1.smithi122.stdout:4/369: symlink d11/l7a 0 2024-09-13T02:50:46.941 INFO:tasks.workunit.client.1.smithi122.stdout:4/370: truncate d11/d3d/f5f 1282485 0 2024-09-13T02:50:46.941 INFO:tasks.workunit.client.1.smithi122.stdout:4/371: mknod d11/d13/d14/d2a/c7b 0 2024-09-13T02:50:46.942 INFO:tasks.workunit.client.1.smithi122.stdout:4/372: unlink d11/d30/f3b 0 2024-09-13T02:50:46.943 INFO:tasks.workunit.client.1.smithi122.stdout:4/373: write d11/d13/d14/f48 [329205,28165] 0 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.004+0000 7fa5c047e640 1 -- 172.21.15.100:0/2148892539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 msgr2=0x7fa5b80ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.004+0000 7fa5c047e640 1 --2- 172.21.15.100:0/2148892539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80ff1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40048d0 tx=0x7fa5b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.004+0000 7fa5c047e640 1 -- 172.21.15.100:0/2148892539 shutdown_connections 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.004+0000 7fa5c047e640 1 --2- 172.21.15.100:0/2148892539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 0x7fa5b8101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.004+0000 7fa5c047e640 1 --2- 172.21.15.100:0/2148892539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80ff1a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- 172.21.15.100:0/2148892539 >> 172.21.15.100:0/2148892539 conn(0x7fa5b80f6c10 msgr2=0x7fa5b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- 172.21.15.100:0/2148892539 shutdown_connections 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- 172.21.15.100:0/2148892539 wait complete. 2024-09-13T02:50:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 Processor -- start 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- start start 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 0x7fa5b80fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80fb5e0 con 0x7fa5b8065be0 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5c047e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80fb720 con 0x7fa5b80ff6e0 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5be21a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5bda19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 0x7fa5b80fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5be21a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39930/0 (socket says 172.21.15.100:39930) 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.005+0000 7fa5be21a640 1 -- 172.21.15.100:0/1583865367 learned_addr learned my addr 172.21.15.100:0/1583865367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5be21a640 1 -- 172.21.15.100:0/1583865367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 msgr2=0x7fa5b80fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5be21a640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 0x7fa5b80fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5be21a640 1 -- 172.21.15.100:0/1583865367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4005040 con 0x7fa5b8065be0 2024-09-13T02:50:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5be21a640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009ac0 tx=0x7fa5b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b4038070 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5b4032d30 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b80fb9a0 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b403eba0 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.006+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8115180 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.007+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b80fa890 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.008+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fa5b4030020 con 0x7fa5b8065be0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.008+0000 7fa5aeffd640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 0x7fa5a4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.008+0000 7fa5bda19640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 0x7fa5a4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.008+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa5b40adf10 con 0x7fa5b8065be0 2024-09-13T02:50:47.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.009+0000 7fa5bda19640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 0x7fa5a4070a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009af0 tx=0x7fa5a800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.013+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa5b407b060 con 0x7fa5b8065be0 2024-09-13T02:50:47.038 INFO:tasks.workunit.client.1.smithi122.stdout:0/238: sync 2024-09-13T02:50:47.038 INFO:tasks.workunit.client.1.smithi122.stdout:8/179: sync 2024-09-13T02:50:47.038 INFO:tasks.workunit.client.1.smithi122.stdout:8/180: fdatasync d3/f9 0 2024-09-13T02:50:47.039 INFO:tasks.workunit.client.1.smithi122.stdout:0/239: unlink d1/d5/d10/l4c 0 2024-09-13T02:50:47.042 INFO:tasks.workunit.client.1.smithi122.stdout:8/181: dread d3/da/d1f/d20/d21/f2f [0,4194304] 0 2024-09-13T02:50:47.049 INFO:tasks.workunit.client.1.smithi122.stdout:8/182: write d3/da/d1f/f11 [3037974,102829] 0 2024-09-13T02:50:47.057 INFO:tasks.workunit.client.1.smithi122.stdout:0/240: dwrite d1/d5/d15/f48 [0,4194304] 0 2024-09-13T02:50:47.065 INFO:tasks.workunit.client.1.smithi122.stdout:8/183: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:47.068 INFO:tasks.workunit.client.1.smithi122.stdout:0/241: write d1/d5/d15/f48 [1609822,11395] 0 2024-09-13T02:50:47.068 INFO:tasks.workunit.client.1.smithi122.stdout:8/184: mkdir d3/d31 0 2024-09-13T02:50:47.068 INFO:tasks.workunit.client.1.smithi122.stdout:8/185: write d3/da/f10 [2157841,116150] 0 2024-09-13T02:50:47.070 INFO:tasks.workunit.client.1.smithi122.stdout:8/186: symlink d3/l32 0 2024-09-13T02:50:47.082 INFO:tasks.workunit.client.1.smithi122.stdout:8/187: write d3/f9 [2472962,29459] 0 2024-09-13T02:50:47.095 INFO:tasks.workunit.client.1.smithi122.stdout:0/242: dwrite d1/f30 [0,4194304] 0 2024-09-13T02:50:47.095 INFO:tasks.workunit.client.1.smithi122.stdout:8/188: write f2 [3861192,127777] 0 2024-09-13T02:50:47.100 INFO:tasks.workunit.client.1.smithi122.stdout:0/243: dread d1/f3a [0,4194304] 0 2024-09-13T02:50:47.100 INFO:tasks.workunit.client.1.smithi122.stdout:0/244: readlink d1/d5/d15/d1d/l37 0 2024-09-13T02:50:47.116 INFO:tasks.workunit.client.1.smithi122.stdout:8/189: dwrite d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:47.128 INFO:tasks.workunit.client.1.smithi122.stdout:0/245: dwrite d1/d5/d9/da/f46 [0,4194304] 0 2024-09-13T02:50:47.132 INFO:tasks.workunit.client.1.smithi122.stdout:8/190: write d3/da/d1f/f27 [1445249,121905] 0 2024-09-13T02:50:47.134 INFO:tasks.workunit.client.1.smithi122.stdout:8/191: creat d3/da/d1f/d20/d21/f33 x:0 0 0 2024-09-13T02:50:47.141 INFO:tasks.workunit.client.1.smithi122.stdout:0/246: dread d1/d5/d10/d29/f34 [0,4194304] 0 2024-09-13T02:50:47.141 INFO:tasks.workunit.client.1.smithi122.stdout:0/247: write d1/d5/f1e [5116598,23391] 0 2024-09-13T02:50:47.144 INFO:tasks.workunit.client.1.smithi122.stdout:0/248: unlink d1/d5/fd 0 2024-09-13T02:50:47.148 INFO:tasks.workunit.client.1.smithi122.stdout:0/249: link d1/d5/d9/da/d17/c24 d1/c54 0 2024-09-13T02:50:47.153 INFO:tasks.workunit.client.1.smithi122.stdout:0/250: write d1/d5/d15/d1d/f1f [1873384,16783] 0 2024-09-13T02:50:47.161 INFO:tasks.workunit.client.1.smithi122.stdout:0/251: unlink d1/d5/d9/da/d17/c19 0 2024-09-13T02:50:47.163 INFO:tasks.workunit.client.1.smithi122.stdout:0/252: creat d1/d5/d15/d35/f55 x:0 0 0 2024-09-13T02:50:47.166 INFO:tasks.workunit.client.1.smithi122.stdout:0/253: write d1/d5/d2d/f4e [223004,60533] 0 2024-09-13T02:50:47.167 INFO:tasks.workunit.client.1.smithi122.stdout:0/254: mkdir d1/d4b/d56 0 2024-09-13T02:50:47.169 INFO:tasks.workunit.client.1.smithi122.stdout:0/255: readlink d1/d5/d15/d1d/l37 0 2024-09-13T02:50:47.172 INFO:tasks.workunit.client.1.smithi122.stdout:0/256: mknod d1/d5/d2d/c57 0 2024-09-13T02:50:47.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:46 smithi122 ceph-mon[34559]: pgmap v254: 65 pgs: 65 active+clean; 2.2 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 220 MiB/s wr, 304 op/s 2024-09-13T02:50:47.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:46 smithi122 ceph-mon[34559]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:47.189 INFO:tasks.workunit.client.1.smithi122.stdout:0/257: dwrite d1/d5/d9/f20 [0,4194304] 0 2024-09-13T02:50:47.192 INFO:tasks.workunit.client.1.smithi122.stdout:0/258: chown d1/d5/d15/c3b 850 1 2024-09-13T02:50:47.193 INFO:tasks.workunit.client.1.smithi122.stdout:0/259: symlink d1/d5/l58 0 2024-09-13T02:50:47.194 INFO:tasks.workunit.client.1.smithi122.stdout:0/260: chown d1/d5/d10/d29/f40 0 1 2024-09-13T02:50:47.195 INFO:tasks.workunit.client.1.smithi122.stdout:0/261: symlink d1/d5/d10/d29/d32/l59 0 2024-09-13T02:50:47.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/262: symlink d1/d5/d9/l5a 0 2024-09-13T02:50:47.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/263: chown d1/d4b/l4f 1 1 2024-09-13T02:50:47.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/264: chown d1/d5/d9/da/f2b 184762798 1 2024-09-13T02:50:47.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/265: mknod d1/d5/d15/d1d/c5b 0 2024-09-13T02:50:47.199 INFO:tasks.workunit.client.1.smithi122.stdout:0/266: link d1/d5/d9/f25 d1/d5/d15/d1d/f5c 0 2024-09-13T02:50:47.208 INFO:tasks.workunit.client.1.smithi122.stdout:0/267: dread d1/d5/d9/da/d17/f2a [0,4194304] 0 2024-09-13T02:50:47.230 INFO:tasks.workunit.client.1.smithi122.stdout:0/268: dwrite d1/d5/d15/d35/f55 [0,4194304] 0 2024-09-13T02:50:47.235 INFO:tasks.workunit.client.1.smithi122.stdout:0/269: creat d1/d5/d10/d29/d32/f5d x:0 0 0 2024-09-13T02:50:47.235 INFO:tasks.workunit.client.1.smithi122.stdout:0/270: write d1/d5/d15/d1d/f5c [5311936,117484] 0 2024-09-13T02:50:47.235 INFO:tasks.workunit.client.1.smithi122.stdout:0/271: getdents d1 0 2024-09-13T02:50:47.238 INFO:tasks.workunit.client.1.smithi122.stdout:0/272: truncate d1/d5/d15/f50 1024513 0 2024-09-13T02:50:47.240 INFO:tasks.workunit.client.1.smithi122.stdout:0/273: creat d1/d5/d10/f5e x:0 0 0 2024-09-13T02:50:47.242 INFO:tasks.workunit.client.1.smithi122.stdout:0/274: unlink d1/d5/d9/da/f46 0 2024-09-13T02:50:47.242 INFO:tasks.workunit.client.1.smithi122.stdout:0/275: write d1/d5/d10/d29/d32/f5d [359728,65094] 0 2024-09-13T02:50:47.242 INFO:tasks.workunit.client.1.smithi122.stdout:0/276: chown d1/d5/d15/f50 381788 1 2024-09-13T02:50:47.244 INFO:tasks.workunit.client.1.smithi122.stdout:0/277: dread d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:47.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/278: rename d1/d5/d15 to d1/d5/d10/d29/d32/d5f 0 2024-09-13T02:50:47.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/279: chown d1/d5 1 1 2024-09-13T02:50:47.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/280: fdatasync d1/d5/d10/d29/f42 0 2024-09-13T02:50:47.249 INFO:tasks.workunit.client.1.smithi122.stdout:0/281: rename d1/d5/d10/d29/d32/d5f/d35 to d1/d4b/d56/d60 0 2024-09-13T02:50:47.250 INFO:tasks.workunit.client.1.smithi122.stdout:0/282: dread d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:47.251 INFO:tasks.workunit.client.1.smithi122.stdout:0/283: symlink d1/d4b/l61 0 2024-09-13T02:50:47.252 INFO:tasks.workunit.client.1.smithi122.stdout:0/284: getdents d1/d5/d9 0 2024-09-13T02:50:47.276 INFO:tasks.workunit.client.1.smithi122.stdout:0/285: dwrite d1/d5/d9/f25 [4194304,4194304] 0 2024-09-13T02:50:47.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/286: fsync d1/d5/d10/d29/f40 0 2024-09-13T02:50:47.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/287: chown d1/d5/d9/da/ff 0 1 2024-09-13T02:50:47.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/288: write d1/d5/d10/d29/f40 [122016,67349] 0 2024-09-13T02:50:47.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/289: mknod d1/c62 0 2024-09-13T02:50:47.283 INFO:tasks.workunit.client.1.smithi122.stdout:0/290: dread d1/d5/d9/da/d17/f2a [0,4194304] 0 2024-09-13T02:50:47.283 INFO:tasks.workunit.client.1.smithi122.stdout:0/291: chown d1/d5/d10/d29/d32/d5f/d1d/f2c 0 1 2024-09-13T02:50:47.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/292: dread f0 [0,4194304] 0 2024-09-13T02:50:47.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/293: chown d1/f30 378648 1 2024-09-13T02:50:47.288 INFO:tasks.workunit.client.1.smithi122.stdout:0/294: truncate d1/f30 3823766 0 2024-09-13T02:50:47.302 INFO:tasks.workunit.client.1.smithi122.stdout:0/295: dwrite d1/d5/d9/da/f2b [4194304,4194304] 0 2024-09-13T02:50:47.302 INFO:tasks.workunit.client.1.smithi122.stdout:0/296: write d1/d5/d10/d29/f40 [917968,115925] 0 2024-09-13T02:50:47.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/297: symlink d1/d5/d2d/l63 0 2024-09-13T02:50:47.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/298: chown d1/d5/d9/da/ff 266232 1 2024-09-13T02:50:47.304 INFO:tasks.workunit.client.1.smithi122.stdout:0/299: chown d1/d5/d10/d29/d32/d5f/f50 3870 1 2024-09-13T02:50:47.305 INFO:tasks.workunit.client.1.smithi122.stdout:0/300: rename d1/d5/d10/d29/d32/d5f/d1d/l37 to d1/d4b/d56/d60/l64 0 2024-09-13T02:50:47.305 INFO:tasks.workunit.client.1.smithi122.stdout:0/301: creat d1/d5/d9/da/f65 x:0 0 0 2024-09-13T02:50:47.306 INFO:tasks.workunit.client.1.smithi122.stdout:0/302: rmdir d1 39 2024-09-13T02:50:47.306 INFO:tasks.workunit.client.1.smithi122.stdout:0/303: readlink d1/d5/d2d/l63 0 2024-09-13T02:50:47.306 INFO:tasks.workunit.client.1.smithi122.stdout:0/304: chown d1/d5/d10/d29/d32 14 1 2024-09-13T02:50:47.306 INFO:tasks.workunit.client.1.smithi122.stdout:0/305: symlink d1/d4b/d56/l66 0 2024-09-13T02:50:47.310 INFO:tasks.workunit.client.1.smithi122.stdout:0/306: dread d1/d5/d9/f25 [0,4194304] 0 2024-09-13T02:50:47.310 INFO:tasks.workunit.client.1.smithi122.stdout:0/307: chown d1/d5/d10/f5e 2946156 1 2024-09-13T02:50:47.326 INFO:tasks.workunit.client.1.smithi122.stdout:0/308: dwrite d1/d5/d10/d29/d32/d5f/d1d/f31 [0,4194304] 0 2024-09-13T02:50:47.336 INFO:tasks.workunit.client.1.smithi122.stdout:0/309: dread d1/d5/d10/d29/d32/d5f/d1d/f1f [4194304,4194304] 0 2024-09-13T02:50:47.337 INFO:tasks.workunit.client.1.smithi122.stdout:0/310: creat d1/d5/d9/f67 x:0 0 0 2024-09-13T02:50:47.338 INFO:tasks.workunit.client.1.smithi122.stdout:0/311: mkdir d1/d5/d10/d29/d68 0 2024-09-13T02:50:47.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.337+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5b8115310 con 0x7fa5b8065be0 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.337+0000 7fa5aeffd640 1 -- 172.21.15.100:0/1583865367 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fa5b407aa00 con 0x7fa5b8065be0 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:47.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:50:47.340 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:50:47.341 INFO:tasks.workunit.client.1.smithi122.stdout:0/312: mkdir d1/d5/d9/da/d17/d69 0 2024-09-13T02:50:47.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 msgr2=0x7fa5a4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 0x7fa5a4070a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009af0 tx=0x7fa5a800b040 comp rx=0 tx=0).stop 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 msgr2=0x7fa5b80fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009ac0 tx=0x7fa5b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 shutdown_connections 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7fa5a406e5c0 0x7fa5a4070a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5b80ff6e0 0x7fa5b80fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 --2- 172.21.15.100:0/1583865367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8065be0 0x7fa5b80fcb60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 >> 172.21.15.100:0/1583865367 conn(0x7fa5b80f6c10 msgr2=0x7fa5b80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 shutdown_connections 2024-09-13T02:50:47.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.340+0000 7fa5c047e640 1 -- 172.21.15.100:0/1583865367 wait complete. 2024-09-13T02:50:47.355 INFO:tasks.workunit.client.1.smithi122.stdout:0/313: dwrite d1/d5/d10/d29/f40 [0,4194304] 0 2024-09-13T02:50:47.369 INFO:tasks.workunit.client.1.smithi122.stdout:0/314: dwrite d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:47.369 INFO:tasks.workunit.client.1.smithi122.stdout:0/315: write d1/d5/d10/d29/f40 [5026666,108631] 0 2024-09-13T02:50:47.371 INFO:tasks.workunit.client.1.smithi122.stdout:0/316: symlink d1/d5/d10/d29/d32/d5f/l6a 0 2024-09-13T02:50:47.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/317: unlink d1/d5/d2d/c57 0 2024-09-13T02:50:47.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/318: write d1/d5/d10/d29/d32/d5f/d1d/f1f [1861070,16662] 0 2024-09-13T02:50:47.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/319: fdatasync d1/d5/d9/f67 0 2024-09-13T02:50:47.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/320: creat d1/d5/d10/f6b x:0 0 0 2024-09-13T02:50:47.375 INFO:tasks.workunit.client.1.smithi122.stdout:0/321: creat d1/d5/d10/d29/d32/d5f/f6c x:0 0 0 2024-09-13T02:50:47.375 INFO:tasks.workunit.client.1.smithi122.stdout:0/322: write f0 [2102294,68195] 0 2024-09-13T02:50:47.377 INFO:tasks.workunit.client.1.smithi122.stdout:0/323: rename d1/f30 to d1/d5/d10/d29/d32/d5f/d1d/f6d 0 2024-09-13T02:50:47.377 INFO:tasks.workunit.client.1.smithi122.stdout:0/324: creat d1/d5/d9/f6e x:0 0 0 2024-09-13T02:50:47.393 INFO:tasks.workunit.client.1.smithi122.stdout:0/325: dwrite d1/d5/f1e [8388608,4194304] 0 2024-09-13T02:50:47.393 INFO:tasks.workunit.client.1.smithi122.stdout:0/326: creat d1/d5/d10/d29/d32/f6f x:0 0 0 2024-09-13T02:50:47.396 INFO:tasks.workunit.client.1.smithi122.stdout:0/327: unlink d1/d5/d9/da/f65 0 2024-09-13T02:50:47.397 INFO:tasks.workunit.client.1.smithi122.stdout:3/372: sync 2024-09-13T02:50:47.398 INFO:tasks.workunit.client.1.smithi122.stdout:3/373: symlink d4/d11/dd/d21/d2b/d36/d3c/l8c 0 2024-09-13T02:50:47.399 INFO:tasks.workunit.client.1.smithi122.stdout:7/243: sync 2024-09-13T02:50:47.406 INFO:tasks.workunit.client.1.smithi122.stdout:0/328: dread d1/d5/d2d/f44 [0,4194304] 0 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/374: dwrite d4/d11/dd/d21/d4e/d53/f89 [0,4194304] 0 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/375: write d4/d11/dd/d21/d74/f83 [301260,71357] 0 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:0/329: write d1/d5/d9/da/d17/f43 [492390,93620] 0 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:0/330: fdatasync d1/d5/d9/da/ff 0 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:0/331: chown d1/d5/d10/d29/d32/d5f/d1d/f1f 16649 1 2024-09-13T02:50:47.420 INFO:tasks.workunit.client.1.smithi122.stdout:7/244: dwrite d4/d8/db/f2a [0,4194304] 0 2024-09-13T02:50:47.421 INFO:tasks.workunit.client.1.smithi122.stdout:3/376: truncate d4/d6/f16 2374341 0 2024-09-13T02:50:47.423 INFO:tasks.workunit.client.1.smithi122.stdout:0/332: readlink d1/d5/d9/da/d17/l45 0 2024-09-13T02:50:47.424 INFO:tasks.workunit.client.1.smithi122.stdout:7/245: rename d4/d8/db/dc/d36/l48 to d4/d8/db/dc/d46/l59 0 2024-09-13T02:50:47.425 INFO:tasks.workunit.client.1.smithi122.stdout:3/377: mknod d4/d11/dd/d21/d2b/d36/d3c/d43/d60/c8d 0 2024-09-13T02:50:47.425 INFO:tasks.workunit.client.1.smithi122.stdout:0/333: stat d1/d5/l21 0 2024-09-13T02:50:47.427 INFO:tasks.workunit.client.1.smithi122.stdout:7/246: mkdir d4/d8/db/dc/d46/d5a 0 2024-09-13T02:50:47.429 INFO:tasks.workunit.client.1.smithi122.stdout:0/334: creat d1/d4b/d56/f70 x:0 0 0 2024-09-13T02:50:47.429 INFO:tasks.workunit.client.1.smithi122.stdout:0/335: chown d1/f38 332698 1 2024-09-13T02:50:47.429 INFO:tasks.workunit.client.1.smithi122.stdout:7/247: symlink d4/d8/db/l5b 0 2024-09-13T02:50:47.429 INFO:tasks.workunit.client.1.smithi122.stdout:7/248: readlink d4/d8/db/dc/d36/l4d 0 2024-09-13T02:50:47.446 INFO:tasks.workunit.client.1.smithi122.stdout:3/378: dwrite d4/d6/df/f7b [0,4194304] 0 2024-09-13T02:50:47.446 INFO:tasks.workunit.client.1.smithi122.stdout:3/379: read d4/d6/f8 [68076,88223] 0 2024-09-13T02:50:47.448 INFO:tasks.workunit.client.1.smithi122.stdout:3/380: link d4/d6/de/d1f/l2c d4/d6/df/l8e 0 2024-09-13T02:50:47.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 -- 172.21.15.100:0/3185274313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 msgr2=0x7f6a940fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/3185274313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a940fc970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6a840048d0 tx=0x7f6a84009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 -- 172.21.15.100:0/3185274313 shutdown_connections 2024-09-13T02:50:47.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/3185274313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 0x7f6a940fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/3185274313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a940fc970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 -- 172.21.15.100:0/3185274313 >> 172.21.15.100:0/3185274313 conn(0x7f6a940f7d20 msgr2=0x7f6a940fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 -- 172.21.15.100:0/3185274313 shutdown_connections 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.447+0000 7f6a9ae59640 1 -- 172.21.15.100:0/3185274313 wait complete. 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.448+0000 7f6a9ae59640 1 Processor -- start 2024-09-13T02:50:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.448+0000 7f6a9ae59640 1 -- start start 2024-09-13T02:50:47.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 0x7f6a9410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9410dbd0 con 0x7f6a940fc560 2024-09-13T02:50:47.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9410e3f0 con 0x7f6a940fd830 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39950/0 (socket says 172.21.15.100:39950) 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 -- 172.21.15.100:0/2094770670 learned_addr learned my addr 172.21.15.100:0/2094770670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a93fff640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 0x7f6a9410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 -- 172.21.15.100:0/2094770670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 msgr2=0x7f6a9410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 0x7f6a9410d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 -- 172.21.15.100:0/2094770670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84005040 con 0x7f6a940fc560 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a98bf5640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6a84003080 tx=0x7f6a84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a84038070 con 0x7f6a940fc560 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a84009800 con 0x7f6a940fc560 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9410e620 con 0x7f6a940fc560 2024-09-13T02:50:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a84033660 con 0x7f6a940fc560 2024-09-13T02:50:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.449+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9410eb60 con 0x7f6a940fc560 2024-09-13T02:50:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.451+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a940fb9c0 con 0x7f6a940fc560 2024-09-13T02:50:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.451+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f6a84030020 con 0x7f6a940fc560 2024-09-13T02:50:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.451+0000 7f6a917fa640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 0x7f6a7c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.452+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6a840adc70 con 0x7f6a940fc560 2024-09-13T02:50:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.452+0000 7f6a93fff640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 0x7f6a7c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.452+0000 7f6a93fff640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 0x7f6a7c070a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a9410cdf0 tx=0x7f6a88004330 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.456+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6a8407adf0 con 0x7f6a940fc560 2024-09-13T02:50:47.459 INFO:tasks.workunit.client.1.smithi122.stdout:0/336: dwrite d1/d5/d10/d29/d32/d5f/d1d/f31 [0,4194304] 0 2024-09-13T02:50:47.459 INFO:tasks.workunit.client.1.smithi122.stdout:3/381: dread d4/d6/df/f7b [0,4194304] 0 2024-09-13T02:50:47.459 INFO:tasks.workunit.client.1.smithi122.stdout:0/337: chown d1/d4b/d56 1234095 1 2024-09-13T02:50:47.460 INFO:tasks.workunit.client.1.smithi122.stdout:0/338: stat d1/d5/f1e 0 2024-09-13T02:50:47.460 INFO:tasks.workunit.client.1.smithi122.stdout:7/249: dwrite d4/d8/d24/f3e [4194304,4194304] 0 2024-09-13T02:50:47.461 INFO:tasks.workunit.client.1.smithi122.stdout:0/339: mknod d1/d4b/d56/c71 0 2024-09-13T02:50:47.461 INFO:tasks.workunit.client.1.smithi122.stdout:7/250: truncate d4/d8/db/dc/f28 3716965 0 2024-09-13T02:50:47.462 INFO:tasks.workunit.client.1.smithi122.stdout:3/382: getdents d4/d11/dd/d21/d2b 0 2024-09-13T02:50:47.462 INFO:tasks.workunit.client.1.smithi122.stdout:3/383: write d4/d11/dd/d21/d6c/f39 [1718398,115224] 0 2024-09-13T02:50:47.462 INFO:tasks.workunit.client.1.smithi122.stdout:3/384: chown d4/d11/d38/l7a 77635 1 2024-09-13T02:50:47.463 INFO:tasks.workunit.client.1.smithi122.stdout:0/340: truncate d1/d5/d9/da/f2b 90602 0 2024-09-13T02:50:47.463 INFO:tasks.workunit.client.1.smithi122.stdout:3/385: creat d4/d11/dd/d21/f8f x:0 0 0 2024-09-13T02:50:47.464 INFO:tasks.workunit.client.1.smithi122.stdout:0/341: rmdir d1/d5 39 2024-09-13T02:50:47.465 INFO:tasks.workunit.client.1.smithi122.stdout:3/386: mkdir d4/d6/df/d15/d68/d90 0 2024-09-13T02:50:47.466 INFO:tasks.workunit.client.1.smithi122.stdout:3/387: rename d4/d11/d38/f3f to d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f91 0 2024-09-13T02:50:47.467 INFO:tasks.workunit.client.1.smithi122.stdout:3/388: write d4/d11/dd/d21/d2b/d36/d3c/f20 [5174486,86451] 0 2024-09-13T02:50:47.470 INFO:tasks.workunit.client.1.smithi122.stdout:3/389: mknod d4/d6/df/d15/c92 0 2024-09-13T02:50:47.482 INFO:tasks.workunit.client.1.smithi122.stdout:3/390: write d4/d11/d38/f70 [3804733,38300] 0 2024-09-13T02:50:47.482 INFO:tasks.workunit.client.1.smithi122.stdout:3/391: fdatasync d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f79 0 2024-09-13T02:50:47.483 INFO:tasks.workunit.client.1.smithi122.stdout:3/392: symlink d4/d11/dd/d21/d74/l93 0 2024-09-13T02:50:47.485 INFO:tasks.workunit.client.1.smithi122.stdout:3/393: dread d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f91 [0,4194304] 0 2024-09-13T02:50:47.485 INFO:tasks.workunit.client.1.smithi122.stdout:0/342: dwrite d1/d5/d2d/f4e [0,4194304] 0 2024-09-13T02:50:47.486 INFO:tasks.workunit.client.1.smithi122.stdout:3/394: dread d4/d11/dd/d21/d2b/d36/f66 [0,4194304] 0 2024-09-13T02:50:47.488 INFO:tasks.workunit.client.1.smithi122.stdout:0/343: creat d1/d5/d2d/f72 x:0 0 0 2024-09-13T02:50:47.489 INFO:tasks.workunit.client.1.smithi122.stdout:3/395: symlink d4/d11/dd/d21/d30/l94 0 2024-09-13T02:50:47.489 INFO:tasks.workunit.client.1.smithi122.stdout:3/396: write d4/d11/dd/d21/d2b/f45 [538673,68164] 0 2024-09-13T02:50:47.489 INFO:tasks.workunit.client.1.smithi122.stdout:0/344: read d1/d5/d9/da/f2b [72148,74270] 0 2024-09-13T02:50:47.489 INFO:tasks.workunit.client.1.smithi122.stdout:0/345: chown d1/d5/d10/f5e 11167 1 2024-09-13T02:50:47.491 INFO:tasks.workunit.client.1.smithi122.stdout:3/397: rename d4/f56 to d4/d11/dd/d21/d4e/d53/f95 0 2024-09-13T02:50:47.493 INFO:tasks.workunit.client.1.smithi122.stdout:0/346: rename d1/d4b/d56/f70 to d1/f73 0 2024-09-13T02:50:47.508 INFO:tasks.workunit.client.1.smithi122.stdout:3/398: dwrite d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:47.508 INFO:tasks.workunit.client.1.smithi122.stdout:3/399: creat d4/d11/dd/d21/f96 x:0 0 0 2024-09-13T02:50:47.508 INFO:tasks.workunit.client.1.smithi122.stdout:3/400: chown d4/d6/df/f7b 3932504 1 2024-09-13T02:50:47.519 INFO:tasks.workunit.client.1.smithi122.stdout:3/401: write d4/d11/f2d [692994,103216] 0 2024-09-13T02:50:47.519 INFO:tasks.workunit.client.1.smithi122.stdout:3/402: mknod d4/d11/dd/d21/d2b/d36/d3c/d43/d60/c97 0 2024-09-13T02:50:47.534 INFO:tasks.workunit.client.1.smithi122.stdout:3/403: dwrite d4/d11/f2e [0,4194304] 0 2024-09-13T02:50:47.540 INFO:tasks.workunit.client.1.smithi122.stdout:3/404: rmdir d4/d11/dd/d21 39 2024-09-13T02:50:47.541 INFO:tasks.workunit.client.1.smithi122.stdout:3/405: creat d4/d6/df/f98 x:0 0 0 2024-09-13T02:50:47.541 INFO:tasks.workunit.client.1.smithi122.stdout:3/406: dread - d4/d11/dd/d21/d4e/d53/f6b zero size 2024-09-13T02:50:47.541 INFO:tasks.workunit.client.1.smithi122.stdout:3/407: stat d4/d11/dd/d21/d74 0 2024-09-13T02:50:47.547 INFO:tasks.workunit.client.1.smithi122.stdout:3/408: dread d4/d11/dd/d21/d2b/f2f [0,4194304] 0 2024-09-13T02:50:47.548 INFO:tasks.workunit.client.1.smithi122.stdout:3/409: rename d4/d11/dd/d21/d2b/f45 to d4/d6/de/d1f/f99 0 2024-09-13T02:50:47.549 INFO:tasks.workunit.client.1.smithi122.stdout:3/410: mknod d4/d6/de/d41/c9a 0 2024-09-13T02:50:47.550 INFO:tasks.workunit.client.1.smithi122.stdout:3/411: link d4/d11/dd/d21/d74/l93 d4/d6/de/d1f/l9b 0 2024-09-13T02:50:47.551 INFO:tasks.workunit.client.1.smithi122.stdout:3/412: rename d4/d11/dd/d21/d2b/f2f to d4/d11/d38/f9c 0 2024-09-13T02:50:47.552 INFO:tasks.workunit.client.1.smithi122.stdout:3/413: write d4/d6/df/d15/f61 [11489,121878] 0 2024-09-13T02:50:47.558 INFO:tasks.workunit.client.1.smithi122.stdout:3/414: read f3 [1110722,115609] 0 2024-09-13T02:50:47.558 INFO:tasks.workunit.client.1.smithi122.stdout:3/415: readlink d4/d6/df/l8e 0 2024-09-13T02:50:47.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/416: dwrite d4/d11/dd/d21/d6c/f39 [0,4194304] 0 2024-09-13T02:50:47.580 INFO:tasks.workunit.client.1.smithi122.stdout:3/417: getdents d4/d6/df 0 2024-09-13T02:50:47.580 INFO:tasks.workunit.client.1.smithi122.stdout:3/418: creat d4/f9d x:0 0 0 2024-09-13T02:50:47.582 INFO:tasks.workunit.client.1.smithi122.stdout:3/419: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e 0 2024-09-13T02:50:47.595 INFO:tasks.workunit.client.1.smithi122.stdout:3/420: dwrite d4/f5d [0,4194304] 0 2024-09-13T02:50:47.604 INFO:tasks.workunit.client.1.smithi122.stdout:3/421: dread d4/d11/dd/d21/f4d [4194304,4194304] 0 2024-09-13T02:50:47.621 INFO:tasks.workunit.client.1.smithi122.stdout:3/422: dwrite d4/d11/dd/d21/d4e/d53/f6b [0,4194304] 0 2024-09-13T02:50:47.638 INFO:tasks.workunit.client.1.smithi122.stdout:3/423: dwrite d4/d11/dd/d21/f8f [0,4194304] 0 2024-09-13T02:50:47.677 INFO:tasks.workunit.client.1.smithi122.stdout:3/424: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f x:0 0 0 2024-09-13T02:50:47.678 INFO:tasks.workunit.client.1.smithi122.stdout:3/425: dread d4/d11/dd/d21/d2b/d36/f66 [0,4194304] 0 2024-09-13T02:50:47.679 INFO:tasks.workunit.client.1.smithi122.stdout:3/426: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0 0 2024-09-13T02:50:47.679 INFO:tasks.workunit.client.1.smithi122.stdout:3/427: write d4/d6/de/d1f/f8a [455056,32308] 0 2024-09-13T02:50:47.694 INFO:tasks.workunit.client.1.smithi122.stdout:3/428: dwrite d4/d11/dd/d21/d74/f83 [0,4194304] 0 2024-09-13T02:50:47.694 INFO:tasks.workunit.client.1.smithi122.stdout:3/429: truncate d4/d6/f25 4365639 0 2024-09-13T02:50:47.698 INFO:tasks.workunit.client.1.smithi122.stdout:3/430: creat d4/d11/dd/d21/d2b/d36/d3c/d43/fa1 x:0 0 0 2024-09-13T02:50:47.706 INFO:tasks.workunit.client.1.smithi122.stdout:9/356: sync 2024-09-13T02:50:47.707 INFO:tasks.workunit.client.1.smithi122.stdout:3/431: read d4/d11/dd/d21/d4e/d53/f89 [1894279,17119] 0 2024-09-13T02:50:47.707 INFO:tasks.workunit.client.1.smithi122.stdout:3/432: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f [322809,42920] 0 2024-09-13T02:50:47.707 INFO:tasks.workunit.client.1.smithi122.stdout:3/433: write d4/d6/f8 [7344370,120824] 0 2024-09-13T02:50:47.709 INFO:tasks.workunit.client.1.smithi122.stdout:9/357: dread d8/f9 [4194304,4194304] 0 2024-09-13T02:50:47.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/434: unlink d4/d6/de/d1f/d33/c87 0 2024-09-13T02:50:47.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/435: write d4/d11/dd/d21/d2b/d55/f62 [951313,127654] 0 2024-09-13T02:50:47.711 INFO:tasks.workunit.client.1.smithi122.stdout:9/358: mknod d8/d16/d3d/d59/d49/c70 0 2024-09-13T02:50:47.711 INFO:tasks.workunit.client.1.smithi122.stdout:9/359: write d8/d16/d3d/d59/f4d [8699692,121340] 0 2024-09-13T02:50:47.712 INFO:tasks.workunit.client.1.smithi122.stdout:3/436: dread d4/d11/dd/d21/d4e/d53/f95 [0,4194304] 0 2024-09-13T02:50:47.712 INFO:tasks.workunit.client.1.smithi122.stdout:9/360: write d8/d16/d3d/d59/d23/f66 [381979,43044] 0 2024-09-13T02:50:47.712 INFO:tasks.workunit.client.1.smithi122.stdout:3/437: dread - d4/d11/dd/d21/f96 zero size 2024-09-13T02:50:47.713 INFO:tasks.workunit.client.1.smithi122.stdout:9/361: getdents d8/d16 0 2024-09-13T02:50:47.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.715+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a9410eec0 con 0x7f6a940fc560 2024-09-13T02:50:47.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.716+0000 7f6a917fa640 1 -- 172.21.15.100:0/2094770670 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f6a8407a790 con 0x7f6a940fc560 2024-09-13T02:50:47.717 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:50:47.717 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:50:47.717 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:50:47.718 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:47.720 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 msgr2=0x7f6a7c070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 0x7f6a7c070a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a9410cdf0 tx=0x7f6a88004330 comp rx=0 tx=0).stop 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 msgr2=0x7f6a9410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6a84003080 tx=0x7f6a84009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 shutdown_connections 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6a7c06e5c0 0x7f6a7c070a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a940fd830 0x7f6a9410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 --2- 172.21.15.100:0/2094770670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a940fc560 0x7f6a9410d040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 >> 172.21.15.100:0/2094770670 conn(0x7f6a940f7d20 msgr2=0x7f6a940f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 shutdown_connections 2024-09-13T02:50:47.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.719+0000 7f6a9ae59640 1 -- 172.21.15.100:0/2094770670 wait complete. 2024-09-13T02:50:47.722 INFO:tasks.workunit.client.1.smithi122.stdout:9/362: rmdir d8/d16/d45 39 2024-09-13T02:50:47.722 INFO:tasks.workunit.client.1.smithi122.stdout:9/363: read d8/d16/d3d/d59/d23/d1f/f2d [149864,105680] 0 2024-09-13T02:50:47.729 INFO:tasks.workunit.client.1.smithi122.stdout:9/364: write d8/d16/d3d/d59/d23/d1f/f37 [347657,19817] 0 2024-09-13T02:50:47.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 -- 172.21.15.100:0/3217020004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fd820 msgr2=0x7f76c40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 --2- 172.21.15.100:0/3217020004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fd820 0x7f76c40fdc90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0048d0 tx=0x7f76ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 -- 172.21.15.100:0/3217020004 shutdown_connections 2024-09-13T02:50:47.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 --2- 172.21.15.100:0/3217020004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fd820 0x7f76c40fdc90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 --2- 172.21.15.100:0/3217020004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fc550 0x7f76c40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 -- 172.21.15.100:0/3217020004 >> 172.21.15.100:0/3217020004 conn(0x7f76c40f7d30 msgr2=0x7f76c40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 -- 172.21.15.100:0/3217020004 shutdown_connections 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 -- 172.21.15.100:0/3217020004 wait complete. 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.804+0000 7f76c989d640 1 Processor -- start 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c989d640 1 -- start start 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c989d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c989d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fd820 0x7f76c410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c989d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c410dc20 con 0x7f76c40fc550 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c989d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c410e440 con 0x7f76c40fd820 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39964/0 (socket says 172.21.15.100:39964) 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 -- 172.21.15.100:0/1939377897 learned_addr learned my addr 172.21.15.100:0/1939377897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76bbfff640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fd820 0x7f76c410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 -- 172.21.15.100:0/1939377897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fd820 msgr2=0x7f76c410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fd820 0x7f76c410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 -- 172.21.15.100:0/1939377897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac005040 con 0x7f76c40fc550 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76c2ffd640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76b400eb70 tx=0x7f76b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.805+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b4007c30 con 0x7f76c40fc550 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.806+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76b400f040 con 0x7f76c40fc550 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.806+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c410e670 con 0x7f76c40fc550 2024-09-13T02:50:47.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.806+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b40094e0 con 0x7f76c40fc550 2024-09-13T02:50:47.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.806+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c410ec10 con 0x7f76c40fc550 2024-09-13T02:50:47.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.807+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c40fb9b0 con 0x7f76c40fc550 2024-09-13T02:50:47.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.807+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f76b4009750 con 0x7f76c40fc550 2024-09-13T02:50:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.808+0000 7f76bb7fe640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 0x7f76b0070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.808+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f76b408d820 con 0x7f76c40fc550 2024-09-13T02:50:47.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.808+0000 7f76bbfff640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 0x7f76b0070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.808+0000 7f76bbfff640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 0x7f76b0070a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76ac007ac0 tx=0x7f76ac035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:47.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:47.812+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f76b405a9a0 con 0x7f76c40fc550 2024-09-13T02:50:47.853 INFO:tasks.workunit.client.1.smithi122.stdout:6/486: sync 2024-09-13T02:50:47.853 INFO:tasks.workunit.client.1.smithi122.stdout:2/220: sync 2024-09-13T02:50:47.853 INFO:tasks.workunit.client.1.smithi122.stdout:8/192: sync 2024-09-13T02:50:47.854 INFO:tasks.workunit.client.1.smithi122.stdout:1/264: sync 2024-09-13T02:50:47.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/290: sync 2024-09-13T02:50:47.854 INFO:tasks.workunit.client.1.smithi122.stdout:4/374: sync 2024-09-13T02:50:47.854 INFO:tasks.workunit.client.1.smithi122.stdout:6/487: fdatasync d5/f36 0 2024-09-13T02:50:47.854 INFO:tasks.workunit.client.1.smithi122.stdout:1/265: write dc/de/d18/d22/f5b [567878,8575] 0 2024-09-13T02:50:47.855 INFO:tasks.workunit.client.1.smithi122.stdout:5/291: rename d0/d17/f3e to d0/f5a 0 2024-09-13T02:50:47.855 INFO:tasks.workunit.client.1.smithi122.stdout:5/292: chown d0/d2/d33 370 1 2024-09-13T02:50:47.855 INFO:tasks.workunit.client.1.smithi122.stdout:6/488: read d5/db/f17 [651573,117859] 0 2024-09-13T02:50:47.855 INFO:tasks.workunit.client.1.smithi122.stdout:2/221: creat d0/d1e/d2e/d33/f3f x:0 0 0 2024-09-13T02:50:47.857 INFO:tasks.workunit.client.1.smithi122.stdout:4/375: rmdir d11/d1b/d2e 39 2024-09-13T02:50:47.858 INFO:tasks.workunit.client.1.smithi122.stdout:5/293: creat d0/da/f5b x:0 0 0 2024-09-13T02:50:47.861 INFO:tasks.workunit.client.1.smithi122.stdout:1/266: rmdir dc/de/d18/d22/d1c 39 2024-09-13T02:50:47.861 INFO:tasks.workunit.client.1.smithi122.stdout:4/376: creat d11/f7c x:0 0 0 2024-09-13T02:50:47.863 INFO:tasks.workunit.client.1.smithi122.stdout:1/267: rmdir dc/de/d18/d22/d1c 39 2024-09-13T02:50:47.864 INFO:tasks.workunit.client.1.smithi122.stdout:4/377: symlink d11/d13/d14/d2a/l7d 0 2024-09-13T02:50:47.864 INFO:tasks.workunit.client.1.smithi122.stdout:4/378: dread - d11/d30/f4b zero size 2024-09-13T02:50:47.867 INFO:tasks.workunit.client.1.smithi122.stdout:1/268: rename dc/f16 to dc/de/d13/f5e 0 2024-09-13T02:50:47.867 INFO:tasks.workunit.client.1.smithi122.stdout:1/269: fsync dc/de/f2e 0 2024-09-13T02:50:47.867 INFO:tasks.workunit.client.1.smithi122.stdout:1/270: write dc/f4a [270575,22993] 0 2024-09-13T02:50:47.867 INFO:tasks.workunit.client.1.smithi122.stdout:1/271: fdatasync dc/de/d18/f39 0 2024-09-13T02:50:47.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/272: mknod dc/c5f 0 2024-09-13T02:50:47.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/273: stat dc/de/d18/f28 0 2024-09-13T02:50:47.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/274: read - dc/de/d18/d22/f43 zero size 2024-09-13T02:50:47.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/275: write dc/de/d18/d22/f43 [52642,14520] 0 2024-09-13T02:50:47.870 INFO:tasks.workunit.client.1.smithi122.stdout:1/276: symlink dc/de/l60 0 2024-09-13T02:50:47.871 INFO:tasks.workunit.client.1.smithi122.stdout:4/379: dread d11/d13/d14/d2a/d40/f51 [0,4194304] 0 2024-09-13T02:50:47.871 INFO:tasks.workunit.client.1.smithi122.stdout:4/380: write d11/f69 [4818090,88238] 0 2024-09-13T02:50:47.871 INFO:tasks.workunit.client.1.smithi122.stdout:4/381: creat d11/d13/d14/f7e x:0 0 0 2024-09-13T02:50:47.871 INFO:tasks.workunit.client.1.smithi122.stdout:1/277: getdents dc/d38/d51 0 2024-09-13T02:50:47.876 INFO:tasks.workunit.client.1.smithi122.stdout:4/382: rename d11/d13/f2c to d11/d1b/d2e/f7f 0 2024-09-13T02:50:47.877 INFO:tasks.workunit.client.1.smithi122.stdout:2/222: dwrite d0/d1e/d22/f24 [0,4194304] 0 2024-09-13T02:50:47.880 INFO:tasks.workunit.client.1.smithi122.stdout:2/223: symlink d0/d1e/d26/d3a/l40 0 2024-09-13T02:50:47.880 INFO:tasks.workunit.client.1.smithi122.stdout:8/193: dwrite d3/da/d1f/f24 [4194304,4194304] 0 2024-09-13T02:50:47.885 INFO:tasks.workunit.client.1.smithi122.stdout:2/224: rename d0/d1e/d2e/d33 to d0/d1c/d3b/d41 0 2024-09-13T02:50:47.886 INFO:tasks.workunit.client.1.smithi122.stdout:4/383: read d11/d13/f66 [427125,79878] 0 2024-09-13T02:50:47.887 INFO:tasks.workunit.client.1.smithi122.stdout:2/225: symlink d0/d1e/d22/l42 0 2024-09-13T02:50:47.891 INFO:tasks.workunit.client.1.smithi122.stdout:2/226: dread d0/d1e/d22/f32 [0,4194304] 0 2024-09-13T02:50:47.891 INFO:tasks.workunit.client.1.smithi122.stdout:2/227: stat d0/d1e 0 2024-09-13T02:50:47.893 INFO:tasks.workunit.client.1.smithi122.stdout:2/228: unlink d0/f27 0 2024-09-13T02:50:47.893 INFO:tasks.workunit.client.1.smithi122.stdout:2/229: truncate d0/f1b 1669643 0 2024-09-13T02:50:47.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/230: chown d0/d1e/d22 5348614 1 2024-09-13T02:50:47.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/231: creat d0/d1e/d26/f43 x:0 0 0 2024-09-13T02:50:47.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/232: rename d0/d1e/d26 to d0/d1e/d26/d44 22 2024-09-13T02:50:47.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/233: fsync d0/d1e/d22/f32 0 2024-09-13T02:50:47.895 INFO:tasks.workunit.client.1.smithi122.stdout:2/234: link d0/f18 d0/d1e/d22/f45 0 2024-09-13T02:50:47.896 INFO:tasks.workunit.client.1.smithi122.stdout:2/235: stat d0/f18 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/294: dwrite d0/da/d48/f45 [0,4194304] 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/295: chown d0/da/d48/c3d 16988091 1 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/296: fsync d0/f7 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:2/236: dread d0/d1c/f1d [0,4194304] 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:6/489: dwrite d5/d3d/d6c/d41/f47 [0,4194304] 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:6/490: write d5/f69 [741854,22014] 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:6/491: readlink d5/d3d/d6c/d41/d4e/l7e 0 2024-09-13T02:50:47.909 INFO:tasks.workunit.client.1.smithi122.stdout:6/492: truncate d5/d11/d2f/f4d 1584139 0 2024-09-13T02:50:47.910 INFO:tasks.workunit.client.1.smithi122.stdout:8/194: dwrite d3/da/d1f/d20/d21/f33 [0,4194304] 0 2024-09-13T02:50:47.910 INFO:tasks.workunit.client.1.smithi122.stdout:8/195: truncate d3/da/f30 176519 0 2024-09-13T02:50:47.910 INFO:tasks.workunit.client.1.smithi122.stdout:4/384: dwrite d11/f56 [0,4194304] 0 2024-09-13T02:50:47.910 INFO:tasks.workunit.client.1.smithi122.stdout:1/278: dwrite dc/de/f42 [0,4194304] 0 2024-09-13T02:50:47.911 INFO:tasks.workunit.client.1.smithi122.stdout:1/279: write dc/de/d13/f48 [331485,104720] 0 2024-09-13T02:50:47.914 INFO:tasks.workunit.client.1.smithi122.stdout:5/297: rename d0/d2/d33/c40 to d0/d17/d36/d25/c5c 0 2024-09-13T02:50:47.920 INFO:tasks.workunit.client.1.smithi122.stdout:8/196: mkdir d3/da/d1f/d20/d34 0 2024-09-13T02:50:47.926 INFO:tasks.workunit.client.1.smithi122.stdout:1/280: symlink dc/l61 0 2024-09-13T02:50:47.930 INFO:tasks.workunit.client.1.smithi122.stdout:6/493: rmdir d5/d11 39 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:8/197: creat d3/f35 x:0 0 0 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:8/198: write d3/da/d1f/f1a [700195,64286] 0 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:8/199: chown d3/l32 67742 1 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:4/385: getdents d11/d30 0 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:4/386: write d11/f47 [686906,126946] 0 2024-09-13T02:50:47.933 INFO:tasks.workunit.client.1.smithi122.stdout:4/387: creat d11/f80 x:0 0 0 2024-09-13T02:50:47.934 INFO:tasks.workunit.client.1.smithi122.stdout:1/281: unlink dc/de/l1b 0 2024-09-13T02:50:47.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/282: write dc/de/d13/f48 [1191259,104714] 0 2024-09-13T02:50:47.935 INFO:tasks.workunit.client.1.smithi122.stdout:8/200: mknod d3/da/d1e/c36 0 2024-09-13T02:50:47.935 INFO:tasks.workunit.client.1.smithi122.stdout:8/201: fdatasync f2 0 2024-09-13T02:50:47.937 INFO:tasks.workunit.client.1.smithi122.stdout:4/388: link d11/d13/d14/d2a/l44 d11/d1b/d32/l81 0 2024-09-13T02:50:47.939 INFO:tasks.workunit.client.1.smithi122.stdout:8/202: unlink d3/da/f1b 0 2024-09-13T02:50:47.941 INFO:tasks.workunit.client.1.smithi122.stdout:2/237: dwrite d0/f2c [4194304,4194304] 0 2024-09-13T02:50:47.941 INFO:tasks.workunit.client.1.smithi122.stdout:5/298: dwrite d0/d1d/f1f [4194304,4194304] 0 2024-09-13T02:50:47.941 INFO:tasks.workunit.client.1.smithi122.stdout:5/299: stat d0/d1d 0 2024-09-13T02:50:47.942 INFO:tasks.workunit.client.1.smithi122.stdout:5/300: fsync d0/d17/f18 0 2024-09-13T02:50:47.942 INFO:tasks.workunit.client.1.smithi122.stdout:5/301: read d0/f4d [3740434,44030] 0 2024-09-13T02:50:47.942 INFO:tasks.workunit.client.1.smithi122.stdout:8/203: creat d3/da/d1f/f37 x:0 0 0 2024-09-13T02:50:47.942 INFO:tasks.workunit.client.1.smithi122.stdout:8/204: truncate d3/f35 315647 0 2024-09-13T02:50:47.948 INFO:tasks.workunit.client.1.smithi122.stdout:8/205: creat d3/da/d1f/d20/d34/f38 x:0 0 0 2024-09-13T02:50:47.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/206: fdatasync d3/da/d1f/d20/d21/f26 0 2024-09-13T02:50:47.954 INFO:tasks.workunit.client.1.smithi122.stdout:4/389: rename d11/d13/d14 to d11/d13/d82 0 2024-09-13T02:50:47.955 INFO:tasks.workunit.client.1.smithi122.stdout:2/238: read d0/d1e/d26/f30 [4908869,84342] 0 2024-09-13T02:50:47.956 INFO:tasks.workunit.client.1.smithi122.stdout:2/239: link d0/d1e/d22/f32 d0/d1e/d2e/d3e/f46 0 2024-09-13T02:50:47.956 INFO:tasks.workunit.client.1.smithi122.stdout:2/240: fdatasync d0/d1e/f38 0 2024-09-13T02:50:47.964 INFO:tasks.workunit.client.1.smithi122.stdout:4/390: write d11/d13/d82/f16 [1710583,2254] 0 2024-09-13T02:50:47.967 INFO:tasks.workunit.client.1.smithi122.stdout:1/283: dwrite dc/de/f42 [4194304,4194304] 0 2024-09-13T02:50:47.968 INFO:tasks.workunit.client.1.smithi122.stdout:1/284: mkdir dc/de/d18/d22/d1c/d62 0 2024-09-13T02:50:47.970 INFO:tasks.workunit.client.1.smithi122.stdout:1/285: unlink dc/de/d18/d22/d1c/f3c 0 2024-09-13T02:50:47.970 INFO:tasks.workunit.client.1.smithi122.stdout:1/286: write dc/de/d18/d1d/f23 [906886,59550] 0 2024-09-13T02:50:47.970 INFO:tasks.workunit.client.1.smithi122.stdout:1/287: fdatasync dc/de/d18/d1d/f53 0 2024-09-13T02:50:47.971 INFO:tasks.workunit.client.1.smithi122.stdout:1/288: mknod dc/de/d18/d22/d1c/c63 0 2024-09-13T02:50:47.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/207: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:47.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/208: readlink d3/l32 0 2024-09-13T02:50:47.976 INFO:tasks.workunit.client.1.smithi122.stdout:2/241: dwrite d0/d1e/d2e/d3e/f46 [0,4194304] 0 2024-09-13T02:50:47.976 INFO:tasks.workunit.client.1.smithi122.stdout:2/242: write d0/f10 [6620078,22179] 0 2024-09-13T02:50:47.976 INFO:tasks.workunit.client.1.smithi122.stdout:5/302: dwrite d0/da/d48/f49 [0,4194304] 0 2024-09-13T02:50:47.977 INFO:tasks.workunit.client.1.smithi122.stdout:8/209: read d3/f35 [181176,10870] 0 2024-09-13T02:50:47.979 INFO:tasks.workunit.client.1.smithi122.stdout:4/391: dread d11/d13/d82/d2a/d40/f4d [0,4194304] 0 2024-09-13T02:50:47.981 INFO:tasks.workunit.client.1.smithi122.stdout:2/243: dread d0/d1e/d22/d29/f2b [0,4194304] 0 2024-09-13T02:50:47.981 INFO:tasks.workunit.client.1.smithi122.stdout:2/244: stat d0/d1c/f1d 0 2024-09-13T02:50:47.981 INFO:tasks.workunit.client.1.smithi122.stdout:2/245: read d0/d1e/d22/f45 [33616,18617] 0 2024-09-13T02:50:47.981 INFO:tasks.workunit.client.1.smithi122.stdout:8/210: truncate d3/da/d1f/f29 241542 0 2024-09-13T02:50:47.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/211: fsync d3/da/d1f/f1a 0 2024-09-13T02:50:47.989 INFO:tasks.workunit.client.1.smithi122.stdout:4/392: dread fa [0,4194304] 0 2024-09-13T02:50:47.989 INFO:tasks.workunit.client.1.smithi122.stdout:1/289: dwrite dc/de/f27 [0,4194304] 0 2024-09-13T02:50:47.989 INFO:tasks.workunit.client.1.smithi122.stdout:1/290: read - dc/de/d18/d1d/f53 zero size 2024-09-13T02:50:47.991 INFO:tasks.workunit.client.1.smithi122.stdout:1/291: mknod dc/de/d13/c64 0 2024-09-13T02:50:47.991 INFO:tasks.workunit.client.1.smithi122.stdout:8/212: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:2/246: dread d0/f2c [4194304,4194304] 0 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:2/247: readlink d0/d1e/d22/l42 0 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:2/248: creat d0/d1e/d22/f47 x:0 0 0 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:8/213: link d3/da/d1f/f11 d3/da/d1f/d25/f39 0 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:8/214: chown d3/da/d1f/d20/d21/f2f 12328 1 2024-09-13T02:50:47.993 INFO:tasks.workunit.client.1.smithi122.stdout:8/215: creat d3/da/d1f/d20/d34/f3a x:0 0 0 2024-09-13T02:50:47.994 INFO:tasks.workunit.client.1.smithi122.stdout:2/249: mknod d0/d1e/d26/d3d/c48 0 2024-09-13T02:50:47.995 INFO:tasks.workunit.client.1.smithi122.stdout:1/292: read f0 [1990194,79498] 0 2024-09-13T02:50:47.995 INFO:tasks.workunit.client.1.smithi122.stdout:2/250: creat d0/d1e/d22/d39/f49 x:0 0 0 2024-09-13T02:50:47.997 INFO:tasks.workunit.client.1.smithi122.stdout:1/293: rename dc/de/d13/f48 to dc/de/d18/f65 0 2024-09-13T02:50:47.997 INFO:tasks.workunit.client.1.smithi122.stdout:1/294: stat dc/de/d18/f28 0 2024-09-13T02:50:47.997 INFO:tasks.workunit.client.1.smithi122.stdout:8/216: dread d3/da/d1f/d25/f39 [0,4194304] 0 2024-09-13T02:50:47.998 INFO:tasks.workunit.client.1.smithi122.stdout:2/251: symlink d0/l4a 0 2024-09-13T02:50:47.998 INFO:tasks.workunit.client.1.smithi122.stdout:5/303: dwrite d0/d1d/f2e [0,4194304] 0 2024-09-13T02:50:47.999 INFO:tasks.workunit.client.1.smithi122.stdout:2/252: link d0/d1e/d22/f47 d0/d1e/d2e/d3e/f4b 0 2024-09-13T02:50:48.002 INFO:tasks.workunit.client.1.smithi122.stdout:2/253: rmdir d0/d1c/d3b 39 2024-09-13T02:50:48.002 INFO:tasks.workunit.client.1.smithi122.stdout:5/304: mknod d0/d1d/d46/c5d 0 2024-09-13T02:50:48.002 INFO:tasks.workunit.client.1.smithi122.stdout:2/254: rename d0/d1e/d26/d3d to d0/d1e/d26/d3d/d4c 22 2024-09-13T02:50:48.002 INFO:tasks.workunit.client.1.smithi122.stdout:2/255: creat d0/d1c/f4d x:0 0 0 2024-09-13T02:50:48.004 INFO:tasks.workunit.client.1.smithi122.stdout:8/217: dread d3/f17 [0,4194304] 0 2024-09-13T02:50:48.004 INFO:tasks.workunit.client.1.smithi122.stdout:8/218: dread - d3/da/d1f/d20/f2c zero size 2024-09-13T02:50:48.005 INFO:tasks.workunit.client.1.smithi122.stdout:2/256: unlink d0/d1e/d22/c2f 0 2024-09-13T02:50:48.007 INFO:tasks.workunit.client.1.smithi122.stdout:1/295: dread dc/de/d18/f28 [0,4194304] 0 2024-09-13T02:50:48.007 INFO:tasks.workunit.client.1.smithi122.stdout:2/257: write d0/f10 [5425805,487] 0 2024-09-13T02:50:48.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/219: dread d3/da/d1f/f11 [0,4194304] 0 2024-09-13T02:50:48.010 INFO:tasks.workunit.client.1.smithi122.stdout:1/296: rename f0 to dc/de/d18/f66 0 2024-09-13T02:50:48.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/393: dwrite d11/f3e [0,4194304] 0 2024-09-13T02:50:48.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/394: truncate d11/d13/d82/f42 236853 0 2024-09-13T02:50:48.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/395: truncate d11/d1b/d32/f73 468635 0 2024-09-13T02:50:48.012 INFO:tasks.workunit.client.1.smithi122.stdout:8/220: unlink d3/da/d1f/f24 0 2024-09-13T02:50:48.016 INFO:tasks.workunit.client.1.smithi122.stdout:1/297: symlink dc/de/l67 0 2024-09-13T02:50:48.016 INFO:tasks.workunit.client.1.smithi122.stdout:1/298: write dc/de/d18/d1d/f4e [4776907,503] 0 2024-09-13T02:50:48.023 INFO:tasks.workunit.client.1.smithi122.stdout:1/299: mknod dc/de/d18/d22/d1c/c68 0 2024-09-13T02:50:48.023 INFO:tasks.workunit.client.1.smithi122.stdout:1/300: dread - dc/de/d18/d22/f55 zero size 2024-09-13T02:50:48.025 INFO:tasks.workunit.client.1.smithi122.stdout:1/301: getdents dc/de/d18/d1d/d2f 0 2024-09-13T02:50:48.025 INFO:tasks.workunit.client.1.smithi122.stdout:5/305: dwrite d0/d1d/f1f [0,4194304] 0 2024-09-13T02:50:48.026 INFO:tasks.workunit.client.1.smithi122.stdout:1/302: getdents dc/de/d13 0 2024-09-13T02:50:48.026 INFO:tasks.workunit.client.1.smithi122.stdout:1/303: chown dc/c50 6 1 2024-09-13T02:50:48.028 INFO:tasks.workunit.client.1.smithi122.stdout:5/306: truncate d0/d17/f28 2731199 0 2024-09-13T02:50:48.030 INFO:tasks.workunit.client.1.smithi122.stdout:1/304: rmdir dc/de/d18/d22/d1c/d62 0 2024-09-13T02:50:48.031 INFO:tasks.workunit.client.1.smithi122.stdout:5/307: rename d0/d1d/f2e to d0/d2/d33/f5e 0 2024-09-13T02:50:48.033 INFO:tasks.workunit.client.1.smithi122.stdout:1/305: rename dc/de/f42 to dc/de/d13/f69 0 2024-09-13T02:50:48.034 INFO:tasks.workunit.client.1.smithi122.stdout:5/308: truncate d0/f7 90638 0 2024-09-13T02:50:48.034 INFO:tasks.workunit.client.1.smithi122.stdout:5/309: chown d0 3595 1 2024-09-13T02:50:48.035 INFO:tasks.workunit.client.1.smithi122.stdout:5/310: mknod d0/c5f 0 2024-09-13T02:50:48.036 INFO:tasks.workunit.client.1.smithi122.stdout:5/311: creat d0/d17/d36/d25/f60 x:0 0 0 2024-09-13T02:50:48.037 INFO:tasks.workunit.client.1.smithi122.stdout:5/312: symlink d0/d17/d36/d25/d2b/l61 0 2024-09-13T02:50:48.037 INFO:tasks.workunit.client.1.smithi122.stdout:5/313: truncate d0/d17/d36/d25/f60 861041 0 2024-09-13T02:50:48.042 INFO:tasks.workunit.client.1.smithi122.stdout:1/306: read dc/de/d18/d1d/f4e [3869255,50340] 0 2024-09-13T02:50:48.046 INFO:tasks.workunit.client.1.smithi122.stdout:4/396: dwrite d11/d13/f1f [4194304,4194304] 0 2024-09-13T02:50:48.046 INFO:tasks.workunit.client.1.smithi122.stdout:8/221: dwrite d3/f17 [4194304,4194304] 0 2024-09-13T02:50:48.048 INFO:tasks.workunit.client.1.smithi122.stdout:4/397: truncate fa 2635257 0 2024-09-13T02:50:48.051 INFO:tasks.workunit.client.1.smithi122.stdout:1/307: dread dc/de/d18/d22/f31 [0,4194304] 0 2024-09-13T02:50:48.063 INFO:tasks.workunit.client.1.smithi122.stdout:4/398: getdents d11/d1b/d32 0 2024-09-13T02:50:48.072 INFO:tasks.workunit.client.1.smithi122.stdout:1/308: dwrite dc/de/d18/d1d/f4e [0,4194304] 0 2024-09-13T02:50:48.072 INFO:tasks.workunit.client.1.smithi122.stdout:5/314: dwrite d0/d17/d3a/f56 [0,4194304] 0 2024-09-13T02:50:48.072 INFO:tasks.workunit.client.1.smithi122.stdout:8/222: dwrite d3/da/f30 [0,4194304] 0 2024-09-13T02:50:48.072 INFO:tasks.workunit.client.1.smithi122.stdout:8/223: write d3/da/d1f/d20/d34/f3a [570466,113530] 0 2024-09-13T02:50:48.072 INFO:tasks.workunit.client.1.smithi122.stdout:8/224: write d3/f35 [327043,100892] 0 2024-09-13T02:50:48.077 INFO:tasks.workunit.client.1.smithi122.stdout:5/315: rmdir d0/d17/d36/d25/d2b 39 2024-09-13T02:50:48.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/225: link d3/da/d1f/f37 d3/d31/f3b 0 2024-09-13T02:50:48.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.084+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 --> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76c410ef70 con 0x7f76b006e5c0 2024-09-13T02:50:48.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:47 smithi100 ceph-mon[27894]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.085 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:47 smithi100 ceph-mon[27894]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.086 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:47 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/1583865367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:50:48.086 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:47 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2094770670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:48.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.085+0000 7f76bb7fe640 1 -- 172.21.15.100:0/1939377897 <== mgr.14206 v2:172.21.15.100:6800/3121511218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f76c410ef70 con 0x7f76b006e5c0 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:50:48.087 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:50:48.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 msgr2=0x7f76b0070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 0x7f76b0070a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76ac007ac0 tx=0x7f76ac035040 comp rx=0 tx=0).stop 2024-09-13T02:50:48.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 msgr2=0x7f76c410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f76b400eb70 tx=0x7f76b400b040 comp rx=0 tx=0).stop 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 shutdown_connections 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f76b006e5c0 0x7f76b0070a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76c40fd820 0x7f76c410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 --2- 172.21.15.100:0/1939377897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40fc550 0x7f76c410d090 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 >> 172.21.15.100:0/1939377897 conn(0x7f76c40f7d30 msgr2=0x7f76c40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 shutdown_connections 2024-09-13T02:50:48.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.090+0000 7f76c989d640 1 -- 172.21.15.100:0/1939377897 wait complete. 2024-09-13T02:50:48.107 INFO:tasks.workunit.client.1.smithi122.stdout:4/399: dwrite d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:48.108 INFO:tasks.workunit.client.1.smithi122.stdout:1/309: dwrite dc/de/d18/f28 [0,4194304] 0 2024-09-13T02:50:48.108 INFO:tasks.workunit.client.1.smithi122.stdout:5/316: dwrite d0/da/f5b [0,4194304] 0 2024-09-13T02:50:48.108 INFO:tasks.workunit.client.1.smithi122.stdout:5/317: chown d0/d2/d33 666563 1 2024-09-13T02:50:48.108 INFO:tasks.workunit.client.1.smithi122.stdout:8/226: dwrite d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:48.111 INFO:tasks.workunit.client.1.smithi122.stdout:8/227: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:48.112 INFO:tasks.workunit.client.1.smithi122.stdout:4/400: unlink d11/d13/d82/d2a/f61 0 2024-09-13T02:50:48.112 INFO:tasks.workunit.client.1.smithi122.stdout:4/401: fsync d11/d1b/d32/f73 0 2024-09-13T02:50:48.119 INFO:tasks.workunit.client.1.smithi122.stdout:1/310: creat dc/d38/f6a x:0 0 0 2024-09-13T02:50:48.120 INFO:tasks.workunit.client.1.smithi122.stdout:5/318: write d0/d17/d36/d25/d2b/f2c [8121370,95644] 0 2024-09-13T02:50:48.121 INFO:tasks.workunit.client.1.smithi122.stdout:5/319: chown d0/da 2711 1 2024-09-13T02:50:48.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/228: creat d3/da/d1f/d25/f3c x:0 0 0 2024-09-13T02:50:48.121 INFO:tasks.workunit.client.1.smithi122.stdout:8/229: write d3/da/d1f/d20/d21/f26 [277371,86187] 0 2024-09-13T02:50:48.122 INFO:tasks.workunit.client.1.smithi122.stdout:1/311: unlink dc/de/d18/d22/f43 0 2024-09-13T02:50:48.125 INFO:tasks.workunit.client.1.smithi122.stdout:5/320: rename d0/d1d/c1e to d0/d17/d36/d3f/d4c/c62 0 2024-09-13T02:50:48.127 INFO:tasks.workunit.client.1.smithi122.stdout:8/230: unlink d3/da/d1e/f2b 0 2024-09-13T02:50:48.128 INFO:tasks.workunit.client.1.smithi122.stdout:1/312: symlink dc/de/d18/d1d/l6b 0 2024-09-13T02:50:48.128 INFO:tasks.workunit.client.1.smithi122.stdout:1/313: fsync dc/de/d18/d1d/f53 0 2024-09-13T02:50:48.130 INFO:tasks.workunit.client.1.smithi122.stdout:5/321: rename d0/d1d/d46 to d0/da/d48/d63 0 2024-09-13T02:50:48.131 INFO:tasks.workunit.client.1.smithi122.stdout:1/314: mkdir dc/de/d13/d46/d6c 0 2024-09-13T02:50:48.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/322: rmdir d0/d17/d36/d3f/d4c 39 2024-09-13T02:50:48.134 INFO:tasks.workunit.client.1.smithi122.stdout:5/323: mknod d0/d2/c64 0 2024-09-13T02:50:48.134 INFO:tasks.workunit.client.1.smithi122.stdout:5/324: chown d0/d2/c32 2 1 2024-09-13T02:50:48.134 INFO:tasks.workunit.client.1.smithi122.stdout:5/325: stat d0/d17/d36/d25/d2b/f2c 0 2024-09-13T02:50:48.134 INFO:tasks.workunit.client.1.smithi122.stdout:5/326: creat d0/d17/d36/d25/f65 x:0 0 0 2024-09-13T02:50:48.135 INFO:tasks.workunit.client.1.smithi122.stdout:5/327: readlink d0/d2/d33/l44 0 2024-09-13T02:50:48.135 INFO:tasks.workunit.client.1.smithi122.stdout:5/328: stat d0/d17/d36/d25/d2b/f30 0 2024-09-13T02:50:48.135 INFO:tasks.workunit.client.1.smithi122.stdout:5/329: chown d0/d2/c32 33 1 2024-09-13T02:50:48.136 INFO:tasks.workunit.client.1.smithi122.stdout:5/330: chown d0/d17/d3a/f56 36686995 1 2024-09-13T02:50:48.136 INFO:tasks.workunit.client.1.smithi122.stdout:5/331: write d0/d17/f22 [2232843,15492] 0 2024-09-13T02:50:48.137 INFO:tasks.workunit.client.1.smithi122.stdout:8/231: write d3/f9 [2114290,129335] 0 2024-09-13T02:50:48.142 INFO:tasks.workunit.client.1.smithi122.stdout:7/251: sync 2024-09-13T02:50:48.142 INFO:tasks.workunit.client.1.smithi122.stdout:0/347: sync 2024-09-13T02:50:48.146 INFO:tasks.workunit.client.1.smithi122.stdout:8/232: rmdir d3/da/d1f 39 2024-09-13T02:50:48.147 INFO:tasks.workunit.client.1.smithi122.stdout:1/315: write dc/de/f27 [1410736,95046] 0 2024-09-13T02:50:48.154 INFO:tasks.workunit.client.1.smithi122.stdout:1/316: mkdir dc/de/d18/d22/d1c/d57/d6d 0 2024-09-13T02:50:48.154 INFO:tasks.workunit.client.1.smithi122.stdout:1/317: fdatasync dc/de/d18/d1d/f1f 0 2024-09-13T02:50:48.154 INFO:tasks.workunit.client.1.smithi122.stdout:1/318: write dc/de/d18/f65 [1672782,112067] 0 2024-09-13T02:50:48.156 INFO:tasks.workunit.client.1.smithi122.stdout:5/332: dread d0/da/f2a [0,4194304] 0 2024-09-13T02:50:48.157 INFO:tasks.workunit.client.1.smithi122.stdout:5/333: fsync d0/f4d 0 2024-09-13T02:50:48.161 INFO:tasks.workunit.client.1.smithi122.stdout:5/334: write d0/d2/f20 [3861376,85001] 0 2024-09-13T02:50:48.163 INFO:tasks.workunit.client.1.smithi122.stdout:5/335: creat d0/d17/d36/d3f/d4c/f66 x:0 0 0 2024-09-13T02:50:48.169 INFO:tasks.workunit.client.1.smithi122.stdout:7/252: dwrite d4/d8/d3d/f44 [0,4194304] 0 2024-09-13T02:50:48.169 INFO:tasks.workunit.client.1.smithi122.stdout:7/253: write d4/d8/db/dc/d36/f41 [631670,115557] 0 2024-09-13T02:50:48.169 INFO:tasks.workunit.client.1.smithi122.stdout:7/254: dread - d4/d8/db/dc/f3b zero size 2024-09-13T02:50:48.169 INFO:tasks.workunit.client.1.smithi122.stdout:0/348: dwrite d1/f3a [0,4194304] 0 2024-09-13T02:50:48.169 INFO:tasks.workunit.client.1.smithi122.stdout:0/349: read - d1/d5/d10/d29/d32/d5f/f6c zero size 2024-09-13T02:50:48.173 INFO:tasks.workunit.client.1.smithi122.stdout:7/255: link d4/d8/db/dc/c16 d4/d8/db/dc/d46/d5a/c5c 0 2024-09-13T02:50:48.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/350: unlink d1/d5/d10/d29/d32/d5f/d1d/f6d 0 2024-09-13T02:50:48.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/351: rmdir d1/d5/d10/d29/d32/d5f 39 2024-09-13T02:50:48.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/352: dread - d1/d5/d9/f6e zero size 2024-09-13T02:50:48.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:47 smithi122 ceph-mon[34559]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:47 smithi122 ceph-mon[34559]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:47 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/1583865367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:50:48.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:47 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2094770670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:50:48.192 INFO:tasks.workunit.client.1.smithi122.stdout:5/336: dwrite d0/da/d48/f49 [0,4194304] 0 2024-09-13T02:50:48.192 INFO:tasks.workunit.client.1.smithi122.stdout:1/319: dwrite f2 [4194304,4194304] 0 2024-09-13T02:50:48.193 INFO:tasks.workunit.client.1.smithi122.stdout:7/256: dread d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:48.193 INFO:tasks.workunit.client.1.smithi122.stdout:7/257: chown d4/d8/db/dc/d46/f4f 12 1 2024-09-13T02:50:48.194 INFO:tasks.workunit.client.1.smithi122.stdout:5/337: rename d0/d17/d36/d25/d2b/l61 to d0/d17/d36/d3f/l67 0 2024-09-13T02:50:48.195 INFO:tasks.workunit.client.1.smithi122.stdout:0/353: dread d1/d5/d10/d29/f34 [0,4194304] 0 2024-09-13T02:50:48.197 INFO:tasks.workunit.client.1.smithi122.stdout:1/320: rmdir dc/de/d18/d22/d1c/d57/d6d 0 2024-09-13T02:50:48.201 INFO:tasks.workunit.client.1.smithi122.stdout:0/354: link d1/d5/d10/d29/d32/d5f/c3b d1/d5/d10/d29/d32/c74 0 2024-09-13T02:50:48.201 INFO:tasks.workunit.client.1.smithi122.stdout:1/321: mkdir dc/de/d6e 0 2024-09-13T02:50:48.208 INFO:tasks.workunit.client.1.smithi122.stdout:0/355: creat d1/d5/d9/da/f75 x:0 0 0 2024-09-13T02:50:48.208 INFO:tasks.workunit.client.1.smithi122.stdout:0/356: truncate d1/d5/d9/f67 681150 0 2024-09-13T02:50:48.208 INFO:tasks.workunit.client.1.smithi122.stdout:0/357: chown d1/c62 751 1 2024-09-13T02:50:48.211 INFO:tasks.workunit.client.1.smithi122.stdout:0/358: unlink d1/d5/d10/f6b 0 2024-09-13T02:50:48.212 INFO:tasks.workunit.client.1.smithi122.stdout:5/338: rmdir d0/d17 39 2024-09-13T02:50:48.212 INFO:tasks.workunit.client.1.smithi122.stdout:5/339: chown d0/d17/d3a/f4f 3845 1 2024-09-13T02:50:48.213 INFO:tasks.workunit.client.1.smithi122.stdout:0/359: mknod d1/d4b/d56/c76 0 2024-09-13T02:50:48.214 INFO:tasks.workunit.client.1.smithi122.stdout:5/340: creat d0/d17/d36/d25/d2b/f68 x:0 0 0 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 -- 172.21.15.100:0/2863273416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc0fd470 msgr2=0x7f6dfc0ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 --2- 172.21.15.100:0/2863273416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc0ff8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6de80048d0 tx=0x7f6de8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 -- 172.21.15.100:0/2863273416 shutdown_connections 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 --2- 172.21.15.100:0/2863273416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc0ff8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 --2- 172.21.15.100:0/2863273416 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc065c40 0x7f6dfc0fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 -- 172.21.15.100:0/2863273416 >> 172.21.15.100:0/2863273416 conn(0x7f6dfc0f6c10 msgr2=0x7f6dfc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.213+0000 7f6e025ce640 1 -- 172.21.15.100:0/2863273416 shutdown_connections 2024-09-13T02:50:48.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.214+0000 7f6e025ce640 1 -- 172.21.15.100:0/2863273416 wait complete. 2024-09-13T02:50:48.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.214+0000 7f6e025ce640 1 Processor -- start 2024-09-13T02:50:48.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6e025ce640 1 -- start start 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6e025ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc065c40 0x7f6dfc1136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6e025ce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6e025ce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc114240 con 0x7f6dfc065c40 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6e025ce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc114a10 con 0x7f6dfc0fd470 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6dfb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:51422/0 (socket says 172.21.15.100:51422) 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6dfb7fe640 1 -- 172.21.15.100:0/3784590844 learned_addr learned my addr 172.21.15.100:0/3784590844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.215+0000 7f6dfbfff640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc065c40 0x7f6dfc1136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6dfb7fe640 1 -- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc065c40 msgr2=0x7f6dfc1136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6dfb7fe640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc065c40 0x7f6dfc1136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6dfb7fe640 1 -- 172.21.15.100:0/3784590844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8005040 con 0x7f6dfc0fd470 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6dfb7fe640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6de80048a0 tx=0x7f6de8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:48.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de8038070 con 0x7f6dfc0fd470 2024-09-13T02:50:48.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc114c10 con 0x7f6dfc0fd470 2024-09-13T02:50:48.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.216+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6de8009800 con 0x7f6dfc0fd470 2024-09-13T02:50:48.219 INFO:tasks.workunit.client.1.smithi122.stdout:0/360: truncate d1/d5/d10/d29/d32/d5f/f48 1135880 0 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.217+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de803e670 con 0x7f6dfc0fd470 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.217+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc1151b0 con 0x7f6dfc0fd470 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.218+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc0fa890 con 0x7f6dfc0fd470 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.218+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f6de8030020 con 0x7f6dfc0fd470 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.219+0000 7f6df8ff9640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 0x7f6de0070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:48.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.219+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6de80ad4d0 con 0x7f6dfc0fd470 2024-09-13T02:50:48.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.219+0000 7f6dfbfff640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 0x7f6de0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:48.221 INFO:tasks.workunit.client.1.smithi122.stdout:1/322: dwrite dc/f4a [0,4194304] 0 2024-09-13T02:50:48.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.220+0000 7f6dfbfff640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 0x7f6de0070870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009af0 tx=0x7f6dec00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:48.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.227+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6de807a670 con 0x7f6dfc0fd470 2024-09-13T02:50:48.230 INFO:tasks.workunit.client.1.smithi122.stdout:7/258: dwrite d4/d8/db/dc/d1b/f2f [0,4194304] 0 2024-09-13T02:50:48.230 INFO:tasks.workunit.client.1.smithi122.stdout:0/361: dread d1/d5/d10/d29/f36 [0,4194304] 0 2024-09-13T02:50:48.230 INFO:tasks.workunit.client.1.smithi122.stdout:7/259: readlink l2 0 2024-09-13T02:50:48.230 INFO:tasks.workunit.client.1.smithi122.stdout:7/260: dread - d4/d8/d24/d47/f55 zero size 2024-09-13T02:50:48.231 INFO:tasks.workunit.client.1.smithi122.stdout:7/261: truncate d4/d8/d24/d47/f55 233996 0 2024-09-13T02:50:48.234 INFO:tasks.workunit.client.1.smithi122.stdout:7/262: unlink d4/d8/db/dc/d36/f41 0 2024-09-13T02:50:48.244 INFO:tasks.workunit.client.1.smithi122.stdout:7/263: dread d4/fd [0,4194304] 0 2024-09-13T02:50:48.244 INFO:tasks.workunit.client.1.smithi122.stdout:7/264: chown d4/d8/d24 2 1 2024-09-13T02:50:48.250 INFO:tasks.workunit.client.1.smithi122.stdout:7/265: dread d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:48.251 INFO:tasks.workunit.client.1.smithi122.stdout:7/266: mkdir d4/d4e/d5d 0 2024-09-13T02:50:48.251 INFO:tasks.workunit.client.1.smithi122.stdout:7/267: truncate d4/d8/db/dc/d1b/f32 410538 0 2024-09-13T02:50:48.254 INFO:tasks.workunit.client.1.smithi122.stdout:1/323: dwrite dc/de/f2e [0,4194304] 0 2024-09-13T02:50:48.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/324: symlink dc/de/d13/d3f/l6f 0 2024-09-13T02:50:48.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/325: write dc/f4a [4888157,113970] 0 2024-09-13T02:50:48.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/326: fdatasync dc/f35 0 2024-09-13T02:50:48.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/327: readlink l5 0 2024-09-13T02:50:48.256 INFO:tasks.workunit.client.1.smithi122.stdout:1/328: fdatasync dc/f35 0 2024-09-13T02:50:48.257 INFO:tasks.workunit.client.1.smithi122.stdout:0/362: dwrite d1/d5/d10/d29/d32/d5f/d1d/f2c [0,4194304] 0 2024-09-13T02:50:48.257 INFO:tasks.workunit.client.1.smithi122.stdout:1/329: rmdir dc/de/d13/d3f 39 2024-09-13T02:50:48.259 INFO:tasks.workunit.client.1.smithi122.stdout:0/363: rmdir d1/d5/d10/d29/d32/d5f/d1d 39 2024-09-13T02:50:48.260 INFO:tasks.workunit.client.1.smithi122.stdout:7/268: dread d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:48.262 INFO:tasks.workunit.client.1.smithi122.stdout:7/269: creat d4/d4e/d5d/f5e x:0 0 0 2024-09-13T02:50:48.262 INFO:tasks.workunit.client.1.smithi122.stdout:7/270: creat d4/d8/db/dc/f5f x:0 0 0 2024-09-13T02:50:48.262 INFO:tasks.workunit.client.1.smithi122.stdout:7/271: readlink d4/d8/db/l45 0 2024-09-13T02:50:48.262 INFO:tasks.workunit.client.1.smithi122.stdout:7/272: truncate d4/d8/db/dc/d1b/f2f 5208798 0 2024-09-13T02:50:48.262 INFO:tasks.workunit.client.1.smithi122.stdout:1/330: dread dc/de/d18/d22/f5b [0,4194304] 0 2024-09-13T02:50:48.271 INFO:tasks.workunit.client.1.smithi122.stdout:0/364: read d1/d5/d10/d29/d32/d5f/d1d/f2c [4138230,82609] 0 2024-09-13T02:50:48.274 INFO:tasks.workunit.client.1.smithi122.stdout:7/273: dread d4/d8/d24/f3e [4194304,4194304] 0 2024-09-13T02:50:48.275 INFO:tasks.workunit.client.1.smithi122.stdout:7/274: fsync d4/d8/db/f2c 0 2024-09-13T02:50:48.275 INFO:tasks.workunit.client.1.smithi122.stdout:7/275: readlink d4/d8/db/dc/l25 0 2024-09-13T02:50:48.278 INFO:tasks.workunit.client.1.smithi122.stdout:1/331: dwrite dc/de/d18/d1d/f23 [0,4194304] 0 2024-09-13T02:50:48.283 INFO:tasks.workunit.client.1.smithi122.stdout:0/365: dread d1/d5/d10/d29/f40 [0,4194304] 0 2024-09-13T02:50:48.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/366: rmdir d1/d5/d10 39 2024-09-13T02:50:48.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/367: write d1/f38 [221064,58681] 0 2024-09-13T02:50:48.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/368: stat d1/d5/f1e 0 2024-09-13T02:50:48.287 INFO:tasks.workunit.client.1.smithi122.stdout:1/332: write f2 [3478527,37589] 0 2024-09-13T02:50:48.288 INFO:tasks.workunit.client.1.smithi122.stdout:0/369: truncate d1/d5/f1e 10445457 0 2024-09-13T02:50:48.290 INFO:tasks.workunit.client.1.smithi122.stdout:1/333: link dc/de/d18/d1d/f1f dc/de/d13/d46/f70 0 2024-09-13T02:50:48.290 INFO:tasks.workunit.client.1.smithi122.stdout:1/334: fsync dc/f32 0 2024-09-13T02:50:48.292 INFO:tasks.workunit.client.1.smithi122.stdout:7/276: dwrite d4/d8/db/dc/d46/f4f [0,4194304] 0 2024-09-13T02:50:48.292 INFO:tasks.workunit.client.1.smithi122.stdout:1/335: symlink dc/de/d18/d1d/l71 0 2024-09-13T02:50:48.293 INFO:tasks.workunit.client.1.smithi122.stdout:0/370: link d1/d5/d9/l5a d1/d5/d10/d29/d32/d5f/l77 0 2024-09-13T02:50:48.293 INFO:tasks.workunit.client.1.smithi122.stdout:0/371: stat d1/d5/d10/d29/f36 0 2024-09-13T02:50:48.296 INFO:tasks.workunit.client.1.smithi122.stdout:7/277: symlink d4/d8/d24/d47/l60 0 2024-09-13T02:50:48.296 INFO:tasks.workunit.client.1.smithi122.stdout:7/278: dread - d4/d8/d24/f53 zero size 2024-09-13T02:50:48.297 INFO:tasks.workunit.client.1.smithi122.stdout:1/336: unlink dc/de/d18/f39 0 2024-09-13T02:50:48.301 INFO:tasks.workunit.client.1.smithi122.stdout:0/372: rename d1/d5/d2d/l63 to d1/d5/d2d/l78 0 2024-09-13T02:50:48.313 INFO:tasks.workunit.client.1.smithi122.stdout:0/373: dread d1/d5/d10/d29/d32/d5f/f50 [0,4194304] 0 2024-09-13T02:50:48.331 INFO:tasks.workunit.client.1.smithi122.stdout:7/279: dwrite d4/d8/db/dc/d1b/f34 [0,4194304] 0 2024-09-13T02:50:48.331 INFO:tasks.workunit.client.1.smithi122.stdout:7/280: creat d4/d8/db/dc/f61 x:0 0 0 2024-09-13T02:50:48.331 INFO:tasks.workunit.client.1.smithi122.stdout:0/374: dwrite d1/d5/d2d/f72 [0,4194304] 0 2024-09-13T02:50:48.331 INFO:tasks.workunit.client.1.smithi122.stdout:1/337: dwrite dc/f10 [0,4194304] 0 2024-09-13T02:50:48.335 INFO:tasks.workunit.client.1.smithi122.stdout:1/338: dread dc/de/d18/f65 [0,4194304] 0 2024-09-13T02:50:48.340 INFO:tasks.workunit.client.1.smithi122.stdout:0/375: getdents d1/d5/d10/d29/d32/d5f/d1d 0 2024-09-13T02:50:48.341 INFO:tasks.workunit.client.1.smithi122.stdout:1/339: mkdir dc/de/d13/d46/d6c/d72 0 2024-09-13T02:50:48.341 INFO:tasks.workunit.client.1.smithi122.stdout:1/340: stat dc/de/d18/c29 0 2024-09-13T02:50:48.342 INFO:tasks.workunit.client.1.smithi122.stdout:0/376: rmdir d1/d5/d9/da/d17 39 2024-09-13T02:50:48.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/281: dwrite d4/f29 [0,4194304] 0 2024-09-13T02:50:48.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/282: fdatasync d4/d8/d24/f3e 0 2024-09-13T02:50:48.352 INFO:tasks.workunit.client.1.smithi122.stdout:3/438: sync 2024-09-13T02:50:48.352 INFO:tasks.workunit.client.1.smithi122.stdout:9/365: sync 2024-09-13T02:50:48.352 INFO:tasks.workunit.client.1.smithi122.stdout:3/439: read d4/d6/df/d15/f61 [87619,13242] 0 2024-09-13T02:50:48.353 INFO:tasks.workunit.client.1.smithi122.stdout:3/440: mknod d4/d6/de/d1f/ca2 0 2024-09-13T02:50:48.355 INFO:tasks.workunit.client.1.smithi122.stdout:3/441: unlink d4/d11/dd/d21/d6c/f39 0 2024-09-13T02:50:48.355 INFO:tasks.workunit.client.1.smithi122.stdout:3/442: chown d4/d11/dd/d21/d2b/d36/d3c/d9e 3299800 1 2024-09-13T02:50:48.355 INFO:tasks.workunit.client.1.smithi122.stdout:3/443: stat d4/d6/df 0 2024-09-13T02:50:48.355 INFO:tasks.workunit.client.1.smithi122.stdout:3/444: mkdir d4/d11/dd/d21/d2b/d36/d3c/d43/da3 0 2024-09-13T02:50:48.357 INFO:tasks.workunit.client.1.smithi122.stdout:3/445: rename d4/d11/dd/d21/d4e/d53/f89 to d4/d11/dd/d21/d2b/d55/fa4 0 2024-09-13T02:50:48.359 INFO:tasks.workunit.client.1.smithi122.stdout:3/446: rename d4/d6/de/d1f/f99 to d4/d6/df/d15/d68/fa5 0 2024-09-13T02:50:48.359 INFO:tasks.workunit.client.1.smithi122.stdout:7/283: dread d4/d8/d3d/f44 [0,4194304] 0 2024-09-13T02:50:48.359 INFO:tasks.workunit.client.1.smithi122.stdout:0/377: read d1/d5/d2d/f72 [3058299,84102] 0 2024-09-13T02:50:48.360 INFO:tasks.workunit.client.1.smithi122.stdout:0/378: unlink d1/f3a 0 2024-09-13T02:50:48.361 INFO:tasks.workunit.client.1.smithi122.stdout:1/341: dwrite dc/de/f27 [0,4194304] 0 2024-09-13T02:50:48.361 INFO:tasks.workunit.client.1.smithi122.stdout:1/342: creat dc/de/d18/d1d/f73 x:0 0 0 2024-09-13T02:50:48.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/379: creat d1/d5/d9/da/d17/f79 x:0 0 0 2024-09-13T02:50:48.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/380: fsync d1/d5/d9/da/f2b 0 2024-09-13T02:50:48.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/381: chown d1/d4b/d56/l66 5707 1 2024-09-13T02:50:48.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/382: write d1/d5/d9/da/d17/f2a [2822480,121832] 0 2024-09-13T02:50:48.363 INFO:tasks.workunit.client.1.smithi122.stdout:1/343: symlink dc/de/d18/d22/d1c/d47/l74 0 2024-09-13T02:50:48.364 INFO:tasks.workunit.client.1.smithi122.stdout:0/383: mknod d1/d5/d2d/c7a 0 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:1/344: unlink dc/de/d13/f69 0 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:1/345: read - dc/d38/f6a zero size 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:1/346: getdents dc/de/d13/d46/d6c/d72 0 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:1/347: creat dc/de/d18/f75 x:0 0 0 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:9/366: dread d8/f33 [0,4194304] 0 2024-09-13T02:50:48.366 INFO:tasks.workunit.client.1.smithi122.stdout:0/384: creat d1/d5/d10/f7b x:0 0 0 2024-09-13T02:50:48.367 INFO:tasks.workunit.client.1.smithi122.stdout:3/447: read d4/d11/d38/f9c [3926449,8613] 0 2024-09-13T02:50:48.367 INFO:tasks.workunit.client.1.smithi122.stdout:1/348: mkdir dc/de/d18/d22/d76 0 2024-09-13T02:50:48.368 INFO:tasks.workunit.client.1.smithi122.stdout:9/367: fsync d8/d16/d3e/f6b 0 2024-09-13T02:50:48.368 INFO:tasks.workunit.client.1.smithi122.stdout:9/368: rename d8/d16 to d8/d16/d3d/d59/d23/d1f/d36/d44/d71 22 2024-09-13T02:50:48.369 INFO:tasks.workunit.client.1.smithi122.stdout:0/385: creat d1/d4b/f7c x:0 0 0 2024-09-13T02:50:48.370 INFO:tasks.workunit.client.1.smithi122.stdout:0/386: mkdir d1/d5/d9/da/d7d 0 2024-09-13T02:50:48.370 INFO:tasks.workunit.client.1.smithi122.stdout:0/387: creat d1/d5/d10/f7e x:0 0 0 2024-09-13T02:50:48.371 INFO:tasks.workunit.client.1.smithi122.stdout:7/284: write d4/d8/d24/f3e [699972,55026] 0 2024-09-13T02:50:48.372 INFO:tasks.workunit.client.1.smithi122.stdout:3/448: dread d4/d11/f2d [0,4194304] 0 2024-09-13T02:50:48.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/388: rmdir d1/d5/d10/d29/d68 0 2024-09-13T02:50:48.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/389: fsync d1/d5/d9/f6e 0 2024-09-13T02:50:48.374 INFO:tasks.workunit.client.1.smithi122.stdout:0/390: fsync d1/d4b/d56/d60/f55 0 2024-09-13T02:50:48.380 INFO:tasks.workunit.client.1.smithi122.stdout:7/285: dread d4/d8/db/f42 [0,4194304] 0 2024-09-13T02:50:48.381 INFO:tasks.workunit.client.1.smithi122.stdout:3/449: read d4/d6/df/f7b [73885,110529] 0 2024-09-13T02:50:48.381 INFO:tasks.workunit.client.1.smithi122.stdout:3/450: chown d4/d11/dd/d21/f4d 57 1 2024-09-13T02:50:48.381 INFO:tasks.workunit.client.1.smithi122.stdout:3/451: read - d4/d6/f76 zero size 2024-09-13T02:50:48.381 INFO:tasks.workunit.client.1.smithi122.stdout:3/452: chown d4/f9d 223083 1 2024-09-13T02:50:48.382 INFO:tasks.workunit.client.1.smithi122.stdout:7/286: link d4/c51 d4/d8/db/dc/d46/c62 0 2024-09-13T02:50:48.391 INFO:tasks.workunit.client.1.smithi122.stdout:3/453: write d4/d6/f25 [784067,121524] 0 2024-09-13T02:50:48.394 INFO:tasks.workunit.client.1.smithi122.stdout:9/369: dwrite f1 [0,4194304] 0 2024-09-13T02:50:48.397 INFO:tasks.workunit.client.1.smithi122.stdout:9/370: symlink d8/d16/d45/l72 0 2024-09-13T02:50:48.406 INFO:tasks.workunit.client.1.smithi122.stdout:1/349: dwrite fa [4194304,4194304] 0 2024-09-13T02:50:48.406 INFO:tasks.workunit.client.1.smithi122.stdout:1/350: chown dc/l61 459196 1 2024-09-13T02:50:48.407 INFO:tasks.workunit.client.1.smithi122.stdout:0/391: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:50:48.414 INFO:tasks.workunit.client.1.smithi122.stdout:7/287: dwrite d4/d8/db/dc/f3b [0,4194304] 0 2024-09-13T02:50:48.418 INFO:tasks.workunit.client.1.smithi122.stdout:7/288: mkdir d4/d8/db/d63 0 2024-09-13T02:50:48.420 INFO:tasks.workunit.client.1.smithi122.stdout:0/392: dread f0 [0,4194304] 0 2024-09-13T02:50:48.420 INFO:tasks.workunit.client.1.smithi122.stdout:0/393: chown d1/c62 422 1 2024-09-13T02:50:48.420 INFO:tasks.workunit.client.1.smithi122.stdout:3/454: dwrite d4/d6/de/f34 [4194304,4194304] 0 2024-09-13T02:50:48.421 INFO:tasks.workunit.client.1.smithi122.stdout:3/455: rmdir d4/d6/de/d1f/d33 39 2024-09-13T02:50:48.424 INFO:tasks.workunit.client.1.smithi122.stdout:9/371: dwrite d8/d4a/f5c [0,4194304] 0 2024-09-13T02:50:48.425 INFO:tasks.workunit.client.1.smithi122.stdout:7/289: dread d4/f29 [0,4194304] 0 2024-09-13T02:50:48.427 INFO:tasks.workunit.client.1.smithi122.stdout:1/351: dwrite dc/de/d18/f2c [0,4194304] 0 2024-09-13T02:50:48.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/290: mknod d4/d8/db/dc/d46/d5a/c64 0 2024-09-13T02:50:48.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/291: dread - d4/d8/d24/f53 zero size 2024-09-13T02:50:48.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/292: readlink d4/d8/db/l5b 0 2024-09-13T02:50:48.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/293: truncate d4/d8/d24/f37 299886 0 2024-09-13T02:50:48.429 INFO:tasks.workunit.client.1.smithi122.stdout:1/352: truncate dc/de/d18/d1d/f4e 1205270 0 2024-09-13T02:50:48.429 INFO:tasks.workunit.client.1.smithi122.stdout:1/353: chown l7 92646 1 2024-09-13T02:50:48.431 INFO:tasks.workunit.client.1.smithi122.stdout:7/294: unlink d4/d8/db/dc/d1b/l20 0 2024-09-13T02:50:48.433 INFO:tasks.workunit.client.1.smithi122.stdout:7/295: creat d4/d8/db/f65 x:0 0 0 2024-09-13T02:50:48.433 INFO:tasks.workunit.client.1.smithi122.stdout:7/296: truncate d4/d8/db/dc/f22 1983488 0 2024-09-13T02:50:48.434 INFO:tasks.workunit.client.1.smithi122.stdout:1/354: dread dc/de/d13/d46/f70 [0,4194304] 0 2024-09-13T02:50:48.434 INFO:tasks.workunit.client.1.smithi122.stdout:1/355: dread - dc/de/d18/f30 zero size 2024-09-13T02:50:48.434 INFO:tasks.workunit.client.1.smithi122.stdout:3/456: getdents d4/d11/dd/d21/d2b/d55 0 2024-09-13T02:50:48.435 INFO:tasks.workunit.client.1.smithi122.stdout:9/372: dread d8/d16/d45/f63 [0,4194304] 0 2024-09-13T02:50:48.435 INFO:tasks.workunit.client.1.smithi122.stdout:7/297: symlink d4/d8/d3d/l66 0 2024-09-13T02:50:48.436 INFO:tasks.workunit.client.1.smithi122.stdout:7/298: read d4/d8/d24/f37 [254740,45083] 0 2024-09-13T02:50:48.436 INFO:tasks.workunit.client.1.smithi122.stdout:7/299: chown d4/d8/db/dc/c16 121638514 1 2024-09-13T02:50:48.438 INFO:tasks.workunit.client.1.smithi122.stdout:0/394: dwrite d1/d5/d9/f67 [0,4194304] 0 2024-09-13T02:50:48.438 INFO:tasks.workunit.client.1.smithi122.stdout:1/356: creat dc/de/d13/d46/f77 x:0 0 0 2024-09-13T02:50:48.442 INFO:tasks.workunit.client.1.smithi122.stdout:1/357: creat dc/de/d13/d46/d6c/f78 x:0 0 0 2024-09-13T02:50:48.444 INFO:tasks.workunit.client.1.smithi122.stdout:1/358: rename dc/f4a to dc/d38/d51/f79 0 2024-09-13T02:50:48.444 INFO:tasks.workunit.client.1.smithi122.stdout:1/359: fsync dc/de/f27 0 2024-09-13T02:50:48.444 INFO:tasks.workunit.client.1.smithi122.stdout:1/360: chown dc/f10 683405041 1 2024-09-13T02:50:48.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/361: mkdir dc/de/d7a 0 2024-09-13T02:50:48.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/362: read - dc/de/d18/d1d/d2f/f4b zero size 2024-09-13T02:50:48.447 INFO:tasks.workunit.client.1.smithi122.stdout:9/373: dread d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:48.448 INFO:tasks.workunit.client.1.smithi122.stdout:1/363: rename dc/d38/d51/c58 to dc/de/d18/d22/c7b 0 2024-09-13T02:50:48.456 INFO:tasks.workunit.client.1.smithi122.stdout:9/374: truncate f1 2079692 0 2024-09-13T02:50:48.457 INFO:tasks.workunit.client.1.smithi122.stdout:9/375: rmdir d8/d16/d3d/d59/d49 39 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:8/233: sync 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:4/402: sync 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:6/494: sync 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:2/258: sync 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:5/341: sync 2024-09-13T02:50:48.458 INFO:tasks.workunit.client.1.smithi122.stdout:2/259: chown d0/d1e/d22/f37 0 1 2024-09-13T02:50:48.459 INFO:tasks.workunit.client.1.smithi122.stdout:0/395: dwrite d1/d5/f1e [8388608,4194304] 0 2024-09-13T02:50:48.461 INFO:tasks.workunit.client.1.smithi122.stdout:6/495: rename d5/d11/d45/d21/d8b to d5/d3d/d6c/d41/d5b/d97 0 2024-09-13T02:50:48.462 INFO:tasks.workunit.client.1.smithi122.stdout:8/234: mknod d3/d31/c3d 0 2024-09-13T02:50:48.463 INFO:tasks.workunit.client.1.smithi122.stdout:2/260: mkdir d0/d1c/d3b/d41/d4e 0 2024-09-13T02:50:48.465 INFO:tasks.workunit.client.1.smithi122.stdout:5/342: unlink d0/d17/f22 0 2024-09-13T02:50:48.465 INFO:tasks.workunit.client.1.smithi122.stdout:0/396: stat d1/d5/d9/l5a 0 2024-09-13T02:50:48.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/403: getdents d11 0 2024-09-13T02:50:48.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/404: fsync d11/d13/d82/d2a/d40/f51 0 2024-09-13T02:50:48.468 INFO:tasks.workunit.client.1.smithi122.stdout:4/405: readlink d11/d1b/l64 0 2024-09-13T02:50:48.468 INFO:tasks.workunit.client.1.smithi122.stdout:4/406: stat d11/d13/d82/d2a 0 2024-09-13T02:50:48.468 INFO:tasks.workunit.client.1.smithi122.stdout:4/407: write d11/d13/d82/d2a/f2b [1038148,71793] 0 2024-09-13T02:50:48.471 INFO:tasks.workunit.client.1.smithi122.stdout:8/235: rmdir d3/da/d1f/d20/d34 39 2024-09-13T02:50:48.471 INFO:tasks.workunit.client.1.smithi122.stdout:6/496: symlink d5/d11/d45/d21/d8a/l98 0 2024-09-13T02:50:48.471 INFO:tasks.workunit.client.1.smithi122.stdout:8/236: write d3/f35 [1156649,101209] 0 2024-09-13T02:50:48.472 INFO:tasks.workunit.client.1.smithi122.stdout:1/364: dwrite dc/de/d18/d1d/d2f/f4b [0,4194304] 0 2024-09-13T02:50:48.472 INFO:tasks.workunit.client.1.smithi122.stdout:1/365: fsync dc/de/d18/f30 0 2024-09-13T02:50:48.472 INFO:tasks.workunit.client.1.smithi122.stdout:2/261: mkdir d0/d1e/d26/d3d/d4f 0 2024-09-13T02:50:48.475 INFO:tasks.workunit.client.1.smithi122.stdout:8/237: mkdir d3/da/d1f/d25/d3e 0 2024-09-13T02:50:48.476 INFO:tasks.workunit.client.1.smithi122.stdout:8/238: read d3/da/d1f/f1a [557485,110516] 0 2024-09-13T02:50:48.477 INFO:tasks.workunit.client.1.smithi122.stdout:1/366: symlink dc/d38/d51/l7c 0 2024-09-13T02:50:48.479 INFO:tasks.workunit.client.1.smithi122.stdout:2/262: link d0/d1e/ce d0/d1e/d26/c50 0 2024-09-13T02:50:48.481 INFO:tasks.workunit.client.1.smithi122.stdout:0/397: symlink d1/d5/d10/d29/d32/d5f/l7f 0 2024-09-13T02:50:48.481 INFO:tasks.workunit.client.1.smithi122.stdout:0/398: write d1/d5/d10/d29/d32/d5f/f6c [952010,61801] 0 2024-09-13T02:50:48.482 INFO:tasks.workunit.client.1.smithi122.stdout:8/239: mknod d3/da/d1f/d25/d3e/c3f 0 2024-09-13T02:50:48.484 INFO:tasks.workunit.client.1.smithi122.stdout:0/399: mkdir d1/d5/d2d/d80 0 2024-09-13T02:50:48.493 INFO:tasks.workunit.client.1.smithi122.stdout:1/367: read fa [8127352,107026] 0 2024-09-13T02:50:48.495 INFO:tasks.workunit.client.1.smithi122.stdout:7/300: dread d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:48.497 INFO:tasks.workunit.client.1.smithi122.stdout:7/301: creat d4/d8/db/dc/d46/d5a/f67 x:0 0 0 2024-09-13T02:50:48.497 INFO:tasks.workunit.client.1.smithi122.stdout:7/302: fdatasync d4/d8/db/dc/f61 0 2024-09-13T02:50:48.499 INFO:tasks.workunit.client.1.smithi122.stdout:7/303: mknod d4/d8/db/dc/d46/c68 0 2024-09-13T02:50:48.501 INFO:tasks.workunit.client.1.smithi122.stdout:9/376: dwrite d8/d16/d3d/d59/f4e [0,4194304] 0 2024-09-13T02:50:48.504 INFO:tasks.workunit.client.1.smithi122.stdout:9/377: mknod d8/d16/d3d/d59/d5a/c73 0 2024-09-13T02:50:48.504 INFO:tasks.workunit.client.1.smithi122.stdout:9/378: write d8/f2e [4258412,129104] 0 2024-09-13T02:50:48.505 INFO:tasks.workunit.client.1.smithi122.stdout:8/240: dread d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:48.506 INFO:tasks.workunit.client.1.smithi122.stdout:8/241: write d3/da/d1f/d20/f2c [543319,7401] 0 2024-09-13T02:50:48.508 INFO:tasks.workunit.client.1.smithi122.stdout:8/242: rename d3/f35 to d3/d31/f40 0 2024-09-13T02:50:48.508 INFO:tasks.workunit.client.1.smithi122.stdout:8/243: write d3/da/d1f/d20/d21/f2f [2451751,73564] 0 2024-09-13T02:50:48.508 INFO:tasks.workunit.client.1.smithi122.stdout:8/244: write f2 [5966640,53405] 0 2024-09-13T02:50:48.518 INFO:tasks.workunit.client.1.smithi122.stdout:4/408: dwrite d11/d1b/d2e/f7f [4194304,4194304] 0 2024-09-13T02:50:48.518 INFO:tasks.workunit.client.1.smithi122.stdout:0/400: dwrite d1/d5/d10/d29/d32/d5f/d1d/f2c [0,4194304] 0 2024-09-13T02:50:48.519 INFO:tasks.workunit.client.1.smithi122.stdout:6/497: dwrite d5/d11/d45/df/d46/f8f [0,4194304] 0 2024-09-13T02:50:48.519 INFO:tasks.workunit.client.1.smithi122.stdout:6/498: write d5/d3d/d6c/d41/d4e/f88 [365231,67499] 0 2024-09-13T02:50:48.519 INFO:tasks.workunit.client.1.smithi122.stdout:1/368: dwrite dc/f44 [0,4194304] 0 2024-09-13T02:50:48.520 INFO:tasks.workunit.client.1.smithi122.stdout:1/369: getdents dc/de/d7a 0 2024-09-13T02:50:48.520 INFO:tasks.workunit.client.1.smithi122.stdout:4/409: mkdir d11/d13/d82/d2a/d83 0 2024-09-13T02:50:48.520 INFO:tasks.workunit.client.1.smithi122.stdout:4/410: creat d11/d3d/f84 x:0 0 0 2024-09-13T02:50:48.521 INFO:tasks.workunit.client.1.smithi122.stdout:0/401: mkdir d1/d4b/d56/d81 0 2024-09-13T02:50:48.521 INFO:tasks.workunit.client.1.smithi122.stdout:9/379: dread d8/d16/f62 [0,4194304] 0 2024-09-13T02:50:48.521 INFO:tasks.workunit.client.1.smithi122.stdout:5/343: dwrite d0/f5a [0,4194304] 0 2024-09-13T02:50:48.524 INFO:tasks.workunit.client.1.smithi122.stdout:2/263: dwrite d0/d1c/d3b/d41/f3f [0,4194304] 0 2024-09-13T02:50:48.526 INFO:tasks.workunit.client.1.smithi122.stdout:8/245: dwrite d3/da/d1f/f37 [0,4194304] 0 2024-09-13T02:50:48.527 INFO:tasks.workunit.client.1.smithi122.stdout:4/411: symlink d11/d1b/l85 0 2024-09-13T02:50:48.530 INFO:tasks.workunit.client.1.smithi122.stdout:0/402: mknod d1/d5/d2d/d80/c82 0 2024-09-13T02:50:48.532 INFO:tasks.workunit.client.1.smithi122.stdout:9/380: link d8/d16/d3d/d59/d49/c4f d8/d16/d3d/d59/d23/d1f/d36/d44/d65/c74 0 2024-09-13T02:50:48.532 INFO:tasks.workunit.client.1.smithi122.stdout:9/381: fdatasync d8/d16/d3d/d59/d23/d1f/f2d 0 2024-09-13T02:50:48.533 INFO:tasks.workunit.client.1.smithi122.stdout:5/344: mknod d0/d17/d36/c69 0 2024-09-13T02:50:48.534 INFO:tasks.workunit.client.1.smithi122.stdout:5/345: chown d0/d17/d36/d25/l57 16184046 1 2024-09-13T02:50:48.534 INFO:tasks.workunit.client.1.smithi122.stdout:1/370: dread dc/de/f2e [0,4194304] 0 2024-09-13T02:50:48.541 INFO:tasks.workunit.client.1.smithi122.stdout:0/403: rmdir d1/d5/d10/d29/d32/d5f 39 2024-09-13T02:50:48.543 INFO:tasks.workunit.client.1.smithi122.stdout:1/371: mkdir dc/de/d13/d46/d6c/d7d 0 2024-09-13T02:50:48.544 INFO:tasks.workunit.client.1.smithi122.stdout:2/264: dwrite d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:48.544 INFO:tasks.workunit.client.1.smithi122.stdout:1/372: symlink dc/de/d18/d1d/l7e 0 2024-09-13T02:50:48.549 INFO:tasks.workunit.client.1.smithi122.stdout:2/265: creat d0/f51 x:0 0 0 2024-09-13T02:50:48.549 INFO:tasks.workunit.client.1.smithi122.stdout:2/266: stat d0/d1e/d22/d39/f49 0 2024-09-13T02:50:48.554 INFO:tasks.workunit.client.1.smithi122.stdout:9/382: dread d8/d16/d3d/d59/d23/d1f/d36/d44/f68 [0,4194304] 0 2024-09-13T02:50:48.554 INFO:tasks.workunit.client.1.smithi122.stdout:9/383: creat d8/d16/d3e/f75 x:0 0 0 2024-09-13T02:50:48.556 INFO:tasks.workunit.client.1.smithi122.stdout:1/373: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:48.558 INFO:tasks.workunit.client.1.smithi122.stdout:1/374: truncate dc/de/f11 101669 0 2024-09-13T02:50:48.559 INFO:tasks.workunit.client.1.smithi122.stdout:2/267: write d0/f1b [1458588,96038] 0 2024-09-13T02:50:48.559 INFO:tasks.workunit.client.1.smithi122.stdout:2/268: truncate d0/f51 419402 0 2024-09-13T02:50:48.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/269: truncate d0/f5 9104060 0 2024-09-13T02:50:48.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/270: chown d0/d1e/d2e/l36 0 1 2024-09-13T02:50:48.564 INFO:tasks.workunit.client.1.smithi122.stdout:0/404: dread d1/d5/d9/f20 [0,4194304] 0 2024-09-13T02:50:48.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/405: stat d1/d5/d9/da/d17/f1b 0 2024-09-13T02:50:48.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/406: truncate d1/d5/d9/da/d17/f79 25081 0 2024-09-13T02:50:48.566 INFO:tasks.workunit.client.1.smithi122.stdout:0/407: chown d1/d5/d9/da/d17/f22 2995282 1 2024-09-13T02:50:48.566 INFO:tasks.workunit.client.1.smithi122.stdout:8/246: dwrite d3/da/d1f/d20/d21/f33 [0,4194304] 0 2024-09-13T02:50:48.568 INFO:tasks.workunit.client.1.smithi122.stdout:4/412: dwrite d11/d13/f1f [0,4194304] 0 2024-09-13T02:50:48.571 INFO:tasks.workunit.client.1.smithi122.stdout:6/499: dwrite d5/d3d/d6c/d41/d4e/f88 [0,4194304] 0 2024-09-13T02:50:48.576 INFO:tasks.workunit.client.1.smithi122.stdout:5/346: dwrite d0/da/d48/f45 [0,4194304] 0 2024-09-13T02:50:48.577 INFO:tasks.workunit.client.1.smithi122.stdout:5/347: getdents d0/d17/d36 0 2024-09-13T02:50:48.577 INFO:tasks.workunit.client.1.smithi122.stdout:6/500: dread d5/d3d/d48/f6b [0,4194304] 0 2024-09-13T02:50:48.581 INFO:tasks.workunit.client.1.smithi122.stdout:4/413: dread d11/d13/d82/f16 [0,4194304] 0 2024-09-13T02:50:48.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.589+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6dfc10b530 con 0x7f6dfc0fd470 2024-09-13T02:50:48.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.590+0000 7f6df8ff9640 1 -- 172.21.15.100:0/3784590844 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6de807a010 con 0x7f6dfc0fd470 2024-09-13T02:50:48.591 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:50:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 msgr2=0x7f6de0070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 0x7f6de0070870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009af0 tx=0x7f6dec00b040 comp rx=0 tx=0).stop 2024-09-13T02:50:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 msgr2=0x7f6dfc113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6de80048a0 tx=0x7f6de8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 shutdown_connections 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:6800/3121511218,v1:172.21.15.100:6801/3121511218] conn(0x7f6de006e3c0 0x7f6de0070870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6dfc0fd470 0x7f6dfc113bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 --2- 172.21.15.100:0/3784590844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc065c40 0x7f6dfc1136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 >> 172.21.15.100:0/3784590844 conn(0x7f6dfc0f6c10 msgr2=0x7f6dfc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 shutdown_connections 2024-09-13T02:50:48.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:50:48.593+0000 7f6e025ce640 1 -- 172.21.15.100:0/3784590844 wait complete. 2024-09-13T02:50:48.598 INFO:tasks.workunit.client.1.smithi122.stdout:4/414: write d11/d13/f1f [5223036,6530] 0 2024-09-13T02:50:48.600 INFO:tasks.workunit.client.1.smithi122.stdout:4/415: mknod d11/d13/c86 0 2024-09-13T02:50:48.600 INFO:tasks.workunit.client.1.smithi122.stdout:4/416: stat d11/d13/d82/d2a/d40/c4c 0 2024-09-13T02:50:48.600 INFO:tasks.workunit.client.1.smithi122.stdout:9/384: dwrite f1 [0,4194304] 0 2024-09-13T02:50:48.601 INFO:tasks.workunit.client.1.smithi122.stdout:1/375: dwrite fa [4194304,4194304] 0 2024-09-13T02:50:48.601 INFO:tasks.workunit.client.1.smithi122.stdout:0/408: dwrite d1/d5/d2d/f4e [0,4194304] 0 2024-09-13T02:50:48.601 INFO:tasks.workunit.client.1.smithi122.stdout:2/271: dwrite d0/f51 [0,4194304] 0 2024-09-13T02:50:48.602 INFO:tasks.workunit.client.1.smithi122.stdout:0/409: chown d1/d4b/f7c 41010 1 2024-09-13T02:50:48.602 INFO:tasks.workunit.client.1.smithi122.stdout:0/410: fsync d1/d5/d9/da/d17/f79 0 2024-09-13T02:50:48.602 INFO:tasks.workunit.client.1.smithi122.stdout:8/247: dwrite d3/f17 [0,4194304] 0 2024-09-13T02:50:48.602 INFO:tasks.workunit.client.1.smithi122.stdout:4/417: unlink d11/d13/d82/c60 0 2024-09-13T02:50:48.602 INFO:tasks.workunit.client.1.smithi122.stdout:4/418: dread - d11/f43 zero size 2024-09-13T02:50:48.608 INFO:tasks.workunit.client.1.smithi122.stdout:6/501: dwrite d5/d3d/d6c/d41/d4e/d5f/f79 [0,4194304] 0 2024-09-13T02:50:48.614 INFO:tasks.workunit.client.1.smithi122.stdout:2/272: write d0/d1e/d26/f43 [1811634,32367] 0 2024-09-13T02:50:48.615 INFO:tasks.workunit.client.1.smithi122.stdout:0/411: mkdir d1/d5/d10/d29/d32/d83 0 2024-09-13T02:50:48.619 INFO:tasks.workunit.client.1.smithi122.stdout:8/248: rename d3/f17 to d3/da/d1f/d20/f41 0 2024-09-13T02:50:48.619 INFO:tasks.workunit.client.1.smithi122.stdout:8/249: chown d3/da/d1f/f27 1079073523 1 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:0/412: write d1/d5/d9/f20 [907011,91902] 0 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:0/413: chown d1/d4b/d56/d60/f55 1 1 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:4/419: mkdir d11/d1b/d32/d87 0 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:4/420: dread - d11/d1b/d2e/d55/f6a zero size 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:1/376: write dc/d38/d51/f79 [2086644,123482] 0 2024-09-13T02:50:48.620 INFO:tasks.workunit.client.1.smithi122.stdout:1/377: chown dc/de/d13/d46/d6c 36060 1 2024-09-13T02:50:48.621 INFO:tasks.workunit.client.1.smithi122.stdout:9/385: getdents d8/d16/d3e 0 2024-09-13T02:50:48.621 INFO:tasks.workunit.client.1.smithi122.stdout:9/386: chown d8/d16/d3d/d59/d5a/l6d 1 1 2024-09-13T02:50:48.621 INFO:tasks.workunit.client.1.smithi122.stdout:9/387: readlink d8/d16/d3e/l6c 0 2024-09-13T02:50:48.623 INFO:tasks.workunit.client.1.smithi122.stdout:6/502: rename d5/d3d/d48/l5e to d5/d3d/d6c/l99 0 2024-09-13T02:50:48.623 INFO:tasks.workunit.client.1.smithi122.stdout:6/503: fsync d5/d11/d2f/f74 0 2024-09-13T02:50:48.624 INFO:tasks.workunit.client.1.smithi122.stdout:6/504: readlink d5/d3d/l94 0 2024-09-13T02:50:48.625 INFO:tasks.workunit.client.1.smithi122.stdout:2/273: dread d0/d1e/ff [0,4194304] 0 2024-09-13T02:50:48.625 INFO:tasks.workunit.client.1.smithi122.stdout:2/274: dread - d0/d1c/f31 zero size 2024-09-13T02:50:48.625 INFO:tasks.workunit.client.1.smithi122.stdout:8/250: mknod d3/da/d1f/d20/d21/c42 0 2024-09-13T02:50:48.625 INFO:tasks.workunit.client.1.smithi122.stdout:8/251: write d3/da/d1f/d25/f39 [1922403,28647] 0 2024-09-13T02:50:48.626 INFO:tasks.workunit.client.1.smithi122.stdout:0/414: mkdir d1/d5/d9/da/d7d/d84 0 2024-09-13T02:50:48.626 INFO:tasks.workunit.client.1.smithi122.stdout:0/415: readlink d1/d4b/d56/d60/l64 0 2024-09-13T02:50:48.626 INFO:tasks.workunit.client.1.smithi122.stdout:0/416: fdatasync d1/d5/d10/d29/d32/d5f/f6c 0 2024-09-13T02:50:48.626 INFO:tasks.workunit.client.1.smithi122.stdout:0/417: readlink d1/d4b/l4d 0 2024-09-13T02:50:48.627 INFO:tasks.workunit.client.1.smithi122.stdout:4/421: mknod d11/d3d/c88 0 2024-09-13T02:50:48.627 INFO:tasks.workunit.client.1.smithi122.stdout:4/422: readlink d11/d13/d82/d2a/l44 0 2024-09-13T02:50:48.628 INFO:tasks.workunit.client.1.smithi122.stdout:1/378: link dc/de/d18/d1d/f1f dc/de/d13/d3f/f7f 0 2024-09-13T02:50:48.630 INFO:tasks.workunit.client.1.smithi122.stdout:9/388: rename d8/d16/d3d/d59/d23/f32 to d8/d16/d3d/d59/d29/f76 0 2024-09-13T02:50:48.632 INFO:tasks.workunit.client.1.smithi122.stdout:6/505: mkdir d5/d3d/d6c/d41/d5b/d7a/d9a 0 2024-09-13T02:50:48.633 INFO:tasks.workunit.client.1.smithi122.stdout:0/418: unlink d1/d5/l58 0 2024-09-13T02:50:48.634 INFO:tasks.workunit.client.1.smithi122.stdout:8/252: write d3/da/f30 [3970937,44133] 0 2024-09-13T02:50:48.637 INFO:tasks.workunit.client.1.smithi122.stdout:4/423: creat d11/d62/f89 x:0 0 0 2024-09-13T02:50:48.637 INFO:tasks.workunit.client.1.smithi122.stdout:2/275: rename d0/d1e/ce to d0/d1c/d3b/d41/d4e/c52 0 2024-09-13T02:50:48.638 INFO:tasks.workunit.client.1.smithi122.stdout:4/424: chown d11/d13/d82/f25 81531748 1 2024-09-13T02:50:48.638 INFO:tasks.workunit.client.1.smithi122.stdout:4/425: chown d11/d1b/c5c 70876 1 2024-09-13T02:50:48.638 INFO:tasks.workunit.client.1.smithi122.stdout:1/379: write dc/f10 [3965248,16339] 0 2024-09-13T02:50:48.638 INFO:tasks.workunit.client.1.smithi122.stdout:1/380: truncate dc/de/d18/d22/d1c/d47/f4d 233003 0 2024-09-13T02:50:48.638 INFO:tasks.workunit.client.1.smithi122.stdout:9/389: link d8/d16/d3d/d59/d23/c67 d8/d16/d3e/c77 0 2024-09-13T02:50:48.640 INFO:tasks.workunit.client.1.smithi122.stdout:6/506: mknod d5/d11/d45/d21/c9b 0 2024-09-13T02:50:48.645 INFO:tasks.workunit.client.1.smithi122.stdout:8/253: rename d3/l15 to d3/da/d1f/d25/l43 0 2024-09-13T02:50:48.645 INFO:tasks.workunit.client.1.smithi122.stdout:9/390: write d8/d16/d45/f63 [2632069,116744] 0 2024-09-13T02:50:48.646 INFO:tasks.workunit.client.1.smithi122.stdout:1/381: mkdir dc/de/d18/d22/d80 0 2024-09-13T02:50:48.646 INFO:tasks.workunit.client.1.smithi122.stdout:6/507: getdents d5/d3d/d6c/d41/d5b 0 2024-09-13T02:50:48.647 INFO:tasks.workunit.client.1.smithi122.stdout:4/426: dread d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:48.647 INFO:tasks.workunit.client.1.smithi122.stdout:8/254: rmdir d3/da/d1f/d25 39 2024-09-13T02:50:48.648 INFO:tasks.workunit.client.1.smithi122.stdout:9/391: creat d8/d16/d3d/d59/d5a/f78 x:0 0 0 2024-09-13T02:50:48.649 INFO:tasks.workunit.client.1.smithi122.stdout:1/382: truncate dc/de/d18/d1d/d2f/f4b 548466 0 2024-09-13T02:50:48.649 INFO:tasks.workunit.client.1.smithi122.stdout:1/383: read dc/d38/d51/f79 [2580214,88153] 0 2024-09-13T02:50:48.652 INFO:tasks.workunit.client.1.smithi122.stdout:6/508: rename d5/d40/l37 to d5/db/d29/l9c 0 2024-09-13T02:50:48.652 INFO:tasks.workunit.client.1.smithi122.stdout:4/427: creat d11/d30/d59/d6e/f8a x:0 0 0 2024-09-13T02:50:48.652 INFO:tasks.workunit.client.1.smithi122.stdout:8/255: rename d3/da/d1f/d20/f2c to d3/da/d1f/d20/f44 0 2024-09-13T02:50:48.653 INFO:tasks.workunit.client.1.smithi122.stdout:2/276: dwrite d0/f10 [4194304,4194304] 0 2024-09-13T02:50:48.654 INFO:tasks.workunit.client.1.smithi122.stdout:9/392: rename d8/d16/d3d/d59/d5a/l6d to d8/d4a/d64/l79 0 2024-09-13T02:50:48.654 INFO:tasks.workunit.client.1.smithi122.stdout:4/428: creat d11/d30/f8b x:0 0 0 2024-09-13T02:50:48.656 INFO:tasks.workunit.client.1.smithi122.stdout:8/256: creat d3/da/d1f/d20/f45 x:0 0 0 2024-09-13T02:50:48.656 INFO:tasks.workunit.client.1.smithi122.stdout:8/257: fsync d3/da/d1f/f11 0 2024-09-13T02:50:48.656 INFO:tasks.workunit.client.1.smithi122.stdout:8/258: write d3/da/d1f/f27 [2562680,20064] 0 2024-09-13T02:50:48.658 INFO:tasks.workunit.client.1.smithi122.stdout:9/393: link d8/d16/d3d/d59/d23/f66 d8/d16/d3d/d59/d49/f7a 0 2024-09-13T02:50:48.660 INFO:tasks.workunit.client.1.smithi122.stdout:4/429: rmdir d11/d13/d72 0 2024-09-13T02:50:48.660 INFO:tasks.workunit.client.1.smithi122.stdout:4/430: getdents d11 0 2024-09-13T02:50:48.663 INFO:tasks.workunit.client.1.smithi122.stdout:8/259: creat d3/da/d1f/d25/d3e/f46 x:0 0 0 2024-09-13T02:50:48.666 INFO:tasks.workunit.client.1.smithi122.stdout:2/277: write d0/f2c [747165,93257] 0 2024-09-13T02:50:48.668 INFO:tasks.workunit.client.1.smithi122.stdout:1/384: dwrite dc/de/d18/d1d/f52 [0,4194304] 0 2024-09-13T02:50:48.670 INFO:tasks.workunit.client.1.smithi122.stdout:2/278: rename d0/d1e/d26/d3d/d4f to d0/d53 0 2024-09-13T02:50:48.670 INFO:tasks.workunit.client.1.smithi122.stdout:2/279: dread - d0/d1e/d22/f37 zero size 2024-09-13T02:50:48.670 INFO:tasks.workunit.client.1.smithi122.stdout:2/280: chown d0/d1e/d22/d29 341 1 2024-09-13T02:50:48.672 INFO:tasks.workunit.client.1.smithi122.stdout:8/260: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:48.672 INFO:tasks.workunit.client.1.smithi122.stdout:8/261: truncate f2 6814088 0 2024-09-13T02:50:48.675 INFO:tasks.workunit.client.1.smithi122.stdout:8/262: creat d3/da/d1e/f47 x:0 0 0 2024-09-13T02:50:48.677 INFO:tasks.workunit.client.1.smithi122.stdout:8/263: creat d3/da/d1f/d20/d34/f48 x:0 0 0 2024-09-13T02:50:48.677 INFO:tasks.workunit.client.1.smithi122.stdout:8/264: creat d3/da/d1f/d20/d34/f49 x:0 0 0 2024-09-13T02:50:48.679 INFO:tasks.workunit.client.1.smithi122.stdout:8/265: mknod d3/c4a 0 2024-09-13T02:50:48.682 INFO:tasks.workunit.client.1.smithi122.stdout:6/509: rmdir d5/db/d29 39 2024-09-13T02:50:48.682 INFO:tasks.workunit.client.1.smithi122.stdout:6/510: rename d5/d3d to d5/d3d/d6c/d41/d5b/d7a/d9a/d9d 22 2024-09-13T02:50:48.684 INFO:tasks.workunit.client.1.smithi122.stdout:6/511: rename d5/d40/d8e to d5/d3d/d6c/d41/d5b/d9e 0 2024-09-13T02:50:48.684 INFO:tasks.workunit.client.1.smithi122.stdout:6/512: readlink d5/l4c 0 2024-09-13T02:50:48.685 INFO:tasks.workunit.client.1.smithi122.stdout:9/394: rmdir d8/d4a 39 2024-09-13T02:50:48.685 INFO:tasks.workunit.client.1.smithi122.stdout:6/513: mknod d5/d3d/c9f 0 2024-09-13T02:50:48.686 INFO:tasks.workunit.client.1.smithi122.stdout:6/514: creat d5/d40/fa0 x:0 0 0 2024-09-13T02:50:48.690 INFO:tasks.workunit.client.1.smithi122.stdout:4/431: dwrite d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:48.690 INFO:tasks.workunit.client.1.smithi122.stdout:4/432: chown d11/f47 2 1 2024-09-13T02:50:48.690 INFO:tasks.workunit.client.1.smithi122.stdout:4/433: chown f3 1 1 2024-09-13T02:50:48.692 INFO:tasks.workunit.client.1.smithi122.stdout:4/434: symlink d11/d13/d82/d2a/d78/l8c 0 2024-09-13T02:50:48.700 INFO:tasks.workunit.client.1.smithi122.stdout:1/385: dwrite dc/f32 [4194304,4194304] 0 2024-09-13T02:50:48.707 INFO:tasks.workunit.client.1.smithi122.stdout:8/266: dread d3/da/f30 [0,4194304] 0 2024-09-13T02:50:48.708 INFO:tasks.workunit.client.1.smithi122.stdout:8/267: creat d3/da/d1f/d20/d21/f4b x:0 0 0 2024-09-13T02:50:48.710 INFO:tasks.workunit.client.1.smithi122.stdout:2/281: dwrite d0/d1e/d22/f32 [0,4194304] 0 2024-09-13T02:50:48.710 INFO:tasks.workunit.client.1.smithi122.stdout:1/386: write dc/de/d18/f2c [853753,6540] 0 2024-09-13T02:50:48.711 INFO:tasks.workunit.client.1.smithi122.stdout:2/282: link d0/d1e/d2e/d3e/f46 d0/d1e/d2e/f54 0 2024-09-13T02:50:48.712 INFO:tasks.workunit.client.1.smithi122.stdout:1/387: truncate dc/de/d18/d1d/d2f/f4b 313523 0 2024-09-13T02:50:48.712 INFO:tasks.workunit.client.1.smithi122.stdout:2/283: mkdir d0/d55 0 2024-09-13T02:50:48.713 INFO:tasks.workunit.client.1.smithi122.stdout:6/515: dwrite d5/db/f44 [4194304,4194304] 0 2024-09-13T02:50:48.713 INFO:tasks.workunit.client.1.smithi122.stdout:4/435: dwrite d11/d13/d82/d2a/d40/f6d [0,4194304] 0 2024-09-13T02:50:48.713 INFO:tasks.workunit.client.1.smithi122.stdout:4/436: truncate d11/f80 674194 0 2024-09-13T02:50:48.714 INFO:tasks.workunit.client.1.smithi122.stdout:2/284: creat d0/d1e/d26/d3d/f56 x:0 0 0 2024-09-13T02:50:48.715 INFO:tasks.workunit.client.1.smithi122.stdout:4/437: rmdir d11/d13 39 2024-09-13T02:50:48.719 INFO:tasks.workunit.client.1.smithi122.stdout:8/268: rmdir d3/da/d1f/d20 39 2024-09-13T02:50:48.719 INFO:tasks.workunit.client.1.smithi122.stdout:8/269: chown d3/da/d1f/d25/d3e/c3f 2 1 2024-09-13T02:50:48.719 INFO:tasks.workunit.client.1.smithi122.stdout:8/270: fdatasync d3/da/d1f/f19 0 2024-09-13T02:50:48.730 INFO:tasks.workunit.client.1.smithi122.stdout:1/388: read dc/de/d18/d1d/f52 [568953,120936] 0 2024-09-13T02:50:48.730 INFO:tasks.workunit.client.1.smithi122.stdout:1/389: creat dc/de/d13/d46/f81 x:0 0 0 2024-09-13T02:50:48.730 INFO:tasks.workunit.client.1.smithi122.stdout:9/395: dwrite d8/d16/d3d/d59/d29/f76 [0,4194304] 0 2024-09-13T02:50:48.732 INFO:tasks.workunit.client.1.smithi122.stdout:2/285: write d0/d1c/f1d [2443641,13477] 0 2024-09-13T02:50:48.741 INFO:tasks.workunit.client.1.smithi122.stdout:6/516: dwrite d5/d11/d45/df/d46/f5d [4194304,4194304] 0 2024-09-13T02:50:48.743 INFO:tasks.workunit.client.1.smithi122.stdout:4/438: dwrite d11/d13/f68 [0,4194304] 0 2024-09-13T02:50:48.743 INFO:tasks.workunit.client.1.smithi122.stdout:4/439: chown d11/d13/f1f 14 1 2024-09-13T02:50:48.743 INFO:tasks.workunit.client.1.smithi122.stdout:4/440: chown d11/d13/d82/d2a/f2b 55295283 1 2024-09-13T02:50:48.743 INFO:tasks.workunit.client.1.smithi122.stdout:8/271: dwrite d3/da/d1f/d20/d21/f26 [0,4194304] 0 2024-09-13T02:50:48.753 INFO:tasks.workunit.client.1.smithi122.stdout:8/272: write d3/da/d1f/d20/d21/f26 [3677709,128536] 0 2024-09-13T02:50:48.768 INFO:tasks.workunit.client.1.smithi122.stdout:8/273: dwrite d3/da/d1f/d25/f39 [0,4194304] 0 2024-09-13T02:50:48.786 INFO:tasks.workunit.client.1.smithi122.stdout:8/274: dwrite d3/da/d1f/f19 [4194304,4194304] 0 2024-09-13T02:50:48.786 INFO:tasks.workunit.client.1.smithi122.stdout:8/275: chown d3/da/d1f/d20/d34/f48 58085169 1 2024-09-13T02:50:48.786 INFO:tasks.workunit.client.1.smithi122.stdout:8/276: truncate d3/d31/f3b 4753240 0 2024-09-13T02:50:48.786 INFO:tasks.workunit.client.1.smithi122.stdout:8/277: readlink d3/da/d1f/d25/l43 0 2024-09-13T02:50:48.835 INFO:tasks.workunit.client.1.smithi122.stdout:1/390: creat dc/de/d7a/f82 x:0 0 0 2024-09-13T02:50:48.836 INFO:tasks.workunit.client.1.smithi122.stdout:9/396: mkdir d8/d16/d3d/d59/d23/d7b 0 2024-09-13T02:50:48.836 INFO:tasks.workunit.client.1.smithi122.stdout:1/391: chown dc/de/f27 8084809 1 2024-09-13T02:50:48.837 INFO:tasks.workunit.client.1.smithi122.stdout:2/286: link d0/d1c/f1d d0/d1e/d22/d39/f57 0 2024-09-13T02:50:48.839 INFO:tasks.workunit.client.1.smithi122.stdout:6/517: symlink d5/d11/d3a/la1 0 2024-09-13T02:50:48.839 INFO:tasks.workunit.client.1.smithi122.stdout:6/518: readlink d5/d11/d45/df/l71 0 2024-09-13T02:50:48.839 INFO:tasks.workunit.client.1.smithi122.stdout:6/519: read - d5/d11/d45/d21/f87 zero size 2024-09-13T02:50:48.839 INFO:tasks.workunit.client.1.smithi122.stdout:6/520: chown d5/f8 3 1 2024-09-13T02:50:48.840 INFO:tasks.workunit.client.1.smithi122.stdout:4/441: rename d11/d13/d82/d2a/d78/l8c to d11/d13/d82/d2a/l8d 0 2024-09-13T02:50:48.841 INFO:tasks.workunit.client.1.smithi122.stdout:4/442: stat d11/f56 0 2024-09-13T02:50:48.843 INFO:tasks.workunit.client.1.smithi122.stdout:4/443: dread d11/f49 [0,4194304] 0 2024-09-13T02:50:48.845 INFO:tasks.workunit.client.1.smithi122.stdout:8/278: link d3/c4a d3/da/d1f/c4c 0 2024-09-13T02:50:48.858 INFO:tasks.workunit.client.1.smithi122.stdout:6/521: link d5/d3d/d6c/d41/c62 d5/d11/d45/d21/ca2 0 2024-09-13T02:50:48.859 INFO:tasks.workunit.client.1.smithi122.stdout:4/444: mkdir d11/d13/d82/d2a/d78/d8e 0 2024-09-13T02:50:48.860 INFO:tasks.workunit.client.1.smithi122.stdout:8/279: mkdir d3/da/d1f/d20/d4d 0 2024-09-13T02:50:48.860 INFO:tasks.workunit.client.1.smithi122.stdout:6/522: stat d5/d3d/d6c/d41/c62 0 2024-09-13T02:50:48.861 INFO:tasks.workunit.client.1.smithi122.stdout:8/280: rmdir d3/da/d1f/d25 39 2024-09-13T02:50:48.862 INFO:tasks.workunit.client.1.smithi122.stdout:8/281: mkdir d3/da/d1f/d4e 0 2024-09-13T02:50:48.864 INFO:tasks.workunit.client.1.smithi122.stdout:8/282: rename d3/da/d1f/d20/d21/c42 to d3/da/d1f/d20/d21/c4f 0 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: pgmap v255: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 148 MiB/s rd, 182 MiB/s wr, 297 op/s 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3784590844' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:48.866 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr fail", "who": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: Activating manager daemon smithi122.ptcenr 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "mgr fail", "who": "smithi100.lhjyck"}]': finished 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: mgrmap e21: smithi122.ptcenr(active, starting, since 0.00945417s) 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:50:48.867 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:50:48.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:50:48.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:48 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:50:48.869 INFO:tasks.workunit.client.1.smithi122.stdout:9/397: dwrite d8/f33 [0,4194304] 0 2024-09-13T02:50:48.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/392: dwrite dc/de/d18/d1d/f52 [0,4194304] 0 2024-09-13T02:50:48.869 INFO:tasks.workunit.client.1.smithi122.stdout:2/287: dwrite d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:48.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/393: chown l7 145 1 2024-09-13T02:50:48.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/394: dread - dc/de/d18/d1d/f73 zero size 2024-09-13T02:50:48.870 INFO:tasks.workunit.client.1.smithi122.stdout:1/395: truncate dc/de/d7a/f82 580109 0 2024-09-13T02:50:48.874 INFO:tasks.workunit.client.1.smithi122.stdout:2/288: truncate d0/f2c 7224523 0 2024-09-13T02:50:48.874 INFO:tasks.workunit.client.1.smithi122.stdout:2/289: fdatasync d0/f2c 0 2024-09-13T02:50:48.874 INFO:tasks.workunit.client.1.smithi122.stdout:2/290: chown d0/d1c/f4d 11504 1 2024-09-13T02:50:48.874 INFO:tasks.workunit.client.1.smithi122.stdout:2/291: truncate d0/f1b 2340027 0 2024-09-13T02:50:48.876 INFO:tasks.workunit.client.1.smithi122.stdout:2/292: truncate d0/d1e/d2e/d3e/f46 1758283 0 2024-09-13T02:50:48.876 INFO:tasks.workunit.client.1.smithi122.stdout:2/293: creat d0/d1e/d26/d3d/f58 x:0 0 0 2024-09-13T02:50:48.878 INFO:tasks.workunit.client.1.smithi122.stdout:2/294: mkdir d0/d1e/d26/d3a/d59 0 2024-09-13T02:50:48.879 INFO:tasks.workunit.client.1.smithi122.stdout:3/457: sync 2024-09-13T02:50:48.879 INFO:tasks.workunit.client.1.smithi122.stdout:7/304: sync 2024-09-13T02:50:48.879 INFO:tasks.workunit.client.1.smithi122.stdout:5/348: sync 2024-09-13T02:50:48.880 INFO:tasks.workunit.client.1.smithi122.stdout:3/458: fdatasync f3 0 2024-09-13T02:50:48.880 INFO:tasks.workunit.client.1.smithi122.stdout:5/349: readlink d0/d17/d36/d25/l57 0 2024-09-13T02:50:48.880 INFO:tasks.workunit.client.1.smithi122.stdout:5/350: fdatasync d0/d17/f28 0 2024-09-13T02:50:48.882 INFO:tasks.workunit.client.1.smithi122.stdout:5/351: dread d0/da/f2d [0,4194304] 0 2024-09-13T02:50:48.882 INFO:tasks.workunit.client.1.smithi122.stdout:3/459: mkdir d4/d11/da6 0 2024-09-13T02:50:48.882 INFO:tasks.workunit.client.1.smithi122.stdout:9/398: dread d8/d16/d3d/d59/d23/d1f/f2a [0,4194304] 0 2024-09-13T02:50:48.883 INFO:tasks.workunit.client.1.smithi122.stdout:5/352: write d0/da/f2d [187280,88203] 0 2024-09-13T02:50:48.883 INFO:tasks.workunit.client.1.smithi122.stdout:7/305: mknod d4/d8/db/dc/d46/d5a/c69 0 2024-09-13T02:50:48.886 INFO:tasks.workunit.client.1.smithi122.stdout:8/283: dwrite d3/da/d1f/d25/f3c [0,4194304] 0 2024-09-13T02:50:48.886 INFO:tasks.workunit.client.1.smithi122.stdout:8/284: readlink d3/da/d1f/d25/l43 0 2024-09-13T02:50:48.886 INFO:tasks.workunit.client.1.smithi122.stdout:5/353: symlink d0/da/l6a 0 2024-09-13T02:50:48.888 INFO:tasks.workunit.client.1.smithi122.stdout:7/306: symlink d4/d8/db/dc/d36/l6a 0 2024-09-13T02:50:48.888 INFO:tasks.workunit.client.1.smithi122.stdout:0/419: sync 2024-09-13T02:50:48.891 INFO:tasks.workunit.client.1.smithi122.stdout:8/285: mkdir d3/d31/d50 0 2024-09-13T02:50:48.893 INFO:tasks.workunit.client.1.smithi122.stdout:5/354: creat d0/d2/f6b x:0 0 0 2024-09-13T02:50:48.893 INFO:tasks.workunit.client.1.smithi122.stdout:5/355: write d0/d2/d33/f52 [109900,35283] 0 2024-09-13T02:50:48.893 INFO:tasks.workunit.client.1.smithi122.stdout:5/356: fsync d0/d17/d36/d25/d2b/f68 0 2024-09-13T02:50:48.893 INFO:tasks.workunit.client.1.smithi122.stdout:5/357: creat d0/da/f6c x:0 0 0 2024-09-13T02:50:48.894 INFO:tasks.workunit.client.1.smithi122.stdout:7/307: unlink d4/d8/d24/d47/l60 0 2024-09-13T02:50:48.894 INFO:tasks.workunit.client.1.smithi122.stdout:1/396: dwrite dc/d38/d51/f79 [0,4194304] 0 2024-09-13T02:50:48.896 INFO:tasks.workunit.client.1.smithi122.stdout:1/397: write dc/de/f11 [60634,110765] 0 2024-09-13T02:50:48.896 INFO:tasks.workunit.client.1.smithi122.stdout:1/398: chown dc/de/c54 954954411 1 2024-09-13T02:50:48.896 INFO:tasks.workunit.client.1.smithi122.stdout:8/286: symlink d3/da/d1f/d4e/l51 0 2024-09-13T02:50:48.896 INFO:tasks.workunit.client.1.smithi122.stdout:0/420: truncate d1/d5/d9/da/d17/f2a 2246694 0 2024-09-13T02:50:48.897 INFO:tasks.workunit.client.1.smithi122.stdout:9/399: write d8/d16/d3d/d59/d23/d1f/f2a [412493,36889] 0 2024-09-13T02:50:48.897 INFO:tasks.workunit.client.1.smithi122.stdout:9/400: write d8/ff [660606,66433] 0 2024-09-13T02:50:48.897 INFO:tasks.workunit.client.1.smithi122.stdout:9/401: write d8/f9 [174016,25991] 0 2024-09-13T02:50:48.897 INFO:tasks.workunit.client.1.smithi122.stdout:5/358: truncate d0/da/f2a 8265854 0 2024-09-13T02:50:48.897 INFO:tasks.workunit.client.1.smithi122.stdout:7/308: mkdir d4/d4e/d5d/d6b 0 2024-09-13T02:50:48.898 INFO:tasks.workunit.client.1.smithi122.stdout:8/287: mkdir d3/d31/d52 0 2024-09-13T02:50:48.899 INFO:tasks.workunit.client.1.smithi122.stdout:9/402: symlink d8/d16/d3d/d59/d49/l7c 0 2024-09-13T02:50:48.899 INFO:tasks.workunit.client.1.smithi122.stdout:9/403: write d8/d16/d3d/d59/d23/d1f/f2d [154252,38112] 0 2024-09-13T02:50:48.899 INFO:tasks.workunit.client.1.smithi122.stdout:9/404: fdatasync d8/f2e 0 2024-09-13T02:50:48.899 INFO:tasks.workunit.client.1.smithi122.stdout:3/460: dread d4/d6/f16 [0,4194304] 0 2024-09-13T02:50:48.900 INFO:tasks.workunit.client.1.smithi122.stdout:5/359: link d0/d2/d33/f52 d0/d2/f6d 0 2024-09-13T02:50:48.900 INFO:tasks.workunit.client.1.smithi122.stdout:5/360: fsync d0/f5a 0 2024-09-13T02:50:48.901 INFO:tasks.workunit.client.1.smithi122.stdout:7/309: rename d4/d8/db/dc/d46/d5a/f67 to d4/d8/d24/f6c 0 2024-09-13T02:50:48.902 INFO:tasks.workunit.client.1.smithi122.stdout:8/288: truncate d3/da/d1f/f27 1088191 0 2024-09-13T02:50:48.902 INFO:tasks.workunit.client.1.smithi122.stdout:9/405: write d8/d16/f1b [826253,91050] 0 2024-09-13T02:50:48.903 INFO:tasks.workunit.client.1.smithi122.stdout:3/461: creat d4/d6/df/d15/d68/d90/fa7 x:0 0 0 2024-09-13T02:50:48.903 INFO:tasks.workunit.client.1.smithi122.stdout:7/310: mkdir d4/d6d 0 2024-09-13T02:50:48.905 INFO:tasks.workunit.client.1.smithi122.stdout:8/289: rename d3/da/d1f/d20 to d3/d53 0 2024-09-13T02:50:48.906 INFO:tasks.workunit.client.1.smithi122.stdout:9/406: dread d8/f2e [0,4194304] 0 2024-09-13T02:50:48.907 INFO:tasks.workunit.client.1.smithi122.stdout:2/295: dwrite d0/d1e/d26/f30 [8388608,4194304] 0 2024-09-13T02:50:48.907 INFO:tasks.workunit.client.1.smithi122.stdout:3/462: rename d4/d6/df/l50 to d4/d11/dd/d21/d2b/d36/d3c/d43/da3/la8 0 2024-09-13T02:50:48.908 INFO:tasks.workunit.client.1.smithi122.stdout:8/290: link d3/da/d1f/d25/d3e/f46 d3/da/d1f/d4e/f54 0 2024-09-13T02:50:48.910 INFO:tasks.workunit.client.1.smithi122.stdout:0/421: dread d1/d5/d10/d29/f34 [0,4194304] 0 2024-09-13T02:50:48.912 INFO:tasks.workunit.client.1.smithi122.stdout:2/296: mkdir d0/d1e/d2e/d5a 0 2024-09-13T02:50:48.912 INFO:tasks.workunit.client.1.smithi122.stdout:2/297: chown d0/d1e/d22/d39 29179678 1 2024-09-13T02:50:48.912 INFO:tasks.workunit.client.1.smithi122.stdout:1/399: read dc/d38/d51/f79 [1483626,27792] 0 2024-09-13T02:50:48.912 INFO:tasks.workunit.client.1.smithi122.stdout:1/400: fsync dc/de/d18/f66 0 2024-09-13T02:50:48.915 INFO:tasks.workunit.client.1.smithi122.stdout:9/407: dread d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:48.915 INFO:tasks.workunit.client.1.smithi122.stdout:9/408: write d8/f28 [5428359,117015] 0 2024-09-13T02:50:48.915 INFO:tasks.workunit.client.1.smithi122.stdout:3/463: mkdir d4/d11/da9 0 2024-09-13T02:50:48.917 INFO:tasks.workunit.client.1.smithi122.stdout:8/291: unlink d3/da/d1f/c4c 0 2024-09-13T02:50:48.917 INFO:tasks.workunit.client.1.smithi122.stdout:8/292: readlink d3/l18 0 2024-09-13T02:50:48.920 INFO:tasks.workunit.client.1.smithi122.stdout:5/361: dread d0/d1d/f1f [4194304,4194304] 0 2024-09-13T02:50:48.921 INFO:tasks.workunit.client.1.smithi122.stdout:5/362: fsync d0/d17/d36/d25/d2b/f30 0 2024-09-13T02:50:48.922 INFO:tasks.workunit.client.1.smithi122.stdout:3/464: mknod d4/d11/dd/d21/d30/caa 0 2024-09-13T02:50:48.922 INFO:tasks.workunit.client.1.smithi122.stdout:3/465: dread - d4/d11/dd/d21/d2b/d36/d3c/f86 zero size 2024-09-13T02:50:48.927 INFO:tasks.workunit.client.1.smithi122.stdout:5/363: rename d0/da/d48/f51 to d0/d2/f6e 0 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: pgmap v255: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 148 MiB/s rd, 182 MiB/s wr, 297 op/s 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3784590844' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:48.931 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr fail", "who": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: Activating manager daemon smithi122.ptcenr 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.14206 172.21.15.100:0/2093525335' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "mgr fail", "who": "smithi100.lhjyck"}]': finished 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: mgrmap e21: smithi122.ptcenr(active, starting, since 0.00945417s) 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:50:48.932 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:50:48.933 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:48 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:50:48.933 INFO:tasks.workunit.client.1.smithi122.stdout:3/466: symlink d4/d11/dd/lab 0 2024-09-13T02:50:48.935 INFO:tasks.workunit.client.1.smithi122.stdout:9/409: rename d8/d16/d3d/d59/d5a to d8/d16/d3d/d59/d7d 0 2024-09-13T02:50:48.936 INFO:tasks.workunit.client.1.smithi122.stdout:5/364: rename d0/d1d/f29 to d0/d17/f6f 0 2024-09-13T02:50:48.938 INFO:tasks.workunit.client.1.smithi122.stdout:3/467: symlink d4/d11/dd/d21/d2b/d36/d3c/d43/d82/lac 0 2024-09-13T02:50:48.938 INFO:tasks.workunit.client.1.smithi122.stdout:3/468: chown d4/d11/da9 1646 1 2024-09-13T02:50:48.938 INFO:tasks.workunit.client.1.smithi122.stdout:3/469: chown d4/d6/df/d15/f61 86 1 2024-09-13T02:50:48.938 INFO:tasks.workunit.client.1.smithi122.stdout:3/470: truncate d4/d4c/f51 541161 0 2024-09-13T02:50:48.939 INFO:tasks.workunit.client.1.smithi122.stdout:9/410: mknod d8/d16/d45/c7e 0 2024-09-13T02:50:48.939 INFO:tasks.workunit.client.1.smithi122.stdout:9/411: read d8/d16/d3d/d59/d23/d1f/f54 [1801320,1813] 0 2024-09-13T02:50:48.940 INFO:tasks.workunit.client.1.smithi122.stdout:5/365: rename d0/d17/d36/d25/d2b/f68 to d0/d2/d33/f70 0 2024-09-13T02:50:48.941 INFO:tasks.workunit.client.1.smithi122.stdout:5/366: fsync d0/d17/d36/d3f/d4c/f66 0 2024-09-13T02:50:48.942 INFO:tasks.workunit.client.1.smithi122.stdout:9/412: unlink d8/d16/f1b 0 2024-09-13T02:50:48.943 INFO:tasks.workunit.client.1.smithi122.stdout:7/311: dwrite d4/d8/db/dc/f61 [0,4194304] 0 2024-09-13T02:50:48.943 INFO:tasks.workunit.client.1.smithi122.stdout:3/471: dread d4/d11/dd/d21/d2b/d55/f62 [0,4194304] 0 2024-09-13T02:50:48.943 INFO:tasks.workunit.client.1.smithi122.stdout:7/312: fsync d4/d8/db/dc/f5f 0 2024-09-13T02:50:48.946 INFO:tasks.workunit.client.1.smithi122.stdout:7/313: dread d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:48.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/293: dwrite d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:48.951 INFO:tasks.workunit.client.1.smithi122.stdout:7/314: truncate d4/d8/db/ff 1561691 0 2024-09-13T02:50:48.951 INFO:tasks.workunit.client.1.smithi122.stdout:1/401: dwrite dc/de/f11 [0,4194304] 0 2024-09-13T02:50:48.951 INFO:tasks.workunit.client.1.smithi122.stdout:1/402: chown dc/de/d18/d22/c2b 28685616 1 2024-09-13T02:50:48.953 INFO:tasks.workunit.client.1.smithi122.stdout:8/294: creat d3/d53/d34/f55 x:0 0 0 2024-09-13T02:50:48.954 INFO:tasks.workunit.client.1.smithi122.stdout:1/403: write dc/de/d18/d22/f31 [1705396,64656] 0 2024-09-13T02:50:48.957 INFO:tasks.workunit.client.1.smithi122.stdout:8/295: mkdir d3/da/d56 0 2024-09-13T02:50:48.958 INFO:tasks.workunit.client.1.smithi122.stdout:8/296: write d3/d53/d34/f3a [1037265,21247] 0 2024-09-13T02:50:48.966 INFO:tasks.workunit.client.1.smithi122.stdout:9/413: dwrite d8/d16/d3d/d59/f4e [4194304,4194304] 0 2024-09-13T02:50:48.973 INFO:tasks.workunit.client.1.smithi122.stdout:3/472: dwrite d4/d11/dd/f65 [0,4194304] 0 2024-09-13T02:50:48.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/473: getdents d4/d11/dd/d21/d2b/d36/d3c/d9e 0 2024-09-13T02:50:48.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/474: getdents d4/d11/dd/d21/d74 0 2024-09-13T02:50:48.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/475: readlink d4/d11/l7e 0 2024-09-13T02:50:48.977 INFO:tasks.workunit.client.1.smithi122.stdout:8/297: dwrite d3/d53/d34/f49 [0,4194304] 0 2024-09-13T02:50:48.977 INFO:tasks.workunit.client.1.smithi122.stdout:8/298: chown d3/da/c2d 118294246 1 2024-09-13T02:50:48.977 INFO:tasks.workunit.client.1.smithi122.stdout:3/476: rename d4/d11/dd/d21/d30/caa to d4/d11/cad 0 2024-09-13T02:50:48.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/299: mknod d3/d53/d4d/c57 0 2024-09-13T02:50:48.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/300: chown d3/da/d1f/f19 358 1 2024-09-13T02:50:48.981 INFO:tasks.workunit.client.1.smithi122.stdout:3/477: rename d4/d6/de/l19 to d4/d11/dd/d21/d4e/d53/lae 0 2024-09-13T02:50:48.982 INFO:tasks.workunit.client.1.smithi122.stdout:3/478: unlink d4/d6/df/d15/l3b 0 2024-09-13T02:50:48.982 INFO:tasks.workunit.client.1.smithi122.stdout:3/479: chown d4 5841 1 2024-09-13T02:50:48.983 INFO:tasks.workunit.client.1.smithi122.stdout:3/480: creat d4/d11/dd/d21/d2b/d36/d3c/d43/da3/faf x:0 0 0 2024-09-13T02:50:48.983 INFO:tasks.workunit.client.1.smithi122.stdout:3/481: chown d4/d11/dd/d21/d2b/c67 3 1 2024-09-13T02:50:48.983 INFO:tasks.workunit.client.1.smithi122.stdout:3/482: getdents d4/d11/dd/d21/d4e 0 2024-09-13T02:50:48.983 INFO:tasks.workunit.client.1.smithi122.stdout:3/483: dread - d4/d11/dd/d21/d2b/f88 zero size 2024-09-13T02:50:48.984 INFO:tasks.workunit.client.1.smithi122.stdout:3/484: symlink d4/d11/d38/lb0 0 2024-09-13T02:50:48.986 INFO:tasks.workunit.client.1.smithi122.stdout:8/301: write d3/da/d1f/f11 [3629598,8442] 0 2024-09-13T02:50:48.988 INFO:tasks.workunit.client.1.smithi122.stdout:8/302: rename d3/da/d1f/f11 to d3/f58 0 2024-09-13T02:50:48.995 INFO:tasks.workunit.client.1.smithi122.stdout:3/485: dread d4/d11/dd/d21/f28 [0,4194304] 0 2024-09-13T02:50:48.995 INFO:tasks.workunit.client.1.smithi122.stdout:3/486: readlink d4/d11/l7e 0 2024-09-13T02:50:48.995 INFO:tasks.workunit.client.1.smithi122.stdout:3/487: creat d4/d11/dd/d21/d6c/fb1 x:0 0 0 2024-09-13T02:50:48.996 INFO:tasks.workunit.client.1.smithi122.stdout:3/488: creat d4/d11/da9/fb2 x:0 0 0 2024-09-13T02:50:48.997 INFO:tasks.workunit.client.1.smithi122.stdout:3/489: symlink d4/d11/dd/lb3 0 2024-09-13T02:50:49.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/303: dwrite d3/da/d1f/f1a [0,4194304] 0 2024-09-13T02:50:49.004 INFO:tasks.workunit.client.1.smithi122.stdout:8/304: rename d3/da/d1f/d25 to d3/d31/d52/d59 0 2024-09-13T02:50:49.005 INFO:tasks.workunit.client.1.smithi122.stdout:8/305: symlink d3/d31/d52/d59/d3e/l5a 0 2024-09-13T02:50:49.006 INFO:tasks.workunit.client.1.smithi122.stdout:8/306: rename d3/d31/f40 to d3/d31/d52/f5b 0 2024-09-13T02:50:49.006 INFO:tasks.workunit.client.1.smithi122.stdout:8/307: fsync d3/d53/d21/f4b 0 2024-09-13T02:50:49.006 INFO:tasks.workunit.client.1.smithi122.stdout:8/308: chown d3/d31/d52/d59/d3e/f46 12414 1 2024-09-13T02:50:49.024 INFO:tasks.workunit.client.1.smithi122.stdout:8/309: dwrite d3/da/f30 [0,4194304] 0 2024-09-13T02:50:49.025 INFO:tasks.workunit.client.1.smithi122.stdout:8/310: mkdir d3/d31/d52/d59/d3e/d5c 0 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:6/523: sync 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:2/298: sync 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:4/445: sync 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:0/422: sync 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:4/446: read - d11/d3d/f6c zero size 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:6/524: chown d5/d11/d45/df/d46 0 1 2024-09-13T02:50:49.326 INFO:tasks.workunit.client.1.smithi122.stdout:2/299: dread - d0/d1e/f25 zero size 2024-09-13T02:50:49.327 INFO:tasks.workunit.client.1.smithi122.stdout:4/447: mkdir d11/d30/d59/d8f 0 2024-09-13T02:50:49.328 INFO:tasks.workunit.client.1.smithi122.stdout:6/525: mkdir d5/d3d/da3 0 2024-09-13T02:50:49.328 INFO:tasks.workunit.client.1.smithi122.stdout:0/423: dread d1/d5/d10/d29/d32/d5f/f50 [0,4194304] 0 2024-09-13T02:50:49.329 INFO:tasks.workunit.client.1.smithi122.stdout:4/448: truncate d11/d1b/d2e/f7f 376352 0 2024-09-13T02:50:49.333 INFO:tasks.workunit.client.1.smithi122.stdout:6/526: rename d5/d11/d45/df/d26/f84 to d5/db/d29/fa4 0 2024-09-13T02:50:49.333 INFO:tasks.workunit.client.1.smithi122.stdout:6/527: readlink d5/d11/d45/df/l71 0 2024-09-13T02:50:49.340 INFO:tasks.workunit.client.1.smithi122.stdout:0/424: dread d1/d5/d10/d29/d32/d5f/d1d/f31 [0,4194304] 0 2024-09-13T02:50:49.341 INFO:tasks.workunit.client.1.smithi122.stdout:6/528: read d5/d11/d45/df/d46/f5d [7753984,106146] 0 2024-09-13T02:50:49.342 INFO:tasks.workunit.client.1.smithi122.stdout:0/425: mkdir d1/d5/d9/da/d17/d69/d85 0 2024-09-13T02:50:49.344 INFO:tasks.workunit.client.1.smithi122.stdout:6/529: symlink d5/d3d/d6c/la5 0 2024-09-13T02:50:49.345 INFO:tasks.workunit.client.1.smithi122.stdout:2/300: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:49.346 INFO:tasks.workunit.client.1.smithi122.stdout:0/426: link d1/f38 d1/d5/d10/d29/d32/f86 0 2024-09-13T02:50:49.348 INFO:tasks.workunit.client.1.smithi122.stdout:6/530: creat d5/db/dc/fa6 x:0 0 0 2024-09-13T02:50:49.349 INFO:tasks.workunit.client.1.smithi122.stdout:2/301: truncate d0/f10 1651791 0 2024-09-13T02:50:49.351 INFO:tasks.workunit.client.1.smithi122.stdout:2/302: unlink d0/d1e/ff 0 2024-09-13T02:50:49.352 INFO:tasks.workunit.client.1.smithi122.stdout:2/303: creat d0/d1e/d2e/d3e/f5b x:0 0 0 2024-09-13T02:50:49.354 INFO:tasks.workunit.client.1.smithi122.stdout:4/449: dwrite d11/d1b/f31 [0,4194304] 0 2024-09-13T02:50:49.354 INFO:tasks.workunit.client.1.smithi122.stdout:2/304: link d0/c15 d0/d1e/d2e/d5a/c5c 0 2024-09-13T02:50:49.360 INFO:tasks.workunit.client.1.smithi122.stdout:6/531: write d5/d11/d45/df/f13 [1982995,102497] 0 2024-09-13T02:50:49.360 INFO:tasks.workunit.client.1.smithi122.stdout:6/532: chown d5/d11/d2f/l53 1594840958 1 2024-09-13T02:50:49.360 INFO:tasks.workunit.client.1.smithi122.stdout:6/533: truncate d5/db/d29/f7c 89856 0 2024-09-13T02:50:49.363 INFO:tasks.workunit.client.1.smithi122.stdout:4/450: symlink d11/d13/d82/l90 0 2024-09-13T02:50:49.364 INFO:tasks.workunit.client.1.smithi122.stdout:4/451: stat d11/d1b/d2e/d55/f58 0 2024-09-13T02:50:49.364 INFO:tasks.workunit.client.1.smithi122.stdout:4/452: write d11/d30/f8b [852822,39911] 0 2024-09-13T02:50:49.364 INFO:tasks.workunit.client.1.smithi122.stdout:2/305: mkdir d0/d5d 0 2024-09-13T02:50:49.365 INFO:tasks.workunit.client.1.smithi122.stdout:2/306: write d0/d1e/d26/d3d/f58 [57139,21436] 0 2024-09-13T02:50:49.365 INFO:tasks.workunit.client.1.smithi122.stdout:2/307: creat d0/d1c/f5e x:0 0 0 2024-09-13T02:50:49.366 INFO:tasks.workunit.client.1.smithi122.stdout:6/534: rename d5/f36 to d5/d3d/fa7 0 2024-09-13T02:50:49.369 INFO:tasks.workunit.client.1.smithi122.stdout:4/453: symlink d11/d30/d59/d8f/l91 0 2024-09-13T02:50:49.373 INFO:tasks.workunit.client.1.smithi122.stdout:2/308: getdents d0/d1c/d3b/d41 0 2024-09-13T02:50:49.377 INFO:tasks.workunit.client.1.smithi122.stdout:4/454: symlink d11/d1b/d32/d87/l92 0 2024-09-13T02:50:49.382 INFO:tasks.workunit.client.1.smithi122.stdout:4/455: mknod d11/d13/d82/d2a/d78/c93 0 2024-09-13T02:50:49.384 INFO:tasks.workunit.client.1.smithi122.stdout:6/535: dwrite d5/db/d29/f1d [4194304,4194304] 0 2024-09-13T02:50:49.384 INFO:tasks.workunit.client.1.smithi122.stdout:6/536: fsync d5/d11/d45/f2d 0 2024-09-13T02:50:49.384 INFO:tasks.workunit.client.1.smithi122.stdout:6/537: write d5/f8 [422100,126824] 0 2024-09-13T02:50:49.384 INFO:tasks.workunit.client.1.smithi122.stdout:6/538: chown d5/d3d/d6c/d41/d4e/d93 61344691 1 2024-09-13T02:50:49.387 INFO:tasks.workunit.client.1.smithi122.stdout:4/456: rename d11/d3d/f84 to d11/d30/f94 0 2024-09-13T02:50:49.387 INFO:tasks.workunit.client.1.smithi122.stdout:4/457: write d11/d3d/f5b [914083,119388] 0 2024-09-13T02:50:49.388 INFO:tasks.workunit.client.1.smithi122.stdout:6/539: getdents d5/d3d/d6c/d41 0 2024-09-13T02:50:49.400 INFO:tasks.workunit.client.1.smithi122.stdout:4/458: dwrite d11/d1b/d2e/f7f [0,4194304] 0 2024-09-13T02:50:49.402 INFO:tasks.workunit.client.1.smithi122.stdout:4/459: rename d11/d1b/d2e/d55/f6a to d11/d13/d82/d2a/d83/f95 0 2024-09-13T02:50:49.404 INFO:tasks.workunit.client.1.smithi122.stdout:4/460: creat d11/d1b/f96 x:0 0 0 2024-09-13T02:50:49.407 INFO:tasks.workunit.client.1.smithi122.stdout:4/461: getdents d11/d13/d82/d2a/d83 0 2024-09-13T02:50:49.419 INFO:tasks.workunit.client.1.smithi122.stdout:4/462: dwrite d11/d3d/f6c [0,4194304] 0 2024-09-13T02:50:49.427 INFO:tasks.workunit.client.1.smithi122.stdout:4/463: dread d11/d30/f54 [0,4194304] 0 2024-09-13T02:50:49.427 INFO:tasks.workunit.client.1.smithi122.stdout:4/464: write d11/f80 [1572963,59357] 0 2024-09-13T02:50:49.428 INFO:tasks.workunit.client.1.smithi122.stdout:4/465: creat d11/f97 x:0 0 0 2024-09-13T02:50:49.429 INFO:tasks.workunit.client.1.smithi122.stdout:4/466: mkdir d11/d1b/d32/d98 0 2024-09-13T02:50:49.430 INFO:tasks.workunit.client.1.smithi122.stdout:4/467: mknod d11/d30/c99 0 2024-09-13T02:50:49.430 INFO:tasks.workunit.client.1.smithi122.stdout:4/468: read - d11/d30/d59/d6e/f8a zero size 2024-09-13T02:50:49.431 INFO:tasks.workunit.client.1.smithi122.stdout:4/469: mknod d11/d13/d82/d2a/d78/d8e/c9a 0 2024-09-13T02:50:49.433 INFO:tasks.workunit.client.1.smithi122.stdout:4/470: truncate fa 1737172 0 2024-09-13T02:50:49.433 INFO:tasks.workunit.client.1.smithi122.stdout:4/471: write d11/d30/f54 [1501462,26416] 0 2024-09-13T02:50:49.433 INFO:tasks.workunit.client.1.smithi122.stdout:4/472: chown d11/d1b/d32/c33 5159 1 2024-09-13T02:50:49.433 INFO:tasks.workunit.client.1.smithi122.stdout:4/473: creat d11/d1b/d32/d98/f9b x:0 0 0 2024-09-13T02:50:49.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/474: truncate d11/d1b/f45 3523109 0 2024-09-13T02:50:49.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/475: fdatasync d11/d1b/d2e/d55/f67 0 2024-09-13T02:50:49.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/476: chown d11/d13/d82/d2a 55519 1 2024-09-13T02:50:49.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/477: creat d11/d1b/d32/d87/f9c x:0 0 0 2024-09-13T02:50:49.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/478: creat d11/d30/f9d x:0 0 0 2024-09-13T02:50:49.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/479: getdents d11/d3d 0 2024-09-13T02:50:49.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/480: write d11/d1b/d32/d87/f9c [111997,129029] 0 2024-09-13T02:50:49.438 INFO:tasks.workunit.client.1.smithi122.stdout:4/481: mknod d11/d62/c9e 0 2024-09-13T02:50:49.440 INFO:tasks.workunit.client.1.smithi122.stdout:4/482: creat d11/d1b/d2e/f9f x:0 0 0 2024-09-13T02:50:49.440 INFO:tasks.workunit.client.1.smithi122.stdout:4/483: chown d11/d1b/l85 5648672 1 2024-09-13T02:50:49.443 INFO:tasks.workunit.client.1.smithi122.stdout:4/484: symlink d11/d1b/d32/la0 0 2024-09-13T02:50:49.443 INFO:tasks.workunit.client.1.smithi122.stdout:4/485: dread - d11/f97 zero size 2024-09-13T02:50:49.443 INFO:tasks.workunit.client.1.smithi122.stdout:4/486: chown d11/d13/d82/d2a/d40/f6d 12 1 2024-09-13T02:50:49.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/487: dwrite d11/d13/d82/d2a/d40/f51 [0,4194304] 0 2024-09-13T02:50:49.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/488: read d11/d13/f66 [3882158,77460] 0 2024-09-13T02:50:49.459 INFO:tasks.workunit.client.1.smithi122.stdout:4/489: rename d11/d13/d82/d2a/l7d to d11/d3d/la1 0 2024-09-13T02:50:49.460 INFO:tasks.workunit.client.1.smithi122.stdout:4/490: mkdir d11/d30/d59/d8f/da2 0 2024-09-13T02:50:49.460 INFO:tasks.workunit.client.1.smithi122.stdout:4/491: truncate d11/d1b/d2e/f9f 786977 0 2024-09-13T02:50:49.461 INFO:tasks.workunit.client.1.smithi122.stdout:4/492: chown d11/d1b/d2e/l76 0 1 2024-09-13T02:50:49.461 INFO:tasks.workunit.client.1.smithi122.stdout:4/493: truncate d11/f97 348585 0 2024-09-13T02:50:49.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/494: getdents d11/d13/d82/d2a 0 2024-09-13T02:50:49.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/495: write d11/d30/f8b [1921583,79419] 0 2024-09-13T02:50:49.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/496: truncate d11/d30/f94 656011 0 2024-09-13T02:50:49.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/497: fdatasync d11/d62/f89 0 2024-09-13T02:50:49.464 INFO:tasks.workunit.client.1.smithi122.stdout:4/498: dread - d11/d1b/f96 zero size 2024-09-13T02:50:49.484 INFO:tasks.workunit.client.1.smithi122.stdout:4/499: dwrite d11/d13/d82/f7e [0,4194304] 0 2024-09-13T02:50:49.492 INFO:tasks.workunit.client.1.smithi122.stdout:5/367: sync 2024-09-13T02:50:49.492 INFO:tasks.workunit.client.1.smithi122.stdout:5/368: truncate d0/d2/f6b 617401 0 2024-09-13T02:50:49.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/500: dwrite d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:49.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/501: chown d11/d13/f1f 5845 1 2024-09-13T02:50:49.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/502: write d11/d1b/d2e/f9f [998442,18197] 0 2024-09-13T02:50:49.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/503: creat d11/d30/d59/d6e/fa3 x:0 0 0 2024-09-13T02:50:49.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/504: fsync fa 0 2024-09-13T02:50:49.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/369: dwrite d0/d17/d36/f50 [4194304,4194304] 0 2024-09-13T02:50:49.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/370: creat d0/d17/d36/d25/d2b/f71 x:0 0 0 2024-09-13T02:50:49.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/371: readlink d0/da/l2f 0 2024-09-13T02:50:49.511 INFO:tasks.workunit.client.1.smithi122.stdout:5/372: write d0/d17/d36/f24 [1659386,68193] 0 2024-09-13T02:50:49.518 INFO:tasks.workunit.client.1.smithi122.stdout:4/505: dwrite d11/d1b/f45 [0,4194304] 0 2024-09-13T02:50:49.519 INFO:tasks.workunit.client.1.smithi122.stdout:4/506: symlink d11/d13/d82/d2a/d83/la4 0 2024-09-13T02:50:49.519 INFO:tasks.workunit.client.1.smithi122.stdout:4/507: chown d11/d62/c9e 160486416 1 2024-09-13T02:50:49.519 INFO:tasks.workunit.client.1.smithi122.stdout:4/508: chown fa 197532 1 2024-09-13T02:50:49.519 INFO:tasks.workunit.client.1.smithi122.stdout:4/509: chown d11/l7a 128724 1 2024-09-13T02:50:49.522 INFO:tasks.workunit.client.1.smithi122.stdout:4/510: unlink d11/d13/d82/d2a/c7b 0 2024-09-13T02:50:49.523 INFO:tasks.workunit.client.1.smithi122.stdout:4/511: dread d11/d13/d82/f42 [0,4194304] 0 2024-09-13T02:50:49.523 INFO:tasks.workunit.client.1.smithi122.stdout:4/512: readlink d11/d1b/d32/la0 0 2024-09-13T02:50:49.532 INFO:tasks.workunit.client.1.smithi122.stdout:5/373: dwrite d0/da/d48/f45 [0,4194304] 0 2024-09-13T02:50:49.542 INFO:tasks.workunit.client.1.smithi122.stdout:4/513: dwrite d11/d1b/f31 [0,4194304] 0 2024-09-13T02:50:49.556 INFO:tasks.workunit.client.1.smithi122.stdout:4/514: dwrite d11/d1b/d2e/f77 [0,4194304] 0 2024-09-13T02:50:49.560 INFO:tasks.workunit.client.1.smithi122.stdout:4/515: rmdir d11/d1b/d32/d87 39 2024-09-13T02:50:49.561 INFO:tasks.workunit.client.1.smithi122.stdout:4/516: mknod d11/d30/ca5 0 2024-09-13T02:50:49.588 INFO:tasks.workunit.client.1.smithi122.stdout:7/315: sync 2024-09-13T02:50:49.588 INFO:tasks.workunit.client.1.smithi122.stdout:1/404: sync 2024-09-13T02:50:49.588 INFO:tasks.workunit.client.1.smithi122.stdout:7/316: write d4/d8/db/f2c [170348,8288] 0 2024-09-13T02:50:49.588 INFO:tasks.workunit.client.1.smithi122.stdout:7/317: truncate d4/d8/f19 9288942 0 2024-09-13T02:50:49.588 INFO:tasks.workunit.client.1.smithi122.stdout:1/405: creat dc/de/d13/d46/d6c/d7d/f83 x:0 0 0 2024-09-13T02:50:49.589 INFO:tasks.workunit.client.1.smithi122.stdout:1/406: creat dc/de/d13/d46/d6c/d7d/f84 x:0 0 0 2024-09-13T02:50:49.593 INFO:tasks.workunit.client.1.smithi122.stdout:7/318: dread d4/d8/d24/f3e [0,4194304] 0 2024-09-13T02:50:49.595 INFO:tasks.workunit.client.1.smithi122.stdout:7/319: unlink d4/d8/db/dc/d36/c54 0 2024-09-13T02:50:49.595 INFO:tasks.workunit.client.1.smithi122.stdout:7/320: creat d4/d8/db/dc/d46/f6e x:0 0 0 2024-09-13T02:50:49.602 INFO:tasks.workunit.client.1.smithi122.stdout:1/407: dwrite dc/de/d13/f5e [0,4194304] 0 2024-09-13T02:50:49.611 INFO:tasks.workunit.client.1.smithi122.stdout:7/321: dwrite d4/d8/d3d/f44 [0,4194304] 0 2024-09-13T02:50:49.612 INFO:tasks.workunit.client.1.smithi122.stdout:7/322: truncate d4/d8/db/ff 597138 0 2024-09-13T02:50:49.612 INFO:tasks.workunit.client.1.smithi122.stdout:7/323: dread - d4/d8/db/dc/d1b/f57 zero size 2024-09-13T02:50:49.612 INFO:tasks.workunit.client.1.smithi122.stdout:1/408: dread dc/de/d18/d1d/f4e [0,4194304] 0 2024-09-13T02:50:49.612 INFO:tasks.workunit.client.1.smithi122.stdout:1/409: creat dc/de/d18/d1d/f85 x:0 0 0 2024-09-13T02:50:49.614 INFO:tasks.workunit.client.1.smithi122.stdout:1/410: dread dc/de/d18/d1d/d2f/f4b [0,4194304] 0 2024-09-13T02:50:49.632 INFO:tasks.workunit.client.1.smithi122.stdout:7/324: dwrite d4/d8/d24/f37 [0,4194304] 0 2024-09-13T02:50:49.632 INFO:tasks.workunit.client.1.smithi122.stdout:7/325: readlink d4/d8/d3d/l66 0 2024-09-13T02:50:49.632 INFO:tasks.workunit.client.1.smithi122.stdout:7/326: write d4/d8/db/dc/d1b/f32 [852293,33270] 0 2024-09-13T02:50:49.633 INFO:tasks.workunit.client.1.smithi122.stdout:1/411: dwrite dc/de/d18/d1d/f4e [0,4194304] 0 2024-09-13T02:50:49.651 INFO:tasks.workunit.client.1.smithi122.stdout:1/412: dwrite dc/de/d13/d46/d6c/d7d/f83 [0,4194304] 0 2024-09-13T02:50:49.653 INFO:tasks.workunit.client.1.smithi122.stdout:1/413: mkdir dc/de/d18/d86 0 2024-09-13T02:50:49.654 INFO:tasks.workunit.client.1.smithi122.stdout:1/414: creat dc/de/d18/d22/d1c/f87 x:0 0 0 2024-09-13T02:50:49.654 INFO:tasks.workunit.client.1.smithi122.stdout:1/415: truncate dc/d38/f6a 571844 0 2024-09-13T02:50:49.654 INFO:tasks.workunit.client.1.smithi122.stdout:1/416: creat dc/de/d13/d46/d6c/d7d/f88 x:0 0 0 2024-09-13T02:50:49.655 INFO:tasks.workunit.client.1.smithi122.stdout:1/417: write dc/de/d18/f66 [3608091,56391] 0 2024-09-13T02:50:49.656 INFO:tasks.workunit.client.1.smithi122.stdout:1/418: symlink dc/d38/l89 0 2024-09-13T02:50:49.656 INFO:tasks.workunit.client.1.smithi122.stdout:1/419: write dc/de/d18/d1d/f73 [667322,58131] 0 2024-09-13T02:50:49.658 INFO:tasks.workunit.client.1.smithi122.stdout:7/327: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:49.658 INFO:tasks.workunit.client.1.smithi122.stdout:7/328: creat d4/d8/db/dc/d46/d5a/f6f x:0 0 0 2024-09-13T02:50:49.669 INFO:tasks.workunit.client.1.smithi122.stdout:7/329: symlink d4/d8/db/dc/d46/d5a/l70 0 2024-09-13T02:50:49.678 INFO:tasks.workunit.client.1.smithi122.stdout:1/420: dwrite dc/de/d13/d46/d6c/d7d/f83 [0,4194304] 0 2024-09-13T02:50:49.679 INFO:tasks.workunit.client.1.smithi122.stdout:1/421: dread dc/de/d7a/f82 [0,4194304] 0 2024-09-13T02:50:49.683 INFO:tasks.workunit.client.1.smithi122.stdout:7/330: dread d4/d8/db/dc/f28 [0,4194304] 0 2024-09-13T02:50:49.683 INFO:tasks.workunit.client.1.smithi122.stdout:7/331: dread - d4/d8/db/dc/d46/f6e zero size 2024-09-13T02:50:49.685 INFO:tasks.workunit.client.1.smithi122.stdout:9/414: sync 2024-09-13T02:50:49.685 INFO:tasks.workunit.client.1.smithi122.stdout:3/490: sync 2024-09-13T02:50:49.685 INFO:tasks.workunit.client.1.smithi122.stdout:9/415: chown d8/d16/d3d/d59/d7d/f78 5 1 2024-09-13T02:50:49.685 INFO:tasks.workunit.client.1.smithi122.stdout:7/332: symlink d4/d6d/l71 0 2024-09-13T02:50:49.685 INFO:tasks.workunit.client.1.smithi122.stdout:7/333: fsync d4/d8/db/dc/d46/f6e 0 2024-09-13T02:50:49.686 INFO:tasks.workunit.client.1.smithi122.stdout:3/491: mknod d4/d11/cb4 0 2024-09-13T02:50:49.688 INFO:tasks.workunit.client.1.smithi122.stdout:7/334: unlink d4/d8/db/dc/d46/d5a/c64 0 2024-09-13T02:50:49.688 INFO:tasks.workunit.client.1.smithi122.stdout:7/335: chown d4/d8/db/dc/f22 491951 1 2024-09-13T02:50:49.688 INFO:tasks.workunit.client.1.smithi122.stdout:7/336: creat d4/d8/db/dc/f72 x:0 0 0 2024-09-13T02:50:49.692 INFO:tasks.workunit.client.1.smithi122.stdout:7/337: rename d4/fd to d4/d4e/f73 0 2024-09-13T02:50:49.693 INFO:tasks.workunit.client.1.smithi122.stdout:8/311: sync 2024-09-13T02:50:49.693 INFO:tasks.workunit.client.1.smithi122.stdout:8/312: write d3/da/f30 [5161600,18378] 0 2024-09-13T02:50:49.694 INFO:tasks.workunit.client.1.smithi122.stdout:5/374: sync 2024-09-13T02:50:49.695 INFO:tasks.workunit.client.1.smithi122.stdout:0/427: sync 2024-09-13T02:50:49.695 INFO:tasks.workunit.client.1.smithi122.stdout:4/517: sync 2024-09-13T02:50:49.695 INFO:tasks.workunit.client.1.smithi122.stdout:6/540: sync 2024-09-13T02:50:49.695 INFO:tasks.workunit.client.1.smithi122.stdout:2/309: sync 2024-09-13T02:50:49.696 INFO:tasks.workunit.client.1.smithi122.stdout:9/416: read d8/d4a/f5c [2036315,86658] 0 2024-09-13T02:50:49.697 INFO:tasks.workunit.client.1.smithi122.stdout:4/518: creat d11/d30/d59/fa6 x:0 0 0 2024-09-13T02:50:49.697 INFO:tasks.workunit.client.1.smithi122.stdout:6/541: rename d5/d3d/d6c/d41/d4e/d5f/f86 to d5/db/dc/fa8 0 2024-09-13T02:50:49.697 INFO:tasks.workunit.client.1.smithi122.stdout:6/542: write d5/d11/d45/df/d46/f5d [6746605,44294] 0 2024-09-13T02:50:49.698 INFO:tasks.workunit.client.1.smithi122.stdout:6/543: chown d5/d3d/f77 7617025 1 2024-09-13T02:50:49.698 INFO:tasks.workunit.client.1.smithi122.stdout:9/417: truncate d8/d16/d3d/d59/d29/f76 2418183 0 2024-09-13T02:50:49.699 INFO:tasks.workunit.client.1.smithi122.stdout:4/519: symlink d11/d1b/d32/d98/la7 0 2024-09-13T02:50:49.700 INFO:tasks.workunit.client.1.smithi122.stdout:4/520: chown d11/d1b/d32/c33 9475 1 2024-09-13T02:50:49.700 INFO:tasks.workunit.client.1.smithi122.stdout:4/521: readlink d11/d1b/d32/l4a 0 2024-09-13T02:50:49.703 INFO:tasks.workunit.client.1.smithi122.stdout:6/544: creat d5/d3d/d6c/d41/d4e/d93/fa9 x:0 0 0 2024-09-13T02:50:49.709 INFO:tasks.workunit.client.1.smithi122.stdout:6/545: rename d5/d3d/d6c/f6a to d5/d11/d45/df/d46/faa 0 2024-09-13T02:50:49.710 INFO:tasks.workunit.client.1.smithi122.stdout:1/422: dwrite dc/de/d13/d46/f70 [0,4194304] 0 2024-09-13T02:50:49.711 INFO:tasks.workunit.client.1.smithi122.stdout:8/313: write d3/da/d1f/f19 [7571611,62191] 0 2024-09-13T02:50:49.713 INFO:tasks.workunit.client.1.smithi122.stdout:1/423: mknod dc/de/d13/d46/d6c/d7d/c8a 0 2024-09-13T02:50:49.714 INFO:tasks.workunit.client.1.smithi122.stdout:3/492: dwrite d4/d6/df/d15/d68/d90/fa7 [0,4194304] 0 2024-09-13T02:50:49.714 INFO:tasks.workunit.client.1.smithi122.stdout:3/493: chown d4/f73 15590913 1 2024-09-13T02:50:49.714 INFO:tasks.workunit.client.1.smithi122.stdout:8/314: symlink d3/d31/d52/l5d 0 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:1/424: unlink dc/de/d18/d22/d1c/d57/l5d 0 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:1/425: chown dc/de/c26 3747474 1 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:1/426: fdatasync f2 0 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:1/427: dread - dc/de/d18/d22/f55 zero size 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:7/338: read d4/d8/db/dc/d1b/f34 [4176190,20672] 0 2024-09-13T02:50:49.718 INFO:tasks.workunit.client.1.smithi122.stdout:7/339: chown d4/d8/db/f65 1 1 2024-09-13T02:50:49.721 INFO:tasks.workunit.client.1.smithi122.stdout:5/375: read d0/d17/f6f [3210099,20092] 0 2024-09-13T02:50:49.721 INFO:tasks.workunit.client.1.smithi122.stdout:7/340: rename d4/c51 to d4/c74 0 2024-09-13T02:50:49.721 INFO:tasks.workunit.client.1.smithi122.stdout:2/310: dread d0/f51 [0,4194304] 0 2024-09-13T02:50:49.722 INFO:tasks.workunit.client.1.smithi122.stdout:3/494: truncate d4/d6/f8 4520471 0 2024-09-13T02:50:49.722 INFO:tasks.workunit.client.1.smithi122.stdout:3/495: chown d4/d6/de/d1f/c78 14262060 1 2024-09-13T02:50:49.722 INFO:tasks.workunit.client.1.smithi122.stdout:8/315: creat d3/d53/d21/f5e x:0 0 0 2024-09-13T02:50:49.723 INFO:tasks.workunit.client.1.smithi122.stdout:5/376: mkdir d0/d17/d36/d25/d2b/d72 0 2024-09-13T02:50:49.723 INFO:tasks.workunit.client.1.smithi122.stdout:5/377: creat d0/da/f73 x:0 0 0 2024-09-13T02:50:49.723 INFO:tasks.workunit.client.1.smithi122.stdout:7/341: creat d4/d8/db/dc/d36/f75 x:0 0 0 2024-09-13T02:50:49.724 INFO:tasks.workunit.client.1.smithi122.stdout:2/311: unlink d0/d1e/d26/d3d/f58 0 2024-09-13T02:50:49.724 INFO:tasks.workunit.client.1.smithi122.stdout:3/496: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/lb5 0 2024-09-13T02:50:49.725 INFO:tasks.workunit.client.1.smithi122.stdout:3/497: truncate d4/d11/dd/d21/d2b/d36/d3c/d43/da3/faf 74478 0 2024-09-13T02:50:49.726 INFO:tasks.workunit.client.1.smithi122.stdout:2/312: mknod d0/d1e/c5f 0 2024-09-13T02:50:49.726 INFO:tasks.workunit.client.1.smithi122.stdout:2/313: fsync d0/d1e/d2e/f54 0 2024-09-13T02:50:49.727 INFO:tasks.workunit.client.1.smithi122.stdout:2/314: write d0/d1c/f4d [1016196,102513] 0 2024-09-13T02:50:49.728 INFO:tasks.workunit.client.1.smithi122.stdout:0/428: dwrite d1/d5/d9/da/d17/f43 [0,4194304] 0 2024-09-13T02:50:49.728 INFO:tasks.workunit.client.1.smithi122.stdout:0/429: readlink d1/d5/d9/l5a 0 2024-09-13T02:50:49.729 INFO:tasks.workunit.client.1.smithi122.stdout:4/522: dwrite d11/d1b/d2e/f77 [0,4194304] 0 2024-09-13T02:50:49.730 INFO:tasks.workunit.client.1.smithi122.stdout:4/523: readlink d11/d1b/l85 0 2024-09-13T02:50:49.731 INFO:tasks.workunit.client.1.smithi122.stdout:2/315: creat d0/d1c/d3b/d41/d4e/f60 x:0 0 0 2024-09-13T02:50:49.737 INFO:tasks.workunit.client.1.smithi122.stdout:0/430: rename d1/d5/d9/da/d17/f2a to d1/d5/d2d/d80/f87 0 2024-09-13T02:50:49.740 INFO:tasks.workunit.client.1.smithi122.stdout:8/316: dread d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:49.742 INFO:tasks.workunit.client.1.smithi122.stdout:9/418: dwrite d8/d16/d3d/d59/d23/d1f/f2a [0,4194304] 0 2024-09-13T02:50:49.745 INFO:tasks.workunit.client.1.smithi122.stdout:4/524: creat d11/d1b/d32/d87/fa8 x:0 0 0 2024-09-13T02:50:49.745 INFO:tasks.workunit.client.1.smithi122.stdout:4/525: truncate d11/f49 1156829 0 2024-09-13T02:50:49.748 INFO:tasks.workunit.client.1.smithi122.stdout:4/526: dread d11/d1b/d2e/f6b [0,4194304] 0 2024-09-13T02:50:49.751 INFO:tasks.workunit.client.1.smithi122.stdout:4/527: getdents d11/d13/d82/d2a/d78/d8e 0 2024-09-13T02:50:49.752 INFO:tasks.workunit.client.1.smithi122.stdout:0/431: dread d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:50:49.753 INFO:tasks.workunit.client.1.smithi122.stdout:4/528: read d11/d1b/d2e/f9f [518356,63255] 0 2024-09-13T02:50:49.754 INFO:tasks.workunit.client.1.smithi122.stdout:4/529: stat d11/d30/d59/d6e/fa3 0 2024-09-13T02:50:49.755 INFO:tasks.workunit.client.1.smithi122.stdout:0/432: creat d1/d5/d10/d29/f88 x:0 0 0 2024-09-13T02:50:49.757 INFO:tasks.workunit.client.1.smithi122.stdout:5/378: dwrite d0/da/f5b [0,4194304] 0 2024-09-13T02:50:49.757 INFO:tasks.workunit.client.1.smithi122.stdout:5/379: write d0/f4d [4431437,112548] 0 2024-09-13T02:50:49.757 INFO:tasks.workunit.client.1.smithi122.stdout:5/380: fsync d0/d17/d36/d3f/d4c/f66 0 2024-09-13T02:50:49.757 INFO:tasks.workunit.client.1.smithi122.stdout:5/381: dread - d0/d17/d36/d25/d2b/f30 zero size 2024-09-13T02:50:49.758 INFO:tasks.workunit.client.1.smithi122.stdout:5/382: stat d0/da/f5b 0 2024-09-13T02:50:49.758 INFO:tasks.workunit.client.1.smithi122.stdout:5/383: fdatasync d0/da/d48/f49 0 2024-09-13T02:50:49.759 INFO:tasks.workunit.client.1.smithi122.stdout:5/384: dread d0/f7 [0,4194304] 0 2024-09-13T02:50:49.760 INFO:tasks.workunit.client.1.smithi122.stdout:0/433: creat d1/d4b/d56/d81/f89 x:0 0 0 2024-09-13T02:50:49.760 INFO:tasks.workunit.client.1.smithi122.stdout:0/434: write d1/d5/d10/f7b [724463,104578] 0 2024-09-13T02:50:49.760 INFO:tasks.workunit.client.1.smithi122.stdout:0/435: creat d1/d5/d9/da/f8a x:0 0 0 2024-09-13T02:50:49.760 INFO:tasks.workunit.client.1.smithi122.stdout:0/436: fsync d1/d5/d2d/f4e 0 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/530: getdents d11/d13/d82 0 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/531: rename d11 to d11/d3d/da9 22 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/532: creat d11/d62/faa x:0 0 0 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/533: truncate d11/f69 2067716 0 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/534: chown d11/d1b/d2e/l76 226109 1 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/535: read - d11/d30/f9d zero size 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:4/536: truncate d11/d1b/d2e/f34 333971 0 2024-09-13T02:50:49.763 INFO:tasks.workunit.client.1.smithi122.stdout:1/428: dwrite dc/de/d13/d46/f81 [0,4194304] 0 2024-09-13T02:50:49.767 INFO:tasks.workunit.client.1.smithi122.stdout:0/437: mknod d1/d5/d2d/c8b 0 2024-09-13T02:50:49.769 INFO:tasks.workunit.client.1.smithi122.stdout:1/429: mknod dc/d38/c8b 0 2024-09-13T02:50:49.770 INFO:tasks.workunit.client.1.smithi122.stdout:0/438: creat d1/d4b/d56/d60/f8c x:0 0 0 2024-09-13T02:50:49.771 INFO:tasks.workunit.client.1.smithi122.stdout:4/537: rmdir d11/d30/d59 39 2024-09-13T02:50:49.776 INFO:tasks.workunit.client.1.smithi122.stdout:2/316: dwrite d0/f51 [0,4194304] 0 2024-09-13T02:50:49.776 INFO:tasks.workunit.client.1.smithi122.stdout:2/317: write d0/d1e/d2e/d3e/f4b [141773,73876] 0 2024-09-13T02:50:49.777 INFO:tasks.workunit.client.1.smithi122.stdout:2/318: mknod d0/d1e/c61 0 2024-09-13T02:50:49.779 INFO:tasks.workunit.client.1.smithi122.stdout:7/342: dwrite d4/d8/db/f42 [0,4194304] 0 2024-09-13T02:50:49.779 INFO:tasks.workunit.client.1.smithi122.stdout:7/343: fdatasync d4/d8/db/f2a 0 2024-09-13T02:50:49.786 INFO:tasks.workunit.client.1.smithi122.stdout:7/344: read d4/f29 [2182513,101657] 0 2024-09-13T02:50:49.786 INFO:tasks.workunit.client.1.smithi122.stdout:7/345: fsync d4/d8/db/ff 0 2024-09-13T02:50:49.786 INFO:tasks.workunit.client.1.smithi122.stdout:9/419: dwrite f1 [0,4194304] 0 2024-09-13T02:50:49.788 INFO:tasks.workunit.client.1.smithi122.stdout:5/385: dread d0/d17/f18 [0,4194304] 0 2024-09-13T02:50:49.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/420: creat d8/d16/d3d/d59/f7f x:0 0 0 2024-09-13T02:50:49.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/421: fsync d8/d16/d3e/f6b 0 2024-09-13T02:50:49.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/422: write d8/f2e [1088007,112655] 0 2024-09-13T02:50:49.789 INFO:tasks.workunit.client.1.smithi122.stdout:9/423: chown d8/d16/d3d/d59/l48 2897 1 2024-09-13T02:50:49.790 INFO:tasks.workunit.client.1.smithi122.stdout:0/439: dread d1/d5/d10/d29/f40 [0,4194304] 0 2024-09-13T02:50:49.790 INFO:tasks.workunit.client.1.smithi122.stdout:0/440: creat d1/d5/d10/d29/f8d x:0 0 0 2024-09-13T02:50:49.791 INFO:tasks.workunit.client.1.smithi122.stdout:8/317: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:49.791 INFO:tasks.workunit.client.1.smithi122.stdout:8/318: write d3/d31/d52/d59/f39 [1760193,54121] 0 2024-09-13T02:50:49.791 INFO:tasks.workunit.client.1.smithi122.stdout:5/386: link d0/f5a d0/d17/d36/d25/f74 0 2024-09-13T02:50:49.792 INFO:tasks.workunit.client.1.smithi122.stdout:9/424: truncate d8/f1a 1404520 0 2024-09-13T02:50:49.797 INFO:tasks.workunit.client.1.smithi122.stdout:8/319: rename d3/d53/d21/f26 to d3/d31/d52/d59/f5f 0 2024-09-13T02:50:49.797 INFO:tasks.workunit.client.1.smithi122.stdout:8/320: readlink d3/da/d1f/d4e/l51 0 2024-09-13T02:50:49.797 INFO:tasks.workunit.client.1.smithi122.stdout:8/321: fdatasync d3/da/d1e/f47 0 2024-09-13T02:50:49.797 INFO:tasks.workunit.client.1.smithi122.stdout:8/322: dread - d3/d53/f45 zero size 2024-09-13T02:50:49.799 INFO:tasks.workunit.client.1.smithi122.stdout:5/387: mknod d0/d17/d36/d25/c75 0 2024-09-13T02:50:49.801 INFO:tasks.workunit.client.1.smithi122.stdout:9/425: rename d8/d16/d3d/d59/d29/l35 to d8/d16/d3d/d59/d23/d1f/l80 0 2024-09-13T02:50:49.802 INFO:tasks.workunit.client.1.smithi122.stdout:5/388: creat d0/d17/d36/f76 x:0 0 0 2024-09-13T02:50:49.802 INFO:tasks.workunit.client.1.smithi122.stdout:5/389: dread - d0/f53 zero size 2024-09-13T02:50:49.802 INFO:tasks.workunit.client.1.smithi122.stdout:5/390: read - d0/da/d48/f47 zero size 2024-09-13T02:50:49.804 INFO:tasks.workunit.client.1.smithi122.stdout:5/391: creat d0/d17/d36/d3f/d4c/f77 x:0 0 0 2024-09-13T02:50:49.804 INFO:tasks.workunit.client.1.smithi122.stdout:5/392: write d0/d2/d33/f52 [1018053,112953] 0 2024-09-13T02:50:49.804 INFO:tasks.workunit.client.1.smithi122.stdout:5/393: fdatasync d0/d17/f28 0 2024-09-13T02:50:49.805 INFO:tasks.workunit.client.1.smithi122.stdout:5/394: read - d0/d2/d33/f70 zero size 2024-09-13T02:50:49.805 INFO:tasks.workunit.client.1.smithi122.stdout:9/426: unlink d8/d16/c26 0 2024-09-13T02:50:49.805 INFO:tasks.workunit.client.1.smithi122.stdout:1/430: dwrite dc/de/d13/d46/d6c/f78 [0,4194304] 0 2024-09-13T02:50:49.811 INFO:tasks.workunit.client.1.smithi122.stdout:2/319: dwrite d0/d1e/d2e/d3e/f46 [0,4194304] 0 2024-09-13T02:50:49.811 INFO:tasks.workunit.client.1.smithi122.stdout:1/431: link dc/de/d13/d3f/f7f dc/de/d13/d46/d6c/f8c 0 2024-09-13T02:50:49.811 INFO:tasks.workunit.client.1.smithi122.stdout:1/432: creat dc/de/f8d x:0 0 0 2024-09-13T02:50:49.814 INFO:tasks.workunit.client.1.smithi122.stdout:2/320: link d0/d1e/d22/d39/f49 d0/d55/f62 0 2024-09-13T02:50:49.814 INFO:tasks.workunit.client.1.smithi122.stdout:7/346: dwrite d4/d8/db/dc/d46/f6e [0,4194304] 0 2024-09-13T02:50:49.816 INFO:tasks.workunit.client.1.smithi122.stdout:1/433: truncate dc/de/d18/f28 567121 0 2024-09-13T02:50:49.817 INFO:tasks.workunit.client.1.smithi122.stdout:1/434: creat dc/de/f8e x:0 0 0 2024-09-13T02:50:49.818 INFO:tasks.workunit.client.1.smithi122.stdout:5/395: dread d0/d17/d36/d25/f74 [0,4194304] 0 2024-09-13T02:50:49.819 INFO:tasks.workunit.client.1.smithi122.stdout:5/396: fsync d0/d17/d36/d25/f60 0 2024-09-13T02:50:49.819 INFO:tasks.workunit.client.1.smithi122.stdout:5/397: dread - d0/d17/d36/d25/d2b/f71 zero size 2024-09-13T02:50:49.819 INFO:tasks.workunit.client.1.smithi122.stdout:5/398: chown d0/d17/d36/d25/d2b/f2c 1005316960 1 2024-09-13T02:50:49.823 INFO:tasks.workunit.client.1.smithi122.stdout:2/321: symlink d0/d1e/d22/d39/l63 0 2024-09-13T02:50:49.823 INFO:tasks.workunit.client.1.smithi122.stdout:2/322: fsync d0/d1e/d22/f47 0 2024-09-13T02:50:49.823 INFO:tasks.workunit.client.1.smithi122.stdout:2/323: fdatasync d0/f10 0 2024-09-13T02:50:49.825 INFO:tasks.workunit.client.1.smithi122.stdout:9/427: dwrite d8/d16/d3e/f75 [0,4194304] 0 2024-09-13T02:50:49.825 INFO:tasks.workunit.client.1.smithi122.stdout:8/323: dwrite d3/d53/f45 [0,4194304] 0 2024-09-13T02:50:49.826 INFO:tasks.workunit.client.1.smithi122.stdout:7/347: rename d4/d8/db/f2a to d4/d8/db/dc/d46/d5a/f76 0 2024-09-13T02:50:49.826 INFO:tasks.workunit.client.1.smithi122.stdout:7/348: fdatasync d4/d4e/d5d/f5e 0 2024-09-13T02:50:49.826 INFO:tasks.workunit.client.1.smithi122.stdout:7/349: fdatasync d4/d8/db/dc/d46/f6e 0 2024-09-13T02:50:49.828 INFO:tasks.workunit.client.1.smithi122.stdout:2/324: symlink d0/d1c/d3b/l64 0 2024-09-13T02:50:49.832 INFO:tasks.workunit.client.1.smithi122.stdout:9/428: creat d8/d16/d45/f81 x:0 0 0 2024-09-13T02:50:49.832 INFO:tasks.workunit.client.1.smithi122.stdout:9/429: chown d8/d4a/d64 6774 1 2024-09-13T02:50:49.832 INFO:tasks.workunit.client.1.smithi122.stdout:9/430: fdatasync d8/d16/d3d/d59/f4d 0 2024-09-13T02:50:49.832 INFO:tasks.workunit.client.1.smithi122.stdout:9/431: fsync d8/d16/d3d/d59/f4e 0 2024-09-13T02:50:49.833 INFO:tasks.workunit.client.1.smithi122.stdout:7/350: dread d4/d8/db/ff [0,4194304] 0 2024-09-13T02:50:49.835 INFO:tasks.workunit.client.1.smithi122.stdout:8/324: symlink d3/da/d1e/l60 0 2024-09-13T02:50:49.837 INFO:tasks.workunit.client.1.smithi122.stdout:2/325: rmdir d0/d1e/d2e 39 2024-09-13T02:50:49.837 INFO:tasks.workunit.client.1.smithi122.stdout:7/351: mkdir d4/d77 0 2024-09-13T02:50:49.837 INFO:tasks.workunit.client.1.smithi122.stdout:7/352: fdatasync d4/d8/db/dc/d1b/f2f 0 2024-09-13T02:50:49.842 INFO:tasks.workunit.client.1.smithi122.stdout:5/399: dwrite d0/d2/d33/f70 [0,4194304] 0 2024-09-13T02:50:49.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/326: symlink d0/d1e/l65 0 2024-09-13T02:50:49.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/327: dread - d0/d1c/d3b/d41/d4e/f60 zero size 2024-09-13T02:50:49.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/328: chown d0/d1e/d26/d3a 961675 1 2024-09-13T02:50:49.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/329: fsync d0/d1e/d26/f30 0 2024-09-13T02:50:49.844 INFO:tasks.workunit.client.1.smithi122.stdout:7/353: creat d4/d4e/d5d/d6b/f78 x:0 0 0 2024-09-13T02:50:49.844 INFO:tasks.workunit.client.1.smithi122.stdout:7/354: fsync d4/d8/db/dc/f28 0 2024-09-13T02:50:49.845 INFO:tasks.workunit.client.1.smithi122.stdout:5/400: write d0/d2/f6d [511007,33433] 0 2024-09-13T02:50:49.845 INFO:tasks.workunit.client.1.smithi122.stdout:7/355: dread d4/d8/d24/d47/f55 [0,4194304] 0 2024-09-13T02:50:49.847 INFO:tasks.workunit.client.1.smithi122.stdout:1/435: dwrite dc/de/d7a/f82 [0,4194304] 0 2024-09-13T02:50:49.848 INFO:tasks.workunit.client.1.smithi122.stdout:1/436: stat dc/de/d7a/f82 0 2024-09-13T02:50:49.848 INFO:tasks.workunit.client.1.smithi122.stdout:5/401: symlink d0/d2/l78 0 2024-09-13T02:50:49.849 INFO:tasks.workunit.client.1.smithi122.stdout:9/432: getdents d8/d16/d3d/d59/d29 0 2024-09-13T02:50:49.849 INFO:tasks.workunit.client.1.smithi122.stdout:9/433: getdents d8/d16/d3d/d59/d23/d7b 0 2024-09-13T02:50:49.853 INFO:tasks.workunit.client.1.smithi122.stdout:1/437: creat dc/d38/d51/f8f x:0 0 0 2024-09-13T02:50:49.855 INFO:tasks.workunit.client.1.smithi122.stdout:5/402: unlink d0/da/c42 0 2024-09-13T02:50:49.856 INFO:tasks.workunit.client.1.smithi122.stdout:8/325: dwrite d3/d53/d34/f49 [0,4194304] 0 2024-09-13T02:50:49.856 INFO:tasks.workunit.client.1.smithi122.stdout:8/326: chown f2 2235 1 2024-09-13T02:50:49.856 INFO:tasks.workunit.client.1.smithi122.stdout:8/327: chown d3/c4a 10 1 2024-09-13T02:50:49.857 INFO:tasks.workunit.client.1.smithi122.stdout:9/434: getdents d8/d16/d3d/d59/d23/d1f/d36 0 2024-09-13T02:50:49.859 INFO:tasks.workunit.client.1.smithi122.stdout:9/435: mkdir d8/d16/d3d/d59/d23/d7b/d82 0 2024-09-13T02:50:49.861 INFO:tasks.workunit.client.1.smithi122.stdout:5/403: write d0/f5a [2237075,79861] 0 2024-09-13T02:50:49.861 INFO:tasks.workunit.client.1.smithi122.stdout:7/356: write d4/d8/d24/f3e [8273388,52358] 0 2024-09-13T02:50:49.861 INFO:tasks.workunit.client.1.smithi122.stdout:2/330: dwrite d0/d1e/d22/f47 [0,4194304] 0 2024-09-13T02:50:49.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/436: getdents d8/d4a/d64 0 2024-09-13T02:50:49.863 INFO:tasks.workunit.client.1.smithi122.stdout:9/437: stat d8/d16/d3d/d59/d23/d7b 0 2024-09-13T02:50:49.870 INFO:tasks.workunit.client.1.smithi122.stdout:8/328: write d3/da/d1f/f37 [2397832,83394] 0 2024-09-13T02:50:49.873 INFO:tasks.workunit.client.1.smithi122.stdout:7/357: unlink d4/d8/db/dc/d46/d5a/f76 0 2024-09-13T02:50:49.874 INFO:tasks.workunit.client.1.smithi122.stdout:1/438: dwrite dc/de/d18/d22/d1c/d47/f4d [0,4194304] 0 2024-09-13T02:50:49.874 INFO:tasks.workunit.client.1.smithi122.stdout:1/439: readlink dc/de/d18/d22/d1c/d47/l74 0 2024-09-13T02:50:49.876 INFO:tasks.workunit.client.1.smithi122.stdout:2/331: mknod d0/d1e/d26/d3a/c66 0 2024-09-13T02:50:49.887 INFO:tasks.workunit.client.1.smithi122.stdout:8/329: creat d3/d31/f61 x:0 0 0 2024-09-13T02:50:49.887 INFO:tasks.workunit.client.1.smithi122.stdout:8/330: write d3/f58 [4978490,30177] 0 2024-09-13T02:50:49.892 INFO:tasks.workunit.client.1.smithi122.stdout:7/358: dwrite d4/f35 [0,4194304] 0 2024-09-13T02:50:49.892 INFO:tasks.workunit.client.1.smithi122.stdout:1/440: truncate dc/de/d18/d1d/f23 1264595 0 2024-09-13T02:50:49.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/332: rename d0/d1c/d3b/l64 to d0/d1e/d26/d3d/l67 0 2024-09-13T02:50:49.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/333: creat d0/f68 x:0 0 0 2024-09-13T02:50:49.895 INFO:tasks.workunit.client.1.smithi122.stdout:9/438: rmdir d8/d16/d45 39 2024-09-13T02:50:49.897 INFO:tasks.workunit.client.1.smithi122.stdout:6/546: sync 2024-09-13T02:50:49.898 INFO:tasks.workunit.client.1.smithi122.stdout:1/441: creat dc/de/d18/d86/f90 x:0 0 0 2024-09-13T02:50:49.898 INFO:tasks.workunit.client.1.smithi122.stdout:1/442: stat dc/de/d13/d46/f70 0 2024-09-13T02:50:49.901 INFO:tasks.workunit.client.1.smithi122.stdout:2/334: truncate d0/f1b 1665692 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:9/439: rmdir d8/d16/d3e 39 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:9/440: write d8/d16/d3d/d59/d7d/f78 [117395,68056] 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/443: rmdir dc/de/d13/d3f 39 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/444: creat dc/de/d18/d1d/f91 x:0 0 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/445: readlink dc/d38/l89 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/446: fdatasync dc/de/d18/d1d/d2f/f4b 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/447: fdatasync dc/de/d18/d1d/f73 0 2024-09-13T02:50:49.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/448: creat dc/de/d13/d46/f92 x:0 0 0 2024-09-13T02:50:49.904 INFO:tasks.workunit.client.1.smithi122.stdout:6/547: symlink d5/d11/lab 0 2024-09-13T02:50:49.904 INFO:tasks.workunit.client.1.smithi122.stdout:6/548: stat d5/db/d29 0 2024-09-13T02:50:49.904 INFO:tasks.workunit.client.1.smithi122.stdout:8/331: dwrite d3/da/d1e/f47 [0,4194304] 0 2024-09-13T02:50:49.906 INFO:tasks.workunit.client.1.smithi122.stdout:7/359: write d4/f35 [4547678,46111] 0 2024-09-13T02:50:49.906 INFO:tasks.workunit.client.1.smithi122.stdout:9/441: read d8/d16/f62 [2667559,90173] 0 2024-09-13T02:50:49.906 INFO:tasks.workunit.client.1.smithi122.stdout:1/449: symlink dc/de/d18/l93 0 2024-09-13T02:50:49.907 INFO:tasks.workunit.client.1.smithi122.stdout:2/335: getdents d0/d1c 0 2024-09-13T02:50:49.907 INFO:tasks.workunit.client.1.smithi122.stdout:2/336: chown d0/d1e/d26/d3a/d59 167854595 1 2024-09-13T02:50:49.908 INFO:tasks.workunit.client.1.smithi122.stdout:6/549: write d5/f69 [331586,109638] 0 2024-09-13T02:50:49.908 INFO:tasks.workunit.client.1.smithi122.stdout:6/550: fdatasync d5/d3d/f77 0 2024-09-13T02:50:49.908 INFO:tasks.workunit.client.1.smithi122.stdout:6/551: stat d5/d3d/d48 0 2024-09-13T02:50:49.908 INFO:tasks.workunit.client.1.smithi122.stdout:6/552: write d5/d11/f75 [1016216,40994] 0 2024-09-13T02:50:49.908 INFO:tasks.workunit.client.1.smithi122.stdout:6/553: readlink d5/d3d/d6c/d41/l80 0 2024-09-13T02:50:49.910 INFO:tasks.workunit.client.1.smithi122.stdout:8/332: rmdir d3/d31/d50 0 2024-09-13T02:50:49.913 INFO:tasks.workunit.client.1.smithi122.stdout:7/360: mkdir d4/d79 0 2024-09-13T02:50:49.913 INFO:tasks.workunit.client.1.smithi122.stdout:7/361: write d4/d8/db/f2c [227129,120104] 0 2024-09-13T02:50:49.915 INFO:tasks.workunit.client.1.smithi122.stdout:9/442: mkdir d8/d16/d3d/d59/d7d/d83 0 2024-09-13T02:50:49.917 INFO:tasks.workunit.client.1.smithi122.stdout:1/450: mkdir dc/de/d18/d1d/d2f/d94 0 2024-09-13T02:50:49.918 INFO:tasks.workunit.client.1.smithi122.stdout:2/337: rename d0/d1c/f4d to d0/d1e/d22/d29/f69 0 2024-09-13T02:50:49.921 INFO:tasks.workunit.client.1.smithi122.stdout:6/554: write d5/db/f1b [201502,128025] 0 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: Manager daemon smithi122.ptcenr is now available 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: Checking for cert/key for grafana.smithi100 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: Migrating grafana.smithi100 cert to cert store 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: Migrating grafana.smithi100 key to cert store 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/trash_purge_schedule"}]: dispatch 2024-09-13T02:50:49.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/trash_purge_schedule"}]: dispatch 2024-09-13T02:50:49.927 INFO:tasks.workunit.client.1.smithi122.stdout:1/451: creat dc/de/d18/d1d/d2f/f95 x:0 0 0 2024-09-13T02:50:49.935 INFO:tasks.workunit.client.1.smithi122.stdout:9/443: dwrite d8/d16/d3e/f75 [0,4194304] 0 2024-09-13T02:50:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: Manager daemon smithi122.ptcenr is now available 2024-09-13T02:50:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: Checking for cert/key for grafana.smithi100 2024-09-13T02:50:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: Migrating grafana.smithi100 cert to cert store 2024-09-13T02:50:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: Migrating grafana.smithi100 key to cert store 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/trash_purge_schedule"}]: dispatch 2024-09-13T02:50:49.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi122.ptcenr/trash_purge_schedule"}]: dispatch 2024-09-13T02:50:49.937 INFO:tasks.workunit.client.1.smithi122.stdout:7/362: dwrite d4/d8/db/f38 [4194304,4194304] 0 2024-09-13T02:50:49.937 INFO:tasks.workunit.client.1.smithi122.stdout:1/452: mkdir dc/d38/d51/d96 0 2024-09-13T02:50:49.938 INFO:tasks.workunit.client.1.smithi122.stdout:1/453: write dc/de/d18/d1d/f4e [4261586,112901] 0 2024-09-13T02:50:49.938 INFO:tasks.workunit.client.1.smithi122.stdout:2/338: rmdir d0/d1e/d2e/d3e 39 2024-09-13T02:50:49.939 INFO:tasks.workunit.client.1.smithi122.stdout:6/555: rmdir d5/d3d/d6c/d41/d4e/d93 39 2024-09-13T02:50:49.941 INFO:tasks.workunit.client.1.smithi122.stdout:7/363: dread d4/d8/db/dc/f28 [0,4194304] 0 2024-09-13T02:50:49.944 INFO:tasks.workunit.client.1.smithi122.stdout:1/454: link dc/de/d18/d22/d1c/c63 dc/de/d13/d46/d6c/d72/c97 0 2024-09-13T02:50:49.944 INFO:tasks.workunit.client.1.smithi122.stdout:1/455: write fa [1183952,7769] 0 2024-09-13T02:50:49.945 INFO:tasks.workunit.client.1.smithi122.stdout:2/339: write d0/d1c/f31 [859444,33019] 0 2024-09-13T02:50:49.946 INFO:tasks.workunit.client.1.smithi122.stdout:9/444: dread d8/f28 [0,4194304] 0 2024-09-13T02:50:49.946 INFO:tasks.workunit.client.1.smithi122.stdout:1/456: mkdir dc/de/d18/d1d/d2f/d94/d98 0 2024-09-13T02:50:49.947 INFO:tasks.workunit.client.1.smithi122.stdout:1/457: write dc/de/d18/d1d/f34 [112561,39106] 0 2024-09-13T02:50:49.948 INFO:tasks.workunit.client.1.smithi122.stdout:2/340: chown d0/d1c/l35 1818732 1 2024-09-13T02:50:49.948 INFO:tasks.workunit.client.1.smithi122.stdout:2/341: stat d0/fc 0 2024-09-13T02:50:49.950 INFO:tasks.workunit.client.1.smithi122.stdout:1/458: mknod dc/d38/d51/c99 0 2024-09-13T02:50:49.951 INFO:tasks.workunit.client.1.smithi122.stdout:7/364: dread d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:49.952 INFO:tasks.workunit.client.1.smithi122.stdout:6/556: dread d5/d3d/d6c/d41/d4e/f88 [0,4194304] 0 2024-09-13T02:50:49.953 INFO:tasks.workunit.client.1.smithi122.stdout:1/459: fsync fa 0 2024-09-13T02:50:49.953 INFO:tasks.workunit.client.1.smithi122.stdout:1/460: read dc/f10 [1714584,39594] 0 2024-09-13T02:50:49.956 INFO:tasks.workunit.client.1.smithi122.stdout:1/461: creat dc/de/d13/f9a x:0 0 0 2024-09-13T02:50:49.959 INFO:tasks.workunit.client.1.smithi122.stdout:2/342: rename d0/d1e/d22/d39 to d0/d1c/d3b/d41/d6a 0 2024-09-13T02:50:49.961 INFO:tasks.workunit.client.1.smithi122.stdout:2/343: symlink d0/d1e/d26/l6b 0 2024-09-13T02:50:49.961 INFO:tasks.workunit.client.1.smithi122.stdout:2/344: chown d0/c11 1231 1 2024-09-13T02:50:49.962 INFO:tasks.workunit.client.1.smithi122.stdout:9/445: write d8/d16/f2b [1856947,71800] 0 2024-09-13T02:50:49.962 INFO:tasks.workunit.client.1.smithi122.stdout:9/446: readlink d8/d16/d3d/d59/l60 0 2024-09-13T02:50:49.963 INFO:tasks.workunit.client.1.smithi122.stdout:1/462: rename dc/de/d18/c29 to dc/de/d18/d22/d80/c9b 0 2024-09-13T02:50:49.963 INFO:tasks.workunit.client.1.smithi122.stdout:1/463: write dc/de/d18/f66 [482925,47771] 0 2024-09-13T02:50:49.964 INFO:tasks.workunit.client.1.smithi122.stdout:6/557: dread d5/d11/d45/df/d46/f8f [0,4194304] 0 2024-09-13T02:50:49.965 INFO:tasks.workunit.client.1.smithi122.stdout:2/345: mknod d0/d1c/d3b/d41/c6c 0 2024-09-13T02:50:49.965 INFO:tasks.workunit.client.1.smithi122.stdout:2/346: read - d0/d1e/f38 zero size 2024-09-13T02:50:49.968 INFO:tasks.workunit.client.1.smithi122.stdout:6/558: mkdir d5/db/d29/d60/dac 0 2024-09-13T02:50:49.969 INFO:tasks.workunit.client.1.smithi122.stdout:2/347: link d0/d1e/d22/l23 d0/d1e/d22/l6d 0 2024-09-13T02:50:49.969 INFO:tasks.workunit.client.1.smithi122.stdout:2/348: write d0/f68 [730896,88444] 0 2024-09-13T02:50:49.969 INFO:tasks.workunit.client.1.smithi122.stdout:2/349: fsync d0/d1e/d22/f32 0 2024-09-13T02:50:49.969 INFO:tasks.workunit.client.1.smithi122.stdout:2/350: write d0/d1c/d3b/d41/d6a/f57 [3119842,26874] 0 2024-09-13T02:50:49.970 INFO:tasks.workunit.client.1.smithi122.stdout:2/351: dread - d0/d1e/d2e/d3e/f5b zero size 2024-09-13T02:50:49.975 INFO:tasks.workunit.client.1.smithi122.stdout:1/464: rmdir dc/de/d13/d46/d6c 39 2024-09-13T02:50:49.975 INFO:tasks.workunit.client.1.smithi122.stdout:1/465: chown dc/de/d13/d3f/l6f 36259 1 2024-09-13T02:50:49.975 INFO:tasks.workunit.client.1.smithi122.stdout:1/466: fsync dc/de/d18/d1d/f73 0 2024-09-13T02:50:49.975 INFO:tasks.workunit.client.1.smithi122.stdout:1/467: truncate dc/de/d18/d22/d1c/f87 311525 0 2024-09-13T02:50:49.975 INFO:tasks.workunit.client.1.smithi122.stdout:9/447: dread d8/d16/d3d/d59/f4d [0,4194304] 0 2024-09-13T02:50:49.977 INFO:tasks.workunit.client.1.smithi122.stdout:6/559: write d5/d3d/d6c/d41/f47 [9319278,10242] 0 2024-09-13T02:50:49.977 INFO:tasks.workunit.client.1.smithi122.stdout:7/365: dwrite d4/d8/db/dc/d1b/f32 [0,4194304] 0 2024-09-13T02:50:49.978 INFO:tasks.workunit.client.1.smithi122.stdout:7/366: creat d4/d8/d24/d47/f7a x:0 0 0 2024-09-13T02:50:49.983 INFO:tasks.workunit.client.1.smithi122.stdout:6/560: unlink d5/d11/d45/f2d 0 2024-09-13T02:50:49.985 INFO:tasks.workunit.client.1.smithi122.stdout:7/367: symlink d4/d8/db/dc/d46/l7b 0 2024-09-13T02:50:49.986 INFO:tasks.workunit.client.1.smithi122.stdout:7/368: creat d4/d8/db/dc/d46/d5a/f7c x:0 0 0 2024-09-13T02:50:49.986 INFO:tasks.workunit.client.1.smithi122.stdout:7/369: write d4/d8/db/dc/d46/d5a/f6f [973781,41369] 0 2024-09-13T02:50:49.986 INFO:tasks.workunit.client.1.smithi122.stdout:7/370: stat d4/d8/c4b 0 2024-09-13T02:50:49.986 INFO:tasks.workunit.client.1.smithi122.stdout:2/352: dwrite d0/d1e/d22/f37 [0,4194304] 0 2024-09-13T02:50:49.988 INFO:tasks.workunit.client.1.smithi122.stdout:9/448: mknod d8/d16/c84 0 2024-09-13T02:50:49.994 INFO:tasks.workunit.client.1.smithi122.stdout:1/468: dread dc/de/f11 [0,4194304] 0 2024-09-13T02:50:49.994 INFO:tasks.workunit.client.1.smithi122.stdout:1/469: truncate dc/de/d18/d1d/f85 633213 0 2024-09-13T02:50:50.010 INFO:tasks.workunit.client.1.smithi122.stdout:6/561: dwrite d5/d11/d45/df/f13 [0,4194304] 0 2024-09-13T02:50:50.011 INFO:tasks.workunit.client.1.smithi122.stdout:1/470: dwrite f2 [0,4194304] 0 2024-09-13T02:50:50.011 INFO:tasks.workunit.client.1.smithi122.stdout:1/471: creat dc/f9c x:0 0 0 2024-09-13T02:50:50.011 INFO:tasks.workunit.client.1.smithi122.stdout:9/449: link d8/c5e d8/d16/d3d/d59/d23/d1f/d36/c85 0 2024-09-13T02:50:50.011 INFO:tasks.workunit.client.1.smithi122.stdout:9/450: chown d8/c22 23745730 1 2024-09-13T02:50:50.011 INFO:tasks.workunit.client.1.smithi122.stdout:9/451: chown d8/d16/d3d/d59/d23/d1f/f2a 20013 1 2024-09-13T02:50:50.012 INFO:tasks.workunit.client.1.smithi122.stdout:2/353: unlink d0/d1c/c2d 0 2024-09-13T02:50:50.015 INFO:tasks.workunit.client.1.smithi122.stdout:6/562: creat d5/d11/d45/df/fad x:0 0 0 2024-09-13T02:50:50.015 INFO:tasks.workunit.client.1.smithi122.stdout:6/563: dread - d5/d11/d45/f78 zero size 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:2/354: write d0/f51 [208903,101417] 0 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:2/355: fsync d0/f1b 0 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:1/472: mknod dc/de/d18/d22/d80/c9d 0 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:1/473: read - dc/de/d13/f9a zero size 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:1/474: creat dc/f9e x:0 0 0 2024-09-13T02:50:50.021 INFO:tasks.workunit.client.1.smithi122.stdout:9/452: symlink d8/d16/d3e/d57/l86 0 2024-09-13T02:50:50.023 INFO:tasks.workunit.client.1.smithi122.stdout:6/564: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:50.023 INFO:tasks.workunit.client.1.smithi122.stdout:6/565: chown d5/d11/d45/d21/f87 937833 1 2024-09-13T02:50:50.030 INFO:tasks.workunit.client.1.smithi122.stdout:2/356: creat d0/d1e/d26/d3a/d59/f6e x:0 0 0 2024-09-13T02:50:50.035 INFO:tasks.workunit.client.1.smithi122.stdout:1/475: truncate dc/f10 3272736 0 2024-09-13T02:50:50.038 INFO:tasks.workunit.client.1.smithi122.stdout:9/453: rmdir d8/d16/d3d/d59/d23/d1f/d36/d44/d65 39 2024-09-13T02:50:50.038 INFO:tasks.workunit.client.1.smithi122.stdout:6/566: dwrite d5/d11/d45/df/d46/faa [0,4194304] 0 2024-09-13T02:50:50.039 INFO:tasks.workunit.client.1.smithi122.stdout:6/567: write d5/d11/d45/df/d46/f8f [4352211,52012] 0 2024-09-13T02:50:50.039 INFO:tasks.workunit.client.1.smithi122.stdout:1/476: symlink dc/de/d18/d22/l9f 0 2024-09-13T02:50:50.040 INFO:tasks.workunit.client.1.smithi122.stdout:3/498: sync 2024-09-13T02:50:50.040 INFO:tasks.workunit.client.1.smithi122.stdout:3/499: chown d4/d11/dd/c23 52820 1 2024-09-13T02:50:50.041 INFO:tasks.workunit.client.1.smithi122.stdout:9/454: creat d8/d16/d3d/d59/d23/d1f/f87 x:0 0 0 2024-09-13T02:50:50.045 INFO:tasks.workunit.client.1.smithi122.stdout:2/357: dwrite d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:50.046 INFO:tasks.workunit.client.1.smithi122.stdout:6/568: unlink d5/d11/d45/d21/l43 0 2024-09-13T02:50:50.052 INFO:tasks.workunit.client.1.smithi122.stdout:3/500: symlink d4/d11/dd/d21/d2b/d36/d3c/d43/da3/lb6 0 2024-09-13T02:50:50.052 INFO:tasks.workunit.client.1.smithi122.stdout:3/501: write d4/d11/dd/d21/d2b/d36/d3c/f10 [1333762,81640] 0 2024-09-13T02:50:50.052 INFO:tasks.workunit.client.1.smithi122.stdout:3/502: fsync d4/f5d 0 2024-09-13T02:50:50.055 INFO:tasks.workunit.client.1.smithi122.stdout:9/455: truncate f1 659735 0 2024-09-13T02:50:50.056 INFO:tasks.workunit.client.1.smithi122.stdout:9/456: fdatasync d8/d16/f62 0 2024-09-13T02:50:50.061 INFO:tasks.workunit.client.1.smithi122.stdout:3/503: write d4/d6/df/d15/d68/d90/fa7 [856896,94302] 0 2024-09-13T02:50:50.062 INFO:tasks.workunit.client.1.smithi122.stdout:6/569: dread d5/d3d/d6c/d41/d4e/d5f/f79 [0,4194304] 0 2024-09-13T02:50:50.062 INFO:tasks.workunit.client.1.smithi122.stdout:6/570: dread - d5/d11/d45/d21/f57 zero size 2024-09-13T02:50:50.065 INFO:tasks.workunit.client.1.smithi122.stdout:1/477: dwrite dc/de/d18/d1d/f34 [0,4194304] 0 2024-09-13T02:50:50.065 INFO:tasks.workunit.client.1.smithi122.stdout:1/478: fdatasync dc/f9e 0 2024-09-13T02:50:50.070 INFO:tasks.workunit.client.1.smithi122.stdout:2/358: dwrite d0/d1e/d22/f45 [0,4194304] 0 2024-09-13T02:50:50.070 INFO:tasks.workunit.client.1.smithi122.stdout:2/359: creat d0/d1e/d26/d3d/f6f x:0 0 0 2024-09-13T02:50:50.074 INFO:tasks.workunit.client.1.smithi122.stdout:9/457: dread d8/d16/d3d/d59/d23/d1f/d36/d44/f68 [0,4194304] 0 2024-09-13T02:50:50.078 INFO:tasks.workunit.client.1.smithi122.stdout:9/458: rmdir d8/d16/d3d/d59/d23/d7b 39 2024-09-13T02:50:50.079 INFO:tasks.workunit.client.1.smithi122.stdout:2/360: rename d0/d1e/d26/d3a to d0/d55/d70 0 2024-09-13T02:50:50.079 INFO:tasks.workunit.client.1.smithi122.stdout:2/361: stat d0/d1e/d26 0 2024-09-13T02:50:50.079 INFO:tasks.workunit.client.1.smithi122.stdout:2/362: write d0/d1e/d2e/d3e/f5b [972474,48459] 0 2024-09-13T02:50:50.081 INFO:tasks.workunit.client.1.smithi122.stdout:2/363: mknod d0/d1e/d22/c71 0 2024-09-13T02:50:50.082 INFO:tasks.workunit.client.1.smithi122.stdout:1/479: write dc/de/d13/d46/f81 [2765203,97813] 0 2024-09-13T02:50:50.083 INFO:tasks.workunit.client.1.smithi122.stdout:1/480: stat dc/de/d18/d22/d1c/c3e 0 2024-09-13T02:50:50.083 INFO:tasks.workunit.client.1.smithi122.stdout:1/481: chown dc/de/d7a/f82 1159107 1 2024-09-13T02:50:50.083 INFO:tasks.workunit.client.1.smithi122.stdout:1/482: chown dc/de/d13/c21 110 1 2024-09-13T02:50:50.083 INFO:tasks.workunit.client.1.smithi122.stdout:1/483: dread - dc/d38/d51/f8f zero size 2024-09-13T02:50:50.083 INFO:tasks.workunit.client.1.smithi122.stdout:9/459: rename d8/d16/d3d/d59/d23/d1f/d36/d44 to d8/d88 0 2024-09-13T02:50:50.088 INFO:tasks.workunit.client.1.smithi122.stdout:9/460: rmdir d8/d88/d65 39 2024-09-13T02:50:50.088 INFO:tasks.workunit.client.1.smithi122.stdout:3/504: dwrite d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:50.090 INFO:tasks.workunit.client.1.smithi122.stdout:6/571: dwrite d5/d11/d45/df/d46/f8f [0,4194304] 0 2024-09-13T02:50:50.100 INFO:tasks.workunit.client.1.smithi122.stdout:9/461: dread d8/d16/d3d/d59/d23/d1f/f37 [0,4194304] 0 2024-09-13T02:50:50.101 INFO:tasks.workunit.client.1.smithi122.stdout:1/484: dwrite dc/f35 [0,4194304] 0 2024-09-13T02:50:50.102 INFO:tasks.workunit.client.1.smithi122.stdout:3/505: dread d4/d6/df/d15/f61 [0,4194304] 0 2024-09-13T02:50:50.108 INFO:tasks.workunit.client.1.smithi122.stdout:6/572: creat d5/d11/d45/d21/d83/fae x:0 0 0 2024-09-13T02:50:50.109 INFO:tasks.workunit.client.1.smithi122.stdout:9/462: read d8/d16/d3d/d59/d23/d1f/d36/f52 [1671750,15049] 0 2024-09-13T02:50:50.111 INFO:tasks.workunit.client.1.smithi122.stdout:1/485: dread dc/de/d13/d3f/f7f [0,4194304] 0 2024-09-13T02:50:50.111 INFO:tasks.workunit.client.1.smithi122.stdout:1/486: chown fa 490282 1 2024-09-13T02:50:50.111 INFO:tasks.workunit.client.1.smithi122.stdout:1/487: chown dc/d38/d51/l7c 1686643 1 2024-09-13T02:50:50.112 INFO:tasks.workunit.client.1.smithi122.stdout:1/488: readlink dc/de/d18/d1d/l6b 0 2024-09-13T02:50:50.112 INFO:tasks.workunit.client.1.smithi122.stdout:1/489: creat dc/de/d7a/fa0 x:0 0 0 2024-09-13T02:50:50.114 INFO:tasks.workunit.client.1.smithi122.stdout:2/364: dwrite d0/f51 [4194304,4194304] 0 2024-09-13T02:50:50.115 INFO:tasks.workunit.client.1.smithi122.stdout:2/365: write d0/f68 [597313,29061] 0 2024-09-13T02:50:50.116 INFO:tasks.workunit.client.1.smithi122.stdout:6/573: link d5/d11/d45/d21/d83/fae d5/db/d29/d60/dac/faf 0 2024-09-13T02:50:50.116 INFO:tasks.workunit.client.1.smithi122.stdout:6/574: readlink d5/d3d/l94 0 2024-09-13T02:50:50.117 INFO:tasks.workunit.client.1.smithi122.stdout:9/463: getdents d8/d16/d3d/d59/d23 0 2024-09-13T02:50:50.118 INFO:tasks.workunit.client.1.smithi122.stdout:3/506: dread d4/d11/dd/d21/d2b/d36/d3c/f10 [0,4194304] 0 2024-09-13T02:50:50.119 INFO:tasks.workunit.client.1.smithi122.stdout:0/441: sync 2024-09-13T02:50:50.120 INFO:tasks.workunit.client.1.smithi122.stdout:4/538: sync 2024-09-13T02:50:50.121 INFO:tasks.workunit.client.1.smithi122.stdout:9/464: write d8/d88/f68 [3203546,66220] 0 2024-09-13T02:50:50.123 INFO:tasks.workunit.client.1.smithi122.stdout:9/465: dread f1 [0,4194304] 0 2024-09-13T02:50:50.124 INFO:tasks.workunit.client.1.smithi122.stdout:2/366: creat d0/d1c/d3b/d41/d6a/f72 x:0 0 0 2024-09-13T02:50:50.124 INFO:tasks.workunit.client.1.smithi122.stdout:8/333: sync 2024-09-13T02:50:50.125 INFO:tasks.workunit.client.1.smithi122.stdout:7/371: sync 2024-09-13T02:50:50.125 INFO:tasks.workunit.client.1.smithi122.stdout:5/404: sync 2024-09-13T02:50:50.125 INFO:tasks.workunit.client.1.smithi122.stdout:8/334: write d3/d31/d52/d59/d3e/f46 [50138,10497] 0 2024-09-13T02:50:50.129 INFO:tasks.workunit.client.1.smithi122.stdout:3/507: unlink d4/d6/de/d1f/f57 0 2024-09-13T02:50:50.130 INFO:tasks.workunit.client.1.smithi122.stdout:0/442: mknod d1/d5/d9/da/c8e 0 2024-09-13T02:50:50.130 INFO:tasks.workunit.client.1.smithi122.stdout:0/443: write d1/d5/d9/f20 [4993205,23951] 0 2024-09-13T02:50:50.135 INFO:tasks.workunit.client.1.smithi122.stdout:6/575: write d5/d11/d45/f81 [3198106,54368] 0 2024-09-13T02:50:50.138 INFO:tasks.workunit.client.1.smithi122.stdout:9/466: creat d8/d16/d3d/d59/d49/f89 x:0 0 0 2024-09-13T02:50:50.138 INFO:tasks.workunit.client.1.smithi122.stdout:9/467: write d8/d16/d3d/d59/d23/f3c [4972343,2643] 0 2024-09-13T02:50:50.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/372: unlink d4/d8/db/dc/d1b/f2f 0 2024-09-13T02:50:50.140 INFO:tasks.workunit.client.1.smithi122.stdout:0/444: write d1/d5/f13 [5636258,24802] 0 2024-09-13T02:50:50.142 INFO:tasks.workunit.client.1.smithi122.stdout:8/335: link d3/d53/f41 d3/d53/d4d/f62 0 2024-09-13T02:50:50.143 INFO:tasks.workunit.client.1.smithi122.stdout:3/508: rmdir d4/d11/dd/d21/d2b 39 2024-09-13T02:50:50.145 INFO:tasks.workunit.client.1.smithi122.stdout:4/539: rmdir d11/d1b/d2e 39 2024-09-13T02:50:50.145 INFO:tasks.workunit.client.1.smithi122.stdout:4/540: dread - d11/d30/d59/fa6 zero size 2024-09-13T02:50:50.146 INFO:tasks.workunit.client.1.smithi122.stdout:4/541: write d11/f49 [1681541,69149] 0 2024-09-13T02:50:50.147 INFO:tasks.workunit.client.1.smithi122.stdout:6/576: mknod d5/d3d/d82/cb0 0 2024-09-13T02:50:50.147 INFO:tasks.workunit.client.1.smithi122.stdout:6/577: fsync d5/d11/d45/df/d46/f8f 0 2024-09-13T02:50:50.147 INFO:tasks.workunit.client.1.smithi122.stdout:9/468: mknod d8/d16/d3e/d57/c8a 0 2024-09-13T02:50:50.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/373: rmdir d4/d8 39 2024-09-13T02:50:50.148 INFO:tasks.workunit.client.1.smithi122.stdout:7/374: truncate d4/d8/d24/d47/f55 249052 0 2024-09-13T02:50:50.149 INFO:tasks.workunit.client.1.smithi122.stdout:0/445: unlink d1/d5/d9/f67 0 2024-09-13T02:50:50.150 INFO:tasks.workunit.client.1.smithi122.stdout:8/336: creat d3/da/d1f/f63 x:0 0 0 2024-09-13T02:50:50.150 INFO:tasks.workunit.client.1.smithi122.stdout:8/337: chown d3/da/c6 7138 1 2024-09-13T02:50:50.151 INFO:tasks.workunit.client.1.smithi122.stdout:3/509: rename d4/d6/f16 to d4/fb7 0 2024-09-13T02:50:50.151 INFO:tasks.workunit.client.1.smithi122.stdout:3/510: readlink d4/d6/de/d1f/d33/l58 0 2024-09-13T02:50:50.151 INFO:tasks.workunit.client.1.smithi122.stdout:6/578: mkdir d5/d3d/d82/db1 0 2024-09-13T02:50:50.152 INFO:tasks.workunit.client.1.smithi122.stdout:9/469: symlink d8/d16/d45/l8b 0 2024-09-13T02:50:50.152 INFO:tasks.workunit.client.1.smithi122.stdout:9/470: write d8/d88/f68 [2244873,90173] 0 2024-09-13T02:50:50.152 INFO:tasks.workunit.client.1.smithi122.stdout:9/471: creat d8/d16/d3d/d59/f8c x:0 0 0 2024-09-13T02:50:50.154 INFO:tasks.workunit.client.1.smithi122.stdout:7/375: creat d4/f7d x:0 0 0 2024-09-13T02:50:50.155 INFO:tasks.workunit.client.1.smithi122.stdout:0/446: mkdir d1/d5/d10/d29/d32/d5f/d1d/d8f 0 2024-09-13T02:50:50.156 INFO:tasks.workunit.client.1.smithi122.stdout:8/338: symlink d3/d31/d52/d59/l64 0 2024-09-13T02:50:50.156 INFO:tasks.workunit.client.1.smithi122.stdout:0/447: fdatasync d1/d5/d10/d29/f40 0 2024-09-13T02:50:50.156 INFO:tasks.workunit.client.1.smithi122.stdout:0/448: chown d1/d5/d9/f20 12 1 2024-09-13T02:50:50.156 INFO:tasks.workunit.client.1.smithi122.stdout:3/511: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fb8 x:0 0 0 2024-09-13T02:50:50.158 INFO:tasks.workunit.client.1.smithi122.stdout:6/579: rename d5/d40/l6f to d5/d3d/d6c/d41/d5b/d7a/d9a/lb2 0 2024-09-13T02:50:50.162 INFO:tasks.workunit.client.1.smithi122.stdout:4/542: dwrite d11/d3d/f6c [4194304,4194304] 0 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:4/543: chown d11/d13/d82/d2a/l52 1 1 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:5/405: dwrite d0/d2/d33/f5e [0,4194304] 0 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/376: mkdir d4/d8/d3d/d7e 0 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/377: stat d4/d4e/d5d 0 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/378: creat d4/d8/db/dc/d46/d5a/f7f x:0 0 0 2024-09-13T02:50:50.163 INFO:tasks.workunit.client.1.smithi122.stdout:7/379: write d4/d8/db/dc/f61 [4802029,125039] 0 2024-09-13T02:50:50.164 INFO:tasks.workunit.client.1.smithi122.stdout:2/367: dwrite d0/f2c [4194304,4194304] 0 2024-09-13T02:50:50.166 INFO:tasks.workunit.client.1.smithi122.stdout:0/449: mknod d1/d5/d9/da/d17/d69/c90 0 2024-09-13T02:50:50.167 INFO:tasks.workunit.client.1.smithi122.stdout:0/450: write d1/d5/d10/d29/d32/d5f/f6c [1268892,21903] 0 2024-09-13T02:50:50.167 INFO:tasks.workunit.client.1.smithi122.stdout:0/451: dread - d1/d5/d10/f5e zero size 2024-09-13T02:50:50.168 INFO:tasks.workunit.client.1.smithi122.stdout:0/452: write d1/f38 [45981,51950] 0 2024-09-13T02:50:50.168 INFO:tasks.workunit.client.1.smithi122.stdout:0/453: creat d1/d4b/d56/d60/f91 x:0 0 0 2024-09-13T02:50:50.169 INFO:tasks.workunit.client.1.smithi122.stdout:6/580: symlink d5/d3d/d6c/d41/d4e/d5f/lb3 0 2024-09-13T02:50:50.169 INFO:tasks.workunit.client.1.smithi122.stdout:6/581: chown d5/d3d/d82/cb0 16215 1 2024-09-13T02:50:50.169 INFO:tasks.workunit.client.1.smithi122.stdout:6/582: dread - d5/db/d29/d60/dac/faf zero size 2024-09-13T02:50:50.174 INFO:tasks.workunit.client.1.smithi122.stdout:4/544: mknod d11/d13/d82/d2a/d78/cab 0 2024-09-13T02:50:50.175 INFO:tasks.workunit.client.1.smithi122.stdout:5/406: symlink d0/l79 0 2024-09-13T02:50:50.177 INFO:tasks.workunit.client.1.smithi122.stdout:7/380: truncate d4/d8/db/f42 1951954 0 2024-09-13T02:50:50.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/454: mkdir d1/d5/d9/da/d92 0 2024-09-13T02:50:50.179 INFO:tasks.workunit.client.1.smithi122.stdout:4/545: creat d11/d13/fac x:0 0 0 2024-09-13T02:50:50.179 INFO:tasks.workunit.client.1.smithi122.stdout:4/546: chown d11/f3e 1400 1 2024-09-13T02:50:50.180 INFO:tasks.workunit.client.1.smithi122.stdout:5/407: creat d0/d17/f7a x:0 0 0 2024-09-13T02:50:50.180 INFO:tasks.workunit.client.1.smithi122.stdout:7/381: symlink d4/d8/db/dc/d46/d5a/l80 0 2024-09-13T02:50:50.181 INFO:tasks.workunit.client.1.smithi122.stdout:2/368: rmdir d0/d1e/d26 39 2024-09-13T02:50:50.182 INFO:tasks.workunit.client.1.smithi122.stdout:0/455: link d1/d5/d2d/c3e d1/d5/d9/da/c93 0 2024-09-13T02:50:50.183 INFO:tasks.workunit.client.1.smithi122.stdout:5/408: link d0/da/d48/d63/c5d d0/d17/d36/d3f/d4c/c7b 0 2024-09-13T02:50:50.185 INFO:tasks.workunit.client.1.smithi122.stdout:5/409: link d0/da/l2f d0/d17/d36/l7c 0 2024-09-13T02:50:50.185 INFO:tasks.workunit.client.1.smithi122.stdout:7/382: getdents d4/d4e/d5d/d6b 0 2024-09-13T02:50:50.186 INFO:tasks.workunit.client.1.smithi122.stdout:9/472: dwrite d8/d16/d3d/d59/d49/f7a [0,4194304] 0 2024-09-13T02:50:50.187 INFO:tasks.workunit.client.1.smithi122.stdout:3/512: dwrite d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f [0,4194304] 0 2024-09-13T02:50:50.187 INFO:tasks.workunit.client.1.smithi122.stdout:6/583: dread d5/d11/d45/df/d46/faa [0,4194304] 0 2024-09-13T02:50:50.188 INFO:tasks.workunit.client.1.smithi122.stdout:2/369: getdents d0/d1e/d22 0 2024-09-13T02:50:50.190 INFO:tasks.workunit.client.1.smithi122.stdout:7/383: rename l2 to d4/d8/db/dc/d36/l81 0 2024-09-13T02:50:50.191 INFO:tasks.workunit.client.1.smithi122.stdout:9/473: mknod d8/d16/d3e/c8d 0 2024-09-13T02:50:50.193 INFO:tasks.workunit.client.1.smithi122.stdout:6/584: fdatasync d5/d11/f4f 0 2024-09-13T02:50:50.193 INFO:tasks.workunit.client.1.smithi122.stdout:6/585: read d5/f69 [502856,94404] 0 2024-09-13T02:50:50.193 INFO:tasks.workunit.client.1.smithi122.stdout:6/586: write d5/db/f17 [966359,128849] 0 2024-09-13T02:50:50.194 INFO:tasks.workunit.client.1.smithi122.stdout:2/370: symlink d0/d1e/d22/l73 0 2024-09-13T02:50:50.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/587: truncate d5/d11/d45/df/d46/faa 3530989 0 2024-09-13T02:50:50.195 INFO:tasks.workunit.client.1.smithi122.stdout:8/339: dwrite d3/da/d1f/d4e/f54 [0,4194304] 0 2024-09-13T02:50:50.197 INFO:tasks.workunit.client.1.smithi122.stdout:6/588: rename d5/db/dc/fa6 to d5/db/dc/fb4 0 2024-09-13T02:50:50.198 INFO:tasks.workunit.client.1.smithi122.stdout:2/371: getdents d0/d1e 0 2024-09-13T02:50:50.199 INFO:tasks.workunit.client.1.smithi122.stdout:6/589: mkdir d5/d3d/d6c/db5 0 2024-09-13T02:50:50.200 INFO:tasks.workunit.client.1.smithi122.stdout:2/372: rename d0/d55/d70/l40 to d0/d5d/l74 0 2024-09-13T02:50:50.209 INFO:tasks.workunit.client.1.smithi122.stdout:2/373: dread d0/d1c/d3b/d41/d6a/f57 [0,4194304] 0 2024-09-13T02:50:50.214 INFO:tasks.workunit.client.1.smithi122.stdout:2/374: dread d0/d1c/d3b/d41/d6a/f57 [0,4194304] 0 2024-09-13T02:50:50.216 INFO:tasks.workunit.client.1.smithi122.stdout:2/375: mkdir d0/d1c/d3b/d41/d4e/d75 0 2024-09-13T02:50:50.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/376: mknod d0/d53/c76 0 2024-09-13T02:50:50.219 INFO:tasks.workunit.client.1.smithi122.stdout:2/377: symlink d0/d55/l77 0 2024-09-13T02:50:50.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/378: unlink d0/l1a 0 2024-09-13T02:50:50.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/379: dread - d0/d1e/f38 zero size 2024-09-13T02:50:50.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/380: creat d0/d1c/d3b/d41/d4e/f78 x:0 0 0 2024-09-13T02:50:50.222 INFO:tasks.workunit.client.1.smithi122.stdout:2/381: chown d0/d1e/d26/d3d/f56 44019 1 2024-09-13T02:50:50.223 INFO:tasks.workunit.client.1.smithi122.stdout:2/382: mknod d0/d1e/d2e/d5a/c79 0 2024-09-13T02:50:50.224 INFO:tasks.workunit.client.1.smithi122.stdout:2/383: getdents d0/d1c/d3b/d41/d6a 0 2024-09-13T02:50:50.225 INFO:tasks.workunit.client.1.smithi122.stdout:2/384: creat d0/d1c/f7a x:0 0 0 2024-09-13T02:50:50.225 INFO:tasks.workunit.client.1.smithi122.stdout:2/385: stat d0/d1e/c5f 0 2024-09-13T02:50:50.226 INFO:tasks.workunit.client.1.smithi122.stdout:2/386: read - d0/d1c/d3b/d41/d4e/f78 zero size 2024-09-13T02:50:50.226 INFO:tasks.workunit.client.1.smithi122.stdout:2/387: dread - d0/d1c/f5e zero size 2024-09-13T02:50:50.229 INFO:tasks.workunit.client.1.smithi122.stdout:8/340: write d3/d53/d21/f33 [3961485,26637] 0 2024-09-13T02:50:50.231 INFO:tasks.workunit.client.1.smithi122.stdout:4/547: dwrite d11/d3d/f5b [0,4194304] 0 2024-09-13T02:50:50.231 INFO:tasks.workunit.client.1.smithi122.stdout:5/410: dwrite d0/d17/d36/d25/f60 [0,4194304] 0 2024-09-13T02:50:50.232 INFO:tasks.workunit.client.1.smithi122.stdout:0/456: dwrite d1/d5/d10/d29/f8d [0,4194304] 0 2024-09-13T02:50:50.232 INFO:tasks.workunit.client.1.smithi122.stdout:3/513: dwrite d4/d11/dd/d21/d2b/d36/f66 [0,4194304] 0 2024-09-13T02:50:50.232 INFO:tasks.workunit.client.1.smithi122.stdout:3/514: stat d4/d6/f4a 0 2024-09-13T02:50:50.233 INFO:tasks.workunit.client.1.smithi122.stdout:6/590: dwrite d5/d11/d45/df/f13 [4194304,4194304] 0 2024-09-13T02:50:50.235 INFO:tasks.workunit.client.1.smithi122.stdout:4/548: unlink d11/d1b/d32/d98/f9b 0 2024-09-13T02:50:50.236 INFO:tasks.workunit.client.1.smithi122.stdout:4/549: getdents d11/d30/d59/d8f/da2 0 2024-09-13T02:50:50.236 INFO:tasks.workunit.client.1.smithi122.stdout:4/550: chown d11/d1b/d2e/d55/f67 1648728 1 2024-09-13T02:50:50.236 INFO:tasks.workunit.client.1.smithi122.stdout:4/551: write d11/d30/d59/fa6 [798441,28652] 0 2024-09-13T02:50:50.236 INFO:tasks.workunit.client.1.smithi122.stdout:5/411: truncate d0/da/f2a 5270152 0 2024-09-13T02:50:50.237 INFO:tasks.workunit.client.1.smithi122.stdout:5/412: read d0/d2/f6b [607950,62085] 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:3/515: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fb9 x:0 0 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:3/516: readlink d4/d6/de/d1f/d33/l58 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:8/341: dread d3/d31/d52/d59/f3c [0,4194304] 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:8/342: truncate d3/d31/d52/d59/f5f 4761515 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:8/343: chown d3/d31/d52 6 1 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:7/384: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:7/385: fsync d4/f29 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:7/386: write d4/d8/f7 [1378739,70686] 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:7/387: fdatasync d4/d8/db/f38 0 2024-09-13T02:50:50.243 INFO:tasks.workunit.client.1.smithi122.stdout:7/388: write d4/d8/db/ff [832516,62377] 0 2024-09-13T02:50:50.245 INFO:tasks.workunit.client.1.smithi122.stdout:6/591: rmdir d5/d11/d45 39 2024-09-13T02:50:50.247 INFO:tasks.workunit.client.1.smithi122.stdout:2/388: dwrite d0/d1e/d22/f37 [4194304,4194304] 0 2024-09-13T02:50:50.252 INFO:tasks.workunit.client.1.smithi122.stdout:5/413: creat d0/d1d/f7d x:0 0 0 2024-09-13T02:50:50.253 INFO:tasks.workunit.client.1.smithi122.stdout:0/457: getdents d1/d5/d10 0 2024-09-13T02:50:50.254 INFO:tasks.workunit.client.1.smithi122.stdout:3/517: unlink d4/d6/de/d1f/l59 0 2024-09-13T02:50:50.256 INFO:tasks.workunit.client.1.smithi122.stdout:8/344: rename d3/da/d1f/d4e to d3/d31/d65 0 2024-09-13T02:50:50.256 INFO:tasks.workunit.client.1.smithi122.stdout:2/389: read d0/d1e/d22/f24 [1656645,103752] 0 2024-09-13T02:50:50.257 INFO:tasks.workunit.client.1.smithi122.stdout:2/390: read d0/fc [1698364,116719] 0 2024-09-13T02:50:50.257 INFO:tasks.workunit.client.1.smithi122.stdout:2/391: readlink d0/d55/l77 0 2024-09-13T02:50:50.258 INFO:tasks.workunit.client.1.smithi122.stdout:7/389: mkdir d4/d8/d24/d82 0 2024-09-13T02:50:50.258 INFO:tasks.workunit.client.1.smithi122.stdout:7/390: stat d4/d8/db/dc/d46/d5a 0 2024-09-13T02:50:50.258 INFO:tasks.workunit.client.1.smithi122.stdout:7/391: dread - d4/d4e/d5d/f5e zero size 2024-09-13T02:50:50.258 INFO:tasks.workunit.client.1.smithi122.stdout:7/392: readlink d4/d8/d3d/l66 0 2024-09-13T02:50:50.258 INFO:tasks.workunit.client.1.smithi122.stdout:7/393: fsync d4/d8/d24/f6c 0 2024-09-13T02:50:50.260 INFO:tasks.workunit.client.1.smithi122.stdout:5/414: write d0/da/f23 [1299835,12061] 0 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:2/392: dread d0/f1b [0,4194304] 0 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:2/393: stat d0/d1c/d3b/d41/d6a/f49 0 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:2/394: fdatasync d0/d55/f62 0 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:2/395: chown d0/d1e/d22/f24 456427 1 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:2/396: truncate d0/f68 1649037 0 2024-09-13T02:50:50.273 INFO:tasks.workunit.client.1.smithi122.stdout:4/552: rmdir d11/d1b 39 2024-09-13T02:50:50.275 INFO:tasks.workunit.client.1.smithi122.stdout:3/518: dwrite d4/d6/df/f7b [0,4194304] 0 2024-09-13T02:50:50.275 INFO:tasks.workunit.client.1.smithi122.stdout:3/519: dread - d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fb9 zero size 2024-09-13T02:50:50.280 INFO:tasks.workunit.client.1.smithi122.stdout:6/592: rename d5/d3d/d6c/d41/d5b/f65 to d5/db/d29/fb6 0 2024-09-13T02:50:50.280 INFO:tasks.workunit.client.1.smithi122.stdout:6/593: chown d5/d11/d3a/la1 57985784 1 2024-09-13T02:50:50.281 INFO:tasks.workunit.client.1.smithi122.stdout:5/415: mknod d0/d17/d36/d25/d2b/c7e 0 2024-09-13T02:50:50.281 INFO:tasks.workunit.client.1.smithi122.stdout:5/416: fsync d0/d2/f6d 0 2024-09-13T02:50:50.282 INFO:tasks.workunit.client.1.smithi122.stdout:2/397: creat d0/d1c/d3b/f7b x:0 0 0 2024-09-13T02:50:50.282 INFO:tasks.workunit.client.1.smithi122.stdout:6/594: dread d5/db/d29/f7c [0,4194304] 0 2024-09-13T02:50:50.283 INFO:tasks.workunit.client.1.smithi122.stdout:3/520: symlink d4/d11/dd/d21/d2b/d36/lba 0 2024-09-13T02:50:50.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/458: rename d1/d5/d10/d29/d32/d5f/d1d to d1/d5/d9/da/d92/d94 0 2024-09-13T02:50:50.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/459: write d1/d5/d10/d29/d32/f5d [543368,89069] 0 2024-09-13T02:50:50.285 INFO:tasks.workunit.client.1.smithi122.stdout:5/417: mkdir d0/d17/d36/d3f/d4c/d7f 0 2024-09-13T02:50:50.287 INFO:tasks.workunit.client.1.smithi122.stdout:6/595: symlink d5/db/d29/lb7 0 2024-09-13T02:50:50.289 INFO:tasks.workunit.client.1.smithi122.stdout:4/553: dwrite d11/d30/f9d [0,4194304] 0 2024-09-13T02:50:50.289 INFO:tasks.workunit.client.1.smithi122.stdout:3/521: link d4/d6/de/d1f/d33/l58 d4/d11/dd/d21/d74/lbb 0 2024-09-13T02:50:50.289 INFO:tasks.workunit.client.1.smithi122.stdout:4/554: write d11/f97 [764823,50244] 0 2024-09-13T02:50:50.289 INFO:tasks.workunit.client.1.smithi122.stdout:4/555: write d11/d13/f66 [262288,5039] 0 2024-09-13T02:50:50.292 INFO:tasks.workunit.client.1.smithi122.stdout:8/345: rename d3/f58 to d3/d31/d52/d59/d3e/f66 0 2024-09-13T02:50:50.294 INFO:tasks.workunit.client.1.smithi122.stdout:0/460: mkdir d1/d5/d9/da/d7d/d95 0 2024-09-13T02:50:50.296 INFO:tasks.workunit.client.1.smithi122.stdout:5/418: symlink d0/d17/d36/d3f/l80 0 2024-09-13T02:50:50.296 INFO:tasks.workunit.client.1.smithi122.stdout:5/419: fdatasync d0/da/f2a 0 2024-09-13T02:50:50.296 INFO:tasks.workunit.client.1.smithi122.stdout:5/420: write d0/d17/d3a/f4f [906851,105335] 0 2024-09-13T02:50:50.305 INFO:tasks.workunit.client.1.smithi122.stdout:3/522: mknod d4/d11/dd/d21/d74/cbc 0 2024-09-13T02:50:50.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/394: rename d4/d8/db/f2c to d4/f83 0 2024-09-13T02:50:50.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/395: creat d4/d8/db/f84 x:0 0 0 2024-09-13T02:50:50.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/396: stat d4/d8/db/dc/d36 0 2024-09-13T02:50:50.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/397: fsync d4/d8/db/dc/f22 0 2024-09-13T02:50:50.311 INFO:tasks.workunit.client.1.smithi122.stdout:8/346: truncate d3/da/f30 850609 0 2024-09-13T02:50:50.311 INFO:tasks.workunit.client.1.smithi122.stdout:2/398: truncate d0/f2c 5789484 0 2024-09-13T02:50:50.312 INFO:tasks.workunit.client.1.smithi122.stdout:5/421: creat d0/da/d48/d63/f81 x:0 0 0 2024-09-13T02:50:50.314 INFO:tasks.workunit.client.1.smithi122.stdout:3/523: rename d4/d11/dd/d21/d2b/d36/d3c/d43/fa1 to d4/d6/df/d15/fbd 0 2024-09-13T02:50:50.316 INFO:tasks.workunit.client.1.smithi122.stdout:7/398: symlink d4/l85 0 2024-09-13T02:50:50.317 INFO:tasks.workunit.client.1.smithi122.stdout:7/399: creat d4/d8/db/f86 x:0 0 0 2024-09-13T02:50:50.317 INFO:tasks.workunit.client.1.smithi122.stdout:7/400: write d4/d8/db/dc/d1b/f34 [1577564,48343] 0 2024-09-13T02:50:50.318 INFO:tasks.workunit.client.1.smithi122.stdout:8/347: symlink d3/d31/d52/d59/l67 0 2024-09-13T02:50:50.319 INFO:tasks.workunit.client.1.smithi122.stdout:0/461: dwrite d1/d5/d10/d29/f8d [0,4194304] 0 2024-09-13T02:50:50.320 INFO:tasks.workunit.client.1.smithi122.stdout:2/399: symlink d0/d1e/d2e/d3e/l7c 0 2024-09-13T02:50:50.320 INFO:tasks.workunit.client.1.smithi122.stdout:6/596: dwrite d5/d11/d2f/f39 [0,4194304] 0 2024-09-13T02:50:50.320 INFO:tasks.workunit.client.1.smithi122.stdout:4/556: dwrite d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:50.320 INFO:tasks.workunit.client.1.smithi122.stdout:4/557: stat d11/d13/d82/d2a/d40/f6d 0 2024-09-13T02:50:50.323 INFO:tasks.workunit.client.1.smithi122.stdout:5/422: link d0/da/f16 d0/da/d48/d63/f82 0 2024-09-13T02:50:50.329 INFO:tasks.workunit.client.1.smithi122.stdout:7/401: dread d4/d8/db/dc/f61 [0,4194304] 0 2024-09-13T02:50:50.329 INFO:tasks.workunit.client.1.smithi122.stdout:7/402: chown d4/d8/db/dc/d1b/f32 33 1 2024-09-13T02:50:50.329 INFO:tasks.workunit.client.1.smithi122.stdout:7/403: write d4/d8/db/dc/d46/d5a/f7f [241939,101260] 0 2024-09-13T02:50:50.329 INFO:tasks.workunit.client.1.smithi122.stdout:7/404: fsync d4/d8/db/dc/f3b 0 2024-09-13T02:50:50.332 INFO:tasks.workunit.client.1.smithi122.stdout:8/348: mkdir d3/d31/d52/d68 0 2024-09-13T02:50:50.332 INFO:tasks.workunit.client.1.smithi122.stdout:8/349: chown d3/d31/d52/f5b 232600 1 2024-09-13T02:50:50.334 INFO:tasks.workunit.client.1.smithi122.stdout:0/462: unlink d1/d4b/l61 0 2024-09-13T02:50:50.335 INFO:tasks.workunit.client.1.smithi122.stdout:6/597: dwrite d5/db/d29/fb6 [0,4194304] 0 2024-09-13T02:50:50.336 INFO:tasks.workunit.client.1.smithi122.stdout:2/400: creat d0/d1e/d22/d29/f7d x:0 0 0 2024-09-13T02:50:50.339 INFO:tasks.workunit.client.1.smithi122.stdout:4/558: rmdir d11/d30/d59 39 2024-09-13T02:50:50.339 INFO:tasks.workunit.client.1.smithi122.stdout:4/559: creat d11/fad x:0 0 0 2024-09-13T02:50:50.340 INFO:tasks.workunit.client.1.smithi122.stdout:4/560: write d11/d30/f54 [2433313,74347] 0 2024-09-13T02:50:50.341 INFO:tasks.workunit.client.1.smithi122.stdout:5/423: mknod d0/d2/c83 0 2024-09-13T02:50:50.341 INFO:tasks.workunit.client.1.smithi122.stdout:5/424: write d0/d17/d36/f76 [1014085,71546] 0 2024-09-13T02:50:50.341 INFO:tasks.workunit.client.1.smithi122.stdout:5/425: write d0/da/d48/d63/f82 [3069077,114437] 0 2024-09-13T02:50:50.341 INFO:tasks.workunit.client.1.smithi122.stdout:5/426: chown d0/d17/d36/d3f/d4c/c7b 247529477 1 2024-09-13T02:50:50.342 INFO:tasks.workunit.client.1.smithi122.stdout:3/524: rmdir d4/d4c 39 2024-09-13T02:50:50.343 INFO:tasks.workunit.client.1.smithi122.stdout:7/405: creat d4/d79/f87 x:0 0 0 2024-09-13T02:50:50.344 INFO:tasks.workunit.client.1.smithi122.stdout:7/406: dread - d4/d8/db/dc/f5f zero size 2024-09-13T02:50:50.344 INFO:tasks.workunit.client.1.smithi122.stdout:5/427: dread d0/d2/d33/f52 [0,4194304] 0 2024-09-13T02:50:50.345 INFO:tasks.workunit.client.1.smithi122.stdout:8/350: rmdir d3/d31/d52/d68 0 2024-09-13T02:50:50.345 INFO:tasks.workunit.client.1.smithi122.stdout:8/351: stat d3/d53/d4d/c57 0 2024-09-13T02:50:50.348 INFO:tasks.workunit.client.1.smithi122.stdout:0/463: symlink d1/d4b/d56/d81/l96 0 2024-09-13T02:50:50.348 INFO:tasks.workunit.client.1.smithi122.stdout:1/490: sync 2024-09-13T02:50:50.351 INFO:tasks.workunit.client.1.smithi122.stdout:6/598: rename d5/f9 to d5/d3d/d6c/d41/fb8 0 2024-09-13T02:50:50.353 INFO:tasks.workunit.client.1.smithi122.stdout:2/401: link d0/d55/f62 d0/d1e/d26/f7e 0 2024-09-13T02:50:50.353 INFO:tasks.workunit.client.1.smithi122.stdout:2/402: fdatasync d0/f51 0 2024-09-13T02:50:50.354 INFO:tasks.workunit.client.1.smithi122.stdout:2/403: write d0/d1e/d26/d3d/f56 [903975,123962] 0 2024-09-13T02:50:50.358 INFO:tasks.workunit.client.1.smithi122.stdout:3/525: creat d4/d6/df/d15/d68/fbe x:0 0 0 2024-09-13T02:50:50.360 INFO:tasks.workunit.client.1.smithi122.stdout:5/428: creat d0/f84 x:0 0 0 2024-09-13T02:50:50.364 INFO:tasks.workunit.client.1.smithi122.stdout:0/464: creat d1/d5/d10/d29/d32/d83/f97 x:0 0 0 2024-09-13T02:50:50.365 INFO:tasks.workunit.client.1.smithi122.stdout:1/491: symlink dc/de/d18/d22/d1c/d57/la1 0 2024-09-13T02:50:50.372 INFO:tasks.workunit.client.1.smithi122.stdout:3/526: dread d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f [0,4194304] 0 2024-09-13T02:50:50.372 INFO:tasks.workunit.client.1.smithi122.stdout:3/527: rename d4 to d4/d11/dd/d21/d2b/d36/d3c/d43/d82/dbf 22 2024-09-13T02:50:50.373 INFO:tasks.workunit.client.1.smithi122.stdout:2/404: unlink d0/d1e/d22/d29/f69 0 2024-09-13T02:50:50.375 INFO:tasks.workunit.client.1.smithi122.stdout:0/465: mknod d1/d5/d9/da/d17/d69/d85/c98 0 2024-09-13T02:50:50.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/474: sync 2024-09-13T02:50:50.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/475: truncate d8/d16/d3d/d59/f7f 870195 0 2024-09-13T02:50:50.378 INFO:tasks.workunit.client.1.smithi122.stdout:9/476: chown d8/d16/d3d/d59/d49/f89 1888117 1 2024-09-13T02:50:50.378 INFO:tasks.workunit.client.1.smithi122.stdout:1/492: link dc/c5f dc/de/d13/d46/d6c/ca2 0 2024-09-13T02:50:50.378 INFO:tasks.workunit.client.1.smithi122.stdout:3/528: mknod d4/d4c/cc0 0 2024-09-13T02:50:50.379 INFO:tasks.workunit.client.1.smithi122.stdout:3/529: chown d4/fb7 64517 1 2024-09-13T02:50:50.379 INFO:tasks.workunit.client.1.smithi122.stdout:3/530: creat d4/d6/fc1 x:0 0 0 2024-09-13T02:50:50.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/405: mkdir d0/d1e/d22/d7f 0 2024-09-13T02:50:50.382 INFO:tasks.workunit.client.1.smithi122.stdout:1/493: link dc/d38/d51/f79 dc/de/d13/d46/d6c/fa3 0 2024-09-13T02:50:50.382 INFO:tasks.workunit.client.1.smithi122.stdout:0/466: symlink d1/d5/d9/da/d17/d69/l99 0 2024-09-13T02:50:50.382 INFO:tasks.workunit.client.1.smithi122.stdout:0/467: dread - d1/d4b/d56/d60/f8c zero size 2024-09-13T02:50:50.383 INFO:tasks.workunit.client.1.smithi122.stdout:6/599: dwrite d5/fe [0,4194304] 0 2024-09-13T02:50:50.385 INFO:tasks.workunit.client.1.smithi122.stdout:8/352: dwrite f2 [0,4194304] 0 2024-09-13T02:50:50.385 INFO:tasks.workunit.client.1.smithi122.stdout:8/353: creat d3/d53/d21/f69 x:0 0 0 2024-09-13T02:50:50.387 INFO:tasks.workunit.client.1.smithi122.stdout:2/406: read d0/f10 [160306,72737] 0 2024-09-13T02:50:50.387 INFO:tasks.workunit.client.1.smithi122.stdout:0/468: rename d1/d5/d2d/d80/c82 to d1/d5/d10/d29/d32/d5f/c9a 0 2024-09-13T02:50:50.387 INFO:tasks.workunit.client.1.smithi122.stdout:0/469: chown d1/d5 21 1 2024-09-13T02:50:50.387 INFO:tasks.workunit.client.1.smithi122.stdout:0/470: getdents d1/d5/d9/da/d92/d94/d8f 0 2024-09-13T02:50:50.388 INFO:tasks.workunit.client.1.smithi122.stdout:0/471: dread - d1/d4b/d56/d60/f8c zero size 2024-09-13T02:50:50.388 INFO:tasks.workunit.client.1.smithi122.stdout:7/407: dwrite d4/d8/d3d/f44 [0,4194304] 0 2024-09-13T02:50:50.388 INFO:tasks.workunit.client.1.smithi122.stdout:5/429: dwrite d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:50.388 INFO:tasks.workunit.client.1.smithi122.stdout:6/600: mkdir d5/d3d/d6c/d41/db9 0 2024-09-13T02:50:50.397 INFO:tasks.workunit.client.1.smithi122.stdout:6/601: link d5/db/d29/lb7 d5/d3d/d6c/lba 0 2024-09-13T02:50:50.402 INFO:tasks.workunit.client.1.smithi122.stdout:9/477: dwrite d8/f28 [0,4194304] 0 2024-09-13T02:50:50.402 INFO:tasks.workunit.client.1.smithi122.stdout:8/354: dread d3/d53/d4d/f62 [0,4194304] 0 2024-09-13T02:50:50.402 INFO:tasks.workunit.client.1.smithi122.stdout:8/355: stat d3/d53/d34 0 2024-09-13T02:50:50.402 INFO:tasks.workunit.client.1.smithi122.stdout:8/356: chown d3/f9 3948 1 2024-09-13T02:50:50.408 INFO:tasks.workunit.client.1.smithi122.stdout:9/478: creat d8/d16/d3d/d59/d23/f8e x:0 0 0 2024-09-13T02:50:50.410 INFO:tasks.workunit.client.1.smithi122.stdout:8/357: creat d3/d31/d52/d59/d3e/d5c/f6a x:0 0 0 2024-09-13T02:50:50.412 INFO:tasks.workunit.client.1.smithi122.stdout:1/494: dwrite dc/de/d18/d1d/d2f/f4b [0,4194304] 0 2024-09-13T02:50:50.414 INFO:tasks.workunit.client.1.smithi122.stdout:9/479: link d8/d4a/d64/l79 d8/d16/d3d/l8f 0 2024-09-13T02:50:50.415 INFO:tasks.workunit.client.1.smithi122.stdout:7/408: write d4/d8/db/f11 [1814336,7728] 0 2024-09-13T02:50:50.420 INFO:tasks.workunit.client.1.smithi122.stdout:7/409: mknod d4/d8/d3d/c88 0 2024-09-13T02:50:50.420 INFO:tasks.workunit.client.1.smithi122.stdout:7/410: chown d4/d4e 362379303 1 2024-09-13T02:50:50.422 INFO:tasks.workunit.client.1.smithi122.stdout:7/411: mknod d4/d4e/d5d/c89 0 2024-09-13T02:50:50.423 INFO:tasks.workunit.client.1.smithi122.stdout:7/412: rmdir d4/d8/db/dc/d1b/d49 39 2024-09-13T02:50:50.425 INFO:tasks.workunit.client.1.smithi122.stdout:7/413: mkdir d4/d4e/d5d/d8a 0 2024-09-13T02:50:50.442 INFO:tasks.workunit.client.1.smithi122.stdout:5/430: dwrite d0/f84 [0,4194304] 0 2024-09-13T02:50:50.443 INFO:tasks.workunit.client.1.smithi122.stdout:3/531: dwrite d4/d11/dd/d21/f75 [0,4194304] 0 2024-09-13T02:50:50.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/431: creat d0/d17/d36/d25/f85 x:0 0 0 2024-09-13T02:50:50.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/432: chown d0/d17/d36/d25/d2b/c39 3 1 2024-09-13T02:50:50.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/433: chown d0/d2/d33 399 1 2024-09-13T02:50:50.465 INFO:tasks.workunit.client.1.smithi122.stdout:1/495: dwrite dc/f32 [8388608,4194304] 0 2024-09-13T02:50:50.468 INFO:tasks.workunit.client.1.smithi122.stdout:1/496: dread dc/de/d18/d22/f5b [0,4194304] 0 2024-09-13T02:50:50.473 INFO:tasks.workunit.client.1.smithi122.stdout:8/358: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-09-13T02:50:50.474 INFO:tasks.workunit.client.1.smithi122.stdout:0/472: dwrite d1/d5/d9/da/d92/d94/f5c [4194304,4194304] 0 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:0/473: stat d1/d5/d10/c3c 0 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:0/474: read - d1/d5/d10/d29/d32/f6f zero size 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:0/475: getdents d1/d5/d9/da/d7d/d95 0 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:8/359: unlink d3/da/d1e/c36 0 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:8/360: chown d3/da 452888 1 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:2/407: dwrite d0/d55/d70/d59/f6e [0,4194304] 0 2024-09-13T02:50:50.475 INFO:tasks.workunit.client.1.smithi122.stdout:2/408: chown d0/d1e/d26/d3d/c48 2625794 1 2024-09-13T02:50:50.476 INFO:tasks.workunit.client.1.smithi122.stdout:6/602: dwrite d5/d11/d45/d21/d83/fae [0,4194304] 0 2024-09-13T02:50:50.476 INFO:tasks.workunit.client.1.smithi122.stdout:9/480: dwrite d8/d16/d3d/d59/d23/d1f/d36/f52 [0,4194304] 0 2024-09-13T02:50:50.476 INFO:tasks.workunit.client.1.smithi122.stdout:9/481: chown d8/d16/d45 306399 1 2024-09-13T02:50:50.476 INFO:tasks.workunit.client.1.smithi122.stdout:3/532: dwrite d4/f73 [0,4194304] 0 2024-09-13T02:50:50.477 INFO:tasks.workunit.client.1.smithi122.stdout:5/434: dwrite d0/d2/f6b [0,4194304] 0 2024-09-13T02:50:50.477 INFO:tasks.workunit.client.1.smithi122.stdout:5/435: fsync d0/d17/d36/d25/f74 0 2024-09-13T02:50:50.477 INFO:tasks.workunit.client.1.smithi122.stdout:7/414: dwrite d4/d8/db/f38 [0,4194304] 0 2024-09-13T02:50:50.479 INFO:tasks.workunit.client.1.smithi122.stdout:8/361: getdents d3/d53 0 2024-09-13T02:50:50.482 INFO:tasks.workunit.client.1.smithi122.stdout:9/482: dread d8/d16/d3d/d59/d23/d1f/f54 [4194304,4194304] 0 2024-09-13T02:50:50.494 INFO:tasks.workunit.client.1.smithi122.stdout:8/362: write d3/d31/d52/d59/f39 [4754238,73159] 0 2024-09-13T02:50:50.496 INFO:tasks.workunit.client.1.smithi122.stdout:9/483: dread d8/d4a/f5c [0,4194304] 0 2024-09-13T02:50:50.496 INFO:tasks.workunit.client.1.smithi122.stdout:9/484: chown d8/d16/d3e/f75 86 1 2024-09-13T02:50:50.500 INFO:tasks.workunit.client.1.smithi122.stdout:3/533: link d4/d11/dd/c23 d4/d6/cc2 0 2024-09-13T02:50:50.501 INFO:tasks.workunit.client.1.smithi122.stdout:9/485: dread d8/f2e [0,4194304] 0 2024-09-13T02:50:50.503 INFO:tasks.workunit.client.1.smithi122.stdout:0/476: dwrite d1/d5/d10/d29/f36 [0,4194304] 0 2024-09-13T02:50:50.504 INFO:tasks.workunit.client.1.smithi122.stdout:7/415: rmdir d4/d4e/d5d/d6b 39 2024-09-13T02:50:50.507 INFO:tasks.workunit.client.1.smithi122.stdout:6/603: symlink d5/db/lbb 0 2024-09-13T02:50:50.507 INFO:tasks.workunit.client.1.smithi122.stdout:0/477: dread d1/d5/d10/f7b [0,4194304] 0 2024-09-13T02:50:50.509 INFO:tasks.workunit.client.1.smithi122.stdout:8/363: truncate d3/d53/d34/f49 3948708 0 2024-09-13T02:50:50.509 INFO:tasks.workunit.client.1.smithi122.stdout:2/409: dwrite d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:50.509 INFO:tasks.workunit.client.1.smithi122.stdout:2/410: fdatasync d0/d1e/f25 0 2024-09-13T02:50:50.510 INFO:tasks.workunit.client.1.smithi122.stdout:5/436: dwrite d0/d17/d36/d25/d2b/f2c [4194304,4194304] 0 2024-09-13T02:50:50.510 INFO:tasks.workunit.client.1.smithi122.stdout:5/437: creat d0/d17/d36/d3f/d4c/f86 x:0 0 0 2024-09-13T02:50:50.513 INFO:tasks.workunit.client.1.smithi122.stdout:6/604: creat d5/d11/d45/df/d46/fbc x:0 0 0 2024-09-13T02:50:50.513 INFO:tasks.workunit.client.1.smithi122.stdout:6/605: readlink d5/d11/d45/d21/d8a/l98 0 2024-09-13T02:50:50.514 INFO:tasks.workunit.client.1.smithi122.stdout:8/364: unlink d3/d53/d21/f2f 0 2024-09-13T02:50:50.514 INFO:tasks.workunit.client.1.smithi122.stdout:8/365: chown d3/f9 2441 1 2024-09-13T02:50:50.518 INFO:tasks.workunit.client.1.smithi122.stdout:8/366: rename d3/d31/d52/d59/d3e/f66 to d3/d53/d4d/f6b 0 2024-09-13T02:50:50.519 INFO:tasks.workunit.client.1.smithi122.stdout:8/367: write d3/d31/f3b [1688185,21386] 0 2024-09-13T02:50:50.519 INFO:tasks.workunit.client.1.smithi122.stdout:8/368: chown d3/da/d1f/f19 9494762 1 2024-09-13T02:50:50.520 INFO:tasks.workunit.client.1.smithi122.stdout:7/416: dread d4/d8/db/dc/f1d [0,4194304] 0 2024-09-13T02:50:50.520 INFO:tasks.workunit.client.1.smithi122.stdout:7/417: readlink d4/d8/db/dc/d1b/l3c 0 2024-09-13T02:50:50.520 INFO:tasks.workunit.client.1.smithi122.stdout:7/418: write d4/d79/f87 [915848,69912] 0 2024-09-13T02:50:50.520 INFO:tasks.workunit.client.1.smithi122.stdout:4/561: sync 2024-09-13T02:50:50.521 INFO:tasks.workunit.client.1.smithi122.stdout:7/419: getdents d4/d4e 0 2024-09-13T02:50:50.521 INFO:tasks.workunit.client.1.smithi122.stdout:9/486: read d8/d16/d3d/d59/f4e [4420603,85583] 0 2024-09-13T02:50:50.522 INFO:tasks.workunit.client.1.smithi122.stdout:9/487: write d8/d16/d3d/d59/f7f [855761,20279] 0 2024-09-13T02:50:50.522 INFO:tasks.workunit.client.1.smithi122.stdout:9/488: dread - d8/d16/d3d/d59/d49/f89 zero size 2024-09-13T02:50:50.523 INFO:tasks.workunit.client.1.smithi122.stdout:4/562: rename d11/d13/d82/d2a/f6f to d11/d13/d82/d2a/d83/fae 0 2024-09-13T02:50:50.525 INFO:tasks.workunit.client.1.smithi122.stdout:7/420: symlink d4/d8/db/dc/d46/d5a/l8b 0 2024-09-13T02:50:50.525 INFO:tasks.workunit.client.1.smithi122.stdout:7/421: write d4/f7d [702118,57051] 0 2024-09-13T02:50:50.531 INFO:tasks.workunit.client.1.smithi122.stdout:3/534: dwrite d4/d6/de/d1f/f8a [0,4194304] 0 2024-09-13T02:50:50.534 INFO:tasks.workunit.client.1.smithi122.stdout:9/489: dread d8/d16/d3e/f75 [0,4194304] 0 2024-09-13T02:50:50.535 INFO:tasks.workunit.client.1.smithi122.stdout:2/411: dwrite d0/d1e/d2e/f54 [0,4194304] 0 2024-09-13T02:50:50.535 INFO:tasks.workunit.client.1.smithi122.stdout:2/412: readlink d0/d1e/d22/l6d 0 2024-09-13T02:50:50.535 INFO:tasks.workunit.client.1.smithi122.stdout:8/369: write d3/d53/d34/f49 [4634537,39495] 0 2024-09-13T02:50:50.539 INFO:tasks.workunit.client.1.smithi122.stdout:9/490: stat d8/d16/d3e/c77 0 2024-09-13T02:50:50.542 INFO:tasks.workunit.client.1.smithi122.stdout:8/370: dread d3/d53/d4d/f62 [0,4194304] 0 2024-09-13T02:50:50.542 INFO:tasks.workunit.client.1.smithi122.stdout:0/478: dwrite d1/d5/d10/d29/d32/f6f [0,4194304] 0 2024-09-13T02:50:50.545 INFO:tasks.workunit.client.1.smithi122.stdout:8/371: link d3/da/d1f/f37 d3/d31/d52/d59/d3e/d5c/f6c 0 2024-09-13T02:50:50.546 INFO:tasks.workunit.client.1.smithi122.stdout:8/372: chown d3/da/d1f/c2a 672 1 2024-09-13T02:50:50.548 INFO:tasks.workunit.client.1.smithi122.stdout:3/535: dread d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:50.548 INFO:tasks.workunit.client.1.smithi122.stdout:5/438: dwrite d0/f4d [4194304,4194304] 0 2024-09-13T02:50:50.548 INFO:tasks.workunit.client.1.smithi122.stdout:5/439: creat d0/d2/d33/f87 x:0 0 0 2024-09-13T02:50:50.551 INFO:tasks.workunit.client.1.smithi122.stdout:9/491: getdents d8/d16/d3d/d59/d23/d1f 0 2024-09-13T02:50:50.551 INFO:tasks.workunit.client.1.smithi122.stdout:9/492: stat d8/d16/d3d 0 2024-09-13T02:50:50.555 INFO:tasks.workunit.client.1.smithi122.stdout:8/373: rmdir d3/da/d56 0 2024-09-13T02:50:50.556 INFO:tasks.workunit.client.1.smithi122.stdout:4/563: dwrite d11/f3e [0,4194304] 0 2024-09-13T02:50:50.556 INFO:tasks.workunit.client.1.smithi122.stdout:4/564: chown d11/d3d/f6c 931 1 2024-09-13T02:50:50.558 INFO:tasks.workunit.client.1.smithi122.stdout:2/413: dwrite d0/d1e/d2e/d3e/f4b [0,4194304] 0 2024-09-13T02:50:50.565 INFO:tasks.workunit.client.1.smithi122.stdout:0/479: dwrite d1/d5/d10/d29/d32/d5f/f50 [0,4194304] 0 2024-09-13T02:50:50.565 INFO:tasks.workunit.client.1.smithi122.stdout:5/440: mknod d0/c88 0 2024-09-13T02:50:50.565 INFO:tasks.workunit.client.1.smithi122.stdout:5/441: chown d0/l79 79 1 2024-09-13T02:50:50.569 INFO:tasks.workunit.client.1.smithi122.stdout:9/493: mkdir d8/d16/d3d/d59/d29/d90 0 2024-09-13T02:50:50.569 INFO:tasks.workunit.client.1.smithi122.stdout:9/494: chown d8/d16/d3d/d59/f4e 181745 1 2024-09-13T02:50:50.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/536: rmdir d4/d11/dd/d21/d2b/d36/d3c/d43 39 2024-09-13T02:50:50.580 INFO:tasks.workunit.client.1.smithi122.stdout:0/480: creat d1/d5/d10/d29/d32/f9b x:0 0 0 2024-09-13T02:50:50.582 INFO:tasks.workunit.client.1.smithi122.stdout:9/495: truncate d8/d16/d3d/d59/d23/d1f/f37 1751694 0 2024-09-13T02:50:50.583 INFO:tasks.workunit.client.1.smithi122.stdout:9/496: chown d8/d16/d3d/d59/f4d 2268 1 2024-09-13T02:50:50.583 INFO:tasks.workunit.client.1.smithi122.stdout:9/497: creat d8/d16/d3d/d59/d23/f91 x:0 0 0 2024-09-13T02:50:50.585 INFO:tasks.workunit.client.1.smithi122.stdout:9/498: link d8/d16/d3d/d59/d49/l7c d8/d16/d3d/l92 0 2024-09-13T02:50:50.586 INFO:tasks.workunit.client.1.smithi122.stdout:9/499: mknod d8/d16/d3d/d59/d7d/d83/c93 0 2024-09-13T02:50:50.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/500: dread f1 [0,4194304] 0 2024-09-13T02:50:50.590 INFO:tasks.workunit.client.1.smithi122.stdout:9/501: mkdir d8/d16/d3d/d59/d7d/d94 0 2024-09-13T02:50:50.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/374: dwrite d3/d53/d21/f33 [0,4194304] 0 2024-09-13T02:50:50.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/375: write d3/d31/d52/d59/f39 [2802946,14477] 0 2024-09-13T02:50:50.597 INFO:tasks.workunit.client.1.smithi122.stdout:3/537: write d4/d11/dd/d21/d2b/d36/f66 [3382878,31782] 0 2024-09-13T02:50:50.598 INFO:tasks.workunit.client.1.smithi122.stdout:3/538: creat d4/d11/dd/d21/d6c/fc3 x:0 0 0 2024-09-13T02:50:50.598 INFO:tasks.workunit.client.1.smithi122.stdout:4/565: dwrite d11/f49 [0,4194304] 0 2024-09-13T02:50:50.598 INFO:tasks.workunit.client.1.smithi122.stdout:5/442: dwrite d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:50.598 INFO:tasks.workunit.client.1.smithi122.stdout:5/443: dread - d0/d17/f54 zero size 2024-09-13T02:50:50.598 INFO:tasks.workunit.client.1.smithi122.stdout:8/376: mkdir d3/d53/d4d/d6d 0 2024-09-13T02:50:50.599 INFO:tasks.workunit.client.1.smithi122.stdout:2/414: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:50.599 INFO:tasks.workunit.client.1.smithi122.stdout:0/481: dwrite d1/d5/f1e [8388608,4194304] 0 2024-09-13T02:50:50.599 INFO:tasks.workunit.client.1.smithi122.stdout:0/482: readlink d1/d4b/d56/d81/l96 0 2024-09-13T02:50:50.599 INFO:tasks.workunit.client.1.smithi122.stdout:0/483: creat d1/d5/d9/da/f9c x:0 0 0 2024-09-13T02:50:50.603 INFO:tasks.workunit.client.1.smithi122.stdout:9/502: write d8/d16/d3d/d59/d23/d1f/d36/f52 [2830143,101663] 0 2024-09-13T02:50:50.603 INFO:tasks.workunit.client.1.smithi122.stdout:3/539: symlink d4/d6/df/d15/d68/d90/lc4 0 2024-09-13T02:50:50.604 INFO:tasks.workunit.client.1.smithi122.stdout:5/444: mknod d0/d17/c89 0 2024-09-13T02:50:50.604 INFO:tasks.workunit.client.1.smithi122.stdout:5/445: fsync d0/f53 0 2024-09-13T02:50:50.606 INFO:tasks.workunit.client.1.smithi122.stdout:8/377: link d3/da/d1f/f27 d3/d31/f6e 0 2024-09-13T02:50:50.606 INFO:tasks.workunit.client.1.smithi122.stdout:8/378: write d3/da/d1f/f63 [246673,95044] 0 2024-09-13T02:50:50.606 INFO:tasks.workunit.client.1.smithi122.stdout:4/566: write d11/d13/d82/f25 [3100457,1579] 0 2024-09-13T02:50:50.607 INFO:tasks.workunit.client.1.smithi122.stdout:5/446: dread d0/d17/d3a/f4f [0,4194304] 0 2024-09-13T02:50:50.607 INFO:tasks.workunit.client.1.smithi122.stdout:5/447: truncate d0/d17/d36/d25/d2b/f71 1003358 0 2024-09-13T02:50:50.610 INFO:tasks.workunit.client.1.smithi122.stdout:2/415: rename d0/d1e/d26/f7e to d0/d1c/d3b/d41/f80 0 2024-09-13T02:50:50.610 INFO:tasks.workunit.client.1.smithi122.stdout:2/416: fdatasync d0/f16 0 2024-09-13T02:50:50.613 INFO:tasks.workunit.client.1.smithi122.stdout:0/484: mknod d1/d5/d9/da/d7d/c9d 0 2024-09-13T02:50:50.613 INFO:tasks.workunit.client.1.smithi122.stdout:0/485: fdatasync d1/d5/d10/d29/d32/d5f/f48 0 2024-09-13T02:50:50.617 INFO:tasks.workunit.client.1.smithi122.stdout:9/503: unlink d8/d16/d3d/d59/d23/d1f/l39 0 2024-09-13T02:50:50.617 INFO:tasks.workunit.client.1.smithi122.stdout:3/540: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fc5 x:0 0 0 2024-09-13T02:50:50.619 INFO:tasks.workunit.client.1.smithi122.stdout:8/379: symlink d3/d31/d52/d59/d3e/d5c/l6f 0 2024-09-13T02:50:50.620 INFO:tasks.workunit.client.1.smithi122.stdout:9/504: dread d8/d16/f62 [0,4194304] 0 2024-09-13T02:50:50.621 INFO:tasks.workunit.client.1.smithi122.stdout:5/448: truncate d0/d17/d36/d25/d2b/f2c 1936255 0 2024-09-13T02:50:50.621 INFO:tasks.workunit.client.1.smithi122.stdout:5/449: readlink d0/d17/d36/d25/l57 0 2024-09-13T02:50:50.621 INFO:tasks.workunit.client.1.smithi122.stdout:5/450: fsync d0/f84 0 2024-09-13T02:50:50.624 INFO:tasks.workunit.client.1.smithi122.stdout:2/417: creat d0/d55/f81 x:0 0 0 2024-09-13T02:50:50.626 INFO:tasks.workunit.client.1.smithi122.stdout:8/380: mknod d3/da/c70 0 2024-09-13T02:50:50.628 INFO:tasks.workunit.client.1.smithi122.stdout:9/505: link d8/d88/f68 d8/d16/d3d/d59/d23/d7b/d82/f95 0 2024-09-13T02:50:50.629 INFO:tasks.workunit.client.1.smithi122.stdout:0/486: dwrite d1/d5/d9/da/f75 [0,4194304] 0 2024-09-13T02:50:50.630 INFO:tasks.workunit.client.1.smithi122.stdout:0/487: fsync d1/d5/d10/d29/f88 0 2024-09-13T02:50:50.630 INFO:tasks.workunit.client.1.smithi122.stdout:0/488: getdents d1/d5/d10 0 2024-09-13T02:50:50.630 INFO:tasks.workunit.client.1.smithi122.stdout:2/418: rmdir d0/d1e/d22/d7f 0 2024-09-13T02:50:50.632 INFO:tasks.workunit.client.1.smithi122.stdout:8/381: link d3/d53/d4d/f62 d3/d31/d52/d59/d3e/f71 0 2024-09-13T02:50:50.632 INFO:tasks.workunit.client.1.smithi122.stdout:8/382: creat d3/d31/f72 x:0 0 0 2024-09-13T02:50:50.636 INFO:tasks.workunit.client.1.smithi122.stdout:9/506: symlink d8/d16/d3e/d57/l96 0 2024-09-13T02:50:50.638 INFO:tasks.workunit.client.1.smithi122.stdout:0/489: dread d1/d5/d9/da/d17/f43 [0,4194304] 0 2024-09-13T02:50:50.641 INFO:tasks.workunit.client.1.smithi122.stdout:2/419: mknod d0/d5d/c82 0 2024-09-13T02:50:50.641 INFO:tasks.workunit.client.1.smithi122.stdout:2/420: stat d0/d55 0 2024-09-13T02:50:50.644 INFO:tasks.workunit.client.1.smithi122.stdout:8/383: symlink d3/d53/d21/l73 0 2024-09-13T02:50:50.646 INFO:tasks.workunit.client.1.smithi122.stdout:9/507: mknod d8/d16/d3d/d59/d23/c97 0 2024-09-13T02:50:50.646 INFO:tasks.workunit.client.1.smithi122.stdout:2/421: unlink d0/d1e/d22/l6d 0 2024-09-13T02:50:50.646 INFO:tasks.workunit.client.1.smithi122.stdout:2/422: chown d0/d1e/f25 6 1 2024-09-13T02:50:50.647 INFO:tasks.workunit.client.1.smithi122.stdout:9/508: rename d8/d16/d3e/l6c to d8/d4a/l98 0 2024-09-13T02:50:50.651 INFO:tasks.workunit.client.1.smithi122.stdout:2/423: rename d0/d1c/f1d to d0/d1e/d22/d29/f83 0 2024-09-13T02:50:50.652 INFO:tasks.workunit.client.1.smithi122.stdout:2/424: mkdir d0/d1e/d26/d3d/d84 0 2024-09-13T02:50:50.655 INFO:tasks.workunit.client.1.smithi122.stdout:2/425: rename d0/d1c/c21 to d0/d1c/d3b/d41/d4e/c85 0 2024-09-13T02:50:50.663 INFO:tasks.workunit.client.1.smithi122.stdout:8/384: dwrite d3/d31/d65/f54 [0,4194304] 0 2024-09-13T02:50:50.665 INFO:tasks.workunit.client.1.smithi122.stdout:1/497: sync 2024-09-13T02:50:50.666 INFO:tasks.workunit.client.1.smithi122.stdout:1/498: mkdir dc/d38/d51/da4 0 2024-09-13T02:50:50.667 INFO:tasks.workunit.client.1.smithi122.stdout:1/499: mknod dc/de/d18/d22/d1c/d57/ca5 0 2024-09-13T02:50:50.669 INFO:tasks.workunit.client.1.smithi122.stdout:1/500: rename dc/de/c26 to dc/de/d13/d46/ca6 0 2024-09-13T02:50:50.669 INFO:tasks.workunit.client.1.smithi122.stdout:2/426: dread d0/d1e/d22/f37 [4194304,4194304] 0 2024-09-13T02:50:50.671 INFO:tasks.workunit.client.1.smithi122.stdout:1/501: rename dc/d38/d51/d96 to dc/de/d18/d86/da7 0 2024-09-13T02:50:50.672 INFO:tasks.workunit.client.1.smithi122.stdout:2/427: getdents d0/d1e/d2e/d3e 0 2024-09-13T02:50:50.673 INFO:tasks.workunit.client.1.smithi122.stdout:8/385: write d3/d53/d21/f33 [2348786,122675] 0 2024-09-13T02:50:50.673 INFO:tasks.workunit.client.1.smithi122.stdout:8/386: chown d3/d31/d52/d59/d3e/f46 2023 1 2024-09-13T02:50:50.674 INFO:tasks.workunit.client.1.smithi122.stdout:1/502: mknod dc/de/d13/ca8 0 2024-09-13T02:50:50.676 INFO:tasks.workunit.client.1.smithi122.stdout:2/428: symlink d0/d1c/d3b/l86 0 2024-09-13T02:50:50.678 INFO:tasks.workunit.client.1.smithi122.stdout:2/429: unlink d0/d1e/d26/c50 0 2024-09-13T02:50:50.681 INFO:tasks.workunit.client.1.smithi122.stdout:2/430: rename d0/d1e/c5f to d0/d1e/d2e/d3e/c87 0 2024-09-13T02:50:50.682 INFO:tasks.workunit.client.1.smithi122.stdout:2/431: creat d0/d55/d70/d59/f88 x:0 0 0 2024-09-13T02:50:50.700 INFO:tasks.workunit.client.1.smithi122.stdout:2/432: dwrite d0/d1e/d22/d29/f83 [0,4194304] 0 2024-09-13T02:50:50.701 INFO:tasks.workunit.client.1.smithi122.stdout:2/433: write d0/d55/f62 [851216,46527] 0 2024-09-13T02:50:50.703 INFO:tasks.workunit.client.1.smithi122.stdout:2/434: creat d0/d5d/f89 x:0 0 0 2024-09-13T02:50:50.704 INFO:tasks.workunit.client.1.smithi122.stdout:2/435: unlink d0/d1c/d3b/d41/d6a/c3c 0 2024-09-13T02:50:50.736 INFO:tasks.workunit.client.1.smithi122.stdout:7/422: sync 2024-09-13T02:50:50.737 INFO:tasks.workunit.client.1.smithi122.stdout:4/567: sync 2024-09-13T02:50:50.737 INFO:tasks.workunit.client.1.smithi122.stdout:6/606: sync 2024-09-13T02:50:50.740 INFO:tasks.workunit.client.1.smithi122.stdout:6/607: rmdir d5/d3d/d6c/d41/d5b/d9e 0 2024-09-13T02:50:50.740 INFO:tasks.workunit.client.1.smithi122.stdout:6/608: chown d5/d11/d45/df/d46/faa 658 1 2024-09-13T02:50:50.740 INFO:tasks.workunit.client.1.smithi122.stdout:6/609: rename d5/d3d to d5/d3d/d6c/d41/dbd 22 2024-09-13T02:50:50.741 INFO:tasks.workunit.client.1.smithi122.stdout:7/423: mkdir d4/d6d/d8c 0 2024-09-13T02:50:50.742 INFO:tasks.workunit.client.1.smithi122.stdout:4/568: symlink d11/d13/d82/d2a/d78/d8e/laf 0 2024-09-13T02:50:50.744 INFO:tasks.workunit.client.1.smithi122.stdout:6/610: creat d5/d3d/d6c/d41/d5b/fbe x:0 0 0 2024-09-13T02:50:50.745 INFO:tasks.workunit.client.1.smithi122.stdout:7/424: rmdir d4/d4e 39 2024-09-13T02:50:50.746 INFO:tasks.workunit.client.1.smithi122.stdout:7/425: dread - d4/d8/d24/d47/f7a zero size 2024-09-13T02:50:50.749 INFO:tasks.workunit.client.1.smithi122.stdout:4/569: creat d11/d30/d59/d6e/fb0 x:0 0 0 2024-09-13T02:50:50.749 INFO:tasks.workunit.client.1.smithi122.stdout:4/570: readlink d11/d13/d82/l57 0 2024-09-13T02:50:50.760 INFO:tasks.workunit.client.1.smithi122.stdout:6/611: rename d5/d11/d45/df/l71 to d5/d3d/da3/lbf 0 2024-09-13T02:50:50.763 INFO:tasks.workunit.client.1.smithi122.stdout:7/426: unlink d4/d8/db/dc/d36/f75 0 2024-09-13T02:50:50.766 INFO:tasks.workunit.client.1.smithi122.stdout:6/612: creat d5/d11/d3a/fc0 x:0 0 0 2024-09-13T02:50:50.767 INFO:tasks.workunit.client.1.smithi122.stdout:7/427: creat d4/d4e/d5d/d6b/f8d x:0 0 0 2024-09-13T02:50:50.768 INFO:tasks.workunit.client.1.smithi122.stdout:4/571: dwrite d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:50.768 INFO:tasks.workunit.client.1.smithi122.stdout:4/572: write d11/d13/d82/f48 [1486727,84835] 0 2024-09-13T02:50:50.768 INFO:tasks.workunit.client.1.smithi122.stdout:4/573: chown d11/d30/d59/d6e/fb0 300419 1 2024-09-13T02:50:50.768 INFO:tasks.workunit.client.1.smithi122.stdout:6/613: dread d5/db/f14 [0,4194304] 0 2024-09-13T02:50:50.769 INFO:tasks.workunit.client.1.smithi122.stdout:7/428: symlink d4/d8/db/dc/d46/l8e 0 2024-09-13T02:50:50.769 INFO:tasks.workunit.client.1.smithi122.stdout:7/429: chown d4/d6d/l71 0 1 2024-09-13T02:50:50.776 INFO:tasks.workunit.client.1.smithi122.stdout:4/574: getdents d11/d1b/d2e 0 2024-09-13T02:50:50.778 INFO:tasks.workunit.client.1.smithi122.stdout:7/430: mkdir d4/d6d/d8f 0 2024-09-13T02:50:50.778 INFO:tasks.workunit.client.1.smithi122.stdout:7/431: chown d4/d8/db/dc/d46/d5a/f7f 63755921 1 2024-09-13T02:50:50.779 INFO:tasks.workunit.client.1.smithi122.stdout:4/575: mknod d11/d13/d82/d2a/d78/d8e/cb1 0 2024-09-13T02:50:50.781 INFO:tasks.workunit.client.1.smithi122.stdout:4/576: rename f3 to d11/d3d/fb2 0 2024-09-13T02:50:50.783 INFO:tasks.workunit.client.1.smithi122.stdout:3/541: sync 2024-09-13T02:50:50.784 INFO:tasks.workunit.client.1.smithi122.stdout:3/542: mknod d4/d11/dd/d21/cc6 0 2024-09-13T02:50:50.786 INFO:tasks.workunit.client.1.smithi122.stdout:3/543: creat d4/d11/dd/d21/fc7 x:0 0 0 2024-09-13T02:50:50.788 INFO:tasks.workunit.client.1.smithi122.stdout:6/614: dwrite d5/d11/d45/df/d26/f5c [0,4194304] 0 2024-09-13T02:50:50.788 INFO:tasks.workunit.client.1.smithi122.stdout:3/544: rename d4/d11/da6 to d4/d11/dd/d21/d4e/dc8 0 2024-09-13T02:50:50.791 INFO:tasks.workunit.client.1.smithi122.stdout:7/432: write d4/d8/db/f38 [6239021,14369] 0 2024-09-13T02:50:50.791 INFO:tasks.workunit.client.1.smithi122.stdout:7/433: read d4/d8/f19 [7802554,72584] 0 2024-09-13T02:50:50.792 INFO:tasks.workunit.client.1.smithi122.stdout:7/434: write d4/d4e/d5d/f5e [447317,103380] 0 2024-09-13T02:50:50.792 INFO:tasks.workunit.client.1.smithi122.stdout:7/435: creat d4/d8/db/dc/d46/f90 x:0 0 0 2024-09-13T02:50:50.796 INFO:tasks.workunit.client.1.smithi122.stdout:6/615: rmdir d5/d11/d45/df/d26 39 2024-09-13T02:50:50.799 INFO:tasks.workunit.client.1.smithi122.stdout:3/545: link d4/d11/dd/d21/d6c/fb1 d4/d11/dd/d21/d4e/dc8/fc9 0 2024-09-13T02:50:50.799 INFO:tasks.workunit.client.1.smithi122.stdout:3/546: fdatasync d4/d11/dd/d21/d2b/f88 0 2024-09-13T02:50:50.801 INFO:tasks.workunit.client.1.smithi122.stdout:7/436: dread d4/d8/d24/f37 [0,4194304] 0 2024-09-13T02:50:50.801 INFO:tasks.workunit.client.1.smithi122.stdout:7/437: dread - d4/d4e/d5d/d6b/f78 zero size 2024-09-13T02:50:50.803 INFO:tasks.workunit.client.1.smithi122.stdout:6/616: dread d5/d11/d2f/f74 [0,4194304] 0 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:3/547: mkdir d4/d11/dd/dca 0 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:8/387: sync 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:0/490: sync 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:1/503: sync 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:2/436: sync 2024-09-13T02:50:50.806 INFO:tasks.workunit.client.1.smithi122.stdout:5/451: sync 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:2/437: chown d0/d1c/d3b/d41/d6a/f57 4169 1 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:2/438: chown d0/d1c/f5e 36255568 1 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:2/439: fdatasync d0/d1c/f5e 0 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/509: sync 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/510: chown d8/d16/d3d/d59/d29/c5b 249645384 1 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/511: stat d8/d16/d3d/d59/d29/f76 0 2024-09-13T02:50:50.807 INFO:tasks.workunit.client.1.smithi122.stdout:9/512: write d8/d16/d3d/d59/f4e [6289705,120275] 0 2024-09-13T02:50:50.808 INFO:tasks.workunit.client.1.smithi122.stdout:8/388: unlink d3/d31/f72 0 2024-09-13T02:50:50.809 INFO:tasks.workunit.client.1.smithi122.stdout:5/452: creat d0/d17/d36/d3f/f8a x:0 0 0 2024-09-13T02:50:50.810 INFO:tasks.workunit.client.1.smithi122.stdout:1/504: symlink dc/de/d18/d22/d1c/d57/la9 0 2024-09-13T02:50:50.810 INFO:tasks.workunit.client.1.smithi122.stdout:1/505: chown dc/de/d18/d22/l9f 45911395 1 2024-09-13T02:50:50.812 INFO:tasks.workunit.client.1.smithi122.stdout:2/440: mkdir d0/d1e/d2e/d8a 0 2024-09-13T02:50:50.813 INFO:tasks.workunit.client.1.smithi122.stdout:9/513: rmdir d8/d16/d3d 39 2024-09-13T02:50:50.813 INFO:tasks.workunit.client.1.smithi122.stdout:9/514: write d8/d16/d3d/d59/f7f [196543,3383] 0 2024-09-13T02:50:50.813 INFO:tasks.workunit.client.1.smithi122.stdout:7/438: dread d4/d8/db/dc/d46/f4f [0,4194304] 0 2024-09-13T02:50:50.815 INFO:tasks.workunit.client.1.smithi122.stdout:6/617: rename d5/d11/d45/df/d46/fbc to d5/d11/fc1 0 2024-09-13T02:50:50.816 INFO:tasks.workunit.client.1.smithi122.stdout:8/389: mknod d3/da/d1e/c74 0 2024-09-13T02:50:50.817 INFO:tasks.workunit.client.1.smithi122.stdout:5/453: mkdir d0/d17/d36/d8b 0 2024-09-13T02:50:50.819 INFO:tasks.workunit.client.1.smithi122.stdout:9/515: creat d8/d16/d3e/f99 x:0 0 0 2024-09-13T02:50:50.822 INFO:tasks.workunit.client.1.smithi122.stdout:2/441: write d0/d1e/d26/f43 [2007866,15449] 0 2024-09-13T02:50:50.822 INFO:tasks.workunit.client.1.smithi122.stdout:2/442: read - d0/d55/d70/d59/f88 zero size 2024-09-13T02:50:50.822 INFO:tasks.workunit.client.1.smithi122.stdout:0/491: rename d1/d5/d9/da/c16 to d1/d5/d2d/c9e 0 2024-09-13T02:50:50.822 INFO:tasks.workunit.client.1.smithi122.stdout:0/492: truncate d1/d5/d9/da/f2b 307740 0 2024-09-13T02:50:50.823 INFO:tasks.workunit.client.1.smithi122.stdout:6/618: link d5/db/f17 d5/d3d/d6c/d41/d5b/d7a/fc2 0 2024-09-13T02:50:50.825 INFO:tasks.workunit.client.1.smithi122.stdout:8/390: truncate d3/da/d1f/f19 802765 0 2024-09-13T02:50:50.825 INFO:tasks.workunit.client.1.smithi122.stdout:8/391: getdents d3/d53 0 2024-09-13T02:50:50.825 INFO:tasks.workunit.client.1.smithi122.stdout:5/454: mkdir d0/da/d8c 0 2024-09-13T02:50:50.827 INFO:tasks.workunit.client.1.smithi122.stdout:2/443: symlink d0/d1e/d22/d29/l8b 0 2024-09-13T02:50:50.828 INFO:tasks.workunit.client.1.smithi122.stdout:1/506: rename dc/f10 to dc/de/d18/faa 0 2024-09-13T02:50:50.831 INFO:tasks.workunit.client.1.smithi122.stdout:8/392: unlink d3/d53/f44 0 2024-09-13T02:50:50.831 INFO:tasks.workunit.client.1.smithi122.stdout:2/444: mkdir d0/d1c/d3b/d41/d8c 0 2024-09-13T02:50:50.834 INFO:tasks.workunit.client.1.smithi122.stdout:9/516: rename d8/d16/d3d/d59/d23/d1f/c55 to d8/d16/d3e/c9a 0 2024-09-13T02:50:50.834 INFO:tasks.workunit.client.1.smithi122.stdout:5/455: rename d0 to d0/d17/d3a/d8d 22 2024-09-13T02:50:50.835 INFO:tasks.workunit.client.1.smithi122.stdout:1/507: truncate fa 2873848 0 2024-09-13T02:50:50.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/445: symlink d0/d1e/d22/l8d 0 2024-09-13T02:50:50.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/446: readlink d0/d1e/d2e/d3e/l7c 0 2024-09-13T02:50:50.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/447: fdatasync d0/d1e/d26/f30 0 2024-09-13T02:50:50.838 INFO:tasks.workunit.client.1.smithi122.stdout:1/508: getdents dc/d38 0 2024-09-13T02:50:50.839 INFO:tasks.workunit.client.1.smithi122.stdout:1/509: mknod dc/d38/d51/cab 0 2024-09-13T02:50:50.843 INFO:tasks.workunit.client.1.smithi122.stdout:1/510: write dc/de/d13/d46/f70 [784498,20108] 0 2024-09-13T02:50:50.844 INFO:tasks.workunit.client.1.smithi122.stdout:2/448: dread d0/d1e/d22/f47 [0,4194304] 0 2024-09-13T02:50:50.846 INFO:tasks.workunit.client.1.smithi122.stdout:3/548: dwrite d4/d11/dd/d21/d4e/dc8/fc9 [0,4194304] 0 2024-09-13T02:50:50.847 INFO:tasks.workunit.client.1.smithi122.stdout:2/449: getdents d0 0 2024-09-13T02:50:50.847 INFO:tasks.workunit.client.1.smithi122.stdout:5/456: dread d0/da/f2a [0,4194304] 0 2024-09-13T02:50:50.849 INFO:tasks.workunit.client.1.smithi122.stdout:3/549: creat d4/d11/dd/d21/d2b/d55/fcb x:0 0 0 2024-09-13T02:50:50.849 INFO:tasks.workunit.client.1.smithi122.stdout:3/550: fdatasync d4/d11/dd/d21/d2b/d36/f72 0 2024-09-13T02:50:50.849 INFO:tasks.workunit.client.1.smithi122.stdout:5/457: mknod d0/d17/d36/d3f/d4c/c8e 0 2024-09-13T02:50:50.850 INFO:tasks.workunit.client.1.smithi122.stdout:3/551: unlink d4/d6/df/d15/d68/d90/lc4 0 2024-09-13T02:50:50.851 INFO:tasks.workunit.client.1.smithi122.stdout:2/450: link d0/d55/d70/c66 d0/d1c/c8e 0 2024-09-13T02:50:50.851 INFO:tasks.workunit.client.1.smithi122.stdout:1/511: write dc/de/d13/d46/d6c/f78 [975078,42095] 0 2024-09-13T02:50:50.851 INFO:tasks.workunit.client.1.smithi122.stdout:5/458: mkdir d0/da/d8c/d8f 0 2024-09-13T02:50:50.851 INFO:tasks.workunit.client.1.smithi122.stdout:1/512: write dc/de/d18/d1d/d2f/f95 [909635,36959] 0 2024-09-13T02:50:50.852 INFO:tasks.workunit.client.1.smithi122.stdout:3/552: rmdir d4/d6/de 39 2024-09-13T02:50:50.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/459: mkdir d0/da/d90 0 2024-09-13T02:50:50.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/460: creat d0/d2/f91 x:0 0 0 2024-09-13T02:50:50.854 INFO:tasks.workunit.client.1.smithi122.stdout:3/553: rmdir d4/d11/dd/d21/d2b/d36/d3c/d43/d82 39 2024-09-13T02:50:50.856 INFO:tasks.workunit.client.1.smithi122.stdout:5/461: link d0/da/f2d d0/f92 0 2024-09-13T02:50:50.856 INFO:tasks.workunit.client.1.smithi122.stdout:3/554: rmdir d4/d11/dd/d21/d2b/d36/d3c 39 2024-09-13T02:50:50.857 INFO:tasks.workunit.client.1.smithi122.stdout:3/555: symlink d4/d11/dd/d21/d4e/d53/lcc 0 2024-09-13T02:50:50.866 INFO:tasks.workunit.client.1.smithi122.stdout:7/439: dwrite d4/d8/db/f1f [0,4194304] 0 2024-09-13T02:50:50.866 INFO:tasks.workunit.client.1.smithi122.stdout:2/451: write d0/d55/d70/d59/f6e [167055,122326] 0 2024-09-13T02:50:50.866 INFO:tasks.workunit.client.1.smithi122.stdout:2/452: write d0/d1e/f38 [407974,28330] 0 2024-09-13T02:50:50.867 INFO:tasks.workunit.client.1.smithi122.stdout:1/513: dwrite dc/de/d13/d46/d6c/fa3 [0,4194304] 0 2024-09-13T02:50:50.867 INFO:tasks.workunit.client.1.smithi122.stdout:0/493: dwrite d1/d5/d9/da/f9c [0,4194304] 0 2024-09-13T02:50:50.868 INFO:tasks.workunit.client.1.smithi122.stdout:8/393: dwrite d3/d53/d21/f4b [0,4194304] 0 2024-09-13T02:50:50.868 INFO:tasks.workunit.client.1.smithi122.stdout:0/494: fdatasync d1/d4b/d56/d60/f91 0 2024-09-13T02:50:50.868 INFO:tasks.workunit.client.1.smithi122.stdout:8/394: write d3/d31/d52/f5b [1285980,100763] 0 2024-09-13T02:50:50.868 INFO:tasks.workunit.client.1.smithi122.stdout:8/395: chown d3/d53 204 1 2024-09-13T02:50:50.873 INFO:tasks.workunit.client.1.smithi122.stdout:3/556: dread d4/d11/dd/f65 [0,4194304] 0 2024-09-13T02:50:50.875 INFO:tasks.workunit.client.1.smithi122.stdout:2/453: symlink d0/d1c/d3b/l8f 0 2024-09-13T02:50:50.875 INFO:tasks.workunit.client.1.smithi122.stdout:8/396: write d3/d53/d4d/f62 [2401483,23878] 0 2024-09-13T02:50:50.879 INFO:tasks.workunit.client.1.smithi122.stdout:0/495: read d1/d5/d2d/f44 [322818,30331] 0 2024-09-13T02:50:50.879 INFO:tasks.workunit.client.1.smithi122.stdout:0/496: stat d1/d5/d9/da/d17/d69/l99 0 2024-09-13T02:50:50.889 INFO:tasks.workunit.client.1.smithi122.stdout:3/557: unlink d4/d11/dd/d21/d74/cbc 0 2024-09-13T02:50:50.889 INFO:tasks.workunit.client.1.smithi122.stdout:3/558: dread - d4/d11/da9/fb2 zero size 2024-09-13T02:50:50.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/454: mkdir d0/d1c/d3b/d41/d4e/d90 0 2024-09-13T02:50:50.894 INFO:tasks.workunit.client.1.smithi122.stdout:2/455: chown d0/d1e/d22/c71 263158822 1 2024-09-13T02:50:50.896 INFO:tasks.workunit.client.1.smithi122.stdout:8/397: dwrite d3/d53/d34/f55 [0,4194304] 0 2024-09-13T02:50:50.897 INFO:tasks.workunit.client.1.smithi122.stdout:0/497: mknod d1/d5/d9/da/d92/c9f 0 2024-09-13T02:50:50.899 INFO:tasks.workunit.client.1.smithi122.stdout:7/440: rename d4/d79 to d4/d6d/d91 0 2024-09-13T02:50:50.905 INFO:tasks.workunit.client.1.smithi122.stdout:2/456: link d0/d1c/d3b/f7b d0/d5d/f91 0 2024-09-13T02:50:50.905 INFO:tasks.workunit.client.1.smithi122.stdout:2/457: stat d0/d1e/d22/d29/f83 0 2024-09-13T02:50:50.905 INFO:tasks.workunit.client.1.smithi122.stdout:2/458: write d0/d1c/f7a [191027,120963] 0 2024-09-13T02:50:50.905 INFO:tasks.workunit.client.1.smithi122.stdout:8/398: dread d3/d31/d52/d59/f3c [0,4194304] 0 2024-09-13T02:50:50.909 INFO:tasks.workunit.client.1.smithi122.stdout:3/559: rename d4/d6/fc1 to d4/d11/dd/fcd 0 2024-09-13T02:50:50.911 INFO:tasks.workunit.client.1.smithi122.stdout:7/441: dread d4/d8/db/dc/d1b/f32 [0,4194304] 0 2024-09-13T02:50:50.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/442: dread - d4/d8/db/dc/d1b/f57 zero size 2024-09-13T02:50:50.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/443: chown d4/d8/db/dc/d46/l8e 2094 1 2024-09-13T02:50:50.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/444: truncate d4/d8/d24/f37 5238990 0 2024-09-13T02:50:50.912 INFO:tasks.workunit.client.1.smithi122.stdout:2/459: stat d0/d1e/d26/d3d/l67 0 2024-09-13T02:50:50.913 INFO:tasks.workunit.client.1.smithi122.stdout:0/498: dwrite d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:50.914 INFO:tasks.workunit.client.1.smithi122.stdout:3/560: mknod d4/d6/de/d1f/cce 0 2024-09-13T02:50:50.914 INFO:tasks.workunit.client.1.smithi122.stdout:3/561: dread - d4/d6/df/d15/d68/fbe zero size 2024-09-13T02:50:50.919 INFO:tasks.workunit.client.1.smithi122.stdout:7/445: creat d4/d6d/d8f/f92 x:0 0 0 2024-09-13T02:50:50.919 INFO:tasks.workunit.client.1.smithi122.stdout:7/446: fdatasync d4/d8/d24/d47/f55 0 2024-09-13T02:50:50.921 INFO:tasks.workunit.client.1.smithi122.stdout:2/460: mkdir d0/d1e/d92 0 2024-09-13T02:50:50.921 INFO:tasks.workunit.client.1.smithi122.stdout:2/461: fdatasync d0/d1c/f5e 0 2024-09-13T02:50:50.926 INFO:tasks.workunit.client.1.smithi122.stdout:7/447: rename d4/d8/db/dc/d1b/f32 to d4/d6d/d91/f93 0 2024-09-13T02:50:50.926 INFO:tasks.workunit.client.1.smithi122.stdout:7/448: chown d4/d6d/d91/f93 4670 1 2024-09-13T02:50:50.926 INFO:tasks.workunit.client.1.smithi122.stdout:7/449: chown d4/c74 154 1 2024-09-13T02:50:50.926 INFO:tasks.workunit.client.1.smithi122.stdout:2/462: creat d0/d1e/d92/f93 x:0 0 0 2024-09-13T02:50:50.929 INFO:tasks.workunit.client.1.smithi122.stdout:8/399: dwrite d3/da/d1f/f37 [0,4194304] 0 2024-09-13T02:50:50.929 INFO:tasks.workunit.client.1.smithi122.stdout:8/400: write d3/d31/d52/d59/f39 [4969374,39454] 0 2024-09-13T02:50:50.933 INFO:tasks.workunit.client.1.smithi122.stdout:8/401: unlink d3/da/d1f/f19 0 2024-09-13T02:50:50.933 INFO:tasks.workunit.client.1.smithi122.stdout:8/402: stat d3/da/c70 0 2024-09-13T02:50:50.934 INFO:tasks.workunit.client.1.smithi122.stdout:8/403: mknod d3/d53/d21/c75 0 2024-09-13T02:50:50.935 INFO:tasks.workunit.client.1.smithi122.stdout:8/404: mkdir d3/d53/d4d/d6d/d76 0 2024-09-13T02:50:50.953 INFO:tasks.workunit.client.1.smithi122.stdout:8/405: write d3/d31/d52/d59/d3e/f46 [356881,127863] 0 2024-09-13T02:50:50.953 INFO:tasks.workunit.client.1.smithi122.stdout:2/463: dwrite d0/d1c/d3b/d41/d4e/f78 [0,4194304] 0 2024-09-13T02:50:50.954 INFO:tasks.workunit.client.1.smithi122.stdout:8/406: unlink d3/d31/d52/d59/d3e/f71 0 2024-09-13T02:50:50.954 INFO:tasks.workunit.client.1.smithi122.stdout:8/407: write d3/d31/f61 [516805,17492] 0 2024-09-13T02:50:50.954 INFO:tasks.workunit.client.1.smithi122.stdout:0/499: dwrite d1/d5/d10/d29/d32/f6f [0,4194304] 0 2024-09-13T02:50:50.954 INFO:tasks.workunit.client.1.smithi122.stdout:7/450: dwrite d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:50.955 INFO:tasks.workunit.client.1.smithi122.stdout:7/451: write d4/d8/db/dc/d1b/f57 [953086,35872] 0 2024-09-13T02:50:50.958 INFO:tasks.workunit.client.1.smithi122.stdout:2/464: creat d0/d1e/d2e/d5a/f94 x:0 0 0 2024-09-13T02:50:50.959 INFO:tasks.workunit.client.1.smithi122.stdout:8/408: mknod d3/d53/d21/c77 0 2024-09-13T02:50:50.963 INFO:tasks.workunit.client.1.smithi122.stdout:0/500: write d1/d5/d10/d29/d32/f6f [1403104,46995] 0 2024-09-13T02:50:50.963 INFO:tasks.workunit.client.1.smithi122.stdout:0/501: write d1/d5/d9/da/f8a [757828,107747] 0 2024-09-13T02:50:50.963 INFO:tasks.workunit.client.1.smithi122.stdout:0/502: readlink d1/d5/d10/d29/d32/d5f/l7f 0 2024-09-13T02:50:50.968 INFO:tasks.workunit.client.1.smithi122.stdout:2/465: mkdir d0/d1c/d3b/d41/d4e/d75/d95 0 2024-09-13T02:50:50.970 INFO:tasks.workunit.client.1.smithi122.stdout:8/409: mknod d3/d53/c78 0 2024-09-13T02:50:50.971 INFO:tasks.workunit.client.1.smithi122.stdout:2/466: write d0/d1e/d22/f47 [407166,58613] 0 2024-09-13T02:50:50.973 INFO:tasks.workunit.client.1.smithi122.stdout:7/452: rmdir d4/d6d/d8f 39 2024-09-13T02:50:50.974 INFO:tasks.workunit.client.1.smithi122.stdout:7/453: readlink d4/d8/db/l10 0 2024-09-13T02:50:50.975 INFO:tasks.workunit.client.1.smithi122.stdout:2/467: rename d0/d1e/d2e/f54 to d0/d1c/d3b/d41/d6a/f96 0 2024-09-13T02:50:50.975 INFO:tasks.workunit.client.1.smithi122.stdout:2/468: fsync d0/f68 0 2024-09-13T02:50:50.975 INFO:tasks.workunit.client.1.smithi122.stdout:7/454: mknod d4/d8/d24/c94 0 2024-09-13T02:50:50.977 INFO:tasks.workunit.client.1.smithi122.stdout:7/455: rmdir d4/d8/db/dc/d1b 39 2024-09-13T02:50:50.980 INFO:tasks.workunit.client.1.smithi122.stdout:8/410: write d3/d31/f6e [2137259,43216] 0 2024-09-13T02:50:50.980 INFO:tasks.workunit.client.1.smithi122.stdout:7/456: getdents d4/d8/db/dc/d46 0 2024-09-13T02:50:50.982 INFO:tasks.workunit.client.1.smithi122.stdout:8/411: symlink d3/d53/d34/l79 0 2024-09-13T02:50:50.982 INFO:tasks.workunit.client.1.smithi122.stdout:4/577: sync 2024-09-13T02:50:50.982 INFO:tasks.workunit.client.1.smithi122.stdout:4/578: readlink d11/d30/d59/l71 0 2024-09-13T02:50:50.983 INFO:tasks.workunit.client.1.smithi122.stdout:6/619: sync 2024-09-13T02:50:50.984 INFO:tasks.workunit.client.1.smithi122.stdout:8/412: symlink d3/d31/d52/l7a 0 2024-09-13T02:50:50.985 INFO:tasks.workunit.client.1.smithi122.stdout:7/457: unlink d4/d8/d3d/l66 0 2024-09-13T02:50:50.989 INFO:tasks.workunit.client.1.smithi122.stdout:4/579: rename d11/d13/d82/f42 to d11/d30/d59/d8f/da2/fb3 0 2024-09-13T02:50:50.989 INFO:tasks.workunit.client.1.smithi122.stdout:4/580: fdatasync d11/d13/d82/f48 0 2024-09-13T02:50:50.989 INFO:tasks.workunit.client.1.smithi122.stdout:6/620: symlink d5/d3d/d6c/d41/d4e/d93/lc3 0 2024-09-13T02:50:50.990 INFO:tasks.workunit.client.1.smithi122.stdout:7/458: mknod d4/d6d/d8f/c95 0 2024-09-13T02:50:50.993 INFO:tasks.workunit.client.1.smithi122.stdout:7/459: mknod d4/d6d/d8c/c96 0 2024-09-13T02:50:50.993 INFO:tasks.workunit.client.1.smithi122.stdout:7/460: chown d4/d6d/l71 26990907 1 2024-09-13T02:50:50.993 INFO:tasks.workunit.client.1.smithi122.stdout:7/461: write d4/d8/db/f84 [610689,110490] 0 2024-09-13T02:50:50.994 INFO:tasks.workunit.client.1.smithi122.stdout:7/462: dread - d4/d8/db/dc/f72 zero size 2024-09-13T02:50:50.994 INFO:tasks.workunit.client.1.smithi122.stdout:7/463: creat d4/d8/d3d/f97 x:0 0 0 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:4/581: dread d11/d13/d82/f25 [0,4194304] 0 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:4/582: creat d11/d30/d59/d6e/fb4 x:0 0 0 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:7/464: link d4/d8/db/dc/d46/d5a/l8b d4/d8/d24/l98 0 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:7/465: chown d4/c2b 177 1 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:7/466: chown d4/d4e 114 1 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:7/467: write d4/d8/db/dc/f5f [657649,29483] 0 2024-09-13T02:50:50.995 INFO:tasks.workunit.client.1.smithi122.stdout:7/468: fsync d4/d8/db/f1f 0 2024-09-13T02:50:50.996 INFO:tasks.workunit.client.1.smithi122.stdout:2/469: dwrite d0/d1e/f25 [0,4194304] 0 2024-09-13T02:50:50.997 INFO:tasks.workunit.client.1.smithi122.stdout:4/583: symlink d11/d13/d82/d2a/d40/lb5 0 2024-09-13T02:50:50.997 INFO:tasks.workunit.client.1.smithi122.stdout:4/584: stat d11/d1b/d32/c33 0 2024-09-13T02:50:50.997 INFO:tasks.workunit.client.1.smithi122.stdout:7/469: creat d4/d6d/d8c/f99 x:0 0 0 2024-09-13T02:50:50.998 INFO:tasks.workunit.client.1.smithi122.stdout:8/413: dwrite d3/d31/f3b [4194304,4194304] 0 2024-09-13T02:50:51.002 INFO:tasks.workunit.client.1.smithi122.stdout:2/470: rename d0/d1c/d3b/d41/d4e/f78 to d0/d1e/d2e/f97 0 2024-09-13T02:50:51.004 INFO:tasks.workunit.client.1.smithi122.stdout:8/414: unlink d3/d31/d52/d59/d3e/f46 0 2024-09-13T02:50:51.005 INFO:tasks.workunit.client.1.smithi122.stdout:2/471: symlink d0/d1c/d3b/d41/d4e/d90/l98 0 2024-09-13T02:50:51.010 INFO:tasks.workunit.client.1.smithi122.stdout:4/585: dread d11/d3d/f5b [0,4194304] 0 2024-09-13T02:50:51.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/586: mkdir d11/d13/d82/d2a/d78/db6 0 2024-09-13T02:50:51.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/587: readlink d11/d13/d82/d2a/l8d 0 2024-09-13T02:50:51.011 INFO:tasks.workunit.client.1.smithi122.stdout:4/588: getdents d11/d1b/d32 0 2024-09-13T02:50:51.013 INFO:tasks.workunit.client.1.smithi122.stdout:6/621: dwrite d5/f69 [0,4194304] 0 2024-09-13T02:50:51.017 INFO:tasks.workunit.client.1.smithi122.stdout:6/622: symlink d5/d11/d45/df/d26/lc4 0 2024-09-13T02:50:51.018 INFO:tasks.workunit.client.1.smithi122.stdout:8/415: write d3/d53/d34/f55 [4064104,32541] 0 2024-09-13T02:50:51.019 INFO:tasks.workunit.client.1.smithi122.stdout:6/623: symlink d5/d3d/d6c/d41/lc5 0 2024-09-13T02:50:51.019 INFO:tasks.workunit.client.1.smithi122.stdout:6/624: readlink l2 0 2024-09-13T02:50:51.020 INFO:tasks.workunit.client.1.smithi122.stdout:6/625: read d5/d11/d45/df/f24 [1231003,87116] 0 2024-09-13T02:50:51.020 INFO:tasks.workunit.client.1.smithi122.stdout:6/626: truncate d5/d11/d45/f81 8989447 0 2024-09-13T02:50:51.021 INFO:tasks.workunit.client.1.smithi122.stdout:4/589: dread d11/d13/d82/d2a/d40/f4d [0,4194304] 0 2024-09-13T02:50:51.022 INFO:tasks.workunit.client.1.smithi122.stdout:8/416: creat d3/d53/d4d/d6d/d76/f7b x:0 0 0 2024-09-13T02:50:51.024 INFO:tasks.workunit.client.1.smithi122.stdout:8/417: mknod d3/d53/d4d/c7c 0 2024-09-13T02:50:51.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/470: dwrite d4/d8/d24/d47/f55 [0,4194304] 0 2024-09-13T02:50:51.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/471: readlink d4/d8/db/l5b 0 2024-09-13T02:50:51.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/472: creat d4/f9a x:0 0 0 2024-09-13T02:50:51.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/473: dread - d4/d8/d24/f6c zero size 2024-09-13T02:50:51.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/474: write d4/d6d/d91/f87 [1063412,103132] 0 2024-09-13T02:50:51.027 INFO:tasks.workunit.client.1.smithi122.stdout:6/627: dread d5/f5a [0,4194304] 0 2024-09-13T02:50:51.027 INFO:tasks.workunit.client.1.smithi122.stdout:6/628: fdatasync d5/d3d/f77 0 2024-09-13T02:50:51.027 INFO:tasks.workunit.client.1.smithi122.stdout:6/629: chown d5/la 795111 1 2024-09-13T02:50:51.027 INFO:tasks.workunit.client.1.smithi122.stdout:6/630: chown d5/d11/d45/df/f24 9 1 2024-09-13T02:50:51.027 INFO:tasks.workunit.client.1.smithi122.stdout:6/631: chown d5/d11/d45/df/d46/l50 22 1 2024-09-13T02:50:51.031 INFO:tasks.workunit.client.1.smithi122.stdout:7/475: rename d4/d8/d24/d47/f55 to d4/d6d/d91/f9b 0 2024-09-13T02:50:51.033 INFO:tasks.workunit.client.1.smithi122.stdout:8/418: getdents d3/d31 0 2024-09-13T02:50:51.035 INFO:tasks.workunit.client.1.smithi122.stdout:7/476: symlink d4/d4e/l9c 0 2024-09-13T02:50:51.035 INFO:tasks.workunit.client.1.smithi122.stdout:7/477: fdatasync d4/d8/db/f86 0 2024-09-13T02:50:51.035 INFO:tasks.workunit.client.1.smithi122.stdout:7/478: creat d4/d8/db/f9d x:0 0 0 2024-09-13T02:50:51.037 INFO:tasks.workunit.client.1.smithi122.stdout:4/590: dwrite d11/d30/f94 [0,4194304] 0 2024-09-13T02:50:51.046 INFO:tasks.workunit.client.1.smithi122.stdout:8/419: rmdir d3/d53/d4d/d6d/d76 39 2024-09-13T02:50:51.046 INFO:tasks.workunit.client.1.smithi122.stdout:8/420: write d3/d53/d34/f55 [4713002,20877] 0 2024-09-13T02:50:51.046 INFO:tasks.workunit.client.1.smithi122.stdout:8/421: write d3/d53/d34/f55 [2057936,60950] 0 2024-09-13T02:50:51.046 INFO:tasks.workunit.client.1.smithi122.stdout:8/422: write d3/f9 [4844849,129439] 0 2024-09-13T02:50:51.051 INFO:tasks.workunit.client.1.smithi122.stdout:4/591: rmdir d11/d13/d82 39 2024-09-13T02:50:51.052 INFO:tasks.workunit.client.1.smithi122.stdout:4/592: creat d11/d30/d59/d6e/fb7 x:0 0 0 2024-09-13T02:50:51.061 INFO:tasks.workunit.client.1.smithi122.stdout:6/632: rename d5/d11/d45/df to d5/db/d29/d60/dac/dc6 0 2024-09-13T02:50:51.062 INFO:tasks.workunit.client.1.smithi122.stdout:8/423: mkdir d3/da/d7d 0 2024-09-13T02:50:51.065 INFO:tasks.workunit.client.1.smithi122.stdout:6/633: dread d5/db/f17 [0,4194304] 0 2024-09-13T02:50:51.065 INFO:tasks.workunit.client.1.smithi122.stdout:6/634: write d5/d11/d45/f81 [9193547,74251] 0 2024-09-13T02:50:51.068 INFO:tasks.workunit.client.1.smithi122.stdout:6/635: getdents d5/d11/d45/d21/d8a 0 2024-09-13T02:50:51.069 INFO:tasks.workunit.client.1.smithi122.stdout:4/593: dwrite d11/d1b/f31 [0,4194304] 0 2024-09-13T02:50:51.070 INFO:tasks.workunit.client.1.smithi122.stdout:4/594: dread d11/d1b/d2e/f34 [0,4194304] 0 2024-09-13T02:50:51.072 INFO:tasks.workunit.client.1.smithi122.stdout:6/636: rename d5/d3d/d6c/d41/d4e/d93/lc3 to d5/d3d/d82/db1/lc7 0 2024-09-13T02:50:51.082 INFO:tasks.workunit.client.1.smithi122.stdout:6/637: write d5/d3d/d6c/d41/f47 [2723630,44646] 0 2024-09-13T02:50:51.084 INFO:tasks.workunit.client.1.smithi122.stdout:6/638: truncate d5/d3d/d6c/d41/fb8 1078419 0 2024-09-13T02:50:51.086 INFO:tasks.workunit.client.1.smithi122.stdout:6/639: rename d5/db/d29/d60/dac/dc6/fad to d5/d40/fc8 0 2024-09-13T02:50:51.091 INFO:tasks.workunit.client.1.smithi122.stdout:4/595: dwrite d11/d13/d82/d2a/f2b [0,4194304] 0 2024-09-13T02:50:51.091 INFO:tasks.workunit.client.1.smithi122.stdout:4/596: chown d11/d1b/d32/c5e 8038 1 2024-09-13T02:50:51.091 INFO:tasks.workunit.client.1.smithi122.stdout:5/462: sync 2024-09-13T02:50:51.092 INFO:tasks.workunit.client.1.smithi122.stdout:9/517: sync 2024-09-13T02:50:51.092 INFO:tasks.workunit.client.1.smithi122.stdout:5/463: creat d0/d1d/f93 x:0 0 0 2024-09-13T02:50:51.094 INFO:tasks.workunit.client.1.smithi122.stdout:6/640: write d5/f69 [1941636,5249] 0 2024-09-13T02:50:51.101 INFO:tasks.workunit.client.1.smithi122.stdout:4/597: rmdir d11/d13/d82/d2a/d40 39 2024-09-13T02:50:51.105 INFO:tasks.workunit.client.1.smithi122.stdout:9/518: getdents d8/d4a 0 2024-09-13T02:50:51.114 INFO:tasks.workunit.client.1.smithi122.stdout:6/641: read d5/db/d29/d60/dac/faf [1693087,108623] 0 2024-09-13T02:50:51.116 INFO:tasks.workunit.client.1.smithi122.stdout:4/598: dwrite d11/d1b/d2e/d55/f58 [0,4194304] 0 2024-09-13T02:50:51.116 INFO:tasks.workunit.client.1.smithi122.stdout:9/519: truncate d8/d16/d3d/d59/d29/f76 359748 0 2024-09-13T02:50:51.116 INFO:tasks.workunit.client.1.smithi122.stdout:5/464: dwrite d0/f53 [0,4194304] 0 2024-09-13T02:50:51.116 INFO:tasks.workunit.client.1.smithi122.stdout:5/465: fsync d0/d17/d3a/f56 0 2024-09-13T02:50:51.118 INFO:tasks.workunit.client.1.smithi122.stdout:6/642: mkdir d5/d3d/d82/dc9 0 2024-09-13T02:50:51.124 INFO:tasks.workunit.client.1.smithi122.stdout:4/599: link d11/d30/d59/d6e/fb0 d11/d1b/d2e/fb8 0 2024-09-13T02:50:51.126 INFO:tasks.workunit.client.1.smithi122.stdout:4/600: read d11/d30/f8b [1359634,118099] 0 2024-09-13T02:50:51.126 INFO:tasks.workunit.client.1.smithi122.stdout:4/601: write d11/d30/f4b [644726,36567] 0 2024-09-13T02:50:51.128 INFO:tasks.workunit.client.1.smithi122.stdout:9/520: creat d8/d16/d3e/d57/f9b x:0 0 0 2024-09-13T02:50:51.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/466: symlink d0/da/d48/d63/l94 0 2024-09-13T02:50:51.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/467: dread - d0/d1d/f7d zero size 2024-09-13T02:50:51.134 INFO:tasks.workunit.client.1.smithi122.stdout:6/643: symlink d5/d11/d3a/lca 0 2024-09-13T02:50:51.137 INFO:tasks.workunit.client.1.smithi122.stdout:4/602: symlink d11/d1b/d32/d98/lb9 0 2024-09-13T02:50:51.138 INFO:tasks.workunit.client.1.smithi122.stdout:5/468: mkdir d0/d17/d36/d25/d2b/d72/d95 0 2024-09-13T02:50:51.138 INFO:tasks.workunit.client.1.smithi122.stdout:5/469: write d0/da/d48/f45 [5175842,83085] 0 2024-09-13T02:50:51.140 INFO:tasks.workunit.client.1.smithi122.stdout:6/644: unlink d5/d3d/d6c/d41/d4e/d5f/f79 0 2024-09-13T02:50:51.143 INFO:tasks.workunit.client.1.smithi122.stdout:5/470: dread d0/f5a [0,4194304] 0 2024-09-13T02:50:51.145 INFO:tasks.workunit.client.1.smithi122.stdout:9/521: dwrite d8/d16/d3d/d59/d23/d1f/d36/f4c [0,4194304] 0 2024-09-13T02:50:51.146 INFO:tasks.workunit.client.1.smithi122.stdout:4/603: dread d11/d3d/f6c [0,4194304] 0 2024-09-13T02:50:51.152 INFO:tasks.workunit.client.1.smithi122.stdout:4/604: rename fa to d11/d13/d82/d2a/fba 0 2024-09-13T02:50:51.154 INFO:tasks.workunit.client.1.smithi122.stdout:5/471: dread d0/d2/d33/f5e [0,4194304] 0 2024-09-13T02:50:51.164 INFO:tasks.workunit.client.1.smithi122.stdout:5/472: rmdir d0/d17/d36 39 2024-09-13T02:50:51.164 INFO:tasks.workunit.client.1.smithi122.stdout:5/473: stat d0/da/d48/c43 0 2024-09-13T02:50:51.164 INFO:tasks.workunit.client.1.smithi122.stdout:5/474: dread - d0/d1d/f7d zero size 2024-09-13T02:50:51.170 INFO:tasks.workunit.client.1.smithi122.stdout:9/522: dwrite f1 [0,4194304] 0 2024-09-13T02:50:51.170 INFO:tasks.workunit.client.1.smithi122.stdout:9/523: chown d8/f28 1914 1 2024-09-13T02:50:51.175 INFO:tasks.workunit.client.1.smithi122.stdout:1/514: sync 2024-09-13T02:50:51.175 INFO:tasks.workunit.client.1.smithi122.stdout:1/515: chown dc/c50 633 1 2024-09-13T02:50:51.175 INFO:tasks.workunit.client.1.smithi122.stdout:3/562: sync 2024-09-13T02:50:51.175 INFO:tasks.workunit.client.1.smithi122.stdout:3/563: fsync d4/d6/df/d15/f61 0 2024-09-13T02:50:51.175 INFO:tasks.workunit.client.1.smithi122.stdout:3/564: dread - d4/f9d zero size 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: mgrmap e22: smithi122.ptcenr(active, since 1.19146s) 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: pgmap v3: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: Deploying cephadm binary to smithi100 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: Deploying cephadm binary to smithi122 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:51.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:50 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:51.177 INFO:tasks.workunit.client.1.smithi122.stdout:1/516: link dc/de/d18/d22/f55 dc/de/d6e/fac 0 2024-09-13T02:50:51.177 INFO:tasks.workunit.client.1.smithi122.stdout:1/517: stat dc/de/d18/d1d/f85 0 2024-09-13T02:50:51.177 INFO:tasks.workunit.client.1.smithi122.stdout:3/565: mkdir d4/d11/dd/d21/d2b/dcf 0 2024-09-13T02:50:51.177 INFO:tasks.workunit.client.1.smithi122.stdout:0/503: sync 2024-09-13T02:50:51.177 INFO:tasks.workunit.client.1.smithi122.stdout:0/504: write d1/d5/d10/d29/d32/d5f/f6c [1622498,25415] 0 2024-09-13T02:50:51.178 INFO:tasks.workunit.client.1.smithi122.stdout:0/505: write d1/d5/d2d/f4e [4499609,25166] 0 2024-09-13T02:50:51.183 INFO:tasks.workunit.client.1.smithi122.stdout:0/506: creat d1/d5/d9/da/d92/d94/fa0 x:0 0 0 2024-09-13T02:50:51.185 INFO:tasks.workunit.client.1.smithi122.stdout:4/605: dwrite d11/d1b/d2e/f9f [0,4194304] 0 2024-09-13T02:50:51.186 INFO:tasks.workunit.client.1.smithi122.stdout:4/606: chown d11/d1b/l64 201468 1 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: mgrmap e22: smithi122.ptcenr(active, since 1.19146s) 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: pgmap v3: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: Deploying cephadm binary to smithi100 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: Deploying cephadm binary to smithi122 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:51.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:50 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:51.187 INFO:tasks.workunit.client.1.smithi122.stdout:5/475: dwrite d0/da/f2d [0,4194304] 0 2024-09-13T02:50:51.187 INFO:tasks.workunit.client.1.smithi122.stdout:0/507: mkdir d1/d4b/d56/da1 0 2024-09-13T02:50:51.190 INFO:tasks.workunit.client.1.smithi122.stdout:4/607: link d11/d13/d82/f79 d11/d30/fbb 0 2024-09-13T02:50:51.191 INFO:tasks.workunit.client.1.smithi122.stdout:4/608: write d11/d1b/d32/f73 [218952,40082] 0 2024-09-13T02:50:51.191 INFO:tasks.workunit.client.1.smithi122.stdout:4/609: fdatasync d11/d3d/f5b 0 2024-09-13T02:50:51.194 INFO:tasks.workunit.client.1.smithi122.stdout:4/610: getdents d11 0 2024-09-13T02:50:51.195 INFO:tasks.workunit.client.1.smithi122.stdout:0/508: rmdir d1/d5/d9/da/d92/d94/d8f 0 2024-09-13T02:50:51.199 INFO:tasks.workunit.client.1.smithi122.stdout:1/518: dwrite f2 [0,4194304] 0 2024-09-13T02:50:51.199 INFO:tasks.workunit.client.1.smithi122.stdout:0/509: creat d1/d5/d9/da/d7d/fa2 x:0 0 0 2024-09-13T02:50:51.199 INFO:tasks.workunit.client.1.smithi122.stdout:1/519: write dc/de/d13/d46/d6c/d7d/f88 [89652,23105] 0 2024-09-13T02:50:51.199 INFO:tasks.workunit.client.1.smithi122.stdout:1/520: chown dc/de/d13/d46/d6c/d7d/f88 49460 1 2024-09-13T02:50:51.199 INFO:tasks.workunit.client.1.smithi122.stdout:9/524: dwrite d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:51.201 INFO:tasks.workunit.client.1.smithi122.stdout:0/510: symlink d1/d4b/d56/la3 0 2024-09-13T02:50:51.206 INFO:tasks.workunit.client.1.smithi122.stdout:4/611: write d11/d30/f9d [21913,78476] 0 2024-09-13T02:50:51.211 INFO:tasks.workunit.client.1.smithi122.stdout:4/612: dread d11/d1b/d2e/f6b [0,4194304] 0 2024-09-13T02:50:51.211 INFO:tasks.workunit.client.1.smithi122.stdout:1/521: dread dc/de/d18/f66 [0,4194304] 0 2024-09-13T02:50:51.211 INFO:tasks.workunit.client.1.smithi122.stdout:4/613: fdatasync d11/d30/f8b 0 2024-09-13T02:50:51.211 INFO:tasks.workunit.client.1.smithi122.stdout:9/525: write d8/d16/d3d/d59/d23/f66 [558249,114039] 0 2024-09-13T02:50:51.214 INFO:tasks.workunit.client.1.smithi122.stdout:0/511: mknod d1/d4b/d56/ca4 0 2024-09-13T02:50:51.217 INFO:tasks.workunit.client.1.smithi122.stdout:9/526: dread d8/d16/d3d/d59/f4e [4194304,4194304] 0 2024-09-13T02:50:51.221 INFO:tasks.workunit.client.1.smithi122.stdout:0/512: symlink d1/d5/d10/la5 0 2024-09-13T02:50:51.221 INFO:tasks.workunit.client.1.smithi122.stdout:1/522: rmdir dc/de/d18/d86 39 2024-09-13T02:50:51.224 INFO:tasks.workunit.client.1.smithi122.stdout:9/527: creat d8/d16/d3d/d59/d7d/f9c x:0 0 0 2024-09-13T02:50:51.224 INFO:tasks.workunit.client.1.smithi122.stdout:9/528: fsync d8/ff 0 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:1/523: rename dc/de/d13/c2a to dc/de/d18/d22/d1c/d47/cad 0 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:1/524: dread - dc/d38/d51/f8f zero size 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:0/513: write d1/d5/d9/da/d92/d94/f31 [1653454,74938] 0 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:0/514: creat d1/d4b/fa6 x:0 0 0 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:9/529: stat d8/d16/l1e 0 2024-09-13T02:50:51.227 INFO:tasks.workunit.client.1.smithi122.stdout:9/530: creat d8/d16/d3d/d59/d49/f9d x:0 0 0 2024-09-13T02:50:51.229 INFO:tasks.workunit.client.1.smithi122.stdout:1/525: symlink dc/de/d18/d1d/d2f/d94/d98/lae 0 2024-09-13T02:50:51.231 INFO:tasks.workunit.client.1.smithi122.stdout:0/515: truncate d1/d5/d9/da/d17/f43 921800 0 2024-09-13T02:50:51.233 INFO:tasks.workunit.client.1.smithi122.stdout:9/531: getdents d8/d16/d3d/d59/d23/d7b 0 2024-09-13T02:50:51.237 INFO:tasks.workunit.client.1.smithi122.stdout:1/526: mkdir dc/d38/d51/daf 0 2024-09-13T02:50:51.237 INFO:tasks.workunit.client.1.smithi122.stdout:1/527: chown dc/de/d18/d22/d1c/d47/l56 51860 1 2024-09-13T02:50:51.239 INFO:tasks.workunit.client.1.smithi122.stdout:0/516: mknod d1/d4b/ca7 0 2024-09-13T02:50:51.241 INFO:tasks.workunit.client.1.smithi122.stdout:0/517: creat d1/d4b/d56/da1/fa8 x:0 0 0 2024-09-13T02:50:51.242 INFO:tasks.workunit.client.1.smithi122.stdout:9/532: symlink d8/d16/l9e 0 2024-09-13T02:50:51.244 INFO:tasks.workunit.client.1.smithi122.stdout:9/533: creat d8/f9f x:0 0 0 2024-09-13T02:50:51.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/518: dread d1/d5/d9/da/d92/d94/f31 [0,4194304] 0 2024-09-13T02:50:51.247 INFO:tasks.workunit.client.1.smithi122.stdout:0/519: creat d1/d5/d9/da/d92/d94/fa9 x:0 0 0 2024-09-13T02:50:51.249 INFO:tasks.workunit.client.1.smithi122.stdout:3/566: rmdir d4/d11/dd 39 2024-09-13T02:50:51.249 INFO:tasks.workunit.client.1.smithi122.stdout:9/534: dread d8/f1a [0,4194304] 0 2024-09-13T02:50:51.259 INFO:tasks.workunit.client.1.smithi122.stdout:1/528: dwrite dc/de/d18/f28 [0,4194304] 0 2024-09-13T02:50:51.261 INFO:tasks.workunit.client.1.smithi122.stdout:0/520: write d1/d5/d10/d29/f40 [3922493,38522] 0 2024-09-13T02:50:51.262 INFO:tasks.workunit.client.1.smithi122.stdout:9/535: dread d8/f9 [0,4194304] 0 2024-09-13T02:50:51.263 INFO:tasks.workunit.client.1.smithi122.stdout:3/567: dread d4/f73 [0,4194304] 0 2024-09-13T02:50:51.271 INFO:tasks.workunit.client.1.smithi122.stdout:3/568: rename d4/d11/dd/d21/d30/l94 to d4/d11/da9/ld0 0 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:2/472: sync 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:3/569: fsync d4/d11/dd/d21/d74/f83 0 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:3/570: chown d4/d11/dd/d21/d2b/d55/fcb 0 1 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:2/473: write d0/f1b [2161547,83893] 0 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:7/479: sync 2024-09-13T02:50:51.272 INFO:tasks.workunit.client.1.smithi122.stdout:7/480: write d4/f83 [217170,45091] 0 2024-09-13T02:50:51.274 INFO:tasks.workunit.client.1.smithi122.stdout:3/571: rename d4/d11/dd/d21/d74/lbb to d4/d11/dd/dca/ld1 0 2024-09-13T02:50:51.275 INFO:tasks.workunit.client.1.smithi122.stdout:2/474: truncate d0/d1e/d26/f43 3707220 0 2024-09-13T02:50:51.278 INFO:tasks.workunit.client.1.smithi122.stdout:7/481: rename d4/d8/db/f86 to d4/d6d/d8f/f9e 0 2024-09-13T02:50:51.278 INFO:tasks.workunit.client.1.smithi122.stdout:9/536: dread d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:51.279 INFO:tasks.workunit.client.1.smithi122.stdout:2/475: mkdir d0/d1e/d2e/d8a/d99 0 2024-09-13T02:50:51.282 INFO:tasks.workunit.client.1.smithi122.stdout:9/537: symlink d8/d16/d3d/d59/d29/d90/la0 0 2024-09-13T02:50:51.285 INFO:tasks.workunit.client.1.smithi122.stdout:3/572: write d4/d11/dd/d21/d2b/d36/d3c/f10 [1159243,19274] 0 2024-09-13T02:50:51.286 INFO:tasks.workunit.client.1.smithi122.stdout:2/476: creat d0/d1c/d3b/d41/d4e/d75/d95/f9a x:0 0 0 2024-09-13T02:50:51.287 INFO:tasks.workunit.client.1.smithi122.stdout:2/477: dread - d0/d1c/f5e zero size 2024-09-13T02:50:51.287 INFO:tasks.workunit.client.1.smithi122.stdout:2/478: dread - d0/d1c/f5e zero size 2024-09-13T02:50:51.288 INFO:tasks.workunit.client.1.smithi122.stdout:9/538: dread d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:51.292 INFO:tasks.workunit.client.1.smithi122.stdout:9/539: symlink d8/d4a/la1 0 2024-09-13T02:50:51.292 INFO:tasks.workunit.client.1.smithi122.stdout:9/540: dread - d8/d16/d3d/d59/d23/f8e zero size 2024-09-13T02:50:51.300 INFO:tasks.workunit.client.1.smithi122.stdout:9/541: write d8/d16/d3e/f6b [4108045,35396] 0 2024-09-13T02:50:51.301 INFO:tasks.workunit.client.1.smithi122.stdout:0/521: dwrite d1/d5/d9/da/d92/d94/f5c [4194304,4194304] 0 2024-09-13T02:50:51.301 INFO:tasks.workunit.client.1.smithi122.stdout:0/522: fsync d1/d5/d10/d29/d32/d5f/f6c 0 2024-09-13T02:50:51.302 INFO:tasks.workunit.client.1.smithi122.stdout:7/482: dwrite d4/d8/db/dc/d1b/f57 [0,4194304] 0 2024-09-13T02:50:51.302 INFO:tasks.workunit.client.1.smithi122.stdout:7/483: dread - d4/d4e/d5d/d6b/f78 zero size 2024-09-13T02:50:51.302 INFO:tasks.workunit.client.1.smithi122.stdout:7/484: chown d4/d8/db/dc/f1d 3974 1 2024-09-13T02:50:51.306 INFO:tasks.workunit.client.1.smithi122.stdout:9/542: link d8/l11 d8/d16/d3d/d59/d7d/d94/la2 0 2024-09-13T02:50:51.308 INFO:tasks.workunit.client.1.smithi122.stdout:3/573: dread d4/d11/dd/d21/d74/f83 [0,4194304] 0 2024-09-13T02:50:51.308 INFO:tasks.workunit.client.1.smithi122.stdout:3/574: chown d4/d11/dd/d21/d2b/d36/d3c/d43/da3/lb6 19 1 2024-09-13T02:50:51.314 INFO:tasks.workunit.client.1.smithi122.stdout:2/479: dwrite d0/d1c/d3b/f7b [0,4194304] 0 2024-09-13T02:50:51.314 INFO:tasks.workunit.client.1.smithi122.stdout:2/480: read d0/d55/d70/d59/f6e [1544443,80695] 0 2024-09-13T02:50:51.323 INFO:tasks.workunit.client.1.smithi122.stdout:7/485: dwrite d4/d4e/f73 [4194304,4194304] 0 2024-09-13T02:50:51.327 INFO:tasks.workunit.client.1.smithi122.stdout:9/543: rename d8/d16/d3d/d59/d7d/d94 to d8/d16/d3d/d59/d23/d7b/d82/da3 0 2024-09-13T02:50:51.327 INFO:tasks.workunit.client.1.smithi122.stdout:2/481: rmdir d0/d1e/d22/d29 39 2024-09-13T02:50:51.328 INFO:tasks.workunit.client.1.smithi122.stdout:0/523: truncate d1/d5/d9/da/d92/d94/f1f 3564995 0 2024-09-13T02:50:51.333 INFO:tasks.workunit.client.1.smithi122.stdout:7/486: rename d4/d8/c4b to d4/d8/db/d63/c9f 0 2024-09-13T02:50:51.333 INFO:tasks.workunit.client.1.smithi122.stdout:2/482: creat d0/d1e/f9b x:0 0 0 2024-09-13T02:50:51.336 INFO:tasks.workunit.client.1.smithi122.stdout:0/524: link d1/d5/d10/f7b d1/d4b/d56/d60/faa 0 2024-09-13T02:50:51.338 INFO:tasks.workunit.client.1.smithi122.stdout:8/424: sync 2024-09-13T02:50:51.338 INFO:tasks.workunit.client.1.smithi122.stdout:5/476: sync 2024-09-13T02:50:51.338 INFO:tasks.workunit.client.1.smithi122.stdout:6/645: sync 2024-09-13T02:50:51.340 INFO:tasks.workunit.client.1.smithi122.stdout:9/544: rename d8/d16/d3d/d59/d29/c5b to d8/d16/d3d/d59/d23/ca4 0 2024-09-13T02:50:51.342 INFO:tasks.workunit.client.1.smithi122.stdout:7/487: mkdir d4/d8/db/dc/d1b/d49/da0 0 2024-09-13T02:50:51.344 INFO:tasks.workunit.client.1.smithi122.stdout:9/545: mknod d8/d16/d3d/d59/d23/d1f/d36/ca5 0 2024-09-13T02:50:51.344 INFO:tasks.workunit.client.1.smithi122.stdout:9/546: readlink d8/d16/l9e 0 2024-09-13T02:50:51.344 INFO:tasks.workunit.client.1.smithi122.stdout:9/547: stat d8/d88/c6f 0 2024-09-13T02:50:51.344 INFO:tasks.workunit.client.1.smithi122.stdout:9/548: write d8/d16/d3d/d59/d23/d1f/f37 [1021867,128682] 0 2024-09-13T02:50:51.354 INFO:tasks.workunit.client.1.smithi122.stdout:8/425: write d3/d53/d34/f49 [1974387,21572] 0 2024-09-13T02:50:51.354 INFO:tasks.workunit.client.1.smithi122.stdout:8/426: chown d3/d53 29 1 2024-09-13T02:50:51.356 INFO:tasks.workunit.client.1.smithi122.stdout:8/427: mknod d3/d53/d21/c7e 0 2024-09-13T02:50:51.356 INFO:tasks.workunit.client.1.smithi122.stdout:8/428: creat d3/da/d1f/f7f x:0 0 0 2024-09-13T02:50:51.356 INFO:tasks.workunit.client.1.smithi122.stdout:5/477: dread d0/da/d48/f49 [0,4194304] 0 2024-09-13T02:50:51.357 INFO:tasks.workunit.client.1.smithi122.stdout:5/478: fdatasync d0/d2/f6d 0 2024-09-13T02:50:51.357 INFO:tasks.workunit.client.1.smithi122.stdout:8/429: getdents d3/d31/d65 0 2024-09-13T02:50:51.359 INFO:tasks.workunit.client.1.smithi122.stdout:5/479: creat d0/d17/d36/d8b/f96 x:0 0 0 2024-09-13T02:50:51.359 INFO:tasks.workunit.client.1.smithi122.stdout:0/525: dread d1/d5/d9/f25 [0,4194304] 0 2024-09-13T02:50:51.361 INFO:tasks.workunit.client.1.smithi122.stdout:7/488: dread d4/d8/db/f38 [4194304,4194304] 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/430: symlink d3/d53/l80 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/431: dread - d3/d53/d4d/d6d/d76/f7b zero size 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/432: getdents d3/d31/d65 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/433: stat d3/da/ce 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/434: write d3/d31/d52/f5b [169245,85319] 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/435: chown d3/d31/f3b 306893 1 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/526: rmdir d1/d5/d9/da/d7d/d84 0 2024-09-13T02:50:51.362 INFO:tasks.workunit.client.1.smithi122.stdout:7/489: stat d4/d8/db/dc/d46/c62 0 2024-09-13T02:50:51.363 INFO:tasks.workunit.client.1.smithi122.stdout:8/436: symlink d3/da/d1e/l81 0 2024-09-13T02:50:51.365 INFO:tasks.workunit.client.1.smithi122.stdout:8/437: symlink d3/da/d1e/l82 0 2024-09-13T02:50:51.369 INFO:tasks.workunit.client.1.smithi122.stdout:7/490: dread d4/d8/db/dc/f5f [0,4194304] 0 2024-09-13T02:50:51.369 INFO:tasks.workunit.client.1.smithi122.stdout:6/646: dwrite d5/d3d/d6c/d41/d5b/d7a/fc2 [0,4194304] 0 2024-09-13T02:50:51.372 INFO:tasks.workunit.client.1.smithi122.stdout:0/527: fsync d1/d4b/d56/d60/faa 0 2024-09-13T02:50:51.372 INFO:tasks.workunit.client.1.smithi122.stdout:8/438: dread d3/d31/d65/f54 [0,4194304] 0 2024-09-13T02:50:51.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/528: rmdir d1/d5/d2d/d80 39 2024-09-13T02:50:51.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/529: readlink d1/d5/d10/d29/d32/d5f/l77 0 2024-09-13T02:50:51.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/530: creat d1/d5/d9/da/d7d/fab x:0 0 0 2024-09-13T02:50:51.373 INFO:tasks.workunit.client.1.smithi122.stdout:0/531: dread - d1/d5/d9/f6e zero size 2024-09-13T02:50:51.373 INFO:tasks.workunit.client.1.smithi122.stdout:7/491: write d4/d8/d24/f37 [241340,116314] 0 2024-09-13T02:50:51.375 INFO:tasks.workunit.client.1.smithi122.stdout:0/532: symlink d1/d5/d9/da/d7d/lac 0 2024-09-13T02:50:51.378 INFO:tasks.workunit.client.1.smithi122.stdout:7/492: mknod d4/d8/db/dc/d36/ca1 0 2024-09-13T02:50:51.378 INFO:tasks.workunit.client.1.smithi122.stdout:7/493: fsync d4/f83 0 2024-09-13T02:50:51.380 INFO:tasks.workunit.client.1.smithi122.stdout:7/494: dread d4/d8/db/dc/f5f [0,4194304] 0 2024-09-13T02:50:51.380 INFO:tasks.workunit.client.1.smithi122.stdout:9/549: dwrite d8/d16/d3d/d59/d49/f89 [0,4194304] 0 2024-09-13T02:50:51.380 INFO:tasks.workunit.client.1.smithi122.stdout:5/480: dwrite d0/f92 [0,4194304] 0 2024-09-13T02:50:51.380 INFO:tasks.workunit.client.1.smithi122.stdout:0/533: rename d1/d5/d10/d29/d32/d5f/l77 to d1/d4b/d56/d81/lad 0 2024-09-13T02:50:51.403 INFO:tasks.workunit.client.1.smithi122.stdout:5/481: dwrite d0/d2/f13 [0,4194304] 0 2024-09-13T02:50:51.403 INFO:tasks.workunit.client.1.smithi122.stdout:5/482: write d0/da/f73 [519258,77290] 0 2024-09-13T02:50:51.405 INFO:tasks.workunit.client.1.smithi122.stdout:7/495: dwrite d4/d8/d3d/f44 [4194304,4194304] 0 2024-09-13T02:50:51.405 INFO:tasks.workunit.client.1.smithi122.stdout:5/483: creat d0/d17/d36/d25/d2b/f97 x:0 0 0 2024-09-13T02:50:51.405 INFO:tasks.workunit.client.1.smithi122.stdout:5/484: write d0/d2/d33/f87 [381435,101774] 0 2024-09-13T02:50:51.408 INFO:tasks.workunit.client.1.smithi122.stdout:7/496: unlink d4/d8/d24/c94 0 2024-09-13T02:50:51.409 INFO:tasks.workunit.client.1.smithi122.stdout:7/497: creat d4/d77/fa2 x:0 0 0 2024-09-13T02:50:51.409 INFO:tasks.workunit.client.1.smithi122.stdout:7/498: write d4/d8/db/dc/d1b/f34 [2878434,90821] 0 2024-09-13T02:50:51.411 INFO:tasks.workunit.client.1.smithi122.stdout:5/485: write d0/d2/d33/f5e [1764255,20148] 0 2024-09-13T02:50:51.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/614: sync 2024-09-13T02:50:51.414 INFO:tasks.workunit.client.1.smithi122.stdout:1/529: sync 2024-09-13T02:50:51.414 INFO:tasks.workunit.client.1.smithi122.stdout:4/615: stat d11/f49 0 2024-09-13T02:50:51.416 INFO:tasks.workunit.client.1.smithi122.stdout:5/486: mkdir d0/da/d48/d63/d98 0 2024-09-13T02:50:51.418 INFO:tasks.workunit.client.1.smithi122.stdout:4/616: rename d11/d30/f94 to d11/d1b/d32/fbc 0 2024-09-13T02:50:51.418 INFO:tasks.workunit.client.1.smithi122.stdout:4/617: truncate d11/d1b/d2e/f34 382437 0 2024-09-13T02:50:51.418 INFO:tasks.workunit.client.1.smithi122.stdout:4/618: getdents d11 0 2024-09-13T02:50:51.418 INFO:tasks.workunit.client.1.smithi122.stdout:4/619: read d11/d13/d82/f16 [2848888,62333] 0 2024-09-13T02:50:51.421 INFO:tasks.workunit.client.1.smithi122.stdout:4/620: unlink d11/d13/d82/d2a/d83/la4 0 2024-09-13T02:50:51.423 INFO:tasks.workunit.client.1.smithi122.stdout:4/621: mkdir d11/d13/d82/d2a/d78/d8e/dbd 0 2024-09-13T02:50:51.425 INFO:tasks.workunit.client.1.smithi122.stdout:4/622: creat d11/d13/d82/fbe x:0 0 0 2024-09-13T02:50:51.426 INFO:tasks.workunit.client.1.smithi122.stdout:4/623: write d11/d30/f54 [358879,125131] 0 2024-09-13T02:50:51.432 INFO:tasks.workunit.client.1.smithi122.stdout:5/487: write d0/f92 [1207827,111700] 0 2024-09-13T02:50:51.432 INFO:tasks.workunit.client.1.smithi122.stdout:5/488: truncate d0/da/f6c 966309 0 2024-09-13T02:50:51.433 INFO:tasks.workunit.client.1.smithi122.stdout:5/489: mkdir d0/d17/d36/d99 0 2024-09-13T02:50:51.445 INFO:tasks.workunit.client.1.smithi122.stdout:7/499: dwrite d4/d8/db/dc/d46/f4f [0,4194304] 0 2024-09-13T02:50:51.445 INFO:tasks.workunit.client.1.smithi122.stdout:9/550: dwrite d8/d16/d3d/d59/d49/f89 [4194304,4194304] 0 2024-09-13T02:50:51.445 INFO:tasks.workunit.client.1.smithi122.stdout:5/490: dread d0/d17/f28 [0,4194304] 0 2024-09-13T02:50:51.445 INFO:tasks.workunit.client.1.smithi122.stdout:1/530: dwrite dc/de/d18/d86/f90 [0,4194304] 0 2024-09-13T02:50:51.446 INFO:tasks.workunit.client.1.smithi122.stdout:4/624: dwrite d11/d13/d82/fbe [0,4194304] 0 2024-09-13T02:50:51.446 INFO:tasks.workunit.client.1.smithi122.stdout:4/625: dread - d11/d1b/d2e/fb8 zero size 2024-09-13T02:50:51.446 INFO:tasks.workunit.client.1.smithi122.stdout:7/500: mkdir d4/d6d/d91/da3 0 2024-09-13T02:50:51.447 INFO:tasks.workunit.client.1.smithi122.stdout:9/551: creat d8/d16/d3d/d59/d23/d7b/d82/fa6 x:0 0 0 2024-09-13T02:50:51.450 INFO:tasks.workunit.client.1.smithi122.stdout:5/491: link d0/d17/d36/c69 d0/d17/d36/d99/c9a 0 2024-09-13T02:50:51.451 INFO:tasks.workunit.client.1.smithi122.stdout:1/531: mknod dc/de/d13/d46/d6c/d7d/cb0 0 2024-09-13T02:50:51.452 INFO:tasks.workunit.client.1.smithi122.stdout:1/532: readlink dc/de/d18/d22/d1c/d47/l74 0 2024-09-13T02:50:51.453 INFO:tasks.workunit.client.1.smithi122.stdout:9/552: mkdir d8/d16/d3d/d59/d23/d7b/d82/da3/da7 0 2024-09-13T02:50:51.455 INFO:tasks.workunit.client.1.smithi122.stdout:5/492: link d0/d17/d36/d25/f74 d0/da/d90/f9b 0 2024-09-13T02:50:51.455 INFO:tasks.workunit.client.1.smithi122.stdout:5/493: write d0/da/d48/f47 [431318,120528] 0 2024-09-13T02:50:51.456 INFO:tasks.workunit.client.1.smithi122.stdout:9/553: dread d8/d16/d3d/d59/d23/d1f/d36/f52 [0,4194304] 0 2024-09-13T02:50:51.456 INFO:tasks.workunit.client.1.smithi122.stdout:9/554: truncate d8/d16/d3d/d59/d29/f76 1121662 0 2024-09-13T02:50:51.457 INFO:tasks.workunit.client.1.smithi122.stdout:5/494: dread d0/d17/d36/f76 [0,4194304] 0 2024-09-13T02:50:51.458 INFO:tasks.workunit.client.1.smithi122.stdout:9/555: creat d8/d16/d3d/d59/d23/d1f/d36/fa8 x:0 0 0 2024-09-13T02:50:51.460 INFO:tasks.workunit.client.1.smithi122.stdout:4/626: dread d11/d13/d82/f25 [0,4194304] 0 2024-09-13T02:50:51.462 INFO:tasks.workunit.client.1.smithi122.stdout:5/495: dread d0/d2/f6d [0,4194304] 0 2024-09-13T02:50:51.464 INFO:tasks.workunit.client.1.smithi122.stdout:7/501: read d4/d8/db/dc/f3b [3637110,76906] 0 2024-09-13T02:50:51.465 INFO:tasks.workunit.client.1.smithi122.stdout:9/556: symlink d8/d88/la9 0 2024-09-13T02:50:51.467 INFO:tasks.workunit.client.1.smithi122.stdout:1/533: rename dc/de/d13/d46/d6c to dc/d38/db1 0 2024-09-13T02:50:51.469 INFO:tasks.workunit.client.1.smithi122.stdout:5/496: rename d0/d17/f7a to d0/d17/d3a/f9c 0 2024-09-13T02:50:51.472 INFO:tasks.workunit.client.1.smithi122.stdout:7/502: rename d4/d8/db/dc/d46/l8e to d4/d4e/d5d/d6b/la4 0 2024-09-13T02:50:51.476 INFO:tasks.workunit.client.1.smithi122.stdout:5/497: unlink d0/da/d48/f47 0 2024-09-13T02:50:51.477 INFO:tasks.workunit.client.1.smithi122.stdout:5/498: getdents d0/d17/d36/d25/d2b/d72 0 2024-09-13T02:50:51.477 INFO:tasks.workunit.client.1.smithi122.stdout:5/499: stat d0/da/d48/f49 0 2024-09-13T02:50:51.477 INFO:tasks.workunit.client.1.smithi122.stdout:5/500: creat d0/d17/d36/d8b/f9d x:0 0 0 2024-09-13T02:50:51.480 INFO:tasks.workunit.client.1.smithi122.stdout:5/501: creat d0/d17/d36/f9e x:0 0 0 2024-09-13T02:50:51.480 INFO:tasks.workunit.client.1.smithi122.stdout:5/502: fdatasync d0/d2/d33/f5e 0 2024-09-13T02:50:51.480 INFO:tasks.workunit.client.1.smithi122.stdout:1/534: write dc/de/d18/f28 [3457262,84107] 0 2024-09-13T02:50:51.480 INFO:tasks.workunit.client.1.smithi122.stdout:4/627: dwrite d11/f80 [0,4194304] 0 2024-09-13T02:50:51.483 INFO:tasks.workunit.client.1.smithi122.stdout:4/628: symlink d11/d1b/d32/d87/lbf 0 2024-09-13T02:50:51.484 INFO:tasks.workunit.client.1.smithi122.stdout:4/629: fdatasync d11/d30/f8b 0 2024-09-13T02:50:51.513 INFO:tasks.workunit.client.1.smithi122.stdout:7/503: dwrite d4/d4e/f73 [4194304,4194304] 0 2024-09-13T02:50:51.513 INFO:tasks.workunit.client.1.smithi122.stdout:5/503: dwrite d0/f5a [0,4194304] 0 2024-09-13T02:50:51.514 INFO:tasks.workunit.client.1.smithi122.stdout:5/504: creat d0/d17/d3a/f9f x:0 0 0 2024-09-13T02:50:51.514 INFO:tasks.workunit.client.1.smithi122.stdout:5/505: write d0/d17/d36/d25/f65 [409786,4264] 0 2024-09-13T02:50:51.515 INFO:tasks.workunit.client.1.smithi122.stdout:5/506: mkdir d0/da/d8c/d8f/da0 0 2024-09-13T02:50:51.516 INFO:tasks.workunit.client.1.smithi122.stdout:2/483: sync 2024-09-13T02:50:51.516 INFO:tasks.workunit.client.1.smithi122.stdout:3/575: sync 2024-09-13T02:50:51.516 INFO:tasks.workunit.client.1.smithi122.stdout:2/484: write d0/d1c/d3b/d41/d4e/f60 [347275,130086] 0 2024-09-13T02:50:51.516 INFO:tasks.workunit.client.1.smithi122.stdout:2/485: write d0/d1c/f31 [1411944,42418] 0 2024-09-13T02:50:51.518 INFO:tasks.workunit.client.1.smithi122.stdout:7/504: write d4/d8/db/dc/f1d [1911668,3935] 0 2024-09-13T02:50:51.521 INFO:tasks.workunit.client.1.smithi122.stdout:5/507: dread d0/da/d48/d63/f82 [0,4194304] 0 2024-09-13T02:50:51.525 INFO:tasks.workunit.client.1.smithi122.stdout:2/486: dread d0/d1c/d3b/d41/d4e/f60 [0,4194304] 0 2024-09-13T02:50:51.525 INFO:tasks.workunit.client.1.smithi122.stdout:3/576: dread d4/d11/dd/d21/f4d [4194304,4194304] 0 2024-09-13T02:50:51.526 INFO:tasks.workunit.client.1.smithi122.stdout:3/577: truncate d4/d11/d38/f9c 5354717 0 2024-09-13T02:50:51.526 INFO:tasks.workunit.client.1.smithi122.stdout:3/578: write d4/d6/f8 [4196093,124841] 0 2024-09-13T02:50:51.527 INFO:tasks.workunit.client.1.smithi122.stdout:3/579: symlink d4/d4c/ld2 0 2024-09-13T02:50:51.528 INFO:tasks.workunit.client.1.smithi122.stdout:3/580: rename d4/d11/dd/d21/d4e/d53 to d4/d4c/dd3 0 2024-09-13T02:50:51.529 INFO:tasks.workunit.client.1.smithi122.stdout:5/508: dread d0/da/f19 [0,4194304] 0 2024-09-13T02:50:51.529 INFO:tasks.workunit.client.1.smithi122.stdout:5/509: truncate d0/d17/d36/d25/f65 1127702 0 2024-09-13T02:50:51.529 INFO:tasks.workunit.client.1.smithi122.stdout:3/581: mknod d4/d11/dd/d21/d4e/dc8/cd4 0 2024-09-13T02:50:51.530 INFO:tasks.workunit.client.1.smithi122.stdout:5/510: readlink d0/d17/d36/d3f/l4a 0 2024-09-13T02:50:51.530 INFO:tasks.workunit.client.1.smithi122.stdout:5/511: fsync d0/da/d48/d63/f82 0 2024-09-13T02:50:51.530 INFO:tasks.workunit.client.1.smithi122.stdout:5/512: mknod d0/ca1 0 2024-09-13T02:50:51.531 INFO:tasks.workunit.client.1.smithi122.stdout:5/513: rmdir d0/d17/d36/d25/d2b 39 2024-09-13T02:50:51.532 INFO:tasks.workunit.client.1.smithi122.stdout:5/514: chown d0/ca1 2700 1 2024-09-13T02:50:51.533 INFO:tasks.workunit.client.1.smithi122.stdout:5/515: symlink d0/d17/d36/d25/la2 0 2024-09-13T02:50:51.533 INFO:tasks.workunit.client.1.smithi122.stdout:5/516: dread - d0/d17/d36/f9e zero size 2024-09-13T02:50:51.534 INFO:tasks.workunit.client.1.smithi122.stdout:5/517: mknod d0/da/d48/ca3 0 2024-09-13T02:50:51.534 INFO:tasks.workunit.client.1.smithi122.stdout:5/518: dread - d0/d17/d36/d25/d2b/f30 zero size 2024-09-13T02:50:51.538 INFO:tasks.workunit.client.1.smithi122.stdout:5/519: write d0/da/d48/d63/f82 [2857345,48672] 0 2024-09-13T02:50:51.538 INFO:tasks.workunit.client.1.smithi122.stdout:5/520: creat d0/d17/fa4 x:0 0 0 2024-09-13T02:50:51.538 INFO:tasks.workunit.client.1.smithi122.stdout:5/521: stat d0/d17/d36/d25/c75 0 2024-09-13T02:50:51.541 INFO:tasks.workunit.client.1.smithi122.stdout:3/582: dread d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:51.541 INFO:tasks.workunit.client.1.smithi122.stdout:3/583: truncate d4/d6/df/d15/d68/fa5 1640426 0 2024-09-13T02:50:51.543 INFO:tasks.workunit.client.1.smithi122.stdout:3/584: mkdir d4/d6/df/d15/d68/dd5 0 2024-09-13T02:50:51.544 INFO:tasks.workunit.client.1.smithi122.stdout:3/585: readlink d4/d11/dd/d21/d2b/d36/d3c/d43/da3/lb6 0 2024-09-13T02:50:51.545 INFO:tasks.workunit.client.1.smithi122.stdout:7/505: dwrite d4/f29 [0,4194304] 0 2024-09-13T02:50:51.547 INFO:tasks.workunit.client.1.smithi122.stdout:7/506: mknod d4/d8/d3d/ca5 0 2024-09-13T02:50:51.557 INFO:tasks.workunit.client.1.smithi122.stdout:2/487: dwrite d0/d1e/d22/d29/f7d [0,4194304] 0 2024-09-13T02:50:51.557 INFO:tasks.workunit.client.1.smithi122.stdout:2/488: fsync d0/d1e/d26/f43 0 2024-09-13T02:50:51.558 INFO:tasks.workunit.client.1.smithi122.stdout:7/507: mkdir d4/d6d/da6 0 2024-09-13T02:50:51.566 INFO:tasks.workunit.client.1.smithi122.stdout:2/489: write d0/f16 [393409,110659] 0 2024-09-13T02:50:51.566 INFO:tasks.workunit.client.1.smithi122.stdout:2/490: chown d0/d55/d70 1273 1 2024-09-13T02:50:51.566 INFO:tasks.workunit.client.1.smithi122.stdout:2/491: getdents d0 0 2024-09-13T02:50:51.571 INFO:tasks.workunit.client.1.smithi122.stdout:7/508: write d4/d8/db/f11 [3293437,8939] 0 2024-09-13T02:50:51.572 INFO:tasks.workunit.client.1.smithi122.stdout:3/586: dwrite d4/d11/dd/d21/d4e/dc8/fc9 [0,4194304] 0 2024-09-13T02:50:51.572 INFO:tasks.workunit.client.1.smithi122.stdout:3/587: stat d4/d11/dd/d21/d2b/d36/d3c/d43/da3 0 2024-09-13T02:50:51.572 INFO:tasks.workunit.client.1.smithi122.stdout:3/588: chown d4/d11/dd/d21/d2b/d55/fa4 53 1 2024-09-13T02:50:51.575 INFO:tasks.workunit.client.1.smithi122.stdout:7/509: symlink d4/d77/la7 0 2024-09-13T02:50:51.575 INFO:tasks.workunit.client.1.smithi122.stdout:7/510: truncate d4/d4e/d5d/d6b/f8d 925258 0 2024-09-13T02:50:51.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/589: rename d4/d11/dd/d21/d2b/d55/f62 to d4/d11/dd/d21/d2b/d36/fd6 0 2024-09-13T02:50:51.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/590: chown d4/d11/dd/d21/d2b/d55/fcb 872 1 2024-09-13T02:50:51.577 INFO:tasks.workunit.client.1.smithi122.stdout:3/591: read - d4/d11/dd/d21/d4e/f8b zero size 2024-09-13T02:50:51.581 INFO:tasks.workunit.client.1.smithi122.stdout:7/511: link d4/d6d/d91/f87 d4/d8/db/dc/d1b/d49/fa8 0 2024-09-13T02:50:51.582 INFO:tasks.workunit.client.1.smithi122.stdout:3/592: symlink d4/d11/dd/d21/d2b/ld7 0 2024-09-13T02:50:51.583 INFO:tasks.workunit.client.1.smithi122.stdout:2/492: dwrite d0/d1e/d2e/d3e/f4b [4194304,4194304] 0 2024-09-13T02:50:51.584 INFO:tasks.workunit.client.1.smithi122.stdout:7/512: rename d4/d8/db/dc/f28 to d4/d8/db/dc/d1b/fa9 0 2024-09-13T02:50:51.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/493: rmdir d0/d1c/d3b/d41/d4e/d75 39 2024-09-13T02:50:51.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/494: truncate d0/d1c/d3b/d41/d6a/f72 186239 0 2024-09-13T02:50:51.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/495: creat d0/d1e/f9c x:0 0 0 2024-09-13T02:50:51.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/496: dread - d0/d55/d70/d59/f88 zero size 2024-09-13T02:50:51.587 INFO:tasks.workunit.client.1.smithi122.stdout:7/513: mkdir d4/d8/d24/daa 0 2024-09-13T02:50:51.587 INFO:tasks.workunit.client.1.smithi122.stdout:7/514: dread - d4/d8/db/dc/f72 zero size 2024-09-13T02:50:51.590 INFO:tasks.workunit.client.1.smithi122.stdout:7/515: truncate d4/d8/db/dc/d46/d5a/f6f 604591 0 2024-09-13T02:50:51.593 INFO:tasks.workunit.client.1.smithi122.stdout:2/497: unlink d0/d1e/d22/d29/f83 0 2024-09-13T02:50:51.593 INFO:tasks.workunit.client.1.smithi122.stdout:2/498: creat d0/d55/f9d x:0 0 0 2024-09-13T02:50:51.593 INFO:tasks.workunit.client.1.smithi122.stdout:7/516: mknod d4/d6d/d8f/cab 0 2024-09-13T02:50:51.595 INFO:tasks.workunit.client.1.smithi122.stdout:2/499: creat d0/d1e/d22/d29/f9e x:0 0 0 2024-09-13T02:50:51.595 INFO:tasks.workunit.client.1.smithi122.stdout:2/500: chown d0/d1e/d2e/d3e 248639235 1 2024-09-13T02:50:51.596 INFO:tasks.workunit.client.1.smithi122.stdout:3/593: dwrite d4/d6/df/d15/d68/fbe [0,4194304] 0 2024-09-13T02:50:51.597 INFO:tasks.workunit.client.1.smithi122.stdout:2/501: symlink d0/d1c/d3b/d41/d4e/d75/l9f 0 2024-09-13T02:50:51.600 INFO:tasks.workunit.client.1.smithi122.stdout:3/594: getdents d4/d11/dd/d21/d6c 0 2024-09-13T02:50:51.601 INFO:tasks.workunit.client.1.smithi122.stdout:7/517: unlink d4/d8/db/dc/d1b/fa9 0 2024-09-13T02:50:51.602 INFO:tasks.workunit.client.1.smithi122.stdout:7/518: fsync d4/d8/db/dc/d1b/d49/fa8 0 2024-09-13T02:50:51.603 INFO:tasks.workunit.client.1.smithi122.stdout:2/502: creat d0/d1e/d26/fa0 x:0 0 0 2024-09-13T02:50:51.605 INFO:tasks.workunit.client.1.smithi122.stdout:3/595: unlink d4/d11/dd/d21/d2b/d36/d3c/d43/da3/faf 0 2024-09-13T02:50:51.607 INFO:tasks.workunit.client.1.smithi122.stdout:7/519: symlink d4/d8/d24/lac 0 2024-09-13T02:50:51.627 INFO:tasks.workunit.client.1.smithi122.stdout:6/647: sync 2024-09-13T02:50:51.628 INFO:tasks.workunit.client.1.smithi122.stdout:3/596: dwrite d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fb8 [0,4194304] 0 2024-09-13T02:50:51.628 INFO:tasks.workunit.client.1.smithi122.stdout:3/597: stat d4/d11/dd/d21/d2b/d36/d3c/f20 0 2024-09-13T02:50:51.628 INFO:tasks.workunit.client.1.smithi122.stdout:7/520: dwrite d4/d8/f7 [4194304,4194304] 0 2024-09-13T02:50:51.628 INFO:tasks.workunit.client.1.smithi122.stdout:7/521: chown d4/d8/db/ff 90143975 1 2024-09-13T02:50:51.629 INFO:tasks.workunit.client.1.smithi122.stdout:7/522: write d4/d8/db/dc/d46/d5a/f7c [376159,37853] 0 2024-09-13T02:50:51.629 INFO:tasks.workunit.client.1.smithi122.stdout:7/523: creat d4/d8/d24/fad x:0 0 0 2024-09-13T02:50:51.632 INFO:tasks.workunit.client.1.smithi122.stdout:3/598: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fd8 x:0 0 0 2024-09-13T02:50:51.632 INFO:tasks.workunit.client.1.smithi122.stdout:3/599: write d4/d6/df/d15/d68/fa5 [203412,117104] 0 2024-09-13T02:50:51.632 INFO:tasks.workunit.client.1.smithi122.stdout:3/600: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/da0 0 1 2024-09-13T02:50:51.639 INFO:tasks.workunit.client.1.smithi122.stdout:3/601: dread d4/d6/de/d1f/f8a [0,4194304] 0 2024-09-13T02:50:51.641 INFO:tasks.workunit.client.1.smithi122.stdout:7/524: rmdir d4/d8/db 39 2024-09-13T02:50:51.642 INFO:tasks.workunit.client.1.smithi122.stdout:3/602: creat d4/d11/dd/fd9 x:0 0 0 2024-09-13T02:50:51.643 INFO:tasks.workunit.client.1.smithi122.stdout:3/603: chown d4/d4c/ld2 129199 1 2024-09-13T02:50:51.644 INFO:tasks.workunit.client.1.smithi122.stdout:3/604: symlink d4/d6/df/d15/d68/dd5/lda 0 2024-09-13T02:50:51.645 INFO:tasks.workunit.client.1.smithi122.stdout:7/525: unlink d4/d8/db/dc/d46/d5a/f6f 0 2024-09-13T02:50:51.645 INFO:tasks.workunit.client.1.smithi122.stdout:6/648: dwrite d5/db/d29/d60/dac/dc6/f13 [0,4194304] 0 2024-09-13T02:50:51.645 INFO:tasks.workunit.client.1.smithi122.stdout:6/649: read - d5/d40/fc8 zero size 2024-09-13T02:50:51.645 INFO:tasks.workunit.client.1.smithi122.stdout:6/650: read - d5/d11/d45/d21/f90 zero size 2024-09-13T02:50:51.646 INFO:tasks.workunit.client.1.smithi122.stdout:3/605: creat d4/d6/de/d1f/d33/fdb x:0 0 0 2024-09-13T02:50:51.646 INFO:tasks.workunit.client.1.smithi122.stdout:7/526: rmdir d4/d8/db/dc/d1b/d49 39 2024-09-13T02:50:51.646 INFO:tasks.workunit.client.1.smithi122.stdout:7/527: chown d4/d4e/d5d/d8a 31887 1 2024-09-13T02:50:51.646 INFO:tasks.workunit.client.1.smithi122.stdout:7/528: chown d4/d8/db/dc 0 1 2024-09-13T02:50:51.646 INFO:tasks.workunit.client.1.smithi122.stdout:6/651: getdents d5/d11/d2f 0 2024-09-13T02:50:51.647 INFO:tasks.workunit.client.1.smithi122.stdout:7/529: creat d4/d8/d24/daa/fae x:0 0 0 2024-09-13T02:50:51.647 INFO:tasks.workunit.client.1.smithi122.stdout:7/530: chown d4/d8/db/dc/d1b/l3c 883382283 1 2024-09-13T02:50:51.650 INFO:tasks.workunit.client.1.smithi122.stdout:3/606: dread f3 [0,4194304] 0 2024-09-13T02:50:51.650 INFO:tasks.workunit.client.1.smithi122.stdout:3/607: chown d4/d6/df/f98 5261336 1 2024-09-13T02:50:51.655 INFO:tasks.workunit.client.1.smithi122.stdout:3/608: rmdir d4/d6/df/d15/d68 39 2024-09-13T02:50:51.658 INFO:tasks.workunit.client.1.smithi122.stdout:3/609: creat d4/d11/dd/d21/d4e/dc8/fdc x:0 0 0 2024-09-13T02:50:51.658 INFO:tasks.workunit.client.1.smithi122.stdout:3/610: symlink d4/d11/dd/d21/d74/ldd 0 2024-09-13T02:50:51.667 INFO:tasks.workunit.client.1.smithi122.stdout:6/652: dwrite d5/d40/fc8 [0,4194304] 0 2024-09-13T02:50:51.668 INFO:tasks.workunit.client.1.smithi122.stdout:7/531: dwrite d4/d8/db/f9d [0,4194304] 0 2024-09-13T02:50:51.668 INFO:tasks.workunit.client.1.smithi122.stdout:7/532: write d4/d8/d3d/f97 [439687,73126] 0 2024-09-13T02:50:51.670 INFO:tasks.workunit.client.1.smithi122.stdout:6/653: mkdir d5/d3d/da3/dcb 0 2024-09-13T02:50:51.672 INFO:tasks.workunit.client.1.smithi122.stdout:7/533: symlink d4/d8/db/dc/d46/laf 0 2024-09-13T02:50:51.672 INFO:tasks.workunit.client.1.smithi122.stdout:7/534: readlink d4/d8/db/l10 0 2024-09-13T02:50:51.673 INFO:tasks.workunit.client.1.smithi122.stdout:3/611: dread d4/d4c/dd3/f6b [0,4194304] 0 2024-09-13T02:50:51.673 INFO:tasks.workunit.client.1.smithi122.stdout:3/612: truncate d4/d6/f85 755455 0 2024-09-13T02:50:51.674 INFO:tasks.workunit.client.1.smithi122.stdout:3/613: creat d4/d4c/dd3/fde x:0 0 0 2024-09-13T02:50:51.675 INFO:tasks.workunit.client.1.smithi122.stdout:3/614: rename d4/d11/dd/d21/f8f to d4/d6/df/d15/d68/dd5/fdf 0 2024-09-13T02:50:51.677 INFO:tasks.workunit.client.1.smithi122.stdout:3/615: rename d4/d11/dd/d21/d2b/d55/c7f to d4/d6/de/d1f/d33/ce0 0 2024-09-13T02:50:51.677 INFO:tasks.workunit.client.1.smithi122.stdout:3/616: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fe1 x:0 0 0 2024-09-13T02:50:51.678 INFO:tasks.workunit.client.1.smithi122.stdout:3/617: write d4/d4c/f51 [734,91771] 0 2024-09-13T02:50:51.679 INFO:tasks.workunit.client.1.smithi122.stdout:3/618: creat d4/d11/dd/d21/d2b/d36/fe2 x:0 0 0 2024-09-13T02:50:51.681 INFO:tasks.workunit.client.1.smithi122.stdout:6/654: write d5/d3d/d6c/d41/d4e/f88 [3080429,58814] 0 2024-09-13T02:50:51.681 INFO:tasks.workunit.client.1.smithi122.stdout:6/655: chown d5/d11/d3a/lca 8311875 1 2024-09-13T02:50:51.682 INFO:tasks.workunit.client.1.smithi122.stdout:6/656: creat d5/d11/d45/fcc x:0 0 0 2024-09-13T02:50:51.684 INFO:tasks.workunit.client.1.smithi122.stdout:6/657: mkdir d5/d40/dcd 0 2024-09-13T02:50:51.684 INFO:tasks.workunit.client.1.smithi122.stdout:6/658: write d5/db/dc/f96 [360574,121720] 0 2024-09-13T02:50:51.684 INFO:tasks.workunit.client.1.smithi122.stdout:6/659: chown d5/d11/d45/fcc 996 1 2024-09-13T02:50:51.686 INFO:tasks.workunit.client.1.smithi122.stdout:6/660: rename d5/db/f14 to d5/d40/dcd/fce 0 2024-09-13T02:50:51.686 INFO:tasks.workunit.client.1.smithi122.stdout:6/661: chown d5/d11/d45/d21/f57 433735 1 2024-09-13T02:50:51.693 INFO:tasks.workunit.client.1.smithi122.stdout:6/662: dread d5/db/d29/d60/dac/faf [0,4194304] 0 2024-09-13T02:50:51.695 INFO:tasks.workunit.client.1.smithi122.stdout:7/535: dwrite d4/d8/db/dc/f22 [0,4194304] 0 2024-09-13T02:50:51.695 INFO:tasks.workunit.client.1.smithi122.stdout:6/663: rename d5/d11/d45/d21/d83 to d5/d3d/d82/dcf 0 2024-09-13T02:50:51.696 INFO:tasks.workunit.client.1.smithi122.stdout:7/536: unlink d4/d8/l1c 0 2024-09-13T02:50:51.697 INFO:tasks.workunit.client.1.smithi122.stdout:7/537: creat d4/d8/db/dc/d1b/d49/fb0 x:0 0 0 2024-09-13T02:50:51.699 INFO:tasks.workunit.client.1.smithi122.stdout:7/538: write d4/d4e/d5d/d6b/f8d [334623,18256] 0 2024-09-13T02:50:51.699 INFO:tasks.workunit.client.1.smithi122.stdout:7/539: chown d4/d8/db/dc/d46/l7b 0 1 2024-09-13T02:50:51.699 INFO:tasks.workunit.client.1.smithi122.stdout:7/540: fdatasync d4/d4e/d5d/f5e 0 2024-09-13T02:50:51.699 INFO:tasks.workunit.client.1.smithi122.stdout:3/619: dwrite d4/d11/dd/d21/d2b/d55/fcb [0,4194304] 0 2024-09-13T02:50:51.699 INFO:tasks.workunit.client.1.smithi122.stdout:3/620: fdatasync d4/d6/de/d1f/f8a 0 2024-09-13T02:50:51.701 INFO:tasks.workunit.client.1.smithi122.stdout:7/541: truncate d4/d8/db/f11 1634670 0 2024-09-13T02:50:51.705 INFO:tasks.workunit.client.1.smithi122.stdout:3/621: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3 0 2024-09-13T02:50:51.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/622: rename d4/d11/dd/d21/d2b/d36/d3c/d43/d60/c8d to d4/d11/dd/d21/d74/ce4 0 2024-09-13T02:50:51.710 INFO:tasks.workunit.client.1.smithi122.stdout:3/623: readlink d4/d6/df/l24 0 2024-09-13T02:50:51.711 INFO:tasks.workunit.client.1.smithi122.stdout:7/542: getdents d4/d8/d24/daa 0 2024-09-13T02:50:51.712 INFO:tasks.workunit.client.1.smithi122.stdout:3/624: mknod d4/d6/df/d15/d68/d90/ce5 0 2024-09-13T02:50:51.713 INFO:tasks.workunit.client.1.smithi122.stdout:3/625: creat d4/d6/de/d41/fe6 x:0 0 0 2024-09-13T02:50:51.713 INFO:tasks.workunit.client.1.smithi122.stdout:3/626: readlink d4/d11/dd/d21/d4e/l6e 0 2024-09-13T02:50:51.715 INFO:tasks.workunit.client.1.smithi122.stdout:6/664: dwrite d5/d3d/d6c/d41/f47 [0,4194304] 0 2024-09-13T02:50:51.715 INFO:tasks.workunit.client.1.smithi122.stdout:6/665: fdatasync d5/d11/d45/fcc 0 2024-09-13T02:50:51.716 INFO:tasks.workunit.client.1.smithi122.stdout:3/627: rename d4/d6/df/d15/d68/dd5/fdf to d4/d6/df/d15/d68/d90/fe7 0 2024-09-13T02:50:51.716 INFO:tasks.workunit.client.1.smithi122.stdout:3/628: write d4/d11/dd/d21/d6c/fc3 [771627,10130] 0 2024-09-13T02:50:51.726 INFO:tasks.workunit.client.1.smithi122.stdout:3/629: link d4/d4c/cc0 d4/d11/dd/d21/d2b/d36/d3c/d43/d82/ce8 0 2024-09-13T02:50:51.727 INFO:tasks.workunit.client.1.smithi122.stdout:3/630: symlink d4/d6/de/d41/le9 0 2024-09-13T02:50:51.727 INFO:tasks.workunit.client.1.smithi122.stdout:3/631: dread - d4/d11/dd/fd9 zero size 2024-09-13T02:50:51.734 INFO:tasks.workunit.client.1.smithi122.stdout:7/543: dwrite d4/f7d [0,4194304] 0 2024-09-13T02:50:51.737 INFO:tasks.workunit.client.1.smithi122.stdout:7/544: truncate d4/d8/db/dc/f5f 124034 0 2024-09-13T02:50:51.739 INFO:tasks.workunit.client.1.smithi122.stdout:6/666: dwrite d5/d3d/d6c/f7f [0,4194304] 0 2024-09-13T02:50:51.741 INFO:tasks.workunit.client.1.smithi122.stdout:7/545: rename d4/d6d/d91 to d4/d4e/d5d/d8a/db1 0 2024-09-13T02:50:51.743 INFO:tasks.workunit.client.1.smithi122.stdout:7/546: getdents d4/d8/db/dc/d1b/d49 0 2024-09-13T02:50:51.743 INFO:tasks.workunit.client.1.smithi122.stdout:7/547: readlink d4/d8/db/dc/d46/d5a/l8b 0 2024-09-13T02:50:51.745 INFO:tasks.workunit.client.1.smithi122.stdout:3/632: dwrite d4/f5d [0,4194304] 0 2024-09-13T02:50:51.745 INFO:tasks.workunit.client.1.smithi122.stdout:3/633: creat d4/d11/dd/d21/d2b/d36/fea x:0 0 0 2024-09-13T02:50:51.750 INFO:tasks.workunit.client.1.smithi122.stdout:9/557: sync 2024-09-13T02:50:51.753 INFO:tasks.workunit.client.1.smithi122.stdout:7/548: dread d4/d8/d24/f3e [0,4194304] 0 2024-09-13T02:50:51.754 INFO:tasks.workunit.client.1.smithi122.stdout:7/549: symlink d4/d8/lb2 0 2024-09-13T02:50:51.755 INFO:tasks.workunit.client.1.smithi122.stdout:8/439: sync 2024-09-13T02:50:51.756 INFO:tasks.workunit.client.1.smithi122.stdout:4/630: sync 2024-09-13T02:50:51.757 INFO:tasks.workunit.client.1.smithi122.stdout:0/534: sync 2024-09-13T02:50:51.757 INFO:tasks.workunit.client.1.smithi122.stdout:1/535: sync 2024-09-13T02:50:51.757 INFO:tasks.workunit.client.1.smithi122.stdout:0/535: creat d1/d4b/d56/d81/fae x:0 0 0 2024-09-13T02:50:51.757 INFO:tasks.workunit.client.1.smithi122.stdout:6/667: dwrite d5/db/d29/d60/dac/dc6/d46/f8f [0,4194304] 0 2024-09-13T02:50:51.758 INFO:tasks.workunit.client.1.smithi122.stdout:1/536: mkdir dc/d38/db1/db2 0 2024-09-13T02:50:51.758 INFO:tasks.workunit.client.1.smithi122.stdout:1/537: write dc/de/d13/d46/f81 [3947300,107702] 0 2024-09-13T02:50:51.758 INFO:tasks.workunit.client.1.smithi122.stdout:1/538: write dc/de/d13/d46/f77 [525631,38334] 0 2024-09-13T02:50:51.758 INFO:tasks.workunit.client.1.smithi122.stdout:1/539: write dc/d38/d51/f8f [910805,24993] 0 2024-09-13T02:50:51.758 INFO:tasks.workunit.client.1.smithi122.stdout:1/540: creat dc/de/d18/fb3 x:0 0 0 2024-09-13T02:50:51.760 INFO:tasks.workunit.client.1.smithi122.stdout:1/541: creat dc/de/d18/d1d/d2f/fb4 x:0 0 0 2024-09-13T02:50:51.761 INFO:tasks.workunit.client.1.smithi122.stdout:5/522: sync 2024-09-13T02:50:51.761 INFO:tasks.workunit.client.1.smithi122.stdout:5/523: creat d0/d17/d36/d8b/fa5 x:0 0 0 2024-09-13T02:50:51.761 INFO:tasks.workunit.client.1.smithi122.stdout:5/524: chown d0/d17/d3a/c4b 257232 1 2024-09-13T02:50:51.761 INFO:tasks.workunit.client.1.smithi122.stdout:0/536: creat d1/d5/d9/faf x:0 0 0 2024-09-13T02:50:51.764 INFO:tasks.workunit.client.1.smithi122.stdout:1/542: read dc/de/d18/d1d/d2f/f95 [641904,38408] 0 2024-09-13T02:50:51.764 INFO:tasks.workunit.client.1.smithi122.stdout:9/558: write d8/f1a [2257869,116163] 0 2024-09-13T02:50:51.764 INFO:tasks.workunit.client.1.smithi122.stdout:9/559: chown d8/d4a/d64 140055 1 2024-09-13T02:50:51.766 INFO:tasks.workunit.client.1.smithi122.stdout:9/560: symlink d8/d16/laa 0 2024-09-13T02:50:51.775 INFO:tasks.workunit.client.1.smithi122.stdout:8/440: read d3/da/d1f/f1a [2862826,53847] 0 2024-09-13T02:50:51.775 INFO:tasks.workunit.client.1.smithi122.stdout:8/441: readlink d3/da/d1e/l60 0 2024-09-13T02:50:51.775 INFO:tasks.workunit.client.1.smithi122.stdout:8/442: stat d3/l32 0 2024-09-13T02:50:51.775 INFO:tasks.workunit.client.1.smithi122.stdout:8/443: creat d3/d31/d52/d59/d3e/d5c/f83 x:0 0 0 2024-09-13T02:50:51.776 INFO:tasks.workunit.client.1.smithi122.stdout:6/668: dread d5/d11/d2f/f4d [0,4194304] 0 2024-09-13T02:50:51.776 INFO:tasks.workunit.client.1.smithi122.stdout:6/669: chown d5/d3d/d6c/d41/d4e 971373 1 2024-09-13T02:50:51.776 INFO:tasks.workunit.client.1.smithi122.stdout:6/670: chown d5 0 1 2024-09-13T02:50:51.776 INFO:tasks.workunit.client.1.smithi122.stdout:6/671: chown d5/db/d29/d60/dac/dc6 443489 1 2024-09-13T02:50:51.776 INFO:tasks.workunit.client.1.smithi122.stdout:6/672: write d5/d40/f67 [4511252,109755] 0 2024-09-13T02:50:51.777 INFO:tasks.workunit.client.1.smithi122.stdout:4/631: write d11/d13/d82/fbe [3528122,95023] 0 2024-09-13T02:50:51.777 INFO:tasks.workunit.client.1.smithi122.stdout:8/444: symlink d3/d53/d4d/l84 0 2024-09-13T02:50:51.777 INFO:tasks.workunit.client.1.smithi122.stdout:8/445: truncate d3/d53/d21/f69 916138 0 2024-09-13T02:50:51.778 INFO:tasks.workunit.client.1.smithi122.stdout:6/673: symlink d5/d3d/d6c/db5/ld0 0 2024-09-13T02:50:51.780 INFO:tasks.workunit.client.1.smithi122.stdout:2/503: sync 2024-09-13T02:50:51.780 INFO:tasks.workunit.client.1.smithi122.stdout:2/504: creat d0/d1c/d3b/d41/d4e/d75/d95/fa1 x:0 0 0 2024-09-13T02:50:51.780 INFO:tasks.workunit.client.1.smithi122.stdout:2/505: fdatasync d0/d5d/f91 0 2024-09-13T02:50:51.780 INFO:tasks.workunit.client.1.smithi122.stdout:2/506: stat d0/d55/d70/d59/f88 0 2024-09-13T02:50:51.781 INFO:tasks.workunit.client.1.smithi122.stdout:4/632: mknod d11/d62/cc0 0 2024-09-13T02:50:51.781 INFO:tasks.workunit.client.1.smithi122.stdout:4/633: chown d11/d1b 2496 1 2024-09-13T02:50:51.781 INFO:tasks.workunit.client.1.smithi122.stdout:4/634: getdents d11/d13/d82/d2a/d78/d8e/dbd 0 2024-09-13T02:50:51.783 INFO:tasks.workunit.client.1.smithi122.stdout:4/635: rename d11/d3d/l74 to d11/d13/d82/d2a/d78/d8e/dbd/lc1 0 2024-09-13T02:50:51.785 INFO:tasks.workunit.client.1.smithi122.stdout:4/636: creat d11/d1b/d2e/fc2 x:0 0 0 2024-09-13T02:50:51.785 INFO:tasks.workunit.client.1.smithi122.stdout:4/637: chown d11/d1b/d32/la0 53909 1 2024-09-13T02:50:51.786 INFO:tasks.workunit.client.1.smithi122.stdout:4/638: symlink d11/d62/lc3 0 2024-09-13T02:50:51.787 INFO:tasks.workunit.client.1.smithi122.stdout:4/639: mkdir d11/d1b/d32/dc4 0 2024-09-13T02:50:51.787 INFO:tasks.workunit.client.1.smithi122.stdout:4/640: stat d11/d1b/d32/f46 0 2024-09-13T02:50:51.788 INFO:tasks.workunit.client.1.smithi122.stdout:4/641: write d11/d30/d59/d8f/da2/fb3 [235638,33632] 0 2024-09-13T02:50:51.789 INFO:tasks.workunit.client.1.smithi122.stdout:4/642: symlink d11/d1b/d32/d87/lc5 0 2024-09-13T02:50:51.796 INFO:tasks.workunit.client.1.smithi122.stdout:2/507: write d0/d1c/d3b/d41/f3f [2089398,112657] 0 2024-09-13T02:50:51.800 INFO:tasks.workunit.client.1.smithi122.stdout:7/550: dwrite d4/f83 [0,4194304] 0 2024-09-13T02:50:51.802 INFO:tasks.workunit.client.1.smithi122.stdout:0/537: dwrite d1/d4b/d56/d60/faa [0,4194304] 0 2024-09-13T02:50:51.804 INFO:tasks.workunit.client.1.smithi122.stdout:0/538: mknod d1/d4b/cb0 0 2024-09-13T02:50:51.805 INFO:tasks.workunit.client.1.smithi122.stdout:5/525: dwrite d0/da/d48/f49 [0,4194304] 0 2024-09-13T02:50:51.807 INFO:tasks.workunit.client.1.smithi122.stdout:5/526: symlink d0/da/la6 0 2024-09-13T02:50:51.809 INFO:tasks.workunit.client.1.smithi122.stdout:5/527: symlink d0/da/d90/la7 0 2024-09-13T02:50:51.809 INFO:tasks.workunit.client.1.smithi122.stdout:5/528: symlink d0/da/d90/la8 0 2024-09-13T02:50:51.810 INFO:tasks.workunit.client.1.smithi122.stdout:5/529: rmdir d0/d17/d36/d99 39 2024-09-13T02:50:51.816 INFO:tasks.workunit.client.1.smithi122.stdout:7/551: dread d4/d8/d3d/f97 [0,4194304] 0 2024-09-13T02:50:51.816 INFO:tasks.workunit.client.1.smithi122.stdout:7/552: creat d4/d4e/d5d/fb3 x:0 0 0 2024-09-13T02:50:51.816 INFO:tasks.workunit.client.1.smithi122.stdout:7/553: write d4/d77/fa2 [347252,68051] 0 2024-09-13T02:50:51.818 INFO:tasks.workunit.client.1.smithi122.stdout:9/561: dwrite d8/d16/d3d/d59/d29/f76 [0,4194304] 0 2024-09-13T02:50:51.834 INFO:tasks.workunit.client.1.smithi122.stdout:6/674: dwrite d5/d11/d45/f78 [0,4194304] 0 2024-09-13T02:50:51.835 INFO:tasks.workunit.client.1.smithi122.stdout:6/675: chown d5/db/lbb 44110330 1 2024-09-13T02:50:51.835 INFO:tasks.workunit.client.1.smithi122.stdout:6/676: fsync d5/d11/d2f/f74 0 2024-09-13T02:50:51.843 INFO:tasks.workunit.client.1.smithi122.stdout:1/543: dwrite dc/de/d13/d46/f77 [0,4194304] 0 2024-09-13T02:50:51.843 INFO:tasks.workunit.client.1.smithi122.stdout:1/544: creat dc/de/d18/d1d/d2f/fb5 x:0 0 0 2024-09-13T02:50:51.844 INFO:tasks.workunit.client.1.smithi122.stdout:1/545: write dc/d38/f6a [1096343,29273] 0 2024-09-13T02:50:51.844 INFO:tasks.workunit.client.1.smithi122.stdout:0/539: dwrite d1/d5/d2d/d80/f87 [0,4194304] 0 2024-09-13T02:50:51.844 INFO:tasks.workunit.client.1.smithi122.stdout:5/530: dwrite d0/da/d48/f49 [0,4194304] 0 2024-09-13T02:50:51.844 INFO:tasks.workunit.client.1.smithi122.stdout:4/643: dwrite d11/f47 [0,4194304] 0 2024-09-13T02:50:51.844 INFO:tasks.workunit.client.1.smithi122.stdout:9/562: dwrite d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:51.847 INFO:tasks.workunit.client.1.smithi122.stdout:1/546: creat dc/de/d6e/fb6 x:0 0 0 2024-09-13T02:50:51.850 INFO:tasks.workunit.client.1.smithi122.stdout:6/677: dread d5/d11/d45/f81 [4194304,4194304] 0 2024-09-13T02:50:51.850 INFO:tasks.workunit.client.1.smithi122.stdout:8/446: dwrite d3/d31/d65/f54 [0,4194304] 0 2024-09-13T02:50:51.851 INFO:tasks.workunit.client.1.smithi122.stdout:4/644: unlink d11/d62/cc0 0 2024-09-13T02:50:51.853 INFO:tasks.workunit.client.1.smithi122.stdout:5/531: creat d0/d17/d36/d25/fa9 x:0 0 0 2024-09-13T02:50:51.855 INFO:tasks.workunit.client.1.smithi122.stdout:9/563: symlink d8/d16/d45/lab 0 2024-09-13T02:50:51.856 INFO:tasks.workunit.client.1.smithi122.stdout:4/645: dread d11/d13/d82/f48 [0,4194304] 0 2024-09-13T02:50:51.856 INFO:tasks.workunit.client.1.smithi122.stdout:1/547: mkdir dc/de/d13/d46/db7 0 2024-09-13T02:50:51.858 INFO:tasks.workunit.client.1.smithi122.stdout:8/447: creat d3/d31/f85 x:0 0 0 2024-09-13T02:50:51.859 INFO:tasks.workunit.client.1.smithi122.stdout:0/540: dread d1/d5/d2d/f4e [0,4194304] 0 2024-09-13T02:50:51.859 INFO:tasks.workunit.client.1.smithi122.stdout:0/541: stat d1 0 2024-09-13T02:50:51.859 INFO:tasks.workunit.client.1.smithi122.stdout:0/542: chown d1/d4b/d56/d81/l96 3307 1 2024-09-13T02:50:51.859 INFO:tasks.workunit.client.1.smithi122.stdout:0/543: creat d1/d4b/d56/d60/fb1 x:0 0 0 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:0/544: dread - d1/d4b/f7c zero size 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:0/545: write d1/d5/d10/d29/f88 [186405,129605] 0 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:0/546: chown d1/d5/d10/d29/f8d 2 1 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/532: rename d0/da/d48/f49 to d0/d17/d3a/faa 0 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/533: readlink d0/d2/d33/l44 0 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/534: fdatasync d0/da/d48/f45 0 2024-09-13T02:50:51.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/535: read d0/f92 [1748508,103] 0 2024-09-13T02:50:51.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/564: mkdir d8/d16/d3d/d59/d23/d1f/dac 0 2024-09-13T02:50:51.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/565: write d8/d16/f62 [3007269,89406] 0 2024-09-13T02:50:51.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/566: dread - d8/d16/d3d/d59/d23/d7b/d82/fa6 zero size 2024-09-13T02:50:51.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/567: chown d8/d16/d3d/d59/d29/f38 3456 1 2024-09-13T02:50:51.862 INFO:tasks.workunit.client.1.smithi122.stdout:9/568: rename d8/d16 to d8/d16/d3d/d59/d23/d7b/d82/da3/dad 22 2024-09-13T02:50:51.865 INFO:tasks.workunit.client.1.smithi122.stdout:9/569: mknod d8/d16/d3d/d59/d23/d1f/d36/cae 0 2024-09-13T02:50:51.865 INFO:tasks.workunit.client.1.smithi122.stdout:9/570: write d8/d16/d3d/d59/d23/d1f/d36/fa8 [532195,85961] 0 2024-09-13T02:50:51.867 INFO:tasks.workunit.client.1.smithi122.stdout:9/571: link d8/d16/d3d/d59/d23/d1f/d36/fa8 d8/d88/d65/faf 0 2024-09-13T02:50:51.868 INFO:tasks.workunit.client.1.smithi122.stdout:9/572: rename d8/d16/d3d/d59/d23/d7b to d8/d16/d3d/d59/d23/d7b/d82/da3/da7/db0 22 2024-09-13T02:50:51.874 INFO:tasks.workunit.client.1.smithi122.stdout:8/448: dread d3/d31/d52/d59/d3e/d5c/f6c [4194304,4194304] 0 2024-09-13T02:50:51.875 INFO:tasks.workunit.client.1.smithi122.stdout:0/547: dread d1/d5/d9/da/d17/f79 [0,4194304] 0 2024-09-13T02:50:51.875 INFO:tasks.workunit.client.1.smithi122.stdout:8/449: creat d3/d31/d52/d59/d3e/d5c/f86 x:0 0 0 2024-09-13T02:50:51.875 INFO:tasks.workunit.client.1.smithi122.stdout:8/450: dread - d3/d53/d34/f38 zero size 2024-09-13T02:50:51.886 INFO:tasks.workunit.client.1.smithi122.stdout:6/678: dwrite d5/fe [4194304,4194304] 0 2024-09-13T02:50:51.886 INFO:tasks.workunit.client.1.smithi122.stdout:6/679: truncate d5/d11/d45/d21/f87 170107 0 2024-09-13T02:50:51.890 INFO:tasks.workunit.client.1.smithi122.stdout:5/536: dwrite d0/d17/d36/f9e [0,4194304] 0 2024-09-13T02:50:51.892 INFO:tasks.workunit.client.1.smithi122.stdout:5/537: link d0/d17/d3a/c3b d0/da/d8c/cab 0 2024-09-13T02:50:51.892 INFO:tasks.workunit.client.1.smithi122.stdout:5/538: fsync d0/d2/f6d 0 2024-09-13T02:50:51.893 INFO:tasks.workunit.client.1.smithi122.stdout:4/646: dwrite d11/d1b/d2e/d55/f67 [0,4194304] 0 2024-09-13T02:50:51.893 INFO:tasks.workunit.client.1.smithi122.stdout:8/451: write d3/da/d1f/f37 [2354570,30941] 0 2024-09-13T02:50:51.894 INFO:tasks.workunit.client.1.smithi122.stdout:5/539: creat d0/da/d48/d63/d98/fac x:0 0 0 2024-09-13T02:50:51.894 INFO:tasks.workunit.client.1.smithi122.stdout:5/540: creat d0/da/d48/d63/d98/fad x:0 0 0 2024-09-13T02:50:51.894 INFO:tasks.workunit.client.1.smithi122.stdout:5/541: truncate d0/da/d48/f45 5972860 0 2024-09-13T02:50:51.894 INFO:tasks.workunit.client.1.smithi122.stdout:1/548: dwrite dc/d38/f6a [0,4194304] 0 2024-09-13T02:50:51.895 INFO:tasks.workunit.client.1.smithi122.stdout:1/549: write dc/de/f8e [676409,73184] 0 2024-09-13T02:50:51.895 INFO:tasks.workunit.client.1.smithi122.stdout:0/548: dwrite d1/d5/d10/d29/f36 [0,4194304] 0 2024-09-13T02:50:51.895 INFO:tasks.workunit.client.1.smithi122.stdout:0/549: chown d1/d5/d9/f25 0 1 2024-09-13T02:50:51.896 INFO:tasks.workunit.client.1.smithi122.stdout:4/647: symlink d11/d13/d82/d2a/d40/lc6 0 2024-09-13T02:50:51.897 INFO:tasks.workunit.client.1.smithi122.stdout:8/452: creat d3/d31/d52/f87 x:0 0 0 2024-09-13T02:50:51.900 INFO:tasks.workunit.client.1.smithi122.stdout:5/542: creat d0/d17/d36/d3f/fae x:0 0 0 2024-09-13T02:50:51.901 INFO:tasks.workunit.client.1.smithi122.stdout:5/543: readlink d0/d17/d36/d25/la2 0 2024-09-13T02:50:51.902 INFO:tasks.workunit.client.1.smithi122.stdout:1/550: mknod dc/de/d18/d22/d1c/d57/cb8 0 2024-09-13T02:50:51.903 INFO:tasks.workunit.client.1.smithi122.stdout:8/453: symlink d3/da/d1e/l88 0 2024-09-13T02:50:51.903 INFO:tasks.workunit.client.1.smithi122.stdout:8/454: read d3/da/d1f/f37 [2764678,75767] 0 2024-09-13T02:50:51.903 INFO:tasks.workunit.client.1.smithi122.stdout:8/455: read d3/d31/d52/d59/f39 [3562979,24931] 0 2024-09-13T02:50:51.905 INFO:tasks.workunit.client.1.smithi122.stdout:4/648: write d11/d3d/f5b [810276,37089] 0 2024-09-13T02:50:51.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/544: write d0/d1d/f1f [3364880,90053] 0 2024-09-13T02:50:51.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/545: read - d0/da/d48/d63/f81 zero size 2024-09-13T02:50:51.910 INFO:tasks.workunit.client.1.smithi122.stdout:8/456: dread f2 [4194304,4194304] 0 2024-09-13T02:50:51.911 INFO:tasks.workunit.client.1.smithi122.stdout:0/550: dwrite d1/d5/d9/da/d92/d94/f1f [0,4194304] 0 2024-09-13T02:50:51.911 INFO:tasks.workunit.client.1.smithi122.stdout:4/649: link d11/d1b/d32/d87/lc5 d11/d13/d82/d2a/d83/lc7 0 2024-09-13T02:50:51.911 INFO:tasks.workunit.client.1.smithi122.stdout:4/650: dread - d11/d30/d59/d6e/fb7 zero size 2024-09-13T02:50:51.914 INFO:tasks.workunit.client.1.smithi122.stdout:5/546: mkdir d0/d17/d36/d8b/daf 0 2024-09-13T02:50:51.915 INFO:tasks.workunit.client.1.smithi122.stdout:8/457: unlink d3/da/d1f/f1a 0 2024-09-13T02:50:51.917 INFO:tasks.workunit.client.1.smithi122.stdout:5/547: truncate d0/d17/d36/d25/d2b/f71 81312 0 2024-09-13T02:50:51.917 INFO:tasks.workunit.client.1.smithi122.stdout:8/458: mkdir d3/d31/d52/d89 0 2024-09-13T02:50:51.919 INFO:tasks.workunit.client.1.smithi122.stdout:0/551: getdents d1/d5/d9/da 0 2024-09-13T02:50:51.919 INFO:tasks.workunit.client.1.smithi122.stdout:0/552: fdatasync d1/d5/d10/d29/f36 0 2024-09-13T02:50:51.921 INFO:tasks.workunit.client.1.smithi122.stdout:1/551: rmdir dc/de/d18/d22/d1c/d57 39 2024-09-13T02:50:51.921 INFO:tasks.workunit.client.1.smithi122.stdout:0/553: stat d1/d5/d9/da/d17/c24 0 2024-09-13T02:50:51.923 INFO:tasks.workunit.client.1.smithi122.stdout:1/552: link dc/de/d13/d46/f81 dc/d38/fb9 0 2024-09-13T02:50:51.923 INFO:tasks.workunit.client.1.smithi122.stdout:1/553: creat dc/de/d18/d22/d1c/fba x:0 0 0 2024-09-13T02:50:51.928 INFO:tasks.workunit.client.1.smithi122.stdout:8/459: dread d3/d31/d65/f54 [0,4194304] 0 2024-09-13T02:50:51.930 INFO:tasks.workunit.client.1.smithi122.stdout:8/460: link d3/d31/d52/d59/l67 d3/d53/d34/l8a 0 2024-09-13T02:50:51.931 INFO:tasks.workunit.client.1.smithi122.stdout:8/461: truncate d3/da/d1f/f27 104771 0 2024-09-13T02:50:51.932 INFO:tasks.workunit.client.1.smithi122.stdout:4/651: dwrite d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:51.937 INFO:tasks.workunit.client.1.smithi122.stdout:1/554: dread dc/d38/db1/d7d/f83 [0,4194304] 0 2024-09-13T02:50:51.937 INFO:tasks.workunit.client.1.smithi122.stdout:4/652: mkdir d11/d30/d59/d8f/da2/dc8 0 2024-09-13T02:50:51.939 INFO:tasks.workunit.client.1.smithi122.stdout:8/462: rename d3/d31/d52/d59/d3e to d3/d31/d52/d89/d8b 0 2024-09-13T02:50:51.939 INFO:tasks.workunit.client.1.smithi122.stdout:0/554: dwrite d1/d5/d10/d29/d32/d5f/f50 [0,4194304] 0 2024-09-13T02:50:51.940 INFO:tasks.workunit.client.1.smithi122.stdout:4/653: unlink d11/d62/c9e 0 2024-09-13T02:50:51.941 INFO:tasks.workunit.client.1.smithi122.stdout:8/463: truncate d3/d53/d34/f55 4088186 0 2024-09-13T02:50:51.942 INFO:tasks.workunit.client.1.smithi122.stdout:0/555: symlink d1/d5/d9/da/d7d/d95/lb2 0 2024-09-13T02:50:51.944 INFO:tasks.workunit.client.1.smithi122.stdout:8/464: link d3/da/f10 d3/d31/d52/d89/d8b/d5c/f8c 0 2024-09-13T02:50:51.945 INFO:tasks.workunit.client.1.smithi122.stdout:4/654: dread d11/d3d/fb2 [0,4194304] 0 2024-09-13T02:50:51.945 INFO:tasks.workunit.client.1.smithi122.stdout:4/655: write d11/d62/f89 [851861,67133] 0 2024-09-13T02:50:51.945 INFO:tasks.workunit.client.1.smithi122.stdout:4/656: stat d11/d30 0 2024-09-13T02:50:51.946 INFO:tasks.workunit.client.1.smithi122.stdout:0/556: mkdir d1/d5/d10/d29/d32/d83/db3 0 2024-09-13T02:50:51.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/465: getdents d3/d53 0 2024-09-13T02:50:51.950 INFO:tasks.workunit.client.1.smithi122.stdout:8/466: stat d3/d53/d21/c4f 0 2024-09-13T02:50:51.958 INFO:tasks.workunit.client.1.smithi122.stdout:1/555: dwrite dc/d38/db1/f8c [0,4194304] 0 2024-09-13T02:50:51.958 INFO:tasks.workunit.client.1.smithi122.stdout:1/556: chown dc/de/d18/d22/d1c/d57/ca5 439 1 2024-09-13T02:50:51.969 INFO:tasks.workunit.client.1.smithi122.stdout:1/557: write dc/de/f27 [1424248,20939] 0 2024-09-13T02:50:51.970 INFO:tasks.workunit.client.1.smithi122.stdout:1/558: creat dc/de/d18/d22/d1c/d47/fbb x:0 0 0 2024-09-13T02:50:51.970 INFO:tasks.workunit.client.1.smithi122.stdout:1/559: dread - dc/f9e zero size 2024-09-13T02:50:51.971 INFO:tasks.workunit.client.1.smithi122.stdout:1/560: rename dc/de/d18/d1d/f91 to dc/de/d18/d1d/d2f/d94/fbc 0 2024-09-13T02:50:51.971 INFO:tasks.workunit.client.1.smithi122.stdout:1/561: truncate dc/f9c 591260 0 2024-09-13T02:50:51.972 INFO:tasks.workunit.client.1.smithi122.stdout:1/562: mknod dc/de/d6e/cbd 0 2024-09-13T02:50:51.973 INFO:tasks.workunit.client.1.smithi122.stdout:1/563: rename dc/de/d13/d46/l4f to dc/de/d13/d46/lbe 0 2024-09-13T02:50:51.973 INFO:tasks.workunit.client.1.smithi122.stdout:1/564: chown dc/de/d18/f66 0 1 2024-09-13T02:50:51.973 INFO:tasks.workunit.client.1.smithi122.stdout:1/565: chown dc/de 7 1 2024-09-13T02:50:51.981 INFO:tasks.workunit.client.1.smithi122.stdout:4/657: dwrite d11/d13/d82/d2a/d83/f95 [0,4194304] 0 2024-09-13T02:50:51.981 INFO:tasks.workunit.client.1.smithi122.stdout:4/658: chown d11/d13/d82/f48 453702 1 2024-09-13T02:50:51.981 INFO:tasks.workunit.client.1.smithi122.stdout:4/659: getdents d11/d30/d59/d8f/da2/dc8 0 2024-09-13T02:50:51.982 INFO:tasks.workunit.client.1.smithi122.stdout:0/557: dwrite d1/d5/d10/d29/d32/d5f/f48 [0,4194304] 0 2024-09-13T02:50:51.982 INFO:tasks.workunit.client.1.smithi122.stdout:8/467: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-09-13T02:50:51.983 INFO:tasks.workunit.client.1.smithi122.stdout:8/468: fsync d3/d31/f61 0 2024-09-13T02:50:51.983 INFO:tasks.workunit.client.1.smithi122.stdout:4/660: mkdir d11/d13/dc9 0 2024-09-13T02:50:51.984 INFO:tasks.workunit.client.1.smithi122.stdout:8/469: rename d3/da/c2d to d3/da/c8d 0 2024-09-13T02:50:51.984 INFO:tasks.workunit.client.1.smithi122.stdout:8/470: truncate d3/d31/f3b 8895967 0 2024-09-13T02:50:51.984 INFO:tasks.workunit.client.1.smithi122.stdout:8/471: read - d3/d31/d52/d89/d8b/d5c/f86 zero size 2024-09-13T02:50:51.985 INFO:tasks.workunit.client.1.smithi122.stdout:8/472: unlink d3/d31/d52/d89/d8b/d5c/f6c 0 2024-09-13T02:50:51.986 INFO:tasks.workunit.client.1.smithi122.stdout:1/566: read dc/de/f2e [3948271,128018] 0 2024-09-13T02:50:51.987 INFO:tasks.workunit.client.1.smithi122.stdout:8/473: getdents d3/d31/d52/d89 0 2024-09-13T02:50:51.987 INFO:tasks.workunit.client.1.smithi122.stdout:8/474: truncate d3/d31/f61 1458232 0 2024-09-13T02:50:51.988 INFO:tasks.workunit.client.1.smithi122.stdout:1/567: dread dc/de/f8e [0,4194304] 0 2024-09-13T02:50:51.996 INFO:tasks.workunit.client.1.smithi122.stdout:0/558: write d1/d4b/d56/d60/f55 [4193167,54127] 0 2024-09-13T02:50:51.996 INFO:tasks.workunit.client.1.smithi122.stdout:8/475: dread d3/d53/f41 [4194304,4194304] 0 2024-09-13T02:50:52.020 INFO:tasks.workunit.client.1.smithi122.stdout:4/661: dwrite d11/d13/d82/f7e [0,4194304] 0 2024-09-13T02:50:52.020 INFO:tasks.workunit.client.1.smithi122.stdout:0/559: dwrite d1/d4b/d56/d81/fae [0,4194304] 0 2024-09-13T02:50:52.022 INFO:tasks.workunit.client.1.smithi122.stdout:8/476: dwrite d3/d31/f3b [0,4194304] 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/477: readlink d3/d31/d52/d59/l67 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/478: write d3/d31/d52/d59/f39 [5661365,103565] 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/479: dread - d3/d31/d52/f87 zero size 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/480: creat d3/da/f8e x:0 0 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/481: truncate d3/d31/f61 2364564 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/482: dread - d3/d53/d4d/d6d/d76/f7b zero size 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:8/483: fdatasync f2 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:1/568: dwrite dc/de/f2e [0,4194304] 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:1/569: readlink dc/de/d18/d1d/d2f/d94/d98/lae 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:4/662: dread d11/d13/d82/f48 [0,4194304] 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:4/663: chown d11/d13/c3a 889 1 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:4/664: write d11/f69 [3023535,99828] 0 2024-09-13T02:50:52.023 INFO:tasks.workunit.client.1.smithi122.stdout:0/560: mkdir d1/d5/d2d/db4 0 2024-09-13T02:50:52.024 INFO:tasks.workunit.client.1.smithi122.stdout:1/570: symlink dc/de/d13/d46/db7/lbf 0 2024-09-13T02:50:52.024 INFO:tasks.workunit.client.1.smithi122.stdout:1/571: fdatasync dc/de/d13/f9a 0 2024-09-13T02:50:52.025 INFO:tasks.workunit.client.1.smithi122.stdout:0/561: unlink d1/d5/d9/da/d17/d69/l99 0 2024-09-13T02:50:52.026 INFO:tasks.workunit.client.1.smithi122.stdout:1/572: read dc/de/f8e [246988,91525] 0 2024-09-13T02:50:52.026 INFO:tasks.workunit.client.1.smithi122.stdout:1/573: write dc/de/d18/f28 [1825054,87204] 0 2024-09-13T02:50:52.027 INFO:tasks.workunit.client.1.smithi122.stdout:1/574: getdents dc/de/d13/d3f 0 2024-09-13T02:50:52.028 INFO:tasks.workunit.client.1.smithi122.stdout:1/575: symlink dc/d38/d51/lc0 0 2024-09-13T02:50:52.029 INFO:tasks.workunit.client.1.smithi122.stdout:1/576: mkdir dc/de/d13/d3f/dc1 0 2024-09-13T02:50:52.032 INFO:tasks.workunit.client.1.smithi122.stdout:1/577: rmdir dc/de/d18/d22/d1c 39 2024-09-13T02:50:52.033 INFO:tasks.workunit.client.1.smithi122.stdout:1/578: readlink dc/de/d18/d1d/l2d 0 2024-09-13T02:50:52.035 INFO:tasks.workunit.client.1.smithi122.stdout:8/484: dread d3/da/d1f/f29 [0,4194304] 0 2024-09-13T02:50:52.035 INFO:tasks.workunit.client.1.smithi122.stdout:8/485: fsync d3/da/d1f/f27 0 2024-09-13T02:50:52.035 INFO:tasks.workunit.client.1.smithi122.stdout:8/486: write d3/d31/d52/f5b [1719171,101842] 0 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/487: chown d3/l18 55320 1 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/488: chown d3/d31/d65/f54 382 1 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/489: read d3/d53/d21/f33 [621516,114213] 0 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/490: creat d3/da/d1e/f8f x:0 0 0 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/491: truncate d3/da/f30 1194962 0 2024-09-13T02:50:52.036 INFO:tasks.workunit.client.1.smithi122.stdout:8/492: write d3/da/d1e/f8f [856641,72034] 0 2024-09-13T02:50:52.039 INFO:tasks.workunit.client.1.smithi122.stdout:0/562: write d1/d4b/d56/d81/fae [851663,47414] 0 2024-09-13T02:50:52.039 INFO:tasks.workunit.client.1.smithi122.stdout:0/563: stat d1/d5/d10/d29/d32/d5f 0 2024-09-13T02:50:52.039 INFO:tasks.workunit.client.1.smithi122.stdout:0/564: creat d1/d5/d10/d29/fb5 x:0 0 0 2024-09-13T02:50:52.055 INFO:tasks.workunit.client.1.smithi122.stdout:0/565: write d1/d5/d10/d29/f8d [1415883,81302] 0 2024-09-13T02:50:52.055 INFO:tasks.workunit.client.1.smithi122.stdout:0/566: chown d1/d5/d10/d29/f40 16 1 2024-09-13T02:50:52.055 INFO:tasks.workunit.client.1.smithi122.stdout:0/567: chown d1/d5/d10/d29/d32/f6f 0 1 2024-09-13T02:50:52.055 INFO:tasks.workunit.client.1.smithi122.stdout:0/568: creat d1/d5/d9/da/d7d/fb6 x:0 0 0 2024-09-13T02:50:52.057 INFO:tasks.workunit.client.1.smithi122.stdout:4/665: dwrite d11/d13/f66 [0,4194304] 0 2024-09-13T02:50:52.060 INFO:tasks.workunit.client.1.smithi122.stdout:4/666: creat d11/d13/d82/d2a/d78/db6/fca x:0 0 0 2024-09-13T02:50:52.060 INFO:tasks.workunit.client.1.smithi122.stdout:4/667: dread - d11/fad zero size 2024-09-13T02:50:52.060 INFO:tasks.workunit.client.1.smithi122.stdout:4/668: chown f10 29 1 2024-09-13T02:50:52.063 INFO:tasks.workunit.client.1.smithi122.stdout:4/669: dread d11/d30/d59/d8f/da2/fb3 [0,4194304] 0 2024-09-13T02:50:52.064 INFO:tasks.workunit.client.1.smithi122.stdout:8/493: dwrite d3/da/f30 [0,4194304] 0 2024-09-13T02:50:52.064 INFO:tasks.workunit.client.1.smithi122.stdout:8/494: readlink d3/d53/d34/l8a 0 2024-09-13T02:50:52.065 INFO:tasks.workunit.client.1.smithi122.stdout:1/579: dwrite dc/de/d13/f5e [4194304,4194304] 0 2024-09-13T02:50:52.065 INFO:tasks.workunit.client.1.smithi122.stdout:1/580: stat dc/de/d13/d46/f81 0 2024-09-13T02:50:52.066 INFO:tasks.workunit.client.1.smithi122.stdout:8/495: rename d3/da/f30 to d3/d53/d21/f90 0 2024-09-13T02:50:52.073 INFO:tasks.workunit.client.1.smithi122.stdout:1/581: mknod dc/de/d18/d22/d76/cc2 0 2024-09-13T02:50:52.076 INFO:tasks.workunit.client.1.smithi122.stdout:0/569: dwrite d1/d5/d10/d29/d32/d83/f97 [0,4194304] 0 2024-09-13T02:50:52.077 INFO:tasks.workunit.client.1.smithi122.stdout:0/570: truncate d1/f38 21702 0 2024-09-13T02:50:52.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/496: dread f2 [0,4194304] 0 2024-09-13T02:50:52.079 INFO:tasks.workunit.client.1.smithi122.stdout:0/571: mknod d1/d5/d9/da/d7d/d95/cb7 0 2024-09-13T02:50:52.079 INFO:tasks.workunit.client.1.smithi122.stdout:0/572: chown d1/d5/d10/d29/d32/d5f/l7f 53 1 2024-09-13T02:50:52.079 INFO:tasks.workunit.client.1.smithi122.stdout:0/573: write d1/d5/d10/d29/f88 [546575,39432] 0 2024-09-13T02:50:52.081 INFO:tasks.workunit.client.1.smithi122.stdout:4/670: dwrite d11/d1b/d2e/d55/f67 [0,4194304] 0 2024-09-13T02:50:52.081 INFO:tasks.workunit.client.1.smithi122.stdout:4/671: dread - d11/d1b/d2e/fc2 zero size 2024-09-13T02:50:52.083 INFO:tasks.workunit.client.1.smithi122.stdout:8/497: mkdir d3/da/d91 0 2024-09-13T02:50:52.083 INFO:tasks.workunit.client.1.smithi122.stdout:0/574: mknod d1/d5/d9/da/cb8 0 2024-09-13T02:50:52.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/498: mkdir d3/d53/d21/d92 0 2024-09-13T02:50:52.086 INFO:tasks.workunit.client.1.smithi122.stdout:1/582: read dc/de/d18/d1d/f52 [1597299,5852] 0 2024-09-13T02:50:52.086 INFO:tasks.workunit.client.1.smithi122.stdout:1/583: chown dc/d38/db1/d7d/f88 1106 1 2024-09-13T02:50:52.086 INFO:tasks.workunit.client.1.smithi122.stdout:8/499: mknod d3/da/d7d/c93 0 2024-09-13T02:50:52.086 INFO:tasks.workunit.client.1.smithi122.stdout:8/500: chown d3/da/d1f/f37 1851463003 1 2024-09-13T02:50:52.087 INFO:tasks.workunit.client.1.smithi122.stdout:8/501: readlink d3/d53/d34/l8a 0 2024-09-13T02:50:52.087 INFO:tasks.workunit.client.1.smithi122.stdout:0/575: getdents d1/d5/d10/d29/d32 0 2024-09-13T02:50:52.087 INFO:tasks.workunit.client.1.smithi122.stdout:0/576: truncate d1/d5/d9/da/f75 4335398 0 2024-09-13T02:50:52.089 INFO:tasks.workunit.client.1.smithi122.stdout:0/577: rename d1/d5/d9/da/d17/f22 to d1/d5/d9/da/d17/d69/d85/fb9 0 2024-09-13T02:50:52.093 INFO:tasks.workunit.client.1.smithi122.stdout:0/578: rename d1/d5/d2d/d80 to d1/d4b/d56/dba 0 2024-09-13T02:50:52.097 INFO:tasks.workunit.client.1.smithi122.stdout:1/584: dread dc/d38/f6a [0,4194304] 0 2024-09-13T02:50:52.099 INFO:tasks.workunit.client.1.smithi122.stdout:8/502: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:52.102 INFO:tasks.workunit.client.1.smithi122.stdout:8/503: mkdir d3/d53/d34/d94 0 2024-09-13T02:50:52.102 INFO:tasks.workunit.client.1.smithi122.stdout:0/579: dread d1/d5/d2d/f44 [0,4194304] 0 2024-09-13T02:50:52.102 INFO:tasks.workunit.client.1.smithi122.stdout:4/672: dwrite d11/f43 [0,4194304] 0 2024-09-13T02:50:52.102 INFO:tasks.workunit.client.1.smithi122.stdout:0/580: write d1/d5/d10/d29/f40 [1653337,43174] 0 2024-09-13T02:50:52.102 INFO:tasks.workunit.client.1.smithi122.stdout:0/581: fsync d1/d5/d9/da/d92/d94/f31 0 2024-09-13T02:50:52.116 INFO:tasks.workunit.client.1.smithi122.stdout:0/582: write d1/d5/d10/d29/f36 [2824100,73458] 0 2024-09-13T02:50:52.117 INFO:tasks.workunit.client.1.smithi122.stdout:0/583: readlink d1/d5/d2d/l78 0 2024-09-13T02:50:52.139 INFO:tasks.workunit.client.1.smithi122.stdout:8/504: dwrite d3/d53/d21/f69 [0,4194304] 0 2024-09-13T02:50:52.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/505: dread - d3/d31/d52/d89/d8b/d5c/f83 zero size 2024-09-13T02:50:52.142 INFO:tasks.workunit.client.1.smithi122.stdout:8/506: symlink d3/d53/d34/d94/l95 0 2024-09-13T02:50:52.143 INFO:tasks.workunit.client.1.smithi122.stdout:1/585: dwrite dc/de/d13/f9a [0,4194304] 0 2024-09-13T02:50:52.148 INFO:tasks.workunit.client.1.smithi122.stdout:0/584: dwrite d1/d4b/d56/d60/fb1 [0,4194304] 0 2024-09-13T02:50:52.152 INFO:tasks.workunit.client.1.smithi122.stdout:1/586: truncate dc/d38/db1/f78 3568499 0 2024-09-13T02:50:52.152 INFO:tasks.workunit.client.1.smithi122.stdout:1/587: creat dc/de/d6e/fc3 x:0 0 0 2024-09-13T02:50:52.156 INFO:tasks.workunit.client.1.smithi122.stdout:0/585: mkdir d1/d5/d9/da/d92/dbb 0 2024-09-13T02:50:52.159 INFO:tasks.workunit.client.1.smithi122.stdout:1/588: rename dc/de/c25 to dc/de/d18/d22/d80/cc4 0 2024-09-13T02:50:52.161 INFO:tasks.workunit.client.1.smithi122.stdout:0/586: creat d1/d5/d9/da/d17/fbc x:0 0 0 2024-09-13T02:50:52.162 INFO:tasks.workunit.client.1.smithi122.stdout:0/587: truncate f0 4163401 0 2024-09-13T02:50:52.162 INFO:tasks.workunit.client.1.smithi122.stdout:0/588: dread - d1/d5/d9/f6e zero size 2024-09-13T02:50:52.164 INFO:tasks.workunit.client.1.smithi122.stdout:0/589: mknod d1/d4b/d56/da1/cbd 0 2024-09-13T02:50:52.168 INFO:tasks.workunit.client.1.smithi122.stdout:0/590: symlink d1/d5/d2d/lbe 0 2024-09-13T02:50:52.168 INFO:tasks.workunit.client.1.smithi122.stdout:8/507: dwrite d3/d53/d4d/d6d/d76/f7b [0,4194304] 0 2024-09-13T02:50:52.170 INFO:tasks.workunit.client.1.smithi122.stdout:0/591: mkdir d1/d5/d9/da/d92/d94/dbf 0 2024-09-13T02:50:52.174 INFO:tasks.workunit.client.1.smithi122.stdout:0/592: rename d1/d4b/d56/da1/cbd to d1/d5/d10/d29/d32/d83/cc0 0 2024-09-13T02:50:52.174 INFO:tasks.workunit.client.1.smithi122.stdout:8/508: symlink d3/d53/d4d/d6d/d76/l96 0 2024-09-13T02:50:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:51 smithi100 ceph-mon[27894]: pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:52.176 INFO:tasks.workunit.client.1.smithi122.stdout:8/509: symlink d3/d31/d52/l97 0 2024-09-13T02:50:52.176 INFO:tasks.workunit.client.1.smithi122.stdout:8/510: read d3/d53/d34/f49 [353679,10084] 0 2024-09-13T02:50:52.176 INFO:tasks.workunit.client.1.smithi122.stdout:8/511: chown d3/da/d1e/f8f 1557 1 2024-09-13T02:50:52.177 INFO:tasks.workunit.client.1.smithi122.stdout:8/512: fsync d3/d53/d4d/f62 0 2024-09-13T02:50:52.177 INFO:tasks.workunit.client.1.smithi122.stdout:8/513: fsync d3/d53/d4d/f6b 0 2024-09-13T02:50:52.177 INFO:tasks.workunit.client.1.smithi122.stdout:8/514: write d3/d53/d34/f49 [4646565,125144] 0 2024-09-13T02:50:52.177 INFO:tasks.workunit.client.1.smithi122.stdout:8/515: fdatasync d3/d31/f6e 0 2024-09-13T02:50:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:51 smithi122 ceph-mon[34559]: pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:52.187 INFO:tasks.workunit.client.1.smithi122.stdout:1/589: dwrite dc/de/d6e/fb6 [0,4194304] 0 2024-09-13T02:50:52.187 INFO:tasks.workunit.client.1.smithi122.stdout:1/590: chown dc/d38/db1/d7d/f84 5387377 1 2024-09-13T02:50:52.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/516: dread d3/d53/d21/f90 [0,4194304] 0 2024-09-13T02:50:52.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/517: chown d3/da/d1e 19 1 2024-09-13T02:50:52.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/518: dread - d3/da/d1f/f7f zero size 2024-09-13T02:50:52.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/519: creat d3/d53/d21/f98 x:0 0 0 2024-09-13T02:50:52.191 INFO:tasks.workunit.client.1.smithi122.stdout:1/591: truncate fa 847917 0 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:3/634: sync 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:7/554: sync 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:2/508: sync 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:2/509: stat d0/d1c/d3b/d41/d4e/d75/d95 0 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:2/510: creat d0/d1e/d22/d29/fa2 x:0 0 0 2024-09-13T02:50:52.192 INFO:tasks.workunit.client.1.smithi122.stdout:2/511: fdatasync d0/d1c/d3b/d41/d4e/f60 0 2024-09-13T02:50:52.195 INFO:tasks.workunit.client.1.smithi122.stdout:1/592: mknod dc/de/d18/d22/d1c/d47/cc5 0 2024-09-13T02:50:52.197 INFO:tasks.workunit.client.1.smithi122.stdout:3/635: creat d4/d6/df/d15/feb x:0 0 0 2024-09-13T02:50:52.197 INFO:tasks.workunit.client.1.smithi122.stdout:1/593: write dc/de/d18/f65 [1007563,102165] 0 2024-09-13T02:50:52.197 INFO:tasks.workunit.client.1.smithi122.stdout:7/555: truncate d4/d8/db/f84 436427 0 2024-09-13T02:50:52.199 INFO:tasks.workunit.client.1.smithi122.stdout:2/512: rename d0/l13 to d0/d1c/d3b/d41/d4e/d75/d95/la3 0 2024-09-13T02:50:52.201 INFO:tasks.workunit.client.1.smithi122.stdout:3/636: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dec 0 2024-09-13T02:50:52.201 INFO:tasks.workunit.client.1.smithi122.stdout:0/593: dwrite d1/d5/d9/da/d7d/fb6 [0,4194304] 0 2024-09-13T02:50:52.201 INFO:tasks.workunit.client.1.smithi122.stdout:1/594: mkdir dc/de/d18/d22/d1c/d57/dc6 0 2024-09-13T02:50:52.202 INFO:tasks.workunit.client.1.smithi122.stdout:7/556: mkdir d4/d4e/d5d/d6b/db4 0 2024-09-13T02:50:52.202 INFO:tasks.workunit.client.1.smithi122.stdout:2/513: truncate d0/d1e/d2e/d3e/f5b 579024 0 2024-09-13T02:50:52.203 INFO:tasks.workunit.client.1.smithi122.stdout:2/514: write d0/d1e/d26/fa0 [117875,48027] 0 2024-09-13T02:50:52.205 INFO:tasks.workunit.client.1.smithi122.stdout:1/595: symlink dc/de/d18/d1d/d2f/d94/lc7 0 2024-09-13T02:50:52.207 INFO:tasks.workunit.client.1.smithi122.stdout:7/557: rename d4/d8/db/dc/d46/d5a/l70 to d4/d8/d24/d47/lb5 0 2024-09-13T02:50:52.207 INFO:tasks.workunit.client.1.smithi122.stdout:8/520: write d3/da/d1f/f27 [2957516,7767] 0 2024-09-13T02:50:52.207 INFO:tasks.workunit.client.1.smithi122.stdout:8/521: creat d3/d31/f99 x:0 0 0 2024-09-13T02:50:52.209 INFO:tasks.workunit.client.1.smithi122.stdout:2/515: rmdir d0/d1e/d2e/d3e 39 2024-09-13T02:50:52.211 INFO:tasks.workunit.client.1.smithi122.stdout:7/558: dread d4/d4e/d5d/f5e [0,4194304] 0 2024-09-13T02:50:52.212 INFO:tasks.workunit.client.1.smithi122.stdout:0/594: getdents d1/d4b 0 2024-09-13T02:50:52.212 INFO:tasks.workunit.client.1.smithi122.stdout:0/595: dread - d1/d4b/d56/da1/fa8 zero size 2024-09-13T02:50:52.213 INFO:tasks.workunit.client.1.smithi122.stdout:0/596: chown d1/d5/d2d/l78 1345546 1 2024-09-13T02:50:52.213 INFO:tasks.workunit.client.1.smithi122.stdout:1/596: rmdir dc/de/d18/d22/d80 39 2024-09-13T02:50:52.213 INFO:tasks.workunit.client.1.smithi122.stdout:1/597: stat dc/de/d13/f9a 0 2024-09-13T02:50:52.217 INFO:tasks.workunit.client.1.smithi122.stdout:3/637: dread d4/d11/dd/d21/f28 [0,4194304] 0 2024-09-13T02:50:52.217 INFO:tasks.workunit.client.1.smithi122.stdout:8/522: unlink d3/d31/d52/d89/d8b/d5c/f6a 0 2024-09-13T02:50:52.220 INFO:tasks.workunit.client.1.smithi122.stdout:7/559: creat d4/d8/db/d63/fb6 x:0 0 0 2024-09-13T02:50:52.220 INFO:tasks.workunit.client.1.smithi122.stdout:7/560: readlink d4/d8/d24/lac 0 2024-09-13T02:50:52.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/597: creat d1/d5/d9/da/d17/d69/d85/fc1 x:0 0 0 2024-09-13T02:50:52.221 INFO:tasks.workunit.client.1.smithi122.stdout:0/598: creat d1/d4b/d56/d81/fc2 x:0 0 0 2024-09-13T02:50:52.222 INFO:tasks.workunit.client.1.smithi122.stdout:1/598: rmdir dc/de/d18/d1d/d2f/d94 39 2024-09-13T02:50:52.222 INFO:tasks.workunit.client.1.smithi122.stdout:3/638: mknod d4/d11/dd/d21/d2b/d36/d3c/d43/d82/ced 0 2024-09-13T02:50:52.222 INFO:tasks.workunit.client.1.smithi122.stdout:3/639: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fd8 [393928,44027] 0 2024-09-13T02:50:52.222 INFO:tasks.workunit.client.1.smithi122.stdout:3/640: write d4/d11/dd/fcd [222263,69188] 0 2024-09-13T02:50:52.229 INFO:tasks.workunit.client.1.smithi122.stdout:0/599: rename d1/d5/d10/d29/f40 to d1/d5/d9/da/fc3 0 2024-09-13T02:50:52.233 INFO:tasks.workunit.client.1.smithi122.stdout:3/641: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee 0 2024-09-13T02:50:52.238 INFO:tasks.workunit.client.1.smithi122.stdout:0/600: link d1/d5/d9/da/f2b d1/d5/d9/fc4 0 2024-09-13T02:50:52.238 INFO:tasks.workunit.client.1.smithi122.stdout:0/601: dread - d1/d5/d9/da/d17/d69/d85/fc1 zero size 2024-09-13T02:50:52.240 INFO:tasks.workunit.client.1.smithi122.stdout:3/642: rename d4/d11/dd/lb3 to d4/d11/dd/d21/d4e/dc8/lef 0 2024-09-13T02:50:52.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/602: mkdir d1/d4b/d56/d81/dc5 0 2024-09-13T02:50:52.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/603: write d1/d5/d9/da/d17/f79 [332632,16345] 0 2024-09-13T02:50:52.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/604: write d1/d5/d10/d29/f36 [3861122,76670] 0 2024-09-13T02:50:52.243 INFO:tasks.workunit.client.1.smithi122.stdout:0/605: fsync d1/d4b/d56/d60/f91 0 2024-09-13T02:50:52.244 INFO:tasks.workunit.client.1.smithi122.stdout:3/643: truncate d4/d6/df/d15/d68/d90/fa7 48020 0 2024-09-13T02:50:52.244 INFO:tasks.workunit.client.1.smithi122.stdout:3/644: creat d4/d4c/dd3/ff0 x:0 0 0 2024-09-13T02:50:52.244 INFO:tasks.workunit.client.1.smithi122.stdout:3/645: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fd8 [722762,94731] 0 2024-09-13T02:50:52.245 INFO:tasks.workunit.client.1.smithi122.stdout:0/606: mknod d1/d4b/d56/da1/cc6 0 2024-09-13T02:50:52.257 INFO:tasks.workunit.client.1.smithi122.stdout:1/599: dwrite dc/de/d18/d1d/d2f/d94/fbc [0,4194304] 0 2024-09-13T02:50:52.259 INFO:tasks.workunit.client.1.smithi122.stdout:1/600: rmdir dc/de/d18/d1d/d2f/d94/d98 39 2024-09-13T02:50:52.259 INFO:tasks.workunit.client.1.smithi122.stdout:1/601: creat dc/de/d18/d1d/fc8 x:0 0 0 2024-09-13T02:50:52.259 INFO:tasks.workunit.client.1.smithi122.stdout:1/602: write dc/d38/db1/d7d/f83 [4422814,48577] 0 2024-09-13T02:50:52.264 INFO:tasks.workunit.client.1.smithi122.stdout:7/561: dwrite d4/d6d/d8c/f99 [0,4194304] 0 2024-09-13T02:50:52.269 INFO:tasks.workunit.client.1.smithi122.stdout:0/607: dwrite d1/d5/d10/d29/f42 [0,4194304] 0 2024-09-13T02:50:52.273 INFO:tasks.workunit.client.1.smithi122.stdout:0/608: dread d1/d5/d9/da/f2b [0,4194304] 0 2024-09-13T02:50:52.274 INFO:tasks.workunit.client.1.smithi122.stdout:3/646: getdents d4/d11/dd/d21/d4e/dc8 0 2024-09-13T02:50:52.274 INFO:tasks.workunit.client.1.smithi122.stdout:8/523: dwrite d3/da/d1e/f47 [4194304,4194304] 0 2024-09-13T02:50:52.274 INFO:tasks.workunit.client.1.smithi122.stdout:1/603: dread dc/de/d18/d1d/d2f/f4b [0,4194304] 0 2024-09-13T02:50:52.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/609: creat d1/d5/fc7 x:0 0 0 2024-09-13T02:50:52.287 INFO:tasks.workunit.client.1.smithi122.stdout:3/647: unlink d4/d6/de/d1f/f8a 0 2024-09-13T02:50:52.289 INFO:tasks.workunit.client.1.smithi122.stdout:8/524: rmdir d3/d53/d4d/d6d 39 2024-09-13T02:50:52.290 INFO:tasks.workunit.client.1.smithi122.stdout:0/610: dread d1/d5/d10/d29/d32/f5d [0,4194304] 0 2024-09-13T02:50:52.291 INFO:tasks.workunit.client.1.smithi122.stdout:0/611: readlink d1/d5/d9/da/d7d/lac 0 2024-09-13T02:50:52.294 INFO:tasks.workunit.client.1.smithi122.stdout:1/604: mknod dc/de/d18/d22/d1c/cc9 0 2024-09-13T02:50:52.295 INFO:tasks.workunit.client.1.smithi122.stdout:1/605: dread - dc/de/d18/f30 zero size 2024-09-13T02:50:52.295 INFO:tasks.workunit.client.1.smithi122.stdout:3/648: mkdir d4/d11/dd/df1 0 2024-09-13T02:50:52.296 INFO:tasks.workunit.client.1.smithi122.stdout:0/612: link d1/d5/d9/da/d7d/d95/cb7 d1/d5/d9/da/d92/d94/cc8 0 2024-09-13T02:50:52.297 INFO:tasks.workunit.client.1.smithi122.stdout:1/606: mknod dc/de/d18/d22/d76/cca 0 2024-09-13T02:50:52.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/562: dwrite d4/d4e/f73 [4194304,4194304] 0 2024-09-13T02:50:52.299 INFO:tasks.workunit.client.1.smithi122.stdout:0/613: creat d1/fc9 x:0 0 0 2024-09-13T02:50:52.299 INFO:tasks.workunit.client.1.smithi122.stdout:0/614: getdents d1/d4b 0 2024-09-13T02:50:52.299 INFO:tasks.workunit.client.1.smithi122.stdout:0/615: dread - d1/d5/d9/da/d7d/fa2 zero size 2024-09-13T02:50:52.301 INFO:tasks.workunit.client.1.smithi122.stdout:7/563: mkdir d4/d8/db7 0 2024-09-13T02:50:52.303 INFO:tasks.workunit.client.1.smithi122.stdout:1/607: getdents dc/de/d6e 0 2024-09-13T02:50:52.307 INFO:tasks.workunit.client.1.smithi122.stdout:8/525: dread d3/d53/d21/f69 [0,4194304] 0 2024-09-13T02:50:52.309 INFO:tasks.workunit.client.1.smithi122.stdout:1/608: rename dc/de/d18/d86/f90 to dc/d38/d51/fcb 0 2024-09-13T02:50:52.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/564: rmdir d4/d77 39 2024-09-13T02:50:52.311 INFO:tasks.workunit.client.1.smithi122.stdout:3/649: read d4/fb7 [2449172,36668] 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:3/650: fsync d4/d4c/dd3/f6b 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:3/651: fdatasync d4/d6/df/d15/fbd 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:3/652: getdents d4/d11/dd/df1 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:3/653: write d4/d11/dd/d21/d2b/d55/fa4 [4976421,124304] 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:3/654: truncate d4/d11/d38/f70 5797101 0 2024-09-13T02:50:52.312 INFO:tasks.workunit.client.1.smithi122.stdout:6/680: sync 2024-09-13T02:50:52.313 INFO:tasks.workunit.client.1.smithi122.stdout:9/573: sync 2024-09-13T02:50:52.313 INFO:tasks.workunit.client.1.smithi122.stdout:5/548: sync 2024-09-13T02:50:52.313 INFO:tasks.workunit.client.1.smithi122.stdout:5/549: write d0/d17/d36/d25/d2b/f30 [807975,95819] 0 2024-09-13T02:50:52.315 INFO:tasks.workunit.client.1.smithi122.stdout:8/526: truncate d3/d31/d52/f5b 194452 0 2024-09-13T02:50:52.315 INFO:tasks.workunit.client.1.smithi122.stdout:3/655: truncate d4/d11/dd/d21/d2b/d36/f66 2808155 0 2024-09-13T02:50:52.315 INFO:tasks.workunit.client.1.smithi122.stdout:3/656: fdatasync d4/d11/dd/d21/d2b/d36/fd6 0 2024-09-13T02:50:52.316 INFO:tasks.workunit.client.1.smithi122.stdout:3/657: chown d4 4 1 2024-09-13T02:50:52.319 INFO:tasks.workunit.client.1.smithi122.stdout:9/574: truncate d8/f9 2949508 0 2024-09-13T02:50:52.319 INFO:tasks.workunit.client.1.smithi122.stdout:9/575: fdatasync d8/d16/d3d/d59/d23/d7b/d82/f95 0 2024-09-13T02:50:52.321 INFO:tasks.workunit.client.1.smithi122.stdout:8/527: symlink d3/d53/d4d/l9a 0 2024-09-13T02:50:52.323 INFO:tasks.workunit.client.1.smithi122.stdout:5/550: symlink d0/d2/lb0 0 2024-09-13T02:50:52.324 INFO:tasks.workunit.client.1.smithi122.stdout:3/658: mknod d4/d11/dd/d21/d2b/d36/d3c/d43/d82/cf2 0 2024-09-13T02:50:52.325 INFO:tasks.workunit.client.1.smithi122.stdout:6/681: dread d5/d11/d2f/f74 [0,4194304] 0 2024-09-13T02:50:52.330 INFO:tasks.workunit.client.1.smithi122.stdout:3/659: link d4/d4c/dd3/ff0 d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/ff3 0 2024-09-13T02:50:52.330 INFO:tasks.workunit.client.1.smithi122.stdout:3/660: chown d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f 62 1 2024-09-13T02:50:52.330 INFO:tasks.workunit.client.1.smithi122.stdout:3/661: chown d4/d11/dd/d21/d2b/d36/l4f 326292426 1 2024-09-13T02:50:52.332 INFO:tasks.workunit.client.1.smithi122.stdout:0/616: dwrite d1/f73 [0,4194304] 0 2024-09-13T02:50:52.333 INFO:tasks.workunit.client.1.smithi122.stdout:3/662: symlink d4/d11/dd/d21/d6c/lf4 0 2024-09-13T02:50:52.334 INFO:tasks.workunit.client.1.smithi122.stdout:3/663: write d4/d11/dd/d21/fc7 [824597,99274] 0 2024-09-13T02:50:52.334 INFO:tasks.workunit.client.1.smithi122.stdout:3/664: truncate d4/d11/dd/d21/f28 5023128 0 2024-09-13T02:50:52.338 INFO:tasks.workunit.client.1.smithi122.stdout:0/617: unlink d1/d5/d10/f7e 0 2024-09-13T02:50:52.338 INFO:tasks.workunit.client.1.smithi122.stdout:0/618: dread - d1/d5/d10/d29/fb5 zero size 2024-09-13T02:50:52.339 INFO:tasks.workunit.client.1.smithi122.stdout:3/665: rename d4/d6/de/d1f/d33/l58 to d4/d6/de/d1f/d33/lf5 0 2024-09-13T02:50:52.339 INFO:tasks.workunit.client.1.smithi122.stdout:3/666: write d4/d11/dd/d21/d2b/d36/d3c/f10 [1063883,78965] 0 2024-09-13T02:50:52.339 INFO:tasks.workunit.client.1.smithi122.stdout:3/667: chown d4/d11/d38/lb0 406 1 2024-09-13T02:50:52.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/565: dwrite d4/d8/d24/f53 [0,4194304] 0 2024-09-13T02:50:52.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/566: readlink d4/d6d/l71 0 2024-09-13T02:50:52.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/567: chown d4/d8/d24/f3e 779069 1 2024-09-13T02:50:52.346 INFO:tasks.workunit.client.1.smithi122.stdout:7/568: chown d4/d8/db/dc/d36/l4d 409 1 2024-09-13T02:50:52.358 INFO:tasks.workunit.client.1.smithi122.stdout:0/619: write d1/d5/d9/da/d92/d94/f2c [1223013,112480] 0 2024-09-13T02:50:52.359 INFO:tasks.workunit.client.1.smithi122.stdout:0/620: truncate d1/d5/d9/da/d17/f43 177053 0 2024-09-13T02:50:52.373 INFO:tasks.workunit.client.1.smithi122.stdout:1/609: dwrite dc/de/d18/d22/f5b [0,4194304] 0 2024-09-13T02:50:52.375 INFO:tasks.workunit.client.1.smithi122.stdout:1/610: symlink dc/de/d18/d22/d1c/lcc 0 2024-09-13T02:50:52.377 INFO:tasks.workunit.client.1.smithi122.stdout:1/611: mknod dc/de/d18/d22/ccd 0 2024-09-13T02:50:52.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/576: dwrite d8/d16/d3d/d59/d23/f66 [0,4194304] 0 2024-09-13T02:50:52.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/577: write d8/f2e [4915026,47598] 0 2024-09-13T02:50:52.377 INFO:tasks.workunit.client.1.smithi122.stdout:9/578: creat d8/fb1 x:0 0 0 2024-09-13T02:50:52.378 INFO:tasks.workunit.client.1.smithi122.stdout:9/579: stat d8/l15 0 2024-09-13T02:50:52.378 INFO:tasks.workunit.client.1.smithi122.stdout:9/580: dread - d8/d16/d45/f81 zero size 2024-09-13T02:50:52.379 INFO:tasks.workunit.client.1.smithi122.stdout:1/612: mknod dc/de/d18/cce 0 2024-09-13T02:50:52.380 INFO:tasks.workunit.client.1.smithi122.stdout:1/613: mkdir dc/de/d13/d3f/dc1/dcf 0 2024-09-13T02:50:52.380 INFO:tasks.workunit.client.1.smithi122.stdout:1/614: stat dc/de/d18/d22/d80 0 2024-09-13T02:50:52.381 INFO:tasks.workunit.client.1.smithi122.stdout:1/615: write fa [233727,52464] 0 2024-09-13T02:50:52.381 INFO:tasks.workunit.client.1.smithi122.stdout:1/616: chown dc/de/d18/d22/d80/cc4 23708 1 2024-09-13T02:50:52.389 INFO:tasks.workunit.client.1.smithi122.stdout:6/682: dwrite d5/d3d/d6c/d41/d4e/d93/fa9 [0,4194304] 0 2024-09-13T02:50:52.389 INFO:tasks.workunit.client.1.smithi122.stdout:6/683: chown d5/d3d/d82/dc9 490695 1 2024-09-13T02:50:52.390 INFO:tasks.workunit.client.1.smithi122.stdout:6/684: chown d5/d3d/da3/lbf 46 1 2024-09-13T02:50:52.394 INFO:tasks.workunit.client.1.smithi122.stdout:9/581: dread d8/d16/d3d/d59/d49/f7a [0,4194304] 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:9/582: mknod d8/d4a/d64/cb2 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:9/583: write d8/f28 [5971318,106466] 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:5/551: dwrite d0/da/d48/d63/d98/fad [0,4194304] 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:5/552: fsync d0/d17/f54 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:8/528: dwrite d3/d53/d4d/f62 [0,4194304] 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:3/668: dwrite d4/d4c/dd3/f81 [0,4194304] 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:8/529: creat d3/da/f9b x:0 0 0 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:3/669: chown d4/f5d 7810220 1 2024-09-13T02:50:52.397 INFO:tasks.workunit.client.1.smithi122.stdout:8/530: chown d3/d53/d4d/l84 6 1 2024-09-13T02:50:52.398 INFO:tasks.workunit.client.1.smithi122.stdout:8/531: write d3/d31/d52/d59/f5f [4214743,67719] 0 2024-09-13T02:50:52.398 INFO:tasks.workunit.client.1.smithi122.stdout:8/532: getdents d3/d31/d65 0 2024-09-13T02:50:52.398 INFO:tasks.workunit.client.1.smithi122.stdout:8/533: chown d3/da/d1e/c23 823532399 1 2024-09-13T02:50:52.398 INFO:tasks.workunit.client.1.smithi122.stdout:8/534: creat d3/da/d1f/f9c x:0 0 0 2024-09-13T02:50:52.402 INFO:tasks.workunit.client.1.smithi122.stdout:0/621: dwrite d1/d5/d10/d29/f88 [0,4194304] 0 2024-09-13T02:50:52.402 INFO:tasks.workunit.client.1.smithi122.stdout:0/622: write d1/d5/d9/faf [294657,117604] 0 2024-09-13T02:50:52.403 INFO:tasks.workunit.client.1.smithi122.stdout:9/584: dread d8/d88/d65/faf [0,4194304] 0 2024-09-13T02:50:52.404 INFO:tasks.workunit.client.1.smithi122.stdout:1/617: dwrite dc/de/d18/d22/d1c/d57/f59 [0,4194304] 0 2024-09-13T02:50:52.404 INFO:tasks.workunit.client.1.smithi122.stdout:1/618: write dc/de/d18/d1d/f52 [3531156,23431] 0 2024-09-13T02:50:52.404 INFO:tasks.workunit.client.1.smithi122.stdout:5/553: mknod d0/cb1 0 2024-09-13T02:50:52.404 INFO:tasks.workunit.client.1.smithi122.stdout:5/554: readlink d0/d2/lb0 0 2024-09-13T02:50:52.411 INFO:tasks.workunit.client.1.smithi122.stdout:7/569: dwrite d4/d8/f7 [4194304,4194304] 0 2024-09-13T02:50:52.421 INFO:tasks.workunit.client.1.smithi122.stdout:3/670: dwrite d4/d11/dd/d21/d2b/d36/f72 [0,4194304] 0 2024-09-13T02:50:52.421 INFO:tasks.workunit.client.1.smithi122.stdout:3/671: fsync d4/d4c/dd3/f6b 0 2024-09-13T02:50:52.422 INFO:tasks.workunit.client.1.smithi122.stdout:8/535: mkdir d3/d31/d9d 0 2024-09-13T02:50:52.425 INFO:tasks.workunit.client.1.smithi122.stdout:9/585: mknod d8/d16/d3d/d59/d7d/cb3 0 2024-09-13T02:50:52.425 INFO:tasks.workunit.client.1.smithi122.stdout:9/586: chown d8/f9 25 1 2024-09-13T02:50:52.429 INFO:tasks.workunit.client.1.smithi122.stdout:1/619: rename dc/d38/d51/da4 to dc/de/dd0 0 2024-09-13T02:50:52.432 INFO:tasks.workunit.client.1.smithi122.stdout:5/555: dwrite d0/d17/fa4 [0,4194304] 0 2024-09-13T02:50:52.434 INFO:tasks.workunit.client.1.smithi122.stdout:6/685: write d5/d3d/d6c/d41/fb8 [32924,119495] 0 2024-09-13T02:50:52.436 INFO:tasks.workunit.client.1.smithi122.stdout:4/673: sync 2024-09-13T02:50:52.437 INFO:tasks.workunit.client.1.smithi122.stdout:4/674: truncate d11/d13/d82/d2a/d40/f51 4590270 0 2024-09-13T02:50:52.437 INFO:tasks.workunit.client.1.smithi122.stdout:2/516: sync 2024-09-13T02:50:52.438 INFO:tasks.workunit.client.1.smithi122.stdout:3/672: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/ff6 x:0 0 0 2024-09-13T02:50:52.438 INFO:tasks.workunit.client.1.smithi122.stdout:3/673: getdents d4/d11/dd/d21/d4e/dc8 0 2024-09-13T02:50:52.438 INFO:tasks.workunit.client.1.smithi122.stdout:8/536: symlink d3/d53/d4d/d6d/d76/l9e 0 2024-09-13T02:50:52.438 INFO:tasks.workunit.client.1.smithi122.stdout:9/587: rmdir d8/d4a/d64 39 2024-09-13T02:50:52.444 INFO:tasks.workunit.client.1.smithi122.stdout:2/517: dread d0/d1e/d22/f24 [0,4194304] 0 2024-09-13T02:50:52.445 INFO:tasks.workunit.client.1.smithi122.stdout:6/686: mknod d5/d40/dcd/cd1 0 2024-09-13T02:50:52.445 INFO:tasks.workunit.client.1.smithi122.stdout:4/675: getdents d11/d30/d59/d8f/da2 0 2024-09-13T02:50:52.445 INFO:tasks.workunit.client.1.smithi122.stdout:4/676: fsync d11/f3c 0 2024-09-13T02:50:52.446 INFO:tasks.workunit.client.1.smithi122.stdout:3/674: mkdir d4/d11/dd/d21/d4e/df7 0 2024-09-13T02:50:52.447 INFO:tasks.workunit.client.1.smithi122.stdout:4/677: write d11/d62/f89 [34192,82772] 0 2024-09-13T02:50:52.447 INFO:tasks.workunit.client.1.smithi122.stdout:4/678: fdatasync d11/f7c 0 2024-09-13T02:50:52.447 INFO:tasks.workunit.client.1.smithi122.stdout:8/537: symlink d3/d53/d4d/l9f 0 2024-09-13T02:50:52.449 INFO:tasks.workunit.client.1.smithi122.stdout:9/588: symlink d8/d88/lb4 0 2024-09-13T02:50:52.449 INFO:tasks.workunit.client.1.smithi122.stdout:9/589: dread - d8/d16/d3d/d59/f8c zero size 2024-09-13T02:50:52.450 INFO:tasks.workunit.client.1.smithi122.stdout:9/590: chown d8/d16/d3d 7981 1 2024-09-13T02:50:52.450 INFO:tasks.workunit.client.1.smithi122.stdout:9/591: chown d8/d16/d3d/d59/d23/c67 0 1 2024-09-13T02:50:52.450 INFO:tasks.workunit.client.1.smithi122.stdout:5/556: read d0/da/d48/d63/d98/fad [3276333,47339] 0 2024-09-13T02:50:52.450 INFO:tasks.workunit.client.1.smithi122.stdout:5/557: truncate d0/d2/d33/f5e 4474277 0 2024-09-13T02:50:52.451 INFO:tasks.workunit.client.1.smithi122.stdout:5/558: creat d0/d17/d36/d3f/fb2 x:0 0 0 2024-09-13T02:50:52.451 INFO:tasks.workunit.client.1.smithi122.stdout:5/559: read - d0/d2/f6e zero size 2024-09-13T02:50:52.451 INFO:tasks.workunit.client.1.smithi122.stdout:2/518: rmdir d0/d55 39 2024-09-13T02:50:52.452 INFO:tasks.workunit.client.1.smithi122.stdout:3/675: getdents d4/d6/de/d41 0 2024-09-13T02:50:52.454 INFO:tasks.workunit.client.1.smithi122.stdout:5/560: rename d0/da/ce to d0/da/cb3 0 2024-09-13T02:50:52.456 INFO:tasks.workunit.client.1.smithi122.stdout:3/676: creat d4/d11/dd/d21/d6c/ff8 x:0 0 0 2024-09-13T02:50:52.460 INFO:tasks.workunit.client.1.smithi122.stdout:8/538: read d3/d31/d52/d59/f3c [2927733,84474] 0 2024-09-13T02:50:52.460 INFO:tasks.workunit.client.1.smithi122.stdout:8/539: read d3/da/f10 [85723,21073] 0 2024-09-13T02:50:52.460 INFO:tasks.workunit.client.1.smithi122.stdout:5/561: rename d0/d17/d36/d25/d2b/d72 to d0/da/d48/db4 0 2024-09-13T02:50:52.460 INFO:tasks.workunit.client.1.smithi122.stdout:5/562: creat d0/d17/d36/d25/fb5 x:0 0 0 2024-09-13T02:50:52.460 INFO:tasks.workunit.client.1.smithi122.stdout:3/677: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9 0 2024-09-13T02:50:52.463 INFO:tasks.workunit.client.1.smithi122.stdout:5/563: creat d0/d17/d36/d99/fb6 x:0 0 0 2024-09-13T02:50:52.465 INFO:tasks.workunit.client.1.smithi122.stdout:3/678: dread d4/d4c/dd3/f6b [0,4194304] 0 2024-09-13T02:50:52.466 INFO:tasks.workunit.client.1.smithi122.stdout:2/519: dread d0/d1e/d22/f47 [4194304,4194304] 0 2024-09-13T02:50:52.468 INFO:tasks.workunit.client.1.smithi122.stdout:3/679: truncate d4/d11/dd/d21/f28 4059259 0 2024-09-13T02:50:52.470 INFO:tasks.workunit.client.1.smithi122.stdout:2/520: link d0/c15 d0/d55/ca4 0 2024-09-13T02:50:52.470 INFO:tasks.workunit.client.1.smithi122.stdout:6/687: dread d5/db/d29/fb6 [0,4194304] 0 2024-09-13T02:50:52.470 INFO:tasks.workunit.client.1.smithi122.stdout:6/688: read - d5/d11/d45/d21/f57 zero size 2024-09-13T02:50:52.470 INFO:tasks.workunit.client.1.smithi122.stdout:6/689: fdatasync d5/db/d29/fb6 0 2024-09-13T02:50:52.470 INFO:tasks.workunit.client.1.smithi122.stdout:1/620: dwrite dc/de/d18/d1d/d2f/f95 [0,4194304] 0 2024-09-13T02:50:52.471 INFO:tasks.workunit.client.1.smithi122.stdout:3/680: creat d4/d6/df/d15/d68/ffa x:0 0 0 2024-09-13T02:50:52.472 INFO:tasks.workunit.client.1.smithi122.stdout:2/521: truncate d0/f18 1058458 0 2024-09-13T02:50:52.473 INFO:tasks.workunit.client.1.smithi122.stdout:1/621: symlink dc/de/d7a/ld1 0 2024-09-13T02:50:52.474 INFO:tasks.workunit.client.1.smithi122.stdout:1/622: dread dc/f9c [0,4194304] 0 2024-09-13T02:50:52.474 INFO:tasks.workunit.client.1.smithi122.stdout:1/623: chown dc/de/l60 14 1 2024-09-13T02:50:52.475 INFO:tasks.workunit.client.1.smithi122.stdout:2/522: mknod d0/d1c/d3b/d41/d6a/ca5 0 2024-09-13T02:50:52.476 INFO:tasks.workunit.client.1.smithi122.stdout:1/624: write dc/de/d18/d1d/f73 [259362,45813] 0 2024-09-13T02:50:52.477 INFO:tasks.workunit.client.1.smithi122.stdout:4/679: dwrite d11/f80 [0,4194304] 0 2024-09-13T02:50:52.478 INFO:tasks.workunit.client.1.smithi122.stdout:1/625: unlink dc/d38/db1/d7d/cb0 0 2024-09-13T02:50:52.478 INFO:tasks.workunit.client.1.smithi122.stdout:1/626: dread - dc/f9e zero size 2024-09-13T02:50:52.483 INFO:tasks.workunit.client.1.smithi122.stdout:4/680: symlink d11/d30/lcb 0 2024-09-13T02:50:52.483 INFO:tasks.workunit.client.1.smithi122.stdout:4/681: stat d11/d1b/d32/d87/lbf 0 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:1/627: creat dc/de/d18/d22/d1c/d57/dc6/fd2 x:0 0 0 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:1/628: chown dc/de/d18/d1d/l2d 32 1 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:1/629: dread - dc/de/d7a/fa0 zero size 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:1/630: fsync dc/d38/f6a 0 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:3/681: write d4/d6/df/f7b [1413305,83602] 0 2024-09-13T02:50:52.486 INFO:tasks.workunit.client.1.smithi122.stdout:3/682: read d4/d4c/f51 [314897,40644] 0 2024-09-13T02:50:52.487 INFO:tasks.workunit.client.1.smithi122.stdout:2/523: dread d0/d1e/d2e/f97 [0,4194304] 0 2024-09-13T02:50:52.487 INFO:tasks.workunit.client.1.smithi122.stdout:9/592: dwrite f1 [0,4194304] 0 2024-09-13T02:50:52.487 INFO:tasks.workunit.client.1.smithi122.stdout:9/593: write d8/d16/f62 [3367210,28284] 0 2024-09-13T02:50:52.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/682: link cf d11/d30/d59/d6e/ccc 0 2024-09-13T02:50:52.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/683: chown d11/l7a 530569818 1 2024-09-13T02:50:52.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/684: dread - d11/d1b/f96 zero size 2024-09-13T02:50:52.489 INFO:tasks.workunit.client.1.smithi122.stdout:4/685: stat d11/l70 0 2024-09-13T02:50:52.489 INFO:tasks.workunit.client.1.smithi122.stdout:5/564: rmdir d0/d17/d36 39 2024-09-13T02:50:52.492 INFO:tasks.workunit.client.1.smithi122.stdout:3/683: rmdir d4/d11/dd/d21/d4e 39 2024-09-13T02:50:52.492 INFO:tasks.workunit.client.1.smithi122.stdout:3/684: write d4/d6/df/d15/fbd [242016,72027] 0 2024-09-13T02:50:52.495 INFO:tasks.workunit.client.1.smithi122.stdout:2/524: unlink d0/d1e/d22/l23 0 2024-09-13T02:50:52.495 INFO:tasks.workunit.client.1.smithi122.stdout:2/525: dread - d0/d55/f9d zero size 2024-09-13T02:50:52.497 INFO:tasks.workunit.client.1.smithi122.stdout:4/686: truncate d11/d1b/f45 1360234 0 2024-09-13T02:50:52.497 INFO:tasks.workunit.client.1.smithi122.stdout:6/690: dwrite d5/d11/d45/fcc [0,4194304] 0 2024-09-13T02:50:52.499 INFO:tasks.workunit.client.1.smithi122.stdout:2/526: creat d0/d1c/d3b/d41/d4e/d90/fa6 x:0 0 0 2024-09-13T02:50:52.501 INFO:tasks.workunit.client.1.smithi122.stdout:4/687: link d11/d1b/d32/d87/l92 d11/d1b/d2e/d55/lcd 0 2024-09-13T02:50:52.501 INFO:tasks.workunit.client.1.smithi122.stdout:6/691: dread d5/d40/dcd/fce [0,4194304] 0 2024-09-13T02:50:52.501 INFO:tasks.workunit.client.1.smithi122.stdout:6/692: write d5/db/d29/d60/dac/dc6/d46/faa [4537610,55356] 0 2024-09-13T02:50:52.501 INFO:tasks.workunit.client.1.smithi122.stdout:6/693: readlink d5/l4c 0 2024-09-13T02:50:52.501 INFO:tasks.workunit.client.1.smithi122.stdout:6/694: fdatasync d5/d11/f4f 0 2024-09-13T02:50:52.516 INFO:tasks.workunit.client.1.smithi122.stdout:9/594: dwrite d8/d4a/f5c [0,4194304] 0 2024-09-13T02:50:52.518 INFO:tasks.workunit.client.1.smithi122.stdout:9/595: mkdir d8/d16/d3d/db5 0 2024-09-13T02:50:52.521 INFO:tasks.workunit.client.1.smithi122.stdout:1/631: truncate dc/de/d18/d1d/d2f/f95 1973494 0 2024-09-13T02:50:52.521 INFO:tasks.workunit.client.1.smithi122.stdout:1/632: chown dc/d38/d51/l7c 11216 1 2024-09-13T02:50:52.524 INFO:tasks.workunit.client.1.smithi122.stdout:1/633: unlink dc/de/d18/d1d/d2f/fb4 0 2024-09-13T02:50:52.524 INFO:tasks.workunit.client.1.smithi122.stdout:1/634: chown dc/de/d13/f9a 1361078834 1 2024-09-13T02:50:52.526 INFO:tasks.workunit.client.1.smithi122.stdout:5/565: dwrite d0/da/d48/d63/d98/fad [0,4194304] 0 2024-09-13T02:50:52.527 INFO:tasks.workunit.client.1.smithi122.stdout:1/635: truncate dc/f44 3061944 0 2024-09-13T02:50:52.530 INFO:tasks.workunit.client.1.smithi122.stdout:1/636: truncate dc/de/f11 2976076 0 2024-09-13T02:50:52.531 INFO:tasks.workunit.client.1.smithi122.stdout:1/637: creat dc/de/d18/d22/d1c/d57/dc6/fd3 x:0 0 0 2024-09-13T02:50:52.537 INFO:tasks.workunit.client.1.smithi122.stdout:2/527: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:50:52.537 INFO:tasks.workunit.client.1.smithi122.stdout:2/528: chown d0/d55/ca4 31 1 2024-09-13T02:50:52.538 INFO:tasks.workunit.client.1.smithi122.stdout:2/529: write d0/d1e/d22/d29/f9e [922923,129105] 0 2024-09-13T02:50:52.538 INFO:tasks.workunit.client.1.smithi122.stdout:2/530: write d0/f68 [97631,127292] 0 2024-09-13T02:50:52.538 INFO:tasks.workunit.client.1.smithi122.stdout:2/531: write d0/d5d/f89 [803799,30289] 0 2024-09-13T02:50:52.539 INFO:tasks.workunit.client.1.smithi122.stdout:2/532: symlink d0/d1e/d22/d29/la7 0 2024-09-13T02:50:52.539 INFO:tasks.workunit.client.1.smithi122.stdout:2/533: chown d0/c15 5 1 2024-09-13T02:50:52.539 INFO:tasks.workunit.client.1.smithi122.stdout:2/534: symlink d0/d1c/d3b/d41/d4e/d90/la8 0 2024-09-13T02:50:52.547 INFO:tasks.workunit.client.1.smithi122.stdout:2/535: dread d0/d55/f62 [0,4194304] 0 2024-09-13T02:50:52.548 INFO:tasks.workunit.client.1.smithi122.stdout:6/695: dwrite d5/d11/d2f/f74 [4194304,4194304] 0 2024-09-13T02:50:52.548 INFO:tasks.workunit.client.1.smithi122.stdout:6/696: fsync d5/db/d29/fb6 0 2024-09-13T02:50:52.548 INFO:tasks.workunit.client.1.smithi122.stdout:9/596: dwrite d8/d16/d3d/d59/d23/d7b/d82/f95 [0,4194304] 0 2024-09-13T02:50:52.550 INFO:tasks.workunit.client.1.smithi122.stdout:1/638: write dc/de/d18/d1d/f1f [554426,32506] 0 2024-09-13T02:50:52.550 INFO:tasks.workunit.client.1.smithi122.stdout:4/688: dwrite d11/d13/d82/d2a/d40/f51 [4194304,4194304] 0 2024-09-13T02:50:52.550 INFO:tasks.workunit.client.1.smithi122.stdout:4/689: write d11/d13/d82/d2a/d78/db6/fca [47806,90677] 0 2024-09-13T02:50:52.550 INFO:tasks.workunit.client.1.smithi122.stdout:4/690: creat d11/d1b/d2e/fce x:0 0 0 2024-09-13T02:50:52.550 INFO:tasks.workunit.client.1.smithi122.stdout:4/691: getdents d11/d13/dc9 0 2024-09-13T02:50:52.551 INFO:tasks.workunit.client.1.smithi122.stdout:4/692: write d11/d13/d82/d2a/d83/f95 [4228977,119973] 0 2024-09-13T02:50:52.551 INFO:tasks.workunit.client.1.smithi122.stdout:4/693: write d11/d62/f89 [513894,128822] 0 2024-09-13T02:50:52.551 INFO:tasks.workunit.client.1.smithi122.stdout:5/566: dwrite d0/da/f6c [0,4194304] 0 2024-09-13T02:50:52.556 INFO:tasks.workunit.client.1.smithi122.stdout:6/697: mkdir d5/db/d29/d60/dd2 0 2024-09-13T02:50:52.558 INFO:tasks.workunit.client.1.smithi122.stdout:9/597: creat d8/d4a/d64/fb6 x:0 0 0 2024-09-13T02:50:52.558 INFO:tasks.workunit.client.1.smithi122.stdout:9/598: stat d8/d16/d3d/d59/d23/d7b/d82/f95 0 2024-09-13T02:50:52.559 INFO:tasks.workunit.client.1.smithi122.stdout:1/639: creat dc/de/d18/d22/d76/fd4 x:0 0 0 2024-09-13T02:50:52.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/536: dread d0/d5d/f91 [0,4194304] 0 2024-09-13T02:50:52.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/537: creat d0/d1e/fa9 x:0 0 0 2024-09-13T02:50:52.560 INFO:tasks.workunit.client.1.smithi122.stdout:2/538: truncate d0/d1c/d3b/d41/f80 1301217 0 2024-09-13T02:50:52.564 INFO:tasks.workunit.client.1.smithi122.stdout:5/567: write d0/da/d90/f9b [3435461,120892] 0 2024-09-13T02:50:52.565 INFO:tasks.workunit.client.1.smithi122.stdout:6/698: dread d5/db/d29/fb6 [0,4194304] 0 2024-09-13T02:50:52.566 INFO:tasks.workunit.client.1.smithi122.stdout:9/599: mkdir d8/d16/d3d/d59/d29/d90/db7 0 2024-09-13T02:50:52.568 INFO:tasks.workunit.client.1.smithi122.stdout:1/640: link dc/f44 dc/de/d18/d1d/d2f/fd5 0 2024-09-13T02:50:52.572 INFO:tasks.workunit.client.1.smithi122.stdout:6/699: truncate d5/d3d/d6c/d41/fb8 502370 0 2024-09-13T02:50:52.572 INFO:tasks.workunit.client.1.smithi122.stdout:6/700: readlink d5/db/dc/l7b 0 2024-09-13T02:50:52.574 INFO:tasks.workunit.client.1.smithi122.stdout:9/600: getdents d8/d88/d65 0 2024-09-13T02:50:52.574 INFO:tasks.workunit.client.1.smithi122.stdout:9/601: chown d8/d88/c6e 2807 1 2024-09-13T02:50:52.575 INFO:tasks.workunit.client.1.smithi122.stdout:6/701: write d5/d11/d45/f81 [8539420,64237] 0 2024-09-13T02:50:52.575 INFO:tasks.workunit.client.1.smithi122.stdout:6/702: chown d5/d3d/d6c/lba 247334539 1 2024-09-13T02:50:52.578 INFO:tasks.workunit.client.1.smithi122.stdout:4/694: rename d11/d13/d82/d2a/d78/db6 to d11/dcf 0 2024-09-13T02:50:52.592 INFO:tasks.workunit.client.1.smithi122.stdout:2/539: dwrite d0/f16 [0,4194304] 0 2024-09-13T02:50:52.592 INFO:tasks.workunit.client.1.smithi122.stdout:2/540: write d0/d1e/d26/fa0 [585960,109790] 0 2024-09-13T02:50:52.593 INFO:tasks.workunit.client.1.smithi122.stdout:2/541: fdatasync d0/f10 0 2024-09-13T02:50:52.596 INFO:tasks.workunit.client.1.smithi122.stdout:4/695: write d11/f3c [3325060,16900] 0 2024-09-13T02:50:52.605 INFO:tasks.workunit.client.1.smithi122.stdout:1/641: dwrite dc/de/d18/d22/d1c/d47/f4d [0,4194304] 0 2024-09-13T02:50:52.605 INFO:tasks.workunit.client.1.smithi122.stdout:5/568: dwrite d0/f7 [0,4194304] 0 2024-09-13T02:50:52.605 INFO:tasks.workunit.client.1.smithi122.stdout:2/542: write d0/f5 [5915679,125220] 0 2024-09-13T02:50:52.605 INFO:tasks.workunit.client.1.smithi122.stdout:9/602: dwrite d8/f9 [0,4194304] 0 2024-09-13T02:50:52.607 INFO:tasks.workunit.client.1.smithi122.stdout:1/642: getdents dc/de/d18/d22/d1c/d47 0 2024-09-13T02:50:52.656 INFO:tasks.workunit.client.1.smithi122.stdout:1/643: truncate dc/de/d18/d22/d1c/d57/dc6/fd2 473779 0 2024-09-13T02:50:52.656 INFO:tasks.workunit.client.1.smithi122.stdout:1/644: creat dc/de/d18/d22/d1c/d57/dc6/fd6 x:0 0 0 2024-09-13T02:50:52.657 INFO:tasks.workunit.client.1.smithi122.stdout:5/569: creat d0/d17/d36/fb7 x:0 0 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:5/570: unlink d0/d17/c89 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:4/696: dread d11/d1b/d2e/d55/f58 [0,4194304] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:4/697: dread - d11/d30/d59/d6e/fb7 zero size 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:4/698: write d11/d1b/d2e/fce [662617,15340] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:4/699: readlink d11/d13/d82/d2a/l44 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:9/603: write d8/d16/d3d/d59/d23/f66 [2317807,44502] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:1/645: write dc/de/d18/d22/d1c/d47/f4d [1694258,100883] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:2/543: dwrite d0/d55/f81 [0,4194304] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:2/544: write d0/d1e/d2e/d3e/f5b [734535,72086] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:2/545: fdatasync d0/d1e/d26/f30 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:9/604: read d8/f33 [2497033,38802] 0 2024-09-13T02:50:52.658 INFO:tasks.workunit.client.1.smithi122.stdout:5/571: mknod d0/da/d48/d63/cb8 0 2024-09-13T02:50:52.659 INFO:tasks.workunit.client.1.smithi122.stdout:5/572: write d0/d17/d36/d25/d2b/f2c [285421,39532] 0 2024-09-13T02:50:52.659 INFO:tasks.workunit.client.1.smithi122.stdout:4/700: symlink d11/ld0 0 2024-09-13T02:50:52.659 INFO:tasks.workunit.client.1.smithi122.stdout:4/701: write d11/f3e [1861529,26159] 0 2024-09-13T02:50:52.690 INFO:tasks.workunit.client.1.smithi122.stdout:9/605: mknod d8/d16/d3d/d59/d23/d7b/d82/cb8 0 2024-09-13T02:50:52.690 INFO:tasks.workunit.client.1.smithi122.stdout:9/606: truncate d8/d16/d3d/d59/d7d/f78 804201 0 2024-09-13T02:50:52.691 INFO:tasks.workunit.client.1.smithi122.stdout:5/573: symlink d0/da/d48/db4/lb9 0 2024-09-13T02:50:52.693 INFO:tasks.workunit.client.1.smithi122.stdout:4/702: rmdir d11/d13/d82/d2a/d78/d8e 39 2024-09-13T02:50:52.695 INFO:tasks.workunit.client.1.smithi122.stdout:9/607: dread d8/f33 [0,4194304] 0 2024-09-13T02:50:52.695 INFO:tasks.workunit.client.1.smithi122.stdout:5/574: unlink d0/d17/d36/d25/d2b/c7e 0 2024-09-13T02:50:52.701 INFO:tasks.workunit.client.1.smithi122.stdout:5/575: dread d0/f5a [0,4194304] 0 2024-09-13T02:50:52.702 INFO:tasks.workunit.client.1.smithi122.stdout:5/576: chown d0/d17/d36/d8b/f9d 6429699 1 2024-09-13T02:50:52.708 INFO:tasks.workunit.client.1.smithi122.stdout:1/646: rename dc/de/d13 to dc/d38/db1/d72/dd7 0 2024-09-13T02:50:52.708 INFO:tasks.workunit.client.1.smithi122.stdout:1/647: read dc/d38/db1/d72/dd7/d46/f70 [4189308,115554] 0 2024-09-13T02:50:52.711 INFO:tasks.workunit.client.1.smithi122.stdout:2/546: rename d0/d1c/d3b/d41/f80 to d0/d1c/d3b/d41/d4e/d75/faa 0 2024-09-13T02:50:52.711 INFO:tasks.workunit.client.1.smithi122.stdout:2/547: truncate d0/d1e/d22/d29/f9e 1828423 0 2024-09-13T02:50:52.712 INFO:tasks.workunit.client.1.smithi122.stdout:5/577: read d0/f7 [3287635,6230] 0 2024-09-13T02:50:52.712 INFO:tasks.workunit.client.1.smithi122.stdout:1/648: unlink dc/d38/l89 0 2024-09-13T02:50:52.713 INFO:tasks.workunit.client.1.smithi122.stdout:4/703: rename d11/d1b/d2e/f77 to d11/d30/d59/d6e/fd1 0 2024-09-13T02:50:52.713 INFO:tasks.workunit.client.1.smithi122.stdout:4/704: fdatasync d11/d30/f9d 0 2024-09-13T02:50:52.715 INFO:tasks.workunit.client.1.smithi122.stdout:1/649: getdents dc/d38/db1/d72/dd7/d46/db7 0 2024-09-13T02:50:52.716 INFO:tasks.workunit.client.1.smithi122.stdout:1/650: read - dc/de/d18/d1d/fc8 zero size 2024-09-13T02:50:52.716 INFO:tasks.workunit.client.1.smithi122.stdout:1/651: chown dc/de/d18/d22/d76/fd4 19093454 1 2024-09-13T02:50:52.717 INFO:tasks.workunit.client.1.smithi122.stdout:5/578: mkdir d0/da/d8c/d8f/da0/dba 0 2024-09-13T02:50:52.717 INFO:tasks.workunit.client.1.smithi122.stdout:5/579: chown d0/d17/d36/d25/f65 11 1 2024-09-13T02:50:52.717 INFO:tasks.workunit.client.1.smithi122.stdout:5/580: fsync d0/f5a 0 2024-09-13T02:50:52.721 INFO:tasks.workunit.client.1.smithi122.stdout:9/608: dwrite d8/d16/d3e/f99 [0,4194304] 0 2024-09-13T02:50:52.722 INFO:tasks.workunit.client.1.smithi122.stdout:4/705: unlink d11/d1b/d32/la0 0 2024-09-13T02:50:52.722 INFO:tasks.workunit.client.1.smithi122.stdout:4/706: dread - d11/d1b/d32/d87/fa8 zero size 2024-09-13T02:50:52.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/548: unlink d0/d1e/l1f 0 2024-09-13T02:50:52.725 INFO:tasks.workunit.client.1.smithi122.stdout:5/581: unlink d0/da/d48/d63/d98/fac 0 2024-09-13T02:50:52.734 INFO:tasks.workunit.client.1.smithi122.stdout:9/609: rename d8/d16/d3d/d59/d23/d7b/d82/fa6 to d8/d16/d3d/d59/d49/fb9 0 2024-09-13T02:50:52.735 INFO:tasks.workunit.client.1.smithi122.stdout:1/652: dwrite dc/de/d6e/fac [0,4194304] 0 2024-09-13T02:50:52.735 INFO:tasks.workunit.client.1.smithi122.stdout:5/582: dread d0/d17/d36/f9e [0,4194304] 0 2024-09-13T02:50:52.740 INFO:tasks.workunit.client.1.smithi122.stdout:4/707: dwrite d11/d1b/d2e/f7f [0,4194304] 0 2024-09-13T02:50:52.740 INFO:tasks.workunit.client.1.smithi122.stdout:2/549: creat d0/d1c/d3b/d41/d8c/fab x:0 0 0 2024-09-13T02:50:52.740 INFO:tasks.workunit.client.1.smithi122.stdout:2/550: creat d0/d1c/d3b/d41/d4e/d75/d95/fac x:0 0 0 2024-09-13T02:50:52.749 INFO:tasks.workunit.client.1.smithi122.stdout:5/583: link d0/da/d48/d63/f82 d0/da/d8c/d8f/fbb 0 2024-09-13T02:50:52.751 INFO:tasks.workunit.client.1.smithi122.stdout:4/708: symlink d11/ld2 0 2024-09-13T02:50:52.752 INFO:tasks.workunit.client.1.smithi122.stdout:5/584: creat d0/da/d48/db4/d95/fbc x:0 0 0 2024-09-13T02:50:52.752 INFO:tasks.workunit.client.1.smithi122.stdout:5/585: creat d0/d1d/fbd x:0 0 0 2024-09-13T02:50:52.756 INFO:tasks.workunit.client.1.smithi122.stdout:9/610: dwrite d8/d16/d3d/d59/d23/d1f/f37 [0,4194304] 0 2024-09-13T02:50:52.756 INFO:tasks.workunit.client.1.smithi122.stdout:9/611: readlink d8/d16/d3d/l8f 0 2024-09-13T02:50:52.756 INFO:tasks.workunit.client.1.smithi122.stdout:9/612: chown d8/d16/d45 1289453793 1 2024-09-13T02:50:52.759 INFO:tasks.workunit.client.1.smithi122.stdout:9/613: rename d8/d16/d3d/d59/d23/f3c to d8/d88/fba 0 2024-09-13T02:50:52.759 INFO:tasks.workunit.client.1.smithi122.stdout:5/586: dread d0/da/d48/d63/f82 [0,4194304] 0 2024-09-13T02:50:52.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/614: link d8/d16/d3d/d59/f7f d8/d16/d3d/d59/d23/d7b/d82/fbb 0 2024-09-13T02:50:52.761 INFO:tasks.workunit.client.1.smithi122.stdout:9/615: truncate d8/f33 4205113 0 2024-09-13T02:50:52.763 INFO:tasks.workunit.client.1.smithi122.stdout:9/616: mkdir d8/d16/d3d/d59/d29/d90/db7/dbc 0 2024-09-13T02:50:52.764 INFO:tasks.workunit.client.1.smithi122.stdout:1/653: dwrite f2 [4194304,4194304] 0 2024-09-13T02:50:52.767 INFO:tasks.workunit.client.1.smithi122.stdout:4/709: dread d11/d1b/d2e/d55/f67 [0,4194304] 0 2024-09-13T02:50:52.767 INFO:tasks.workunit.client.1.smithi122.stdout:4/710: read - d11/d30/d59/d6e/fb7 zero size 2024-09-13T02:50:52.768 INFO:tasks.workunit.client.1.smithi122.stdout:9/617: link d8/d16/c5d d8/d16/d3d/d59/d7d/cbd 0 2024-09-13T02:50:52.769 INFO:tasks.workunit.client.1.smithi122.stdout:4/711: rmdir d11/d1b/d2e/d55 39 2024-09-13T02:50:52.771 INFO:tasks.workunit.client.1.smithi122.stdout:9/618: mkdir d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe 0 2024-09-13T02:50:52.772 INFO:tasks.workunit.client.1.smithi122.stdout:4/712: creat d11/d1b/d2e/fd3 x:0 0 0 2024-09-13T02:50:52.774 INFO:tasks.workunit.client.1.smithi122.stdout:9/619: dread d8/d16/d3d/d59/d23/d1f/f2d [0,4194304] 0 2024-09-13T02:50:52.775 INFO:tasks.workunit.client.1.smithi122.stdout:9/620: mknod d8/d4a/cbf 0 2024-09-13T02:50:52.776 INFO:tasks.workunit.client.1.smithi122.stdout:9/621: symlink d8/d16/d3d/d59/d29/d90/lc0 0 2024-09-13T02:50:52.777 INFO:tasks.workunit.client.1.smithi122.stdout:9/622: mknod d8/d16/d3d/d59/d23/d7b/d82/da3/cc1 0 2024-09-13T02:50:52.780 INFO:tasks.workunit.client.1.smithi122.stdout:9/623: link d8/d16/d3d/d59/c4b d8/d16/d3d/d59/d23/cc2 0 2024-09-13T02:50:52.780 INFO:tasks.workunit.client.1.smithi122.stdout:9/624: mkdir d8/d16/d3d/d59/d23/d7b/dc3 0 2024-09-13T02:50:52.790 INFO:tasks.workunit.client.1.smithi122.stdout:5/587: dwrite d0/d2/f6d [0,4194304] 0 2024-09-13T02:50:52.793 INFO:tasks.workunit.client.1.smithi122.stdout:1/654: dwrite f2 [0,4194304] 0 2024-09-13T02:50:52.794 INFO:tasks.workunit.client.1.smithi122.stdout:4/713: dwrite d11/d30/f9d [4194304,4194304] 0 2024-09-13T02:50:52.794 INFO:tasks.workunit.client.1.smithi122.stdout:4/714: write d11/f3e [3385018,5545] 0 2024-09-13T02:50:52.795 INFO:tasks.workunit.client.1.smithi122.stdout:1/655: truncate dc/de/d18/d1d/d2f/f95 300012 0 2024-09-13T02:50:52.797 INFO:tasks.workunit.client.1.smithi122.stdout:4/715: mknod d11/d30/d59/d8f/da2/cd4 0 2024-09-13T02:50:52.798 INFO:tasks.workunit.client.1.smithi122.stdout:1/656: symlink dc/de/ld8 0 2024-09-13T02:50:52.798 INFO:tasks.workunit.client.1.smithi122.stdout:1/657: fdatasync dc/d38/db1/d72/dd7/d3f/f7f 0 2024-09-13T02:50:52.798 INFO:tasks.workunit.client.1.smithi122.stdout:1/658: readlink dc/d38/db1/d72/dd7/d3f/l6f 0 2024-09-13T02:50:52.811 INFO:tasks.workunit.client.1.smithi122.stdout:9/625: dwrite d8/f33 [4194304,4194304] 0 2024-09-13T02:50:52.811 INFO:tasks.workunit.client.1.smithi122.stdout:9/626: stat d8/d16/d3d/d59/d23/f8e 0 2024-09-13T02:50:52.812 INFO:tasks.workunit.client.1.smithi122.stdout:9/627: rmdir d8/d16/d3d/d59/d23/d1f 39 2024-09-13T02:50:52.812 INFO:tasks.workunit.client.1.smithi122.stdout:9/628: getdents d8/d16/d3d/d59/d29/d90/db7/dbc 0 2024-09-13T02:50:52.819 INFO:tasks.workunit.client.1.smithi122.stdout:5/588: dwrite d0/da/f23 [4194304,4194304] 0 2024-09-13T02:50:52.820 INFO:tasks.workunit.client.1.smithi122.stdout:5/589: dread - d0/d1d/f93 zero size 2024-09-13T02:50:52.825 INFO:tasks.workunit.client.1.smithi122.stdout:4/716: dwrite d11/d30/d59/fa6 [0,4194304] 0 2024-09-13T02:50:52.825 INFO:tasks.workunit.client.1.smithi122.stdout:4/717: dread - d11/d30/fbb zero size 2024-09-13T02:50:52.840 INFO:tasks.workunit.client.1.smithi122.stdout:9/629: dwrite d8/d88/fba [0,4194304] 0 2024-09-13T02:50:52.849 INFO:tasks.workunit.client.1.smithi122.stdout:5/590: dwrite d0/da/f2d [0,4194304] 0 2024-09-13T02:50:52.850 INFO:tasks.workunit.client.1.smithi122.stdout:4/718: dwrite d11/d1b/d32/d87/fa8 [0,4194304] 0 2024-09-13T02:50:52.850 INFO:tasks.workunit.client.1.smithi122.stdout:4/719: write d11/d30/d59/d6e/f8a [584364,75457] 0 2024-09-13T02:50:52.851 INFO:tasks.workunit.client.1.smithi122.stdout:9/630: write d8/d16/d3d/d59/d23/d1f/f2a [2575821,48897] 0 2024-09-13T02:50:52.851 INFO:tasks.workunit.client.1.smithi122.stdout:9/631: chown d8/d16/d3d/d59/d7d/f9c 1 1 2024-09-13T02:50:52.851 INFO:tasks.workunit.client.1.smithi122.stdout:9/632: read d8/d88/fba [246937,9007] 0 2024-09-13T02:50:52.852 INFO:tasks.workunit.client.1.smithi122.stdout:4/720: truncate d11/d13/d82/d2a/fba 2169585 0 2024-09-13T02:50:52.853 INFO:tasks.workunit.client.1.smithi122.stdout:4/721: symlink d11/dcf/ld5 0 2024-09-13T02:50:52.853 INFO:tasks.workunit.client.1.smithi122.stdout:9/633: dread d8/d16/d3d/d59/d7d/f78 [0,4194304] 0 2024-09-13T02:50:52.853 INFO:tasks.workunit.client.1.smithi122.stdout:9/634: chown d8/d16/d3e/c77 17 1 2024-09-13T02:50:52.853 INFO:tasks.workunit.client.1.smithi122.stdout:9/635: fsync d8/d16/d3d/d59/d23/d1f/d36/fa8 0 2024-09-13T02:50:52.854 INFO:tasks.workunit.client.1.smithi122.stdout:4/722: symlink d11/d1b/d2e/ld6 0 2024-09-13T02:50:52.855 INFO:tasks.workunit.client.1.smithi122.stdout:9/636: unlink d8/d16/d3d/d59/d23/d1f/f37 0 2024-09-13T02:50:52.869 INFO:tasks.workunit.client.1.smithi122.stdout:4/723: dwrite d11/d13/d82/d2a/d40/f4d [4194304,4194304] 0 2024-09-13T02:50:52.870 INFO:tasks.workunit.client.1.smithi122.stdout:9/637: getdents d8/d16/d3d/d59/d23/d1f 0 2024-09-13T02:50:52.870 INFO:tasks.workunit.client.1.smithi122.stdout:9/638: truncate d8/d88/d65/faf 1587269 0 2024-09-13T02:50:52.871 INFO:tasks.workunit.client.1.smithi122.stdout:9/639: unlink d8/d16/d3e/d57/f9b 0 2024-09-13T02:50:52.873 INFO:tasks.workunit.client.1.smithi122.stdout:9/640: truncate d8/d16/d3d/d59/d23/d1f/f54 1007248 0 2024-09-13T02:50:52.876 INFO:tasks.workunit.client.1.smithi122.stdout:0/623: sync 2024-09-13T02:50:52.876 INFO:tasks.workunit.client.1.smithi122.stdout:9/641: dread d8/d16/d3d/d59/f7f [0,4194304] 0 2024-09-13T02:50:52.881 INFO:tasks.workunit.client.1.smithi122.stdout:9/642: rmdir d8 39 2024-09-13T02:50:52.882 INFO:tasks.workunit.client.1.smithi122.stdout:9/643: rmdir d8/d16/d3d/d59/d23/d7b/d82 39 2024-09-13T02:50:52.883 INFO:tasks.workunit.client.1.smithi122.stdout:9/644: mkdir d8/d16/d45/dc4 0 2024-09-13T02:50:52.884 INFO:tasks.workunit.client.1.smithi122.stdout:9/645: rename d8/d16/d3d/d59/d23/f66 to d8/d16/d3d/d59/d49/fc5 0 2024-09-13T02:50:52.885 INFO:tasks.workunit.client.1.smithi122.stdout:9/646: creat d8/d16/d3d/d59/d23/d7b/d82/da3/da7/fc6 x:0 0 0 2024-09-13T02:50:52.885 INFO:tasks.workunit.client.1.smithi122.stdout:9/647: creat d8/d88/d65/fc7 x:0 0 0 2024-09-13T02:50:52.885 INFO:tasks.workunit.client.1.smithi122.stdout:9/648: chown d8/d16/d3d/d59/d23/d1f/f87 7447547 1 2024-09-13T02:50:52.899 INFO:tasks.workunit.client.1.smithi122.stdout:4/724: dwrite d11/d1b/d2e/d55/f67 [4194304,4194304] 0 2024-09-13T02:50:52.900 INFO:tasks.workunit.client.1.smithi122.stdout:4/725: truncate d11/d13/d82/f25 2555061 0 2024-09-13T02:50:52.900 INFO:tasks.workunit.client.1.smithi122.stdout:0/624: dwrite d1/d5/d10/d29/f88 [0,4194304] 0 2024-09-13T02:50:52.900 INFO:tasks.workunit.client.1.smithi122.stdout:0/625: read - d1/d5/d9/da/d7d/fab zero size 2024-09-13T02:50:52.900 INFO:tasks.workunit.client.1.smithi122.stdout:0/626: write d1/d5/d9/da/d7d/fa2 [196636,4726] 0 2024-09-13T02:50:52.900 INFO:tasks.workunit.client.1.smithi122.stdout:0/627: chown d1/d5/d10/d29/d32/f6f 143509972 1 2024-09-13T02:50:52.903 INFO:tasks.workunit.client.1.smithi122.stdout:4/726: rename d11/d1b/d2e/d55/lcd to d11/dcf/ld7 0 2024-09-13T02:50:52.904 INFO:tasks.workunit.client.1.smithi122.stdout:0/628: creat d1/d5/d2d/db4/fca x:0 0 0 2024-09-13T02:50:52.905 INFO:tasks.workunit.client.1.smithi122.stdout:0/629: creat d1/d5/d9/fcb x:0 0 0 2024-09-13T02:50:52.905 INFO:tasks.workunit.client.1.smithi122.stdout:0/630: write d1/d5/d10/f5e [542471,92881] 0 2024-09-13T02:50:52.905 INFO:tasks.workunit.client.1.smithi122.stdout:9/649: write d8/d16/d3d/d59/d23/d7b/d82/f95 [518401,62895] 0 2024-09-13T02:50:52.907 INFO:tasks.workunit.client.1.smithi122.stdout:9/650: rename d8/d16/d3d/d59/d23/d1f/dac to d8/d16/d3d/d59/d29/d90/dc8 0 2024-09-13T02:50:52.915 INFO:tasks.workunit.client.1.smithi122.stdout:4/727: write d11/d13/d82/d2a/d40/f6d [2060333,112807] 0 2024-09-13T02:50:52.916 INFO:tasks.workunit.client.1.smithi122.stdout:0/631: dread d1/d4b/d56/d60/faa [0,4194304] 0 2024-09-13T02:50:52.916 INFO:tasks.workunit.client.1.smithi122.stdout:4/728: mkdir d11/d13/dd8 0 2024-09-13T02:50:52.917 INFO:tasks.workunit.client.1.smithi122.stdout:0/632: mknod d1/d5/d10/d29/d32/ccc 0 2024-09-13T02:50:52.917 INFO:tasks.workunit.client.1.smithi122.stdout:0/633: fsync d1/d5/d10/d29/f88 0 2024-09-13T02:50:52.918 INFO:tasks.workunit.client.1.smithi122.stdout:0/634: dread - d1/d5/d9/da/d17/fbc zero size 2024-09-13T02:50:52.918 INFO:tasks.workunit.client.1.smithi122.stdout:4/729: symlink d11/dcf/ld9 0 2024-09-13T02:50:52.919 INFO:tasks.workunit.client.1.smithi122.stdout:0/635: getdents d1/d5/d10/d29 0 2024-09-13T02:50:52.922 INFO:tasks.workunit.client.1.smithi122.stdout:4/730: symlink d11/d1b/d32/d98/lda 0 2024-09-13T02:50:52.923 INFO:tasks.workunit.client.1.smithi122.stdout:4/731: symlink d11/d13/dc9/ldb 0 2024-09-13T02:50:52.928 INFO:tasks.workunit.client.1.smithi122.stdout:9/651: dwrite d8/d16/d45/f63 [4194304,4194304] 0 2024-09-13T02:50:52.929 INFO:tasks.workunit.client.1.smithi122.stdout:9/652: dread - d8/d88/d65/fc7 zero size 2024-09-13T02:50:52.930 INFO:tasks.workunit.client.1.smithi122.stdout:9/653: creat d8/d88/fc9 x:0 0 0 2024-09-13T02:50:52.945 INFO:tasks.workunit.client.1.smithi122.stdout:0/636: dwrite d1/d5/d10/d29/f42 [0,4194304] 0 2024-09-13T02:50:52.945 INFO:tasks.workunit.client.1.smithi122.stdout:4/732: dwrite d11/fad [0,4194304] 0 2024-09-13T02:50:52.948 INFO:tasks.workunit.client.1.smithi122.stdout:4/733: mkdir d11/d13/dd8/ddc 0 2024-09-13T02:50:52.948 INFO:tasks.workunit.client.1.smithi122.stdout:4/734: creat d11/d30/d59/d6e/fdd x:0 0 0 2024-09-13T02:50:52.949 INFO:tasks.workunit.client.1.smithi122.stdout:0/637: getdents d1/d5/d9/da/d7d 0 2024-09-13T02:50:52.949 INFO:tasks.workunit.client.1.smithi122.stdout:0/638: fsync d1/d5/d10/d29/f42 0 2024-09-13T02:50:52.951 INFO:tasks.workunit.client.1.smithi122.stdout:4/735: creat d11/d30/d59/d8f/da2/dc8/fde x:0 0 0 2024-09-13T02:50:52.951 INFO:tasks.workunit.client.1.smithi122.stdout:4/736: chown d11/fad 23746746 1 2024-09-13T02:50:52.952 INFO:tasks.workunit.client.1.smithi122.stdout:9/654: dread d8/d88/f68 [0,4194304] 0 2024-09-13T02:50:52.952 INFO:tasks.workunit.client.1.smithi122.stdout:9/655: chown d8/d16/d3d/d59/d7d/f78 4073 1 2024-09-13T02:50:52.952 INFO:tasks.workunit.client.1.smithi122.stdout:9/656: fsync d8/d16/d3d/d59/d23/d1f/d36/f4c 0 2024-09-13T02:50:52.952 INFO:tasks.workunit.client.1.smithi122.stdout:0/639: unlink d1/d5/d10/d29/f8d 0 2024-09-13T02:50:52.955 INFO:tasks.workunit.client.1.smithi122.stdout:9/657: link d8/d16/d3e/d57/l96 d8/d4a/d64/lca 0 2024-09-13T02:50:52.955 INFO:tasks.workunit.client.1.smithi122.stdout:9/658: fdatasync d8/d16/d3d/d59/d29/f76 0 2024-09-13T02:50:52.955 INFO:tasks.workunit.client.1.smithi122.stdout:0/640: creat d1/d4b/d56/fcd x:0 0 0 2024-09-13T02:50:52.955 INFO:tasks.workunit.client.1.smithi122.stdout:0/641: stat d1/d5/d2d/db4/fca 0 2024-09-13T02:50:52.957 INFO:tasks.workunit.client.1.smithi122.stdout:9/659: symlink d8/d16/d3d/d59/d23/d7b/d82/lcb 0 2024-09-13T02:50:52.957 INFO:tasks.workunit.client.1.smithi122.stdout:9/660: fsync d8/d16/d3d/d59/d49/f89 0 2024-09-13T02:50:52.978 INFO:tasks.workunit.client.1.smithi122.stdout:4/737: dwrite d11/d30/d59/d6e/fd1 [0,4194304] 0 2024-09-13T02:50:52.979 INFO:tasks.workunit.client.1.smithi122.stdout:4/738: write d11/f7c [753818,75078] 0 2024-09-13T02:50:52.979 INFO:tasks.workunit.client.1.smithi122.stdout:4/739: fsync d11/d13/d82/f16 0 2024-09-13T02:50:52.981 INFO:tasks.workunit.client.1.smithi122.stdout:0/642: dwrite d1/d5/d9/f20 [4194304,4194304] 0 2024-09-13T02:50:52.981 INFO:tasks.workunit.client.1.smithi122.stdout:9/661: dread d8/d16/d3e/f6b [0,4194304] 0 2024-09-13T02:50:52.981 INFO:tasks.workunit.client.1.smithi122.stdout:9/662: write d8/d16/d3d/d59/d23/f8e [493047,76377] 0 2024-09-13T02:50:52.981 INFO:tasks.workunit.client.1.smithi122.stdout:0/643: write d1/f38 [675687,70634] 0 2024-09-13T02:50:52.984 INFO:tasks.workunit.client.1.smithi122.stdout:9/663: creat d8/d16/d3d/d59/d23/d7b/d82/da3/fcc x:0 0 0 2024-09-13T02:50:52.984 INFO:tasks.workunit.client.1.smithi122.stdout:9/664: read - d8/fb1 zero size 2024-09-13T02:50:52.984 INFO:tasks.workunit.client.1.smithi122.stdout:9/665: mknod d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe/ccd 0 2024-09-13T02:50:52.985 INFO:tasks.workunit.client.1.smithi122.stdout:9/666: getdents d8/d16 0 2024-09-13T02:50:52.987 INFO:tasks.workunit.client.1.smithi122.stdout:9/667: link d8/d16/d3e/c77 d8/d16/d3d/d59/d29/d90/cce 0 2024-09-13T02:50:52.991 INFO:tasks.workunit.client.1.smithi122.stdout:0/644: write d1/d5/d9/f20 [5548410,95301] 0 2024-09-13T02:50:52.991 INFO:tasks.workunit.client.1.smithi122.stdout:0/645: readlink d1/d5/d9/da/d7d/lac 0 2024-09-13T02:50:52.995 INFO:tasks.workunit.client.1.smithi122.stdout:0/646: write d1/d4b/d56/d60/faa [3583637,95252] 0 2024-09-13T02:50:52.995 INFO:tasks.workunit.client.1.smithi122.stdout:0/647: write d1/d5/f1e [4330219,36693] 0 2024-09-13T02:50:52.997 INFO:tasks.workunit.client.1.smithi122.stdout:9/668: write d8/d16/d3e/f75 [853927,29967] 0 2024-09-13T02:50:52.997 INFO:tasks.workunit.client.1.smithi122.stdout:0/648: fdatasync d1/d5/d9/f20 0 2024-09-13T02:50:52.998 INFO:tasks.workunit.client.1.smithi122.stdout:9/669: unlink d8/d16/d3e/f99 0 2024-09-13T02:50:52.998 INFO:tasks.workunit.client.1.smithi122.stdout:9/670: readlink d8/l12 0 2024-09-13T02:50:52.998 INFO:tasks.workunit.client.1.smithi122.stdout:0/649: mkdir d1/d5/d9/dce 0 2024-09-13T02:50:53.000 INFO:tasks.workunit.client.1.smithi122.stdout:0/650: mknod d1/d4b/d56/d60/ccf 0 2024-09-13T02:50:53.001 INFO:tasks.workunit.client.1.smithi122.stdout:0/651: rmdir d1/d4b 39 2024-09-13T02:50:53.015 INFO:tasks.workunit.client.1.smithi122.stdout:0/652: dwrite d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:53.019 INFO:tasks.workunit.client.1.smithi122.stdout:0/653: dread d1/d5/d10/f7b [0,4194304] 0 2024-09-13T02:50:53.020 INFO:tasks.workunit.client.1.smithi122.stdout:0/654: link d1/c39 d1/d5/d2d/db4/cd0 0 2024-09-13T02:50:53.020 INFO:tasks.workunit.client.1.smithi122.stdout:0/655: fsync d1/d5/d2d/db4/fca 0 2024-09-13T02:50:53.029 INFO:tasks.workunit.client.1.smithi122.stdout:0/656: dread d1/d5/d9/da/f9c [0,4194304] 0 2024-09-13T02:50:53.030 INFO:tasks.workunit.client.1.smithi122.stdout:0/657: link d1/d5/d9/da/d92/d94/c2e d1/d5/d9/da/d92/cd1 0 2024-09-13T02:50:53.030 INFO:tasks.workunit.client.1.smithi122.stdout:0/658: truncate d1/d5/d9/fc4 696001 0 2024-09-13T02:50:53.030 INFO:tasks.workunit.client.1.smithi122.stdout:0/659: mknod d1/d5/d9/da/d17/d69/d85/cd2 0 2024-09-13T02:50:53.032 INFO:tasks.workunit.client.1.smithi122.stdout:0/660: link d1/d5/d10/d29/d32/d5f/f50 d1/d5/d9/da/d92/d94/fd3 0 2024-09-13T02:50:53.033 INFO:tasks.workunit.client.1.smithi122.stdout:0/661: symlink d1/d4b/d56/dba/ld4 0 2024-09-13T02:50:53.046 INFO:tasks.workunit.client.1.smithi122.stdout:0/662: dwrite d1/d4b/d56/d81/fae [0,4194304] 0 2024-09-13T02:50:53.055 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:52 smithi100 ceph-mon[27894]: mgrmap e23: smithi122.ptcenr(active, since 3s) 2024-09-13T02:50:53.056 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:52 smithi100 ceph-mon[27894]: [13/Sep/2024:02:50:52] ENGINE Bus STARTING 2024-09-13T02:50:53.059 INFO:tasks.workunit.client.1.smithi122.stdout:7/570: sync 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:6/703: sync 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:3/685: sync 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:8/540: sync 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:8/541: fsync d3/da/d1f/f29 0 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:6/704: write d5/d11/d45/f81 [10244566,21539] 0 2024-09-13T02:50:53.060 INFO:tasks.workunit.client.1.smithi122.stdout:0/663: getdents d1/d4b/d56/dba 0 2024-09-13T02:50:53.062 INFO:tasks.workunit.client.1.smithi122.stdout:7/571: mknod d4/d4e/d5d/d6b/db4/cb8 0 2024-09-13T02:50:53.062 INFO:tasks.workunit.client.1.smithi122.stdout:3/686: creat d4/d11/dd/d21/d2b/d36/d3c/ffb x:0 0 0 2024-09-13T02:50:53.062 INFO:tasks.workunit.client.1.smithi122.stdout:6/705: symlink d5/d3d/d82/db1/ld3 0 2024-09-13T02:50:53.063 INFO:tasks.workunit.client.1.smithi122.stdout:3/687: creat d4/d11/dd/d21/d4e/df7/ffc x:0 0 0 2024-09-13T02:50:53.063 INFO:tasks.workunit.client.1.smithi122.stdout:3/688: dread - d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/ff3 zero size 2024-09-13T02:50:53.065 INFO:tasks.workunit.client.1.smithi122.stdout:8/542: dread d3/d31/f6e [0,4194304] 0 2024-09-13T02:50:53.066 INFO:tasks.workunit.client.1.smithi122.stdout:6/706: mkdir d5/d3d/d6c/d41/d4e/d93/dd4 0 2024-09-13T02:50:53.076 INFO:tasks.workunit.client.1.smithi122.stdout:7/572: write d4/d4e/d5d/d8a/db1/f9b [967936,18111] 0 2024-09-13T02:50:53.079 INFO:tasks.workunit.client.1.smithi122.stdout:8/543: dread d3/d53/d4d/f62 [0,4194304] 0 2024-09-13T02:50:53.085 INFO:tasks.workunit.client.1.smithi122.stdout:0/664: dwrite d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:53.085 INFO:tasks.workunit.client.1.smithi122.stdout:0/665: fdatasync d1/d5/d9/f20 0 2024-09-13T02:50:53.086 INFO:tasks.workunit.client.1.smithi122.stdout:0/666: dread d1/d5/d9/da/f2b [0,4194304] 0 2024-09-13T02:50:53.086 INFO:tasks.workunit.client.1.smithi122.stdout:0/667: chown d1/d5/d9/da/f9c 1 1 2024-09-13T02:50:53.087 INFO:tasks.workunit.client.1.smithi122.stdout:8/544: dread d3/d31/d52/d89/d8b/d5c/f8c [0,4194304] 0 2024-09-13T02:50:53.087 INFO:tasks.workunit.client.1.smithi122.stdout:8/545: fsync d3/d53/d34/f38 0 2024-09-13T02:50:53.087 INFO:tasks.workunit.client.1.smithi122.stdout:0/668: symlink d1/d5/d2d/ld5 0 2024-09-13T02:50:53.089 INFO:tasks.workunit.client.1.smithi122.stdout:3/689: dwrite d4/d11/dd/d21/f75 [4194304,4194304] 0 2024-09-13T02:50:53.089 INFO:tasks.workunit.client.1.smithi122.stdout:7/573: dread d4/d8/d24/f3e [0,4194304] 0 2024-09-13T02:50:53.089 INFO:tasks.workunit.client.1.smithi122.stdout:7/574: fdatasync d4/d8/db/dc/d46/d5a/f7f 0 2024-09-13T02:50:53.089 INFO:tasks.workunit.client.1.smithi122.stdout:8/546: symlink d3/la0 0 2024-09-13T02:50:53.089 INFO:tasks.workunit.client.1.smithi122.stdout:8/547: write d3/d53/d21/f5e [322519,24748] 0 2024-09-13T02:50:53.093 INFO:tasks.workunit.client.1.smithi122.stdout:3/690: link d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fd8 d4/ffd 0 2024-09-13T02:50:53.094 INFO:tasks.workunit.client.1.smithi122.stdout:7/575: rmdir d4/d4e/d5d/d6b/db4 39 2024-09-13T02:50:53.096 INFO:tasks.workunit.client.1.smithi122.stdout:8/548: mknod d3/d31/d52/d89/d8b/d5c/ca1 0 2024-09-13T02:50:53.098 INFO:tasks.workunit.client.1.smithi122.stdout:3/691: mkdir d4/d6/df/d15/d68/d90/dfe 0 2024-09-13T02:50:53.098 INFO:tasks.workunit.client.1.smithi122.stdout:3/692: readlink d4/d6/df/l49 0 2024-09-13T02:50:53.100 INFO:tasks.workunit.client.1.smithi122.stdout:7/576: creat d4/d4e/d5d/d8a/db1/da3/fb9 x:0 0 0 2024-09-13T02:50:53.110 INFO:tasks.workunit.client.1.smithi122.stdout:0/669: truncate d1/d5/d9/da/ff 3893757 0 2024-09-13T02:50:53.111 INFO:tasks.workunit.client.1.smithi122.stdout:0/670: chown d1/d5/d9/f6e 56 1 2024-09-13T02:50:53.112 INFO:tasks.workunit.client.1.smithi122.stdout:6/707: dwrite d5/d3d/d6c/d41/f47 [8388608,4194304] 0 2024-09-13T02:50:53.113 INFO:tasks.workunit.client.1.smithi122.stdout:0/671: symlink d1/d5/d9/da/d17/ld6 0 2024-09-13T02:50:53.114 INFO:tasks.workunit.client.1.smithi122.stdout:0/672: mkdir d1/d5/d10/d29/d32/d83/dd7 0 2024-09-13T02:50:53.118 INFO:tasks.workunit.client.1.smithi122.stdout:0/673: rename d1/d5/d10/d29/d32/d5f/c9a to d1/d5/d10/d29/d32/cd8 0 2024-09-13T02:50:53.118 INFO:tasks.workunit.client.1.smithi122.stdout:0/674: chown d1/d4b/d56/d60/faa 0 1 2024-09-13T02:50:53.118 INFO:tasks.workunit.client.1.smithi122.stdout:0/675: creat d1/d5/d9/da/d92/d94/fd9 x:0 0 0 2024-09-13T02:50:53.122 INFO:tasks.workunit.client.1.smithi122.stdout:0/676: getdents d1/d5/d10 0 2024-09-13T02:50:53.125 INFO:tasks.workunit.client.1.smithi122.stdout:0/677: rename d1/d5/d10/d29/f42 to d1/d4b/d56/d81/dc5/fda 0 2024-09-13T02:50:53.137 INFO:tasks.workunit.client.1.smithi122.stdout:3/693: dwrite d4/d6/df/f7b [0,4194304] 0 2024-09-13T02:50:53.138 INFO:tasks.workunit.client.1.smithi122.stdout:3/694: write d4/d11/dd/d21/d2b/d36/fea [963017,22413] 0 2024-09-13T02:50:53.138 INFO:tasks.workunit.client.1.smithi122.stdout:7/577: dwrite d4/d8/d3d/f97 [0,4194304] 0 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:8/549: dwrite d3/d53/d21/f69 [4194304,4194304] 0 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:0/678: dread d1/d5/d9/da/d92/d94/f1f [0,4194304] 0 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:0/679: write d1/d5/d9/da/d17/f1b [1751509,117906] 0 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:0/680: dread - d1/d5/fc7 zero size 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:0/681: write d1/d5/d10/f7b [4819268,100733] 0 2024-09-13T02:50:53.139 INFO:tasks.workunit.client.1.smithi122.stdout:6/708: dwrite d5/d11/d2f/f74 [0,4194304] 0 2024-09-13T02:50:53.140 INFO:tasks.workunit.client.1.smithi122.stdout:3/695: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dff 0 2024-09-13T02:50:53.143 INFO:tasks.workunit.client.1.smithi122.stdout:7/578: getdents d4/d6d/d8f 0 2024-09-13T02:50:53.143 INFO:tasks.workunit.client.1.smithi122.stdout:3/696: dread d4/d6/df/d15/fbd [0,4194304] 0 2024-09-13T02:50:53.156 INFO:tasks.workunit.client.1.smithi122.stdout:6/709: mknod d5/d3d/d6c/d41/d5b/cd5 0 2024-09-13T02:50:53.158 INFO:tasks.workunit.client.1.smithi122.stdout:7/579: mknod d4/d6d/da6/cba 0 2024-09-13T02:50:53.159 INFO:tasks.workunit.client.1.smithi122.stdout:3/697: mkdir d4/d11/dd/dca/d100 0 2024-09-13T02:50:53.159 INFO:tasks.workunit.client.1.smithi122.stdout:3/698: chown d4/d6/df/d15/d68/dd5 32034 1 2024-09-13T02:50:53.160 INFO:tasks.workunit.client.1.smithi122.stdout:3/699: write d4/d6/de/f18 [4608958,22109] 0 2024-09-13T02:50:53.161 INFO:tasks.workunit.client.1.smithi122.stdout:0/682: truncate d1/d5/d10/f7b 2720883 0 2024-09-13T02:50:53.161 INFO:tasks.workunit.client.1.smithi122.stdout:0/683: creat d1/d5/d9/fdb x:0 0 0 2024-09-13T02:50:53.163 INFO:tasks.workunit.client.1.smithi122.stdout:6/710: creat d5/db/d29/d60/fd6 x:0 0 0 2024-09-13T02:50:53.164 INFO:tasks.workunit.client.1.smithi122.stdout:7/580: rmdir d4/d6d/d8f 39 2024-09-13T02:50:53.165 INFO:tasks.workunit.client.1.smithi122.stdout:8/550: dwrite d3/d53/d34/f38 [0,4194304] 0 2024-09-13T02:50:53.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/700: rename d4/d6/de/f34 to d4/d11/dd/d21/d2b/d36/d3c/f101 0 2024-09-13T02:50:53.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/701: write d4/d11/dd/f1b [5049523,31027] 0 2024-09-13T02:50:53.171 INFO:tasks.workunit.client.1.smithi122.stdout:0/684: mkdir d1/d5/d2d/db4/ddc 0 2024-09-13T02:50:53.171 INFO:tasks.workunit.client.1.smithi122.stdout:0/685: read - d1/d5/d9/da/d7d/fab zero size 2024-09-13T02:50:53.171 INFO:tasks.workunit.client.1.smithi122.stdout:6/711: write d5/d11/f75 [556025,42580] 0 2024-09-13T02:50:53.173 INFO:tasks.workunit.client.1.smithi122.stdout:7/581: mkdir d4/d8/db/d63/dbb 0 2024-09-13T02:50:53.173 INFO:tasks.workunit.client.1.smithi122.stdout:7/582: fsync d4/d4e/d5d/f5e 0 2024-09-13T02:50:53.176 INFO:tasks.workunit.client.1.smithi122.stdout:8/551: truncate d3/d31/f61 603066 0 2024-09-13T02:50:53.176 INFO:tasks.workunit.client.1.smithi122.stdout:8/552: write d3/d31/d52/f5b [369922,55843] 0 2024-09-13T02:50:53.177 INFO:tasks.workunit.client.1.smithi122.stdout:0/686: link d1/d5/d10/d29/f36 d1/d5/d10/d29/d32/d83/dd7/fdd 0 2024-09-13T02:50:53.178 INFO:tasks.workunit.client.1.smithi122.stdout:6/712: mkdir d5/d3d/d48/dd7 0 2024-09-13T02:50:53.179 INFO:tasks.workunit.client.1.smithi122.stdout:7/583: creat d4/d8/d3d/d7e/fbc x:0 0 0 2024-09-13T02:50:53.179 INFO:tasks.workunit.client.1.smithi122.stdout:7/584: chown d4/d8/d24/c3f 90 1 2024-09-13T02:50:53.179 INFO:tasks.workunit.client.1.smithi122.stdout:7/585: fdatasync d4/d8/db/f38 0 2024-09-13T02:50:53.181 INFO:tasks.workunit.client.1.smithi122.stdout:7/586: link d4/f7d d4/d4e/d5d/fbd 0 2024-09-13T02:50:53.184 INFO:tasks.workunit.client.1.smithi122.stdout:7/587: mknod d4/d8/db/dc/d36/cbe 0 2024-09-13T02:50:53.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:52 smithi122 ceph-mon[34559]: mgrmap e23: smithi122.ptcenr(active, since 3s) 2024-09-13T02:50:53.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:52 smithi122 ceph-mon[34559]: [13/Sep/2024:02:50:52] ENGINE Bus STARTING 2024-09-13T02:50:53.193 INFO:tasks.workunit.client.1.smithi122.stdout:2/551: sync 2024-09-13T02:50:53.194 INFO:tasks.workunit.client.1.smithi122.stdout:2/552: truncate d0/d1e/d26/fa0 1308073 0 2024-09-13T02:50:53.199 INFO:tasks.workunit.client.1.smithi122.stdout:2/553: rename d0/d55/d70/d59/f88 to d0/d1c/fad 0 2024-09-13T02:50:53.199 INFO:tasks.workunit.client.1.smithi122.stdout:7/588: dread d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:53.201 INFO:tasks.workunit.client.1.smithi122.stdout:3/702: dwrite d4/d11/dd/f1b [0,4194304] 0 2024-09-13T02:50:53.201 INFO:tasks.workunit.client.1.smithi122.stdout:7/589: rename d4/d4e/d5d/d8a to d4/d6d/da6/dbf 0 2024-09-13T02:50:53.204 INFO:tasks.workunit.client.1.smithi122.stdout:3/703: link d4/d11/dd/fd9 d4/d6/f102 0 2024-09-13T02:50:53.204 INFO:tasks.workunit.client.1.smithi122.stdout:2/554: write d0/d5d/f91 [578375,31930] 0 2024-09-13T02:50:53.205 INFO:tasks.workunit.client.1.smithi122.stdout:7/590: creat d4/d8/d24/d82/fc0 x:0 0 0 2024-09-13T02:50:53.207 INFO:tasks.workunit.client.1.smithi122.stdout:3/704: mkdir d4/d6/df/d15/d68/dd5/d103 0 2024-09-13T02:50:53.207 INFO:tasks.workunit.client.1.smithi122.stdout:3/705: chown d4/d11/dd/d21/d2b/d55/l80 6314074 1 2024-09-13T02:50:53.209 INFO:tasks.workunit.client.1.smithi122.stdout:7/591: rename d4/d8/db/dc/d46/l7b to d4/d4e/d5d/d6b/db4/lc1 0 2024-09-13T02:50:53.210 INFO:tasks.workunit.client.1.smithi122.stdout:3/706: creat d4/d11/dd/d21/d2b/dcf/f104 x:0 0 0 2024-09-13T02:50:53.211 INFO:tasks.workunit.client.1.smithi122.stdout:3/707: write d4/d6/df/d15/d68/ffa [589565,86732] 0 2024-09-13T02:50:53.213 INFO:tasks.workunit.client.1.smithi122.stdout:7/592: mkdir d4/d8/d3d/dc2 0 2024-09-13T02:50:53.224 INFO:tasks.workunit.client.1.smithi122.stdout:7/593: dread d4/d8/db/dc/d1b/f34 [0,4194304] 0 2024-09-13T02:50:53.224 INFO:tasks.workunit.client.1.smithi122.stdout:7/594: truncate d4/f29 3798388 0 2024-09-13T02:50:53.226 INFO:tasks.workunit.client.1.smithi122.stdout:7/595: rename d4/d8/db/dc/d46/d5a to d4/d6d/d8c/dc3 0 2024-09-13T02:50:53.227 INFO:tasks.workunit.client.1.smithi122.stdout:7/596: creat d4/fc4 x:0 0 0 2024-09-13T02:50:53.227 INFO:tasks.workunit.client.1.smithi122.stdout:7/597: truncate d4/d8/db/dc/f22 2024615 0 2024-09-13T02:50:53.228 INFO:tasks.workunit.client.1.smithi122.stdout:7/598: getdents d4/d8/d24/d47 0 2024-09-13T02:50:53.231 INFO:tasks.workunit.client.1.smithi122.stdout:7/599: symlink d4/d8/db/dc/d46/lc5 0 2024-09-13T02:50:53.231 INFO:tasks.workunit.client.1.smithi122.stdout:7/600: read - d4/d8/db/d63/fb6 zero size 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:7/601: link d4/d6d/da6/cba d4/d6d/d8f/cc6 0 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:7/602: getdents d4/d8/db/dc/d1b/d49 0 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:7/603: chown d4/d4e/f73 137343249 1 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:2/555: dwrite d0/d1e/d22/d29/f7d [0,4194304] 0 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:3/708: dwrite d4/d11/dd/d21/d2b/dcf/f104 [0,4194304] 0 2024-09-13T02:50:53.233 INFO:tasks.workunit.client.1.smithi122.stdout:7/604: stat d4/d8/db/dc/d1b/l26 0 2024-09-13T02:50:53.234 INFO:tasks.workunit.client.1.smithi122.stdout:2/556: unlink d0/d1c/d3b/d41/d4e/f60 0 2024-09-13T02:50:53.237 INFO:tasks.workunit.client.1.smithi122.stdout:3/709: creat d4/d11/f105 x:0 0 0 2024-09-13T02:50:53.238 INFO:tasks.workunit.client.1.smithi122.stdout:7/605: rename d4/d8/db/dc/d1b/l30 to d4/d8/d3d/d7e/lc7 0 2024-09-13T02:50:53.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/557: symlink d0/d55/lae 0 2024-09-13T02:50:53.241 INFO:tasks.workunit.client.1.smithi122.stdout:3/710: rename d4/d11/dd/d21/d2b/d36/fea to d4/d11/dd/d21/d2b/dcf/f106 0 2024-09-13T02:50:53.242 INFO:tasks.workunit.client.1.smithi122.stdout:7/606: mkdir d4/d8/db/dc/d36/dc8 0 2024-09-13T02:50:53.245 INFO:tasks.workunit.client.1.smithi122.stdout:3/711: rename d4/d6/de/d41/fe6 to d4/d11/dd/d21/d2b/d36/f107 0 2024-09-13T02:50:53.245 INFO:tasks.workunit.client.1.smithi122.stdout:3/712: chown d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f 249930064 1 2024-09-13T02:50:53.245 INFO:tasks.workunit.client.1.smithi122.stdout:3/713: truncate d4/d4c/f51 1568710 0 2024-09-13T02:50:53.246 INFO:tasks.workunit.client.1.smithi122.stdout:7/607: symlink d4/d8/db/d63/dbb/lc9 0 2024-09-13T02:50:53.248 INFO:tasks.workunit.client.1.smithi122.stdout:7/608: dread d4/d8/db/f11 [0,4194304] 0 2024-09-13T02:50:53.266 INFO:tasks.workunit.client.1.smithi122.stdout:2/558: dwrite d0/d1c/d3b/d41/d6a/f57 [0,4194304] 0 2024-09-13T02:50:53.269 INFO:tasks.workunit.client.1.smithi122.stdout:3/714: dwrite d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f [0,4194304] 0 2024-09-13T02:50:53.271 INFO:tasks.workunit.client.1.smithi122.stdout:3/715: mkdir d4/d11/dd/d21/d108 0 2024-09-13T02:50:53.284 INFO:tasks.workunit.client.1.smithi122.stdout:3/716: dread d4/d11/dd/f65 [0,4194304] 0 2024-09-13T02:50:53.284 INFO:tasks.workunit.client.1.smithi122.stdout:2/559: dwrite d0/d1e/d2e/d5a/f94 [0,4194304] 0 2024-09-13T02:50:53.285 INFO:tasks.workunit.client.1.smithi122.stdout:3/717: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/d109 0 2024-09-13T02:50:53.285 INFO:tasks.workunit.client.1.smithi122.stdout:3/718: write d4/d4c/dd3/ff0 [753310,49304] 0 2024-09-13T02:50:53.286 INFO:tasks.workunit.client.1.smithi122.stdout:2/560: mkdir d0/d55/daf 0 2024-09-13T02:50:53.286 INFO:tasks.workunit.client.1.smithi122.stdout:2/561: fdatasync d0/d1c/d3b/d41/d4e/d75/d95/fa1 0 2024-09-13T02:50:53.286 INFO:tasks.workunit.client.1.smithi122.stdout:3/719: truncate d4/d11/dd/d21/d4e/dc8/fc9 3457187 0 2024-09-13T02:50:53.287 INFO:tasks.workunit.client.1.smithi122.stdout:2/562: mknod d0/d1e/d2e/d8a/d99/cb0 0 2024-09-13T02:50:53.288 INFO:tasks.workunit.client.1.smithi122.stdout:3/720: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/f10a x:0 0 0 2024-09-13T02:50:53.288 INFO:tasks.workunit.client.1.smithi122.stdout:3/721: stat d4/d11/dd/d21/d2b/d55/l80 0 2024-09-13T02:50:53.289 INFO:tasks.workunit.client.1.smithi122.stdout:2/563: creat d0/d1e/d26/d3d/fb1 x:0 0 0 2024-09-13T02:50:53.289 INFO:tasks.workunit.client.1.smithi122.stdout:2/564: write d0/d1c/d3b/d41/d4e/d75/d95/fac [986965,7835] 0 2024-09-13T02:50:53.290 INFO:tasks.workunit.client.1.smithi122.stdout:3/722: mknod d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/c10b 0 2024-09-13T02:50:53.290 INFO:tasks.workunit.client.1.smithi122.stdout:3/723: chown d4/d11/f2d 666049781 1 2024-09-13T02:50:53.293 INFO:tasks.workunit.client.1.smithi122.stdout:2/565: rename d0/d1c/d3b/d41/d4e/d90/la8 to d0/d1c/d3b/d41/d4e/d90/lb2 0 2024-09-13T02:50:53.293 INFO:tasks.workunit.client.1.smithi122.stdout:2/566: dread - d0/d55/f9d zero size 2024-09-13T02:50:53.293 INFO:tasks.workunit.client.1.smithi122.stdout:3/724: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9/l10c 0 2024-09-13T02:50:53.304 INFO:tasks.workunit.client.1.smithi122.stdout:3/725: dread d4/d6/f4a [0,4194304] 0 2024-09-13T02:50:53.305 INFO:tasks.workunit.client.1.smithi122.stdout:3/726: mkdir d4/d11/dd/d21/d4e/df7/d10d 0 2024-09-13T02:50:53.306 INFO:tasks.workunit.client.1.smithi122.stdout:3/727: mkdir d4/d4c/d10e 0 2024-09-13T02:50:53.307 INFO:tasks.workunit.client.1.smithi122.stdout:3/728: link d4/d11/d38/f70 d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f10f 0 2024-09-13T02:50:53.308 INFO:tasks.workunit.client.1.smithi122.stdout:2/567: dwrite d0/d1e/d22/f32 [0,4194304] 0 2024-09-13T02:50:53.309 INFO:tasks.workunit.client.1.smithi122.stdout:2/568: symlink d0/d1e/lb3 0 2024-09-13T02:50:53.309 INFO:tasks.workunit.client.1.smithi122.stdout:2/569: chown d0/d1e/d22/f47 347 1 2024-09-13T02:50:53.310 INFO:tasks.workunit.client.1.smithi122.stdout:2/570: dread - d0/d55/f9d zero size 2024-09-13T02:50:53.322 INFO:tasks.workunit.client.1.smithi122.stdout:2/571: dwrite d0/d1e/d26/fa0 [0,4194304] 0 2024-09-13T02:50:53.325 INFO:tasks.workunit.client.1.smithi122.stdout:2/572: creat d0/d1c/d3b/d41/fb4 x:0 0 0 2024-09-13T02:50:53.450 INFO:tasks.workunit.client.1.smithi122.stdout:1/659: sync 2024-09-13T02:50:53.451 INFO:tasks.workunit.client.1.smithi122.stdout:1/660: truncate dc/de/d18/d22/d1c/d57/dc6/fd3 363771 0 2024-09-13T02:50:53.451 INFO:tasks.workunit.client.1.smithi122.stdout:1/661: mknod dc/de/d18/d1d/d2f/d94/cd9 0 2024-09-13T02:50:53.453 INFO:tasks.workunit.client.1.smithi122.stdout:1/662: symlink dc/de/d18/d22/lda 0 2024-09-13T02:50:53.453 INFO:tasks.workunit.client.1.smithi122.stdout:1/663: creat dc/d38/db1/db2/fdb x:0 0 0 2024-09-13T02:50:53.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/740: sync 2024-09-13T02:50:53.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/741: fsync d11/d1b/d2e/f9f 0 2024-09-13T02:50:53.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/742: write d11/d1b/d2e/fc2 [688072,104561] 0 2024-09-13T02:50:53.460 INFO:tasks.workunit.client.1.smithi122.stdout:1/664: dread dc/de/d18/f66 [0,4194304] 0 2024-09-13T02:50:53.463 INFO:tasks.workunit.client.1.smithi122.stdout:1/665: rename dc/de/d18/d22/d1c/d47/l56 to dc/d38/db1/d72/dd7/d46/ldc 0 2024-09-13T02:50:53.463 INFO:tasks.workunit.client.1.smithi122.stdout:1/666: write dc/de/d18/d1d/f52 [2308214,36119] 0 2024-09-13T02:50:53.481 INFO:tasks.workunit.client.1.smithi122.stdout:4/743: dwrite d11/d30/d59/d6e/fb4 [0,4194304] 0 2024-09-13T02:50:53.481 INFO:tasks.workunit.client.1.smithi122.stdout:1/667: dwrite dc/de/d6e/fb6 [0,4194304] 0 2024-09-13T02:50:53.482 INFO:tasks.workunit.client.1.smithi122.stdout:1/668: read - dc/de/d18/d22/d1c/d47/fbb zero size 2024-09-13T02:50:53.483 INFO:tasks.workunit.client.1.smithi122.stdout:1/669: truncate dc/de/d18/d1d/d2f/f4b 2542915 0 2024-09-13T02:50:53.488 INFO:tasks.workunit.client.1.smithi122.stdout:4/744: dread d11/d13/d82/d2a/d40/f6d [0,4194304] 0 2024-09-13T02:50:53.489 INFO:tasks.workunit.client.1.smithi122.stdout:4/745: mkdir d11/d13/d82/d2a/ddf 0 2024-09-13T02:50:53.491 INFO:tasks.workunit.client.1.smithi122.stdout:4/746: link cc d11/d13/dc9/ce0 0 2024-09-13T02:50:53.491 INFO:tasks.workunit.client.1.smithi122.stdout:4/747: fdatasync d11/d13/d82/f48 0 2024-09-13T02:50:53.492 INFO:tasks.workunit.client.1.smithi122.stdout:4/748: symlink d11/d13/le1 0 2024-09-13T02:50:53.493 INFO:tasks.workunit.client.1.smithi122.stdout:4/749: creat d11/d13/d82/d2a/d78/d8e/fe2 x:0 0 0 2024-09-13T02:50:53.497 INFO:tasks.workunit.client.1.smithi122.stdout:1/670: dwrite dc/de/d18/d1d/f53 [0,4194304] 0 2024-09-13T02:50:53.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/750: rename d11/d13/d82/d2a/d78 to d11/d13/dc9/de3 0 2024-09-13T02:50:53.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/751: dread - d11/d1b/d2e/fb8 zero size 2024-09-13T02:50:53.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/752: mkdir d11/d30/d59/d6e/de4 0 2024-09-13T02:50:53.510 INFO:tasks.workunit.client.1.smithi122.stdout:4/753: dread d11/f43 [0,4194304] 0 2024-09-13T02:50:53.510 INFO:tasks.workunit.client.1.smithi122.stdout:4/754: stat d11/d13/dc9/ldb 0 2024-09-13T02:50:53.523 INFO:tasks.workunit.client.1.smithi122.stdout:1/671: dwrite dc/d38/f6a [0,4194304] 0 2024-09-13T02:50:53.531 INFO:tasks.workunit.client.1.smithi122.stdout:1/672: read dc/de/d18/d22/f55 [3673616,77922] 0 2024-09-13T02:50:53.531 INFO:tasks.workunit.client.1.smithi122.stdout:4/755: dwrite d11/d30/d59/d6e/fdd [0,4194304] 0 2024-09-13T02:50:53.532 INFO:tasks.workunit.client.1.smithi122.stdout:4/756: chown d11/d13/dc9/de3/d8e 44 1 2024-09-13T02:50:53.532 INFO:tasks.workunit.client.1.smithi122.stdout:4/757: write d11/d1b/d2e/fd3 [964823,33115] 0 2024-09-13T02:50:53.533 INFO:tasks.workunit.client.1.smithi122.stdout:1/673: link dc/d38/db1/d7d/f84 dc/de/d18/d22/d1c/d57/fdd 0 2024-09-13T02:50:53.533 INFO:tasks.workunit.client.1.smithi122.stdout:1/674: write dc/de/d18/d22/d1c/d47/fbb [635035,13040] 0 2024-09-13T02:50:53.534 INFO:tasks.workunit.client.1.smithi122.stdout:4/758: mkdir d11/d13/dc9/de3/d8e/dbd/de5 0 2024-09-13T02:50:53.534 INFO:tasks.workunit.client.1.smithi122.stdout:1/675: symlink dc/de/d18/d1d/lde 0 2024-09-13T02:50:53.535 INFO:tasks.workunit.client.1.smithi122.stdout:1/676: creat dc/de/d18/d22/d1c/d47/fdf x:0 0 0 2024-09-13T02:50:53.536 INFO:tasks.workunit.client.1.smithi122.stdout:1/677: symlink dc/de/d18/d86/le0 0 2024-09-13T02:50:53.538 INFO:tasks.workunit.client.1.smithi122.stdout:1/678: creat dc/de/d18/d86/da7/fe1 x:0 0 0 2024-09-13T02:50:53.551 INFO:tasks.workunit.client.1.smithi122.stdout:1/679: dread dc/de/d18/d22/f31 [0,4194304] 0 2024-09-13T02:50:53.556 INFO:tasks.workunit.client.1.smithi122.stdout:1/680: fsync dc/de/d18/d22/d1c/d47/fbb 0 2024-09-13T02:50:53.556 INFO:tasks.workunit.client.1.smithi122.stdout:1/681: dread - dc/d38/db1/d72/dd7/d46/f92 zero size 2024-09-13T02:50:53.556 INFO:tasks.workunit.client.1.smithi122.stdout:1/682: write dc/de/d18/d22/d1c/d57/dc6/fd3 [815274,94634] 0 2024-09-13T02:50:53.556 INFO:tasks.workunit.client.1.smithi122.stdout:1/683: fdatasync dc/de/d18/d22/d1c/d57/fdd 0 2024-09-13T02:50:53.556 INFO:tasks.workunit.client.1.smithi122.stdout:4/759: dwrite d11/d1b/d32/d87/f9c [0,4194304] 0 2024-09-13T02:50:53.578 INFO:tasks.workunit.client.1.smithi122.stdout:4/760: dwrite d11/d62/f89 [0,4194304] 0 2024-09-13T02:50:53.579 INFO:tasks.workunit.client.1.smithi122.stdout:4/761: mknod d11/d1b/d32/d98/ce6 0 2024-09-13T02:50:53.582 INFO:tasks.workunit.client.1.smithi122.stdout:4/762: read d11/d13/d82/d2a/fba [273325,37756] 0 2024-09-13T02:50:53.583 INFO:tasks.workunit.client.1.smithi122.stdout:4/763: symlink d11/d30/d59/d8f/da2/dc8/le7 0 2024-09-13T02:50:53.584 INFO:tasks.workunit.client.1.smithi122.stdout:4/764: mkdir d11/d30/d59/de8 0 2024-09-13T02:50:53.584 INFO:tasks.workunit.client.1.smithi122.stdout:4/765: write d11/d13/dc9/de3/d8e/fe2 [778298,16398] 0 2024-09-13T02:50:53.585 INFO:tasks.workunit.client.1.smithi122.stdout:4/766: creat d11/d30/d59/d8f/da2/fe9 x:0 0 0 2024-09-13T02:50:53.585 INFO:tasks.workunit.client.1.smithi122.stdout:4/767: truncate d11/d1b/f96 901577 0 2024-09-13T02:50:53.585 INFO:tasks.workunit.client.1.smithi122.stdout:4/768: chown cb 552 1 2024-09-13T02:50:53.586 INFO:tasks.workunit.client.1.smithi122.stdout:4/769: creat d11/d13/d82/d2a/fea x:0 0 0 2024-09-13T02:50:53.586 INFO:tasks.workunit.client.1.smithi122.stdout:4/770: fdatasync d11/d1b/d2e/fb8 0 2024-09-13T02:50:53.586 INFO:tasks.workunit.client.1.smithi122.stdout:4/771: mknod d11/d13/dc9/de3/d8e/dbd/ceb 0 2024-09-13T02:50:53.587 INFO:tasks.workunit.client.1.smithi122.stdout:4/772: rename d11/d13/d82/c75 to d11/d13/d82/d2a/cec 0 2024-09-13T02:50:53.596 INFO:tasks.workunit.client.1.smithi122.stdout:4/773: dread d11/d13/d82/d2a/f2b [0,4194304] 0 2024-09-13T02:50:53.596 INFO:tasks.workunit.client.1.smithi122.stdout:4/774: readlink d11/l7a 0 2024-09-13T02:50:53.604 INFO:tasks.workunit.client.1.smithi122.stdout:4/775: dread d11/d1b/d2e/f5d [0,4194304] 0 2024-09-13T02:50:53.623 INFO:tasks.workunit.client.1.smithi122.stdout:4/776: dwrite d11/d1b/d2e/fb8 [0,4194304] 0 2024-09-13T02:50:53.624 INFO:tasks.workunit.client.1.smithi122.stdout:4/777: creat d11/d30/d59/d6e/fed x:0 0 0 2024-09-13T02:50:53.640 INFO:tasks.workunit.client.1.smithi122.stdout:4/778: dwrite d11/d13/d82/d2a/d40/f5a [0,4194304] 0 2024-09-13T02:50:53.641 INFO:tasks.workunit.client.1.smithi122.stdout:4/779: readlink d11/d13/dc9/de3/d8e/dbd/lc1 0 2024-09-13T02:50:53.660 INFO:tasks.workunit.client.1.smithi122.stdout:4/780: dwrite d11/f80 [0,4194304] 0 2024-09-13T02:50:53.662 INFO:tasks.workunit.client.1.smithi122.stdout:4/781: creat d11/d30/d59/de8/fee x:0 0 0 2024-09-13T02:50:53.662 INFO:tasks.workunit.client.1.smithi122.stdout:4/782: chown d11/d30/ca5 72 1 2024-09-13T02:50:53.662 INFO:tasks.workunit.client.1.smithi122.stdout:4/783: chown d11/d13/d82/d2a/l52 54066823 1 2024-09-13T02:50:53.662 INFO:tasks.workunit.client.1.smithi122.stdout:4/784: write d11/d30/fbb [517881,55306] 0 2024-09-13T02:50:53.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/785: dread d11/d1b/f45 [0,4194304] 0 2024-09-13T02:50:53.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/786: write d11/f3e [201975,14230] 0 2024-09-13T02:50:53.668 INFO:tasks.workunit.client.1.smithi122.stdout:4/787: write d11/d13/d82/d2a/fea [966501,128923] 0 2024-09-13T02:50:53.669 INFO:tasks.workunit.client.1.smithi122.stdout:4/788: chown d11/d30/fbb 30969 1 2024-09-13T02:50:53.669 INFO:tasks.workunit.client.1.smithi122.stdout:4/789: mknod d11/d13/d82/d2a/ddf/cef 0 2024-09-13T02:50:53.669 INFO:tasks.workunit.client.1.smithi122.stdout:4/790: write d11/d13/d82/d2a/fba [928669,8218] 0 2024-09-13T02:50:53.670 INFO:tasks.workunit.client.1.smithi122.stdout:4/791: dread d11/d1b/f96 [0,4194304] 0 2024-09-13T02:50:53.671 INFO:tasks.workunit.client.1.smithi122.stdout:4/792: rename d11/d30/fbb to d11/d13/d82/d2a/ff0 0 2024-09-13T02:50:53.673 INFO:tasks.workunit.client.1.smithi122.stdout:4/793: dread d11/d1b/d2e/fce [0,4194304] 0 2024-09-13T02:50:53.673 INFO:tasks.workunit.client.1.smithi122.stdout:4/794: write d11/d13/d82/d2a/d83/fae [4863510,84546] 0 2024-09-13T02:50:53.695 INFO:tasks.workunit.client.1.smithi122.stdout:4/795: dwrite d11/d13/d82/d2a/f2b [0,4194304] 0 2024-09-13T02:50:53.695 INFO:tasks.workunit.client.1.smithi122.stdout:4/796: write d11/d13/d82/d2a/d40/f5a [4574905,60497] 0 2024-09-13T02:50:53.696 INFO:tasks.workunit.client.1.smithi122.stdout:4/797: mkdir d11/d13/dd8/df1 0 2024-09-13T02:50:53.696 INFO:tasks.workunit.client.1.smithi122.stdout:4/798: symlink d11/d3d/lf2 0 2024-09-13T02:50:53.697 INFO:tasks.workunit.client.1.smithi122.stdout:4/799: dread d11/d1b/d2e/f34 [0,4194304] 0 2024-09-13T02:50:53.697 INFO:tasks.workunit.client.1.smithi122.stdout:4/800: write d11/d62/faa [241346,114688] 0 2024-09-13T02:50:53.698 INFO:tasks.workunit.client.1.smithi122.stdout:4/801: chown d11/d13/d82/d2a/d40/f51 0 1 2024-09-13T02:50:53.698 INFO:tasks.workunit.client.1.smithi122.stdout:4/802: getdents d11/d13 0 2024-09-13T02:50:53.707 INFO:tasks.workunit.client.1.smithi122.stdout:4/803: write d11/d30/d59/d6e/fdd [1131249,124892] 0 2024-09-13T02:50:53.707 INFO:tasks.workunit.client.1.smithi122.stdout:4/804: readlink d11/d13/d82/d2a/d40/lc6 0 2024-09-13T02:50:53.718 INFO:tasks.workunit.client.1.smithi122.stdout:5/591: sync 2024-09-13T02:50:53.718 INFO:tasks.workunit.client.1.smithi122.stdout:5/592: truncate d0/da/d8c/d8f/fbb 1273732 0 2024-09-13T02:50:53.727 INFO:tasks.workunit.client.1.smithi122.stdout:5/593: write d0/f84 [2597309,9342] 0 2024-09-13T02:50:53.730 INFO:tasks.workunit.client.1.smithi122.stdout:5/594: creat d0/da/d48/db4/fbe x:0 0 0 2024-09-13T02:50:53.731 INFO:tasks.workunit.client.1.smithi122.stdout:5/595: mkdir d0/da/dbf 0 2024-09-13T02:50:53.732 INFO:tasks.workunit.client.1.smithi122.stdout:5/596: symlink d0/da/d8c/lc0 0 2024-09-13T02:50:53.734 INFO:tasks.workunit.client.1.smithi122.stdout:5/597: creat d0/d17/d36/d3f/d4c/d7f/fc1 x:0 0 0 2024-09-13T02:50:53.735 INFO:tasks.workunit.client.1.smithi122.stdout:5/598: symlink d0/da/d48/d63/d98/lc2 0 2024-09-13T02:50:53.745 INFO:tasks.workunit.client.1.smithi122.stdout:5/599: dread d0/d2/d33/f5e [0,4194304] 0 2024-09-13T02:50:53.745 INFO:tasks.workunit.client.1.smithi122.stdout:5/600: chown d0/d17/fa4 1209794 1 2024-09-13T02:50:53.745 INFO:tasks.workunit.client.1.smithi122.stdout:5/601: fsync d0/d1d/f93 0 2024-09-13T02:50:53.745 INFO:tasks.workunit.client.1.smithi122.stdout:5/602: write d0/da/f23 [1439095,120597] 0 2024-09-13T02:50:53.745 INFO:tasks.workunit.client.1.smithi122.stdout:5/603: chown d0/d17/d36/d25/l57 129937 1 2024-09-13T02:50:53.747 INFO:tasks.workunit.client.1.smithi122.stdout:5/604: link d0/da/d8c/lc0 d0/d17/d36/d25/d2b/lc3 0 2024-09-13T02:50:53.747 INFO:tasks.workunit.client.1.smithi122.stdout:5/605: write d0/d17/d36/d25/fa9 [832902,10681] 0 2024-09-13T02:50:53.747 INFO:tasks.workunit.client.1.smithi122.stdout:5/606: read d0/d2/f13 [2631881,9998] 0 2024-09-13T02:50:53.843 INFO:tasks.workunit.client.1.smithi122.stdout:9/671: sync 2024-09-13T02:50:53.844 INFO:tasks.workunit.client.1.smithi122.stdout:9/672: getdents d8/d16/d3d/d59/d7d/d83 0 2024-09-13T02:50:53.844 INFO:tasks.workunit.client.1.smithi122.stdout:9/673: symlink d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe/lcf 0 2024-09-13T02:50:53.846 INFO:tasks.workunit.client.1.smithi122.stdout:9/674: mknod d8/d88/cd0 0 2024-09-13T02:50:53.967 INFO:tasks.workunit.client.1.smithi122.stdout:8/553: sync 2024-09-13T02:50:53.968 INFO:tasks.workunit.client.1.smithi122.stdout:8/554: mknod d3/d53/d34/d94/ca2 0 2024-09-13T02:50:53.974 INFO:tasks.workunit.client.1.smithi122.stdout:8/555: dread d3/d53/f41 [4194304,4194304] 0 2024-09-13T02:50:53.974 INFO:tasks.workunit.client.1.smithi122.stdout:8/556: dread - d3/da/d1f/f9c zero size 2024-09-13T02:50:53.975 INFO:tasks.workunit.client.1.smithi122.stdout:8/557: rmdir d3/d31 39 2024-09-13T02:50:53.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/558: mknod d3/da/d91/ca3 0 2024-09-13T02:50:53.978 INFO:tasks.workunit.client.1.smithi122.stdout:8/559: symlink d3/d53/d4d/d6d/d76/la4 0 2024-09-13T02:50:53.978 INFO:tasks.workunit.client.1.smithi122.stdout:8/560: symlink d3/da/la5 0 2024-09-13T02:50:53.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/561: write d3/d53/d34/f48 [334576,84216] 0 2024-09-13T02:50:53.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/562: readlink d3/l32 0 2024-09-13T02:50:53.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/563: rmdir d3/d53/d4d 39 2024-09-13T02:50:53.979 INFO:tasks.workunit.client.1.smithi122.stdout:8/564: mkdir d3/da6 0 2024-09-13T02:50:53.999 INFO:tasks.workunit.client.1.smithi122.stdout:8/565: dwrite d3/da/d1f/f7f [0,4194304] 0 2024-09-13T02:50:53.999 INFO:tasks.workunit.client.1.smithi122.stdout:8/566: chown d3/da/d1e/c23 429110 1 2024-09-13T02:50:54.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/567: rmdir d3/d31/d9d 0 2024-09-13T02:50:54.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/568: mknod d3/d31/d52/ca7 0 2024-09-13T02:50:54.004 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:53 smithi100 ceph-mon[27894]: [13/Sep/2024:02:50:52] ENGINE Serving on http://172.21.15.122:8765 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:53 smithi100 ceph-mon[27894]: [13/Sep/2024:02:50:52] ENGINE Serving on https://172.21.15.122:7150 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:53 smithi100 ceph-mon[27894]: [13/Sep/2024:02:50:52] ENGINE Bus STARTED 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:53 smithi100 ceph-mon[27894]: [13/Sep/2024:02:50:52] ENGINE Error in HTTPServer.serve 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:50:54.005 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:50:54.006 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:50:54.008 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:50:54.008 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:53 smithi100 ceph-mon[27894]: pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/569: dread d3/d53/d21/f69 [0,4194304] 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/570: link d3/d53/d21/f33 d3/d31/d52/fa8 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/571: symlink d3/d53/la9 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/572: creat d3/d31/d52/d89/d8b/faa x:0 0 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/573: readlink d3/d31/d52/d89/d8b/d5c/l6f 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/574: symlink d3/da/d7d/lab 0 2024-09-13T02:50:54.009 INFO:tasks.workunit.client.1.smithi122.stdout:8/575: chown d3/da/c8d 71192488 1 2024-09-13T02:50:54.011 INFO:tasks.workunit.client.1.smithi122.stdout:8/576: dread d3/da/d1e/f8f [0,4194304] 0 2024-09-13T02:50:54.014 INFO:tasks.workunit.client.1.smithi122.stdout:8/577: write d3/d31/d65/f54 [1956354,48044] 0 2024-09-13T02:50:54.014 INFO:tasks.workunit.client.1.smithi122.stdout:8/578: write d3/da/d1e/f8f [1022380,41431] 0 2024-09-13T02:50:54.016 INFO:tasks.workunit.client.1.smithi122.stdout:8/579: symlink d3/d53/lac 0 2024-09-13T02:50:54.020 INFO:tasks.workunit.client.1.smithi122.stdout:8/580: truncate d3/da/d1e/f8f 289581 0 2024-09-13T02:50:54.148 INFO:tasks.workunit.client.1.smithi122.stdout:0/687: sync 2024-09-13T02:50:54.151 INFO:tasks.workunit.client.1.smithi122.stdout:0/688: link d1/d5/d10/d29/f36 d1/d4b/fde 0 2024-09-13T02:50:54.153 INFO:tasks.workunit.client.1.smithi122.stdout:0/689: link d1/d5/d9/da/d7d/fb6 d1/d5/d9/da/d92/d94/fdf 0 2024-09-13T02:50:54.154 INFO:tasks.workunit.client.1.smithi122.stdout:0/690: creat d1/d5/d2d/fe0 x:0 0 0 2024-09-13T02:50:54.164 INFO:tasks.workunit.client.1.smithi122.stdout:0/691: dread d1/d5/d9/da/d92/d94/fdf [0,4194304] 0 2024-09-13T02:50:54.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/692: write d1/d5/d9/da/f75 [3070697,106564] 0 2024-09-13T02:50:54.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/693: write d1/d4b/f7c [641143,9103] 0 2024-09-13T02:50:54.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/694: chown d1/d5/l21 886 1 2024-09-13T02:50:54.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:53 smithi122 ceph-mon[34559]: [13/Sep/2024:02:50:52] ENGINE Serving on http://172.21.15.122:8765 2024-09-13T02:50:54.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:53 smithi122 ceph-mon[34559]: [13/Sep/2024:02:50:52] ENGINE Serving on https://172.21.15.122:7150 2024-09-13T02:50:54.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:53 smithi122 ceph-mon[34559]: [13/Sep/2024:02:50:52] ENGINE Bus STARTED 2024-09-13T02:50:54.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:53 smithi122 ceph-mon[34559]: [13/Sep/2024:02:50:52] ENGINE Error in HTTPServer.serve 2024-09-13T02:50:54.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Traceback (most recent call last): 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._run(expiration_interval) 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s = self.context.wrap_socket( 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:50:54.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: return self.sslsocket_class._create( 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self.do_handshake() 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._sslobj.do_handshake() 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:50:54.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:53 smithi122 ceph-mon[34559]: pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:54.189 INFO:tasks.workunit.client.1.smithi122.stdout:0/695: write d1/d4b/d56/d60/fb1 [3665473,49242] 0 2024-09-13T02:50:54.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/713: sync 2024-09-13T02:50:54.195 INFO:tasks.workunit.client.1.smithi122.stdout:1/684: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:5/607: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:7/609: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:2/573: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:5/608: creat d0/d17/d36/d3f/d4c/d7f/fc4 x:0 0 0 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:5/609: fsync d0/d17/d36/d25/f74 0 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:5/610: creat d0/da/d48/fc5 x:0 0 0 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:8/581: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:8/582: chown d3/d31/d52/d89/d8b 720 1 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:3/729: sync 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:3/730: readlink d4/d11/l1d 0 2024-09-13T02:50:54.196 INFO:tasks.workunit.client.1.smithi122.stdout:9/675: sync 2024-09-13T02:50:54.197 INFO:tasks.workunit.client.1.smithi122.stdout:4/805: sync 2024-09-13T02:50:54.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/696: dread d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:8/583: read d3/d31/f61 [261743,55809] 0 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:8/584: fsync d3/d53/d4d/f6b 0 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:9/676: read d8/d16/d3d/d59/d29/f38 [4892616,30916] 0 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:9/677: truncate d8/d16/d3d/d59/d23/d1f/d36/fa8 1851323 0 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:9/678: chown d8/d88/c6f 8991 1 2024-09-13T02:50:54.199 INFO:tasks.workunit.client.1.smithi122.stdout:1/685: symlink dc/d38/db1/d72/dd7/d46/le2 0 2024-09-13T02:50:54.202 INFO:tasks.workunit.client.1.smithi122.stdout:6/714: symlink d5/d3d/da3/ld8 0 2024-09-13T02:50:54.204 INFO:tasks.workunit.client.1.smithi122.stdout:5/611: symlink d0/d17/d36/d99/lc6 0 2024-09-13T02:50:54.206 INFO:tasks.workunit.client.1.smithi122.stdout:3/731: rmdir d4/d11/dd/d21/d108 0 2024-09-13T02:50:54.206 INFO:tasks.workunit.client.1.smithi122.stdout:3/732: readlink d4/d11/dd/d21/d2b/d36/d3c/l4b 0 2024-09-13T02:50:54.206 INFO:tasks.workunit.client.1.smithi122.stdout:3/733: write d4/d11/dd/d21/f96 [1024175,27663] 0 2024-09-13T02:50:54.206 INFO:tasks.workunit.client.1.smithi122.stdout:3/734: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f110 x:0 0 0 2024-09-13T02:50:54.207 INFO:tasks.workunit.client.1.smithi122.stdout:0/697: symlink d1/d5/d10/d29/d32/le1 0 2024-09-13T02:50:54.209 INFO:tasks.workunit.client.1.smithi122.stdout:2/574: dread d0/fc [0,4194304] 0 2024-09-13T02:50:54.209 INFO:tasks.workunit.client.1.smithi122.stdout:2/575: write d0/d1c/fad [1680,60683] 0 2024-09-13T02:50:54.212 INFO:tasks.workunit.client.1.smithi122.stdout:8/585: mkdir d3/d53/d34/d94/dad 0 2024-09-13T02:50:54.212 INFO:tasks.workunit.client.1.smithi122.stdout:9/679: mkdir d8/d16/d3d/d59/d29/d90/db7/dd1 0 2024-09-13T02:50:54.212 INFO:tasks.workunit.client.1.smithi122.stdout:9/680: creat d8/d88/fd2 x:0 0 0 2024-09-13T02:50:54.212 INFO:tasks.workunit.client.1.smithi122.stdout:9/681: fsync d8/d16/d3e/f6b 0 2024-09-13T02:50:54.213 INFO:tasks.workunit.client.1.smithi122.stdout:3/735: dread d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f91 [0,4194304] 0 2024-09-13T02:50:54.213 INFO:tasks.workunit.client.1.smithi122.stdout:1/686: mkdir dc/d38/d51/daf/de3 0 2024-09-13T02:50:54.213 INFO:tasks.workunit.client.1.smithi122.stdout:1/687: readlink dc/de/d18/d1d/l6b 0 2024-09-13T02:50:54.214 INFO:tasks.workunit.client.1.smithi122.stdout:5/612: symlink d0/d17/d36/lc7 0 2024-09-13T02:50:54.218 INFO:tasks.workunit.client.1.smithi122.stdout:4/806: getdents d11/d62 0 2024-09-13T02:50:54.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/698: symlink d1/d5/d9/da/d7d/d95/le2 0 2024-09-13T02:50:54.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/699: write d1/d4b/d56/d81/fc2 [806463,130630] 0 2024-09-13T02:50:54.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/700: read d1/d4b/d56/d60/fb1 [4116579,64178] 0 2024-09-13T02:50:54.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/701: dread - d1/d5/d9/da/d92/d94/fa9 zero size 2024-09-13T02:50:54.220 INFO:tasks.workunit.client.1.smithi122.stdout:8/586: symlink d3/d53/d4d/lae 0 2024-09-13T02:50:54.222 INFO:tasks.workunit.client.1.smithi122.stdout:9/682: creat d8/d16/d3d/d59/d23/d7b/fd3 x:0 0 0 2024-09-13T02:50:54.222 INFO:tasks.workunit.client.1.smithi122.stdout:9/683: dread - d8/d88/d65/fc7 zero size 2024-09-13T02:50:54.222 INFO:tasks.workunit.client.1.smithi122.stdout:9/684: dread - d8/d16/d3d/d59/d23/d1f/f87 zero size 2024-09-13T02:50:54.222 INFO:tasks.workunit.client.1.smithi122.stdout:9/685: chown d8/d16/d3d/d59/d7d 13 1 2024-09-13T02:50:54.223 INFO:tasks.workunit.client.1.smithi122.stdout:3/736: mknod d4/d6/df/d15/c111 0 2024-09-13T02:50:54.224 INFO:tasks.workunit.client.1.smithi122.stdout:1/688: mkdir dc/de/d18/de4 0 2024-09-13T02:50:54.224 INFO:tasks.workunit.client.1.smithi122.stdout:1/689: stat dc/de/d18/d22/l9f 0 2024-09-13T02:50:54.224 INFO:tasks.workunit.client.1.smithi122.stdout:1/690: write dc/de/f27 [1338312,31878] 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:5/613: mkdir d0/da/d48/db4/dc8 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:5/614: stat d0/c88 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:5/615: chown d0/da/d90/f9b 2114 1 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:5/616: readlink d0/da/l2f 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:7/610: dwrite d4/d6d/da6/dbf/db1/f87 [0,4194304] 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:7/611: fdatasync d4/d4e/d5d/d6b/f78 0 2024-09-13T02:50:54.225 INFO:tasks.workunit.client.1.smithi122.stdout:6/715: dwrite d5/db/f1b [4194304,4194304] 0 2024-09-13T02:50:54.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/807: symlink d11/d30/d59/d6e/de4/lf3 0 2024-09-13T02:50:54.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/808: chown d11/d13/d82/f16 11116 1 2024-09-13T02:50:54.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/809: readlink d11/d13/d82/d2a/d40/lb5 0 2024-09-13T02:50:54.226 INFO:tasks.workunit.client.1.smithi122.stdout:4/810: chown le 0 1 2024-09-13T02:50:54.229 INFO:tasks.workunit.client.1.smithi122.stdout:9/686: creat d8/d16/d3d/d59/d23/d1f/d36/fd4 x:0 0 0 2024-09-13T02:50:54.232 INFO:tasks.workunit.client.1.smithi122.stdout:3/737: rename d4/d4c/dd3/ff0 to d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f112 0 2024-09-13T02:50:54.233 INFO:tasks.workunit.client.1.smithi122.stdout:3/738: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f113 x:0 0 0 2024-09-13T02:50:54.233 INFO:tasks.workunit.client.1.smithi122.stdout:1/691: mknod dc/de/d18/d1d/ce5 0 2024-09-13T02:50:54.235 INFO:tasks.workunit.client.1.smithi122.stdout:8/587: dwrite d3/d53/d34/f48 [0,4194304] 0 2024-09-13T02:50:54.235 INFO:tasks.workunit.client.1.smithi122.stdout:6/716: mknod d5/cd9 0 2024-09-13T02:50:54.237 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:50:54.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T02:50:54.238 INFO:tasks.workunit.client.1.smithi122.stdout:4/811: link d11/c12 d11/d13/d82/cf4 0 2024-09-13T02:50:54.238 INFO:tasks.workunit.client.1.smithi122.stdout:0/702: symlink d1/d5/le3 0 2024-09-13T02:50:54.238 INFO:tasks.workunit.client.1.smithi122.stdout:9/687: symlink d8/d4a/d64/ld5 0 2024-09-13T02:50:54.241 INFO:tasks.workunit.client.1.smithi122.stdout:3/739: rename d4/d11/da9/ld0 to d4/d11/d38/l114 0 2024-09-13T02:50:54.242 INFO:tasks.workunit.client.1.smithi122.stdout:1/692: symlink dc/le6 0 2024-09-13T02:50:54.244 INFO:tasks.workunit.client.1.smithi122.stdout:6/717: dread d5/d11/d45/f78 [0,4194304] 0 2024-09-13T02:50:54.249 INFO:tasks.workunit.client.1.smithi122.stdout:9/688: creat d8/d16/d3e/fd6 x:0 0 0 2024-09-13T02:50:54.250 INFO:tasks.workunit.client.1.smithi122.stdout:8/588: rename d3/da/c6 to d3/d53/d34/d94/caf 0 2024-09-13T02:50:54.251 INFO:tasks.workunit.client.1.smithi122.stdout:7/612: dwrite d4/d6d/da6/dbf/db1/f87 [0,4194304] 0 2024-09-13T02:50:54.252 INFO:tasks.workunit.client.1.smithi122.stdout:1/693: link l7 dc/de/d18/d22/d1c/d57/dc6/le7 0 2024-09-13T02:50:54.253 INFO:tasks.workunit.client.1.smithi122.stdout:1/694: write dc/d38/db1/d72/dd7/d46/f70 [2297645,35973] 0 2024-09-13T02:50:54.253 INFO:tasks.workunit.client.1.smithi122.stdout:1/695: creat dc/de/d18/d1d/d2f/fe8 x:0 0 0 2024-09-13T02:50:54.254 INFO:tasks.workunit.client.1.smithi122.stdout:0/703: rmdir d1/d5/d9/da/d17 39 2024-09-13T02:50:54.256 INFO:tasks.workunit.client.1.smithi122.stdout:9/689: rename d8/d16/d3d/d59/d23/d1f/f87 to d8/d16/d3d/d59/d7d/d83/fd7 0 2024-09-13T02:50:54.256 INFO:tasks.workunit.client.1.smithi122.stdout:9/690: stat d8/d16/d3d/d59 0 2024-09-13T02:50:54.257 INFO:tasks.workunit.client.1.smithi122.stdout:8/589: symlink d3/d31/d52/d89/lb0 0 2024-09-13T02:50:54.258 INFO:tasks.workunit.client.1.smithi122.stdout:8/590: readlink d3/d53/d4d/lae 0 2024-09-13T02:50:54.259 INFO:tasks.workunit.client.1.smithi122.stdout:3/740: link d4/d6/de/d1f/cce d4/d6/de/c115 0 2024-09-13T02:50:54.261 INFO:tasks.workunit.client.1.smithi122.stdout:7/613: mkdir d4/d8/d3d/dc2/dca 0 2024-09-13T02:50:54.263 INFO:tasks.workunit.client.1.smithi122.stdout:6/718: dwrite d5/db/dc/f96 [0,4194304] 0 2024-09-13T02:50:54.264 INFO:tasks.workunit.client.1.smithi122.stdout:4/812: dwrite d11/d1b/d32/f73 [0,4194304] 0 2024-09-13T02:50:54.265 INFO:tasks.workunit.client.1.smithi122.stdout:1/696: creat dc/d38/db1/d72/fe9 x:0 0 0 2024-09-13T02:50:54.265 INFO:tasks.workunit.client.1.smithi122.stdout:1/697: fsync dc/de/d18/d1d/fc8 0 2024-09-13T02:50:54.265 INFO:tasks.workunit.client.1.smithi122.stdout:7/614: dread d4/d8/db/f42 [0,4194304] 0 2024-09-13T02:50:54.266 INFO:tasks.workunit.client.1.smithi122.stdout:7/615: stat d4/d8/db/dc/d1b/f57 0 2024-09-13T02:50:54.266 INFO:tasks.workunit.client.1.smithi122.stdout:0/704: unlink d1/d4b/d56/d81/fc2 0 2024-09-13T02:50:54.267 INFO:tasks.workunit.client.1.smithi122.stdout:8/591: mkdir d3/d31/d52/d89/db1 0 2024-09-13T02:50:54.268 INFO:tasks.workunit.client.1.smithi122.stdout:4/813: dread d11/d30/f8b [0,4194304] 0 2024-09-13T02:50:54.270 INFO:tasks.workunit.client.1.smithi122.stdout:7/616: mkdir d4/d8/d24/d82/dcb 0 2024-09-13T02:50:54.270 INFO:tasks.workunit.client.1.smithi122.stdout:7/617: write d4/fc4 [335690,81672] 0 2024-09-13T02:50:54.270 INFO:tasks.workunit.client.1.smithi122.stdout:8/592: symlink d3/d53/d4d/d6d/d76/lb2 0 2024-09-13T02:50:54.272 INFO:tasks.workunit.client.1.smithi122.stdout:6/719: link d5/d11/c23 d5/d3d/d6c/d41/d4e/d93/dd4/cda 0 2024-09-13T02:50:54.272 INFO:tasks.workunit.client.1.smithi122.stdout:6/720: readlink d5/db/d29/d60/dac/dc6/d46/l50 0 2024-09-13T02:50:54.272 INFO:tasks.workunit.client.1.smithi122.stdout:6/721: chown d5/d3d/d6c/d41/d4e 0 1 2024-09-13T02:50:54.273 INFO:tasks.workunit.client.1.smithi122.stdout:6/722: dread d5/d11/d45/d21/f87 [0,4194304] 0 2024-09-13T02:50:54.274 INFO:tasks.workunit.client.1.smithi122.stdout:4/814: unlink d11/d1b/d32/d98/ce6 0 2024-09-13T02:50:54.275 INFO:tasks.workunit.client.1.smithi122.stdout:7/618: creat d4/d8/d24/daa/fcc x:0 0 0 2024-09-13T02:50:54.278 INFO:tasks.workunit.client.1.smithi122.stdout:6/723: rename d5/d11/d2f/f4d to d5/d3d/d82/fdb 0 2024-09-13T02:50:54.278 INFO:tasks.workunit.client.1.smithi122.stdout:7/619: mkdir d4/d8/d3d/dcd 0 2024-09-13T02:50:54.280 INFO:tasks.workunit.client.1.smithi122.stdout:1/698: read dc/de/d18/d1d/f34 [910665,86842] 0 2024-09-13T02:50:54.280 INFO:tasks.workunit.client.1.smithi122.stdout:1/699: stat dc/d38/db1/d72/dd7/d3f/f7f 0 2024-09-13T02:50:54.280 INFO:tasks.workunit.client.1.smithi122.stdout:7/620: symlink d4/d6d/d8f/lce 0 2024-09-13T02:50:54.280 INFO:tasks.workunit.client.1.smithi122.stdout:7/621: chown d4 410565 1 2024-09-13T02:50:54.280 INFO:tasks.workunit.client.1.smithi122.stdout:7/622: fsync d4/d8/db/dc/f61 0 2024-09-13T02:50:54.281 INFO:tasks.workunit.client.1.smithi122.stdout:7/623: creat d4/d8/fcf x:0 0 0 2024-09-13T02:50:54.282 INFO:tasks.workunit.client.1.smithi122.stdout:7/624: dread - d4/d8/d24/daa/fcc zero size 2024-09-13T02:50:54.282 INFO:tasks.workunit.client.1.smithi122.stdout:7/625: readlink d4/d8/db/dc/d36/l43 0 2024-09-13T02:50:54.283 INFO:tasks.workunit.client.1.smithi122.stdout:7/626: unlink d4/d8/db/f65 0 2024-09-13T02:50:54.283 INFO:tasks.workunit.client.1.smithi122.stdout:7/627: creat d4/d4e/d5d/d6b/fd0 x:0 0 0 2024-09-13T02:50:54.290 INFO:tasks.workunit.client.1.smithi122.stdout:6/724: dread d5/d3d/d6c/d41/f47 [0,4194304] 0 2024-09-13T02:50:54.294 INFO:tasks.workunit.client.1.smithi122.stdout:4/815: dwrite d11/d30/d59/d6e/fb0 [0,4194304] 0 2024-09-13T02:50:54.295 INFO:tasks.workunit.client.1.smithi122.stdout:4/816: creat d11/d13/d82/d2a/ddf/ff5 x:0 0 0 2024-09-13T02:50:54.296 INFO:tasks.workunit.client.1.smithi122.stdout:4/817: symlink d11/d13/lf6 0 2024-09-13T02:50:54.297 INFO:tasks.workunit.client.1.smithi122.stdout:4/818: creat d11/d13/d82/d2a/ddf/ff7 x:0 0 0 2024-09-13T02:50:54.299 INFO:tasks.workunit.client.1.smithi122.stdout:6/725: dread d5/db/d29/fa4 [0,4194304] 0 2024-09-13T02:50:54.303 INFO:tasks.workunit.client.1.smithi122.stdout:7/628: dwrite d4/d8/d24/f3e [4194304,4194304] 0 2024-09-13T02:50:54.382 INFO:tasks.workunit.client.1.smithi122.stdout:9/691: dwrite d8/d4a/d64/fb6 [0,4194304] 0 2024-09-13T02:50:54.384 INFO:tasks.workunit.client.1.smithi122.stdout:4/819: write d11/d30/d59/d6e/fb4 [2415842,124049] 0 2024-09-13T02:50:54.385 INFO:tasks.workunit.client.1.smithi122.stdout:8/593: dwrite d3/da/d1e/f8f [0,4194304] 0 2024-09-13T02:50:54.385 INFO:tasks.workunit.client.1.smithi122.stdout:8/594: read - d3/d53/d21/f98 zero size 2024-09-13T02:50:54.387 INFO:tasks.workunit.client.1.smithi122.stdout:9/692: mknod d8/d16/d3d/d59/d23/d1f/cd8 0 2024-09-13T02:50:54.390 INFO:tasks.workunit.client.1.smithi122.stdout:8/595: creat d3/da6/fb3 x:0 0 0 2024-09-13T02:50:54.392 INFO:tasks.workunit.client.1.smithi122.stdout:4/820: dread d11/d1b/d2e/d55/f58 [0,4194304] 0 2024-09-13T02:50:54.392 INFO:tasks.workunit.client.1.smithi122.stdout:4/821: chown d11/d13/d82/d2a/d40 52149 1 2024-09-13T02:50:54.393 INFO:tasks.workunit.client.1.smithi122.stdout:9/693: mkdir d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dd9 0 2024-09-13T02:50:54.393 INFO:tasks.workunit.client.1.smithi122.stdout:9/694: chown c7 4 1 2024-09-13T02:50:54.393 INFO:tasks.workunit.client.1.smithi122.stdout:9/695: stat d8/d16/d3d/d59/f4e 0 2024-09-13T02:50:54.393 INFO:tasks.workunit.client.1.smithi122.stdout:9/696: chown d8/d16/d3d/d59/d23/d1f/d36/fa8 624086773 1 2024-09-13T02:50:54.394 INFO:tasks.workunit.client.1.smithi122.stdout:8/596: getdents d3/d31/d52/d89/d8b 0 2024-09-13T02:50:54.395 INFO:tasks.workunit.client.1.smithi122.stdout:6/726: dwrite d5/d11/d45/d21/f73 [0,4194304] 0 2024-09-13T02:50:54.396 INFO:tasks.workunit.client.1.smithi122.stdout:8/597: dread d3/d31/f61 [0,4194304] 0 2024-09-13T02:50:54.397 INFO:tasks.workunit.client.1.smithi122.stdout:8/598: chown d3/da/f10 579719805 1 2024-09-13T02:50:54.398 INFO:tasks.workunit.client.1.smithi122.stdout:6/727: symlink d5/d11/d3a/ldc 0 2024-09-13T02:50:54.399 INFO:tasks.workunit.client.1.smithi122.stdout:8/599: rmdir d3/d31/d52 39 2024-09-13T02:50:54.402 INFO:tasks.workunit.client.1.smithi122.stdout:8/600: creat d3/d31/d52/fb4 x:0 0 0 2024-09-13T02:50:54.404 INFO:tasks.workunit.client.1.smithi122.stdout:8/601: link d3/d31/d52/f87 d3/d53/d4d/fb5 0 2024-09-13T02:50:54.404 INFO:tasks.workunit.client.1.smithi122.stdout:8/602: dread - d3/d31/d52/d89/d8b/d5c/f86 zero size 2024-09-13T02:50:54.404 INFO:tasks.workunit.client.1.smithi122.stdout:8/603: getdents d3/d53/d21/d92 0 2024-09-13T02:50:54.407 INFO:tasks.workunit.client.1.smithi122.stdout:4/822: dwrite d11/d30/d59/d6e/fed [0,4194304] 0 2024-09-13T02:50:54.423 INFO:tasks.workunit.client.1.smithi122.stdout:8/604: dwrite d3/d31/d52/d59/f39 [4194304,4194304] 0 2024-09-13T02:50:54.430 INFO:tasks.workunit.client.1.smithi122.stdout:4/823: dwrite d11/d1b/d2e/d55/f58 [4194304,4194304] 0 2024-09-13T02:50:54.431 INFO:tasks.workunit.client.1.smithi122.stdout:8/605: dread d3/da/d1f/f7f [0,4194304] 0 2024-09-13T02:50:54.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/824: mkdir d11/d13/dc9/de3/d8e/dbd/de5/df8 0 2024-09-13T02:50:54.435 INFO:tasks.workunit.client.1.smithi122.stdout:4/825: creat d11/d30/d59/d6e/ff9 x:0 0 0 2024-09-13T02:50:54.436 INFO:tasks.workunit.client.1.smithi122.stdout:8/606: getdents d3/da/d7d 0 2024-09-13T02:50:54.441 INFO:tasks.workunit.client.1.smithi122.stdout:4/826: dread d11/d13/f68 [0,4194304] 0 2024-09-13T02:50:54.442 INFO:tasks.workunit.client.1.smithi122.stdout:8/607: mknod d3/d31/d65/cb6 0 2024-09-13T02:50:54.446 INFO:tasks.workunit.client.1.smithi122.stdout:4/827: creat d11/d62/ffa x:0 0 0 2024-09-13T02:50:54.446 INFO:tasks.workunit.client.1.smithi122.stdout:4/828: chown d11/d62/ffa 1972663697 1 2024-09-13T02:50:54.448 INFO:tasks.workunit.client.1.smithi122.stdout:4/829: link d11/d13/dc9/ce0 d11/d1b/d32/d98/cfb 0 2024-09-13T02:50:54.454 INFO:tasks.workunit.client.1.smithi122.stdout:4/830: dread d11/f49 [0,4194304] 0 2024-09-13T02:50:54.456 INFO:tasks.workunit.client.1.smithi122.stdout:4/831: rename d11/d30/d59/d6e/fb0 to d11/d13/dd8/df1/ffc 0 2024-09-13T02:50:54.460 INFO:tasks.workunit.client.1.smithi122.stdout:4/832: rename d11/d1b/d2e to d11/d13/dd8/df1/dfd 0 2024-09-13T02:50:54.462 INFO:tasks.workunit.client.1.smithi122.stdout:4/833: link d11/d30/d59/d8f/da2/cd4 d11/d1b/d32/dc4/cfe 0 2024-09-13T02:50:54.467 INFO:tasks.workunit.client.1.smithi122.stdout:4/834: symlink d11/d13/dd8/lff 0 2024-09-13T02:50:54.468 INFO:tasks.workunit.client.1.smithi122.stdout:4/835: rmdir d11/d13/dc9/de3/d8e/dbd/de5 39 2024-09-13T02:50:54.469 INFO:tasks.workunit.client.1.smithi122.stdout:4/836: symlink d11/d13/dc9/de3/d8e/l100 0 2024-09-13T02:50:54.470 INFO:tasks.workunit.client.1.smithi122.stdout:4/837: readlink d11/d1b/d32/l81 0 2024-09-13T02:50:54.487 INFO:tasks.workunit.client.1.smithi122.stdout:4/838: dwrite d11/f3e [0,4194304] 0 2024-09-13T02:50:54.501 INFO:tasks.workunit.client.1.smithi122.stdout:4/839: dwrite d11/d3d/f6c [0,4194304] 0 2024-09-13T02:50:54.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/840: creat d11/d13/f101 x:0 0 0 2024-09-13T02:50:54.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/841: chown d11/d13/dc9/de3/d8e/c9a 0 1 2024-09-13T02:50:54.502 INFO:tasks.workunit.client.1.smithi122.stdout:4/842: getdents d11/d13/dc9/de3/d8e/dbd/de5/df8 0 2024-09-13T02:50:54.503 INFO:tasks.workunit.client.1.smithi122.stdout:4/843: unlink d11/d1b/l1d 0 2024-09-13T02:50:54.504 INFO:tasks.workunit.client.1.smithi122.stdout:4/844: mkdir d11/d30/d59/d8f/d102 0 2024-09-13T02:50:54.504 INFO:tasks.workunit.client.1.smithi122.stdout:4/845: write d11/d13/d82/f79 [922293,14705] 0 2024-09-13T02:50:54.506 INFO:tasks.workunit.client.1.smithi122.stdout:4/846: write d11/d3d/f5f [580441,23753] 0 2024-09-13T02:50:54.507 INFO:tasks.workunit.client.1.smithi122.stdout:4/847: mkdir d11/dcf/d103 0 2024-09-13T02:50:54.508 INFO:tasks.workunit.client.1.smithi122.stdout:4/848: mkdir d11/d13/dc9/de3/d8e/dbd/de5/d104 0 2024-09-13T02:50:54.508 INFO:tasks.workunit.client.1.smithi122.stdout:4/849: mknod d11/d3d/c105 0 2024-09-13T02:50:54.518 INFO:tasks.workunit.client.1.smithi122.stdout:4/850: write d11/d1b/d32/fbc [2749832,14350] 0 2024-09-13T02:50:54.527 INFO:tasks.workunit.client.1.smithi122.stdout:4/851: write d11/d13/dd8/df1/dfd/d55/f67 [6244017,30098] 0 2024-09-13T02:50:54.528 INFO:tasks.workunit.client.1.smithi122.stdout:4/852: chown d11/d1b/c5c 16139 1 2024-09-13T02:50:54.529 INFO:tasks.workunit.client.1.smithi122.stdout:4/853: rename d11/d13/d82/d2a/d40/f51 to d11/d13/dd8/f106 0 2024-09-13T02:50:54.532 INFO:tasks.workunit.client.1.smithi122.stdout:4/854: symlink d11/d13/dc9/de3/d8e/dbd/l107 0 2024-09-13T02:50:54.546 INFO:tasks.workunit.client.1.smithi122.stdout:4/855: dwrite d11/d30/d59/d6e/ff9 [0,4194304] 0 2024-09-13T02:50:54.547 INFO:tasks.workunit.client.1.smithi122.stdout:4/856: truncate d11/d1b/d32/d87/f9c 5119405 0 2024-09-13T02:50:54.549 INFO:tasks.workunit.client.1.smithi122.stdout:4/857: truncate d11/d30/f4b 580621 0 2024-09-13T02:50:54.550 INFO:tasks.workunit.client.1.smithi122.stdout:4/858: unlink d11/d3d/lf2 0 2024-09-13T02:50:54.553 INFO:tasks.workunit.client.1.smithi122.stdout:2/576: sync 2024-09-13T02:50:54.553 INFO:tasks.workunit.client.1.smithi122.stdout:4/859: creat d11/d1b/d32/dc4/f108 x:0 0 0 2024-09-13T02:50:54.562 INFO:tasks.workunit.client.1.smithi122.stdout:4/860: dread d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:54.562 INFO:tasks.workunit.client.1.smithi122.stdout:4/861: chown d11/d13/dd8/ddc 57 1 2024-09-13T02:50:54.568 INFO:tasks.workunit.client.1.smithi122.stdout:2/577: dwrite d0/d1e/d26/fa0 [0,4194304] 0 2024-09-13T02:50:54.573 INFO:tasks.workunit.client.1.smithi122.stdout:4/862: dread d11/d1b/d32/f73 [0,4194304] 0 2024-09-13T02:50:54.573 INFO:tasks.workunit.client.1.smithi122.stdout:4/863: dread - d11/d13/fac zero size 2024-09-13T02:50:54.573 INFO:tasks.workunit.client.1.smithi122.stdout:4/864: fdatasync d11/d13/f68 0 2024-09-13T02:50:54.590 INFO:tasks.workunit.client.1.smithi122.stdout:4/865: dwrite d11/d30/d59/d8f/da2/fb3 [0,4194304] 0 2024-09-13T02:50:54.592 INFO:tasks.workunit.client.1.smithi122.stdout:4/866: creat d11/d30/d59/f109 x:0 0 0 2024-09-13T02:50:54.606 INFO:tasks.workunit.client.1.smithi122.stdout:4/867: dwrite d11/d1b/d32/fbc [4194304,4194304] 0 2024-09-13T02:50:54.608 INFO:tasks.workunit.client.1.smithi122.stdout:4/868: mkdir d11/d1b/d32/d98/d10a 0 2024-09-13T02:50:54.609 INFO:tasks.workunit.client.1.smithi122.stdout:4/869: creat d11/d13/dd8/ddc/f10b x:0 0 0 2024-09-13T02:50:54.609 INFO:tasks.workunit.client.1.smithi122.stdout:4/870: creat d11/d30/d59/f10c x:0 0 0 2024-09-13T02:50:54.610 INFO:tasks.workunit.client.1.smithi122.stdout:4/871: dread d11/d13/dd8/df1/dfd/f34 [0,4194304] 0 2024-09-13T02:50:54.611 INFO:tasks.workunit.client.1.smithi122.stdout:4/872: link d11/d1b/d32/d98/cfb d11/d13/d82/c10d 0 2024-09-13T02:50:54.612 INFO:tasks.workunit.client.1.smithi122.stdout:4/873: mkdir d11/d13/d10e 0 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:0/705: sync 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:3/741: sync 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:9/697: sync 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:7/629: sync 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:6/728: sync 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:3/742: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f110 2999 1 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:3/743: chown d4/d11/dd/d21/d2b/d36/l4f 38033 1 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:3/744: readlink d4/d11/dd/d21/d2b/d55/l80 0 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:3/745: truncate d4/d11/f2e 4903820 0 2024-09-13T02:50:54.631 INFO:tasks.workunit.client.1.smithi122.stdout:9/698: write d8/d16/d3d/d59/d23/d1f/d36/f4c [4690370,129517] 0 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:1/700: sync 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:5/617: sync 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:8/608: sync 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:1/701: fdatasync dc/de/d18/d1d/f34 0 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:5/618: creat d0/fc9 x:0 0 0 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:1/702: creat dc/de/d18/d22/d76/fea x:0 0 0 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:5/619: chown d0/d17/d36/d8b 6003401 1 2024-09-13T02:50:54.632 INFO:tasks.workunit.client.1.smithi122.stdout:7/630: mknod d4/d6d/d8c/dc3/cd1 0 2024-09-13T02:50:54.633 INFO:tasks.workunit.client.1.smithi122.stdout:3/746: rmdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dff 0 2024-09-13T02:50:54.633 INFO:tasks.workunit.client.1.smithi122.stdout:3/747: stat d4/d11 0 2024-09-13T02:50:54.634 INFO:tasks.workunit.client.1.smithi122.stdout:0/706: dread d1/d5/d10/f7b [0,4194304] 0 2024-09-13T02:50:54.634 INFO:tasks.workunit.client.1.smithi122.stdout:0/707: readlink d1/d4b/d56/dba/ld4 0 2024-09-13T02:50:54.635 INFO:tasks.workunit.client.1.smithi122.stdout:4/874: dwrite d11/d13/d82/f16 [4194304,4194304] 0 2024-09-13T02:50:54.635 INFO:tasks.workunit.client.1.smithi122.stdout:4/875: fsync d11/d13/dd8/df1/dfd/fc2 0 2024-09-13T02:50:54.635 INFO:tasks.workunit.client.1.smithi122.stdout:8/609: truncate d3/d31/d52/f5b 27495 0 2024-09-13T02:50:54.636 INFO:tasks.workunit.client.1.smithi122.stdout:8/610: write d3/d31/d52/d59/f3c [1999336,16056] 0 2024-09-13T02:50:54.638 INFO:tasks.workunit.client.1.smithi122.stdout:4/876: dread d11/d1b/d32/f46 [0,4194304] 0 2024-09-13T02:50:54.643 INFO:tasks.workunit.client.1.smithi122.stdout:5/620: link d0/c55 d0/da/d48/cca 0 2024-09-13T02:50:54.643 INFO:tasks.workunit.client.1.smithi122.stdout:1/703: mkdir dc/d38/db1/deb 0 2024-09-13T02:50:54.645 INFO:tasks.workunit.client.1.smithi122.stdout:7/631: link d4/d8/d24/f6c d4/d8/d3d/dcd/fd2 0 2024-09-13T02:50:54.646 INFO:tasks.workunit.client.1.smithi122.stdout:3/748: creat d4/d11/dd/d21/d2b/d36/d3c/d43/da3/f116 x:0 0 0 2024-09-13T02:50:54.652 INFO:tasks.workunit.client.1.smithi122.stdout:5/621: unlink d0/da/d48/d63/cb8 0 2024-09-13T02:50:54.657 INFO:tasks.workunit.client.1.smithi122.stdout:7/632: write d4/d8/db/dc/d46/f6e [2298280,62677] 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:3/749: read d4/d11/d38/f70 [7997240,102090] 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:4/877: getdents d11/d13/d82/d2a 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:3/750: chown d4/d6/df/d15/d68/d90/fa7 7 1 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:5/622: mkdir d0/d17/d36/d3f/d4c/d7f/dcb 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:3/751: dread - d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fe1 zero size 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:5/623: truncate d0/d17/d36/d25/f65 2090390 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:0/708: getdents d1 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:0/709: write d1/d4b/d56/d60/f8c [84467,41322] 0 2024-09-13T02:50:54.659 INFO:tasks.workunit.client.1.smithi122.stdout:0/710: chown d1/d5/d2d/f44 119715 1 2024-09-13T02:50:54.660 INFO:tasks.workunit.client.1.smithi122.stdout:0/711: write d1/d4b/f7c [1386210,32351] 0 2024-09-13T02:50:54.664 INFO:tasks.workunit.client.1.smithi122.stdout:4/878: creat d11/dcf/f10f x:0 0 0 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:4/879: write f10 [5157461,103450] 0 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:4/880: truncate d11/d30/d59/de8/fee 590670 0 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:6/729: dwrite d5/d11/f4f [0,4194304] 0 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:0/712: symlink d1/d5/d2d/le4 0 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:0/713: chown d1/d5/d9/da/d7d/d95/lb2 242304 1 2024-09-13T02:50:54.665 INFO:tasks.workunit.client.1.smithi122.stdout:9/699: dwrite d8/d16/d3e/f6b [4194304,4194304] 0 2024-09-13T02:50:54.679 INFO:tasks.workunit.client.1.smithi122.stdout:9/700: unlink d8/d16/d3d/d59/d23/d1f/d36/fd4 0 2024-09-13T02:50:54.679 INFO:tasks.workunit.client.1.smithi122.stdout:7/633: rmdir d4/d8/d3d 39 2024-09-13T02:50:54.680 INFO:tasks.workunit.client.1.smithi122.stdout:1/704: dwrite dc/d38/db1/d72/dd7/f9a [0,4194304] 0 2024-09-13T02:50:54.683 INFO:tasks.workunit.client.1.smithi122.stdout:0/714: unlink d1/d5/d10/d29/c53 0 2024-09-13T02:50:54.685 INFO:tasks.workunit.client.1.smithi122.stdout:9/701: creat d8/d16/d3d/d59/d7d/d83/fda x:0 0 0 2024-09-13T02:50:54.688 INFO:tasks.workunit.client.1.smithi122.stdout:1/705: getdents dc/d38 0 2024-09-13T02:50:54.688 INFO:tasks.workunit.client.1.smithi122.stdout:0/715: symlink d1/d5/d10/d29/d32/d5f/le5 0 2024-09-13T02:50:54.691 INFO:tasks.workunit.client.1.smithi122.stdout:1/706: unlink dc/d38/db1/d72/dd7/d46/f77 0 2024-09-13T02:50:54.692 INFO:tasks.workunit.client.1.smithi122.stdout:3/752: dwrite d4/d11/dd/d21/d2b/d36/d3c/f10 [0,4194304] 0 2024-09-13T02:50:54.693 INFO:tasks.workunit.client.1.smithi122.stdout:0/716: link d1/d5/d9/da/d17/f43 d1/d5/d10/d29/d32/d83/db3/fe6 0 2024-09-13T02:50:54.693 INFO:tasks.workunit.client.1.smithi122.stdout:0/717: write d1/d5/d10/f7b [1926823,120270] 0 2024-09-13T02:50:54.694 INFO:tasks.workunit.client.1.smithi122.stdout:7/634: dread d4/f35 [0,4194304] 0 2024-09-13T02:50:54.694 INFO:tasks.workunit.client.1.smithi122.stdout:5/624: dwrite d0/d17/d36/d25/fb5 [0,4194304] 0 2024-09-13T02:50:54.694 INFO:tasks.workunit.client.1.smithi122.stdout:5/625: dread - d0/d17/d3a/f9c zero size 2024-09-13T02:50:54.695 INFO:tasks.workunit.client.1.smithi122.stdout:1/707: creat dc/d38/db1/d72/dd7/d46/db7/fec x:0 0 0 2024-09-13T02:50:54.702 INFO:tasks.workunit.client.1.smithi122.stdout:4/881: dwrite d11/d1b/f1c [0,4194304] 0 2024-09-13T02:50:54.703 INFO:tasks.workunit.client.1.smithi122.stdout:0/718: rename d1/d5/d10/d29/d32/d5f/c3b to d1/d4b/d56/d81/dc5/ce7 0 2024-09-13T02:50:54.705 INFO:tasks.workunit.client.1.smithi122.stdout:7/635: symlink d4/d6d/ld3 0 2024-09-13T02:50:54.705 INFO:tasks.workunit.client.1.smithi122.stdout:7/636: readlink d4/d8/lb2 0 2024-09-13T02:50:54.706 INFO:tasks.workunit.client.1.smithi122.stdout:6/730: dwrite d5/db/dc/f96 [0,4194304] 0 2024-09-13T02:50:54.709 INFO:tasks.workunit.client.1.smithi122.stdout:5/626: mknod d0/d17/d3a/ccc 0 2024-09-13T02:50:54.710 INFO:tasks.workunit.client.1.smithi122.stdout:5/627: readlink d0/da/d8c/lc0 0 2024-09-13T02:50:54.710 INFO:tasks.workunit.client.1.smithi122.stdout:5/628: chown d0/d17/d36/d25/c75 33328503 1 2024-09-13T02:50:54.710 INFO:tasks.workunit.client.1.smithi122.stdout:9/702: dwrite d8/d16/d3d/d59/d49/fb9 [0,4194304] 0 2024-09-13T02:50:54.710 INFO:tasks.workunit.client.1.smithi122.stdout:9/703: chown d8/d16/d3e 273187 1 2024-09-13T02:50:54.711 INFO:tasks.workunit.client.1.smithi122.stdout:1/708: symlink dc/de/d18/d1d/led 0 2024-09-13T02:50:54.711 INFO:tasks.workunit.client.1.smithi122.stdout:5/629: write d0/d17/d36/f24 [1546207,104747] 0 2024-09-13T02:50:54.711 INFO:tasks.workunit.client.1.smithi122.stdout:5/630: write d0/d2/d33/f5e [3868494,81244] 0 2024-09-13T02:50:54.713 INFO:tasks.workunit.client.1.smithi122.stdout:3/753: dwrite d4/d11/dd/f65 [0,4194304] 0 2024-09-13T02:50:54.718 INFO:tasks.workunit.client.1.smithi122.stdout:6/731: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:54.719 INFO:tasks.workunit.client.1.smithi122.stdout:4/882: rename d11/d3d/fb2 to d11/d1b/d32/d87/f110 0 2024-09-13T02:50:54.721 INFO:tasks.workunit.client.1.smithi122.stdout:6/732: write d5/d3d/d48/f6b [176142,15968] 0 2024-09-13T02:50:54.723 INFO:tasks.workunit.client.1.smithi122.stdout:0/719: mknod d1/d5/d9/da/d92/d94/ce8 0 2024-09-13T02:50:54.724 INFO:tasks.workunit.client.1.smithi122.stdout:7/637: mknod d4/d6d/d8c/dc3/cd4 0 2024-09-13T02:50:54.725 INFO:tasks.workunit.client.1.smithi122.stdout:1/709: dread f2 [4194304,4194304] 0 2024-09-13T02:50:54.732 INFO:tasks.workunit.client.1.smithi122.stdout:9/704: symlink d8/d16/d3d/d59/d49/ldb 0 2024-09-13T02:50:54.733 INFO:tasks.workunit.client.1.smithi122.stdout:4/883: dread d11/d13/d82/f7e [0,4194304] 0 2024-09-13T02:50:54.734 INFO:tasks.workunit.client.1.smithi122.stdout:3/754: dwrite d4/d11/dd/d21/d2b/d55/fcb [4194304,4194304] 0 2024-09-13T02:50:54.734 INFO:tasks.workunit.client.1.smithi122.stdout:5/631: dwrite d0/d1d/f93 [0,4194304] 0 2024-09-13T02:50:54.734 INFO:tasks.workunit.client.1.smithi122.stdout:5/632: write d0/f84 [453813,123826] 0 2024-09-13T02:50:54.740 INFO:tasks.workunit.client.1.smithi122.stdout:1/710: write dc/d38/f6a [190886,7889] 0 2024-09-13T02:50:54.741 INFO:tasks.workunit.client.1.smithi122.stdout:4/884: write d11/d13/d82/d2a/d83/f95 [844848,82552] 0 2024-09-13T02:50:54.742 INFO:tasks.workunit.client.1.smithi122.stdout:4/885: stat d11/d13/dc9/ldb 0 2024-09-13T02:50:54.748 INFO:tasks.workunit.client.1.smithi122.stdout:5/633: dwrite d0/d17/d36/f76 [0,4194304] 0 2024-09-13T02:50:54.749 INFO:tasks.workunit.client.1.smithi122.stdout:5/634: dread - d0/d17/d36/d3f/d4c/f86 zero size 2024-09-13T02:50:54.752 INFO:tasks.workunit.client.1.smithi122.stdout:1/711: dread dc/de/f27 [0,4194304] 0 2024-09-13T02:50:54.752 INFO:tasks.workunit.client.1.smithi122.stdout:1/712: chown dc/d38/db1/d72/dd7 941694917 1 2024-09-13T02:50:54.752 INFO:tasks.workunit.client.1.smithi122.stdout:1/713: dread - dc/d38/db1/d72/dd7/d46/f92 zero size 2024-09-13T02:50:54.754 INFO:tasks.workunit.client.1.smithi122.stdout:6/733: stat d5/db/l3c 0 2024-09-13T02:50:54.755 INFO:tasks.workunit.client.1.smithi122.stdout:0/720: mkdir d1/d4b/d56/d60/de9 0 2024-09-13T02:50:54.757 INFO:tasks.workunit.client.1.smithi122.stdout:7/638: unlink d4/d8/fcf 0 2024-09-13T02:50:54.759 INFO:tasks.workunit.client.1.smithi122.stdout:9/705: link d8/d16/d3d/d59/d23/ca4 d8/d16/d3d/d59/d49/cdc 0 2024-09-13T02:50:54.759 INFO:tasks.workunit.client.1.smithi122.stdout:9/706: dread - d8/d16/d3d/d59/d23/d7b/d82/da3/da7/fc6 zero size 2024-09-13T02:50:54.762 INFO:tasks.workunit.client.1.smithi122.stdout:5/635: dwrite d0/d17/d36/d3f/d4c/d7f/fc4 [0,4194304] 0 2024-09-13T02:50:54.763 INFO:tasks.workunit.client.1.smithi122.stdout:3/755: unlink d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fb9 0 2024-09-13T02:50:54.763 INFO:tasks.workunit.client.1.smithi122.stdout:3/756: dread - d4/d11/dd/d21/d2b/d36/d3c/d43/d60/fc5 zero size 2024-09-13T02:50:54.766 INFO:tasks.workunit.client.1.smithi122.stdout:4/886: truncate d11/d13/dd8/df1/dfd/fc2 650813 0 2024-09-13T02:50:54.768 INFO:tasks.workunit.client.1.smithi122.stdout:1/714: mkdir dc/d38/d51/daf/dee 0 2024-09-13T02:50:54.771 INFO:tasks.workunit.client.1.smithi122.stdout:6/734: rename d5/db/d29/d60/dac/dc6 to d5/d3d/d6c/d41/d5b/d7d/ddd 0 2024-09-13T02:50:54.773 INFO:tasks.workunit.client.1.smithi122.stdout:0/721: symlink d1/d5/d2d/db4/lea 0 2024-09-13T02:50:54.773 INFO:tasks.workunit.client.1.smithi122.stdout:4/887: write d11/fad [550583,73888] 0 2024-09-13T02:50:54.773 INFO:tasks.workunit.client.1.smithi122.stdout:4/888: chown d11/d30/d59/d6e/fa3 0 1 2024-09-13T02:50:54.774 INFO:tasks.workunit.client.1.smithi122.stdout:7/639: unlink d4/d4e/d5d/c89 0 2024-09-13T02:50:54.776 INFO:tasks.workunit.client.1.smithi122.stdout:9/707: mknod d8/d16/d3d/d59/d29/d90/db7/cdd 0 2024-09-13T02:50:54.776 INFO:tasks.workunit.client.1.smithi122.stdout:9/708: dread - d8/d16/d3d/d59/d23/d7b/d82/da3/fcc zero size 2024-09-13T02:50:54.789 INFO:tasks.workunit.client.1.smithi122.stdout:5/636: creat d0/d17/d36/d3f/fcd x:0 0 0 2024-09-13T02:50:54.789 INFO:tasks.workunit.client.1.smithi122.stdout:5/637: creat d0/d17/d36/d3f/d4c/d7f/fce x:0 0 0 2024-09-13T02:50:54.793 INFO:tasks.workunit.client.1.smithi122.stdout:3/757: mkdir d4/d11/dd/d21/d2b/dcf/d117 0 2024-09-13T02:50:54.793 INFO:tasks.workunit.client.1.smithi122.stdout:3/758: write d4/d6/df/d15/d68/d90/fa7 [989734,75352] 0 2024-09-13T02:50:54.793 INFO:tasks.workunit.client.1.smithi122.stdout:3/759: write d4/d11/dd/fcd [338318,21957] 0 2024-09-13T02:50:54.794 INFO:tasks.workunit.client.1.smithi122.stdout:1/715: symlink dc/d38/db1/d72/dd7/d46/db7/lef 0 2024-09-13T02:50:54.794 INFO:tasks.workunit.client.1.smithi122.stdout:1/716: write dc/de/d18/d22/d1c/fba [495575,55724] 0 2024-09-13T02:50:54.795 INFO:tasks.workunit.client.1.smithi122.stdout:6/735: creat d5/d3d/d82/dcf/fde x:0 0 0 2024-09-13T02:50:54.795 INFO:tasks.workunit.client.1.smithi122.stdout:6/736: readlink d5/d3d/d6c/d41/l80 0 2024-09-13T02:50:54.796 INFO:tasks.workunit.client.1.smithi122.stdout:0/722: mknod d1/d4b/d56/d60/de9/ceb 0 2024-09-13T02:50:54.802 INFO:tasks.workunit.client.1.smithi122.stdout:4/889: mknod d11/d30/c111 0 2024-09-13T02:50:54.802 INFO:tasks.workunit.client.1.smithi122.stdout:7/640: rmdir d4/d8/d3d/dcd 39 2024-09-13T02:50:54.802 INFO:tasks.workunit.client.1.smithi122.stdout:7/641: dread - d4/d8/db/dc/f72 zero size 2024-09-13T02:50:54.803 INFO:tasks.workunit.client.1.smithi122.stdout:1/717: read dc/de/f2e [4133548,25306] 0 2024-09-13T02:50:54.806 INFO:tasks.workunit.client.1.smithi122.stdout:2/578: sync 2024-09-13T02:50:54.807 INFO:tasks.workunit.client.1.smithi122.stdout:5/638: rename d0/d17/d36/f76 to d0/d2/d33/fcf 0 2024-09-13T02:50:54.808 INFO:tasks.workunit.client.1.smithi122.stdout:3/760: mknod d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/c118 0 2024-09-13T02:50:54.809 INFO:tasks.workunit.client.1.smithi122.stdout:5/639: dread d0/da/f73 [0,4194304] 0 2024-09-13T02:50:54.809 INFO:tasks.workunit.client.1.smithi122.stdout:5/640: creat d0/d1d/fd0 x:0 0 0 2024-09-13T02:50:54.810 INFO:tasks.workunit.client.1.smithi122.stdout:5/641: dread - d0/d2/f91 zero size 2024-09-13T02:50:54.810 INFO:tasks.workunit.client.1.smithi122.stdout:1/718: read dc/de/d18/d1d/f23 [1025112,84024] 0 2024-09-13T02:50:54.810 INFO:tasks.workunit.client.1.smithi122.stdout:0/723: symlink d1/d5/d2d/lec 0 2024-09-13T02:50:54.811 INFO:tasks.workunit.client.1.smithi122.stdout:2/579: dread d0/fc [0,4194304] 0 2024-09-13T02:50:54.814 INFO:tasks.workunit.client.1.smithi122.stdout:4/890: rmdir d11/dcf/d103 0 2024-09-13T02:50:54.815 INFO:tasks.workunit.client.1.smithi122.stdout:7/642: mknod d4/d8/db/d63/cd5 0 2024-09-13T02:50:54.817 INFO:tasks.workunit.client.1.smithi122.stdout:9/709: getdents d8/d16/d3d/d59/d7d/d83 0 2024-09-13T02:50:54.817 INFO:tasks.workunit.client.1.smithi122.stdout:9/710: readlink d8/d16/d3d/d59/d23/d1f/l80 0 2024-09-13T02:50:54.818 INFO:tasks.workunit.client.1.smithi122.stdout:4/891: write d11/d1b/d32/f46 [556979,35624] 0 2024-09-13T02:50:54.818 INFO:tasks.workunit.client.1.smithi122.stdout:4/892: fdatasync d11/d1b/f1c 0 2024-09-13T02:50:54.818 INFO:tasks.workunit.client.1.smithi122.stdout:4/893: readlink d11/d13/d82/d2a/l44 0 2024-09-13T02:50:54.819 INFO:tasks.workunit.client.1.smithi122.stdout:8/611: sync 2024-09-13T02:50:54.820 INFO:tasks.workunit.client.1.smithi122.stdout:8/612: truncate d3/d31/d52/d89/d8b/d5c/f83 492103 0 2024-09-13T02:50:54.821 INFO:tasks.workunit.client.1.smithi122.stdout:3/761: rename d4/d11/dd/d21/d2b/d36/d3c/d43/da3/lb6 to d4/d6/df/d15/l119 0 2024-09-13T02:50:54.822 INFO:tasks.workunit.client.1.smithi122.stdout:3/762: stat d4 0 2024-09-13T02:50:54.824 INFO:tasks.workunit.client.1.smithi122.stdout:5/642: rmdir d0/da/d8c 39 2024-09-13T02:50:54.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/719: rmdir dc/de/d18/d22/d80 39 2024-09-13T02:50:54.824 INFO:tasks.workunit.client.1.smithi122.stdout:1/720: write dc/d38/db1/d72/dd7/d46/f81 [137610,84920] 0 2024-09-13T02:50:54.826 INFO:tasks.workunit.client.1.smithi122.stdout:0/724: mknod d1/d5/d2d/ced 0 2024-09-13T02:50:54.826 INFO:tasks.workunit.client.1.smithi122.stdout:0/725: fsync d1/d4b/d56/d60/f55 0 2024-09-13T02:50:54.826 INFO:tasks.workunit.client.1.smithi122.stdout:0/726: fsync d1/d4b/d56/d81/fae 0 2024-09-13T02:50:54.827 INFO:tasks.workunit.client.1.smithi122.stdout:2/580: symlink d0/d5d/lb5 0 2024-09-13T02:50:54.827 INFO:tasks.workunit.client.1.smithi122.stdout:2/581: truncate d0/d1e/fa9 898048 0 2024-09-13T02:50:54.829 INFO:tasks.workunit.client.1.smithi122.stdout:7/643: creat d4/d8/d24/d47/fd6 x:0 0 0 2024-09-13T02:50:54.829 INFO:tasks.workunit.client.1.smithi122.stdout:8/613: dread d3/da/d1e/f8f [0,4194304] 0 2024-09-13T02:50:54.830 INFO:tasks.workunit.client.1.smithi122.stdout:4/894: truncate d11/d13/d82/f16 4062674 0 2024-09-13T02:50:54.833 INFO:tasks.workunit.client.1.smithi122.stdout:3/763: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/l11a 0 2024-09-13T02:50:54.836 INFO:tasks.workunit.client.1.smithi122.stdout:5/643: mkdir d0/d17/d36/d3f/d4c/d7f/dd1 0 2024-09-13T02:50:54.838 INFO:tasks.workunit.client.1.smithi122.stdout:9/711: dwrite f1 [4194304,4194304] 0 2024-09-13T02:50:54.839 INFO:tasks.workunit.client.1.smithi122.stdout:1/721: link dc/d38/d51/c5c dc/de/d18/d22/cf0 0 2024-09-13T02:50:54.842 INFO:tasks.workunit.client.1.smithi122.stdout:0/727: unlink d1/c54 0 2024-09-13T02:50:54.844 INFO:tasks.workunit.client.1.smithi122.stdout:2/582: link d0/c14 d0/d1e/d2e/d3e/cb6 0 2024-09-13T02:50:54.848 INFO:tasks.workunit.client.1.smithi122.stdout:8/614: creat d3/d53/d34/fb7 x:0 0 0 2024-09-13T02:50:54.848 INFO:tasks.workunit.client.1.smithi122.stdout:8/615: creat d3/da/d1e/fb8 x:0 0 0 2024-09-13T02:50:54.848 INFO:tasks.workunit.client.1.smithi122.stdout:8/616: truncate d3/d31/f61 922913 0 2024-09-13T02:50:54.849 INFO:tasks.workunit.client.1.smithi122.stdout:4/895: symlink d11/d13/dd8/df1/dfd/l112 0 2024-09-13T02:50:54.849 INFO:tasks.workunit.client.1.smithi122.stdout:4/896: write d11/d1b/d32/d87/f110 [1971049,30734] 0 2024-09-13T02:50:54.857 INFO:tasks.workunit.client.1.smithi122.stdout:1/722: mkdir dc/de/d18/df1 0 2024-09-13T02:50:54.859 INFO:tasks.workunit.client.1.smithi122.stdout:2/583: symlink d0/d1e/d2e/d8a/lb7 0 2024-09-13T02:50:54.865 INFO:tasks.workunit.client.1.smithi122.stdout:7/644: dwrite d4/d4e/d5d/f5e [0,4194304] 0 2024-09-13T02:50:54.865 INFO:tasks.workunit.client.1.smithi122.stdout:7/645: chown d4/d8/db/dc/d1b/l3c 913 1 2024-09-13T02:50:54.869 INFO:tasks.workunit.client.1.smithi122.stdout:4/897: mknod d11/d13/dd8/df1/dfd/d55/c113 0 2024-09-13T02:50:54.869 INFO:tasks.workunit.client.1.smithi122.stdout:4/898: stat d11/d1b/d32/d87/f9c 0 2024-09-13T02:50:54.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/723: mkdir dc/d38/db1/d72/df2 0 2024-09-13T02:50:54.872 INFO:tasks.workunit.client.1.smithi122.stdout:7/646: creat d4/d77/fd7 x:0 0 0 2024-09-13T02:50:54.873 INFO:tasks.workunit.client.1.smithi122.stdout:4/899: mkdir d11/d13/dd8/d114 0 2024-09-13T02:50:54.874 INFO:tasks.workunit.client.1.smithi122.stdout:7/647: truncate d4/d8/d24/f37 4444747 0 2024-09-13T02:50:54.874 INFO:tasks.workunit.client.1.smithi122.stdout:7/648: dread - d4/d8/d3d/d7e/fbc zero size 2024-09-13T02:50:54.874 INFO:tasks.workunit.client.1.smithi122.stdout:7/649: truncate d4/d8/d24/fad 917597 0 2024-09-13T02:50:54.875 INFO:tasks.workunit.client.1.smithi122.stdout:7/650: link d4/d6d/d8c/dc3/l8b d4/d4e/d5d/ld8 0 2024-09-13T02:50:54.876 INFO:tasks.workunit.client.1.smithi122.stdout:7/651: creat d4/d8/db7/fd9 x:0 0 0 2024-09-13T02:50:54.877 INFO:tasks.workunit.client.1.smithi122.stdout:7/652: truncate d4/d4e/f73 5038485 0 2024-09-13T02:50:54.877 INFO:tasks.workunit.client.1.smithi122.stdout:4/900: dread d11/d13/d82/f7e [0,4194304] 0 2024-09-13T02:50:54.879 INFO:tasks.workunit.client.1.smithi122.stdout:4/901: creat d11/d1b/d32/f115 x:0 0 0 2024-09-13T02:50:54.879 INFO:tasks.workunit.client.1.smithi122.stdout:4/902: dread - d11/d30/d59/d8f/da2/dc8/fde zero size 2024-09-13T02:50:54.907 INFO:tasks.workunit.client.1.smithi122.stdout:5/644: dwrite d0/d17/d36/d3f/fae [0,4194304] 0 2024-09-13T02:50:54.907 INFO:tasks.workunit.client.1.smithi122.stdout:5/645: truncate d0/d17/f6f 8511465 0 2024-09-13T02:50:54.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/646: creat d0/da/d48/db4/dc8/fd2 x:0 0 0 2024-09-13T02:50:54.909 INFO:tasks.workunit.client.1.smithi122.stdout:5/647: fdatasync d0/d2/f13 0 2024-09-13T02:50:54.916 INFO:tasks.workunit.client.1.smithi122.stdout:1/724: dwrite dc/d38/db1/fa3 [4194304,4194304] 0 2024-09-13T02:50:54.917 INFO:tasks.workunit.client.1.smithi122.stdout:2/584: dwrite d0/d1e/d22/f32 [4194304,4194304] 0 2024-09-13T02:50:54.918 INFO:tasks.workunit.client.1.smithi122.stdout:4/903: dwrite d11/d1b/f45 [0,4194304] 0 2024-09-13T02:50:54.918 INFO:tasks.workunit.client.1.smithi122.stdout:4/904: write d11/d30/d59/d6e/fb7 [182278,48526] 0 2024-09-13T02:50:54.918 INFO:tasks.workunit.client.1.smithi122.stdout:4/905: fdatasync d11/d1b/d32/f46 0 2024-09-13T02:50:54.919 INFO:tasks.workunit.client.1.smithi122.stdout:4/906: write d11/d30/d59/d6e/fdd [672130,121283] 0 2024-09-13T02:50:54.919 INFO:tasks.workunit.client.1.smithi122.stdout:7/653: dwrite d4/d6d/da6/dbf/db1/f9b [0,4194304] 0 2024-09-13T02:50:54.919 INFO:tasks.workunit.client.1.smithi122.stdout:7/654: readlink d4/d8/db/dc/d36/l4d 0 2024-09-13T02:50:54.919 INFO:tasks.workunit.client.1.smithi122.stdout:1/725: link dc/de/c54 dc/d38/db1/d7d/cf3 0 2024-09-13T02:50:54.921 INFO:tasks.workunit.client.1.smithi122.stdout:0/728: dwrite d1/d5/d10/d29/d32/d83/db3/fe6 [0,4194304] 0 2024-09-13T02:50:54.922 INFO:tasks.workunit.client.1.smithi122.stdout:9/712: dwrite d8/d16/d3d/d59/d23/d1f/f2a [0,4194304] 0 2024-09-13T02:50:54.922 INFO:tasks.workunit.client.1.smithi122.stdout:8/617: dwrite d3/d53/d21/f4b [4194304,4194304] 0 2024-09-13T02:50:54.922 INFO:tasks.workunit.client.1.smithi122.stdout:9/713: chown d8/d16/d3e/fd6 2 1 2024-09-13T02:50:54.922 INFO:tasks.workunit.client.1.smithi122.stdout:9/714: chown d8/d16/d3d/d59/d7d/d83/c93 2198381 1 2024-09-13T02:50:54.922 INFO:tasks.workunit.client.1.smithi122.stdout:9/715: truncate d8/d16/d3d/d59/d7d/d83/fd7 67664 0 2024-09-13T02:50:54.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/726: creat dc/de/d6e/ff4 x:0 0 0 2024-09-13T02:50:54.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/727: readlink dc/de/d18/d1d/l2d 0 2024-09-13T02:50:54.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/728: rename dc to dc/d38/db1/db2/df5 22 2024-09-13T02:50:54.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/729: chown dc/d38/db1/d7d/c8a 4663 1 2024-09-13T02:50:54.936 INFO:tasks.workunit.client.1.smithi122.stdout:8/618: symlink d3/d53/d34/lb9 0 2024-09-13T02:50:54.937 INFO:tasks.workunit.client.1.smithi122.stdout:0/729: creat d1/d5/d10/d29/d32/d5f/fee x:0 0 0 2024-09-13T02:50:54.937 INFO:tasks.workunit.client.1.smithi122.stdout:9/716: getdents d8/d16/d3d/d59/d49 0 2024-09-13T02:50:54.941 INFO:tasks.workunit.client.1.smithi122.stdout:4/907: getdents d11/d1b 0 2024-09-13T02:50:54.943 INFO:tasks.workunit.client.1.smithi122.stdout:0/730: mkdir d1/d5/d9/da/d92/d94/dbf/def 0 2024-09-13T02:50:54.948 INFO:tasks.workunit.client.1.smithi122.stdout:1/730: read dc/f32 [7650686,33598] 0 2024-09-13T02:50:54.948 INFO:tasks.workunit.client.1.smithi122.stdout:1/731: chown dc/d38/db1/d7d/c8a 55720188 1 2024-09-13T02:50:54.953 INFO:tasks.workunit.client.1.smithi122.stdout:1/732: creat dc/d38/db1/d72/dd7/d3f/ff6 x:0 0 0 2024-09-13T02:50:54.955 INFO:tasks.workunit.client.1.smithi122.stdout:4/908: rename d11/d30/d59 to d11/d13/dc9/de3/d8e/dbd/de5/d116 0 2024-09-13T02:50:54.957 INFO:tasks.workunit.client.1.smithi122.stdout:1/733: mkdir dc/de/d6e/df7 0 2024-09-13T02:50:54.960 INFO:tasks.workunit.client.1.smithi122.stdout:9/717: read d8/d16/d3d/d59/d29/f76 [3246127,11221] 0 2024-09-13T02:50:54.960 INFO:tasks.workunit.client.1.smithi122.stdout:4/909: unlink d11/d1b/f31 0 2024-09-13T02:50:54.961 INFO:tasks.workunit.client.1.smithi122.stdout:4/910: read d11/f97 [174077,68165] 0 2024-09-13T02:50:54.961 INFO:tasks.workunit.client.1.smithi122.stdout:4/911: write d11/d13/d82/d2a/d83/fae [5032900,46884] 0 2024-09-13T02:50:54.961 INFO:tasks.workunit.client.1.smithi122.stdout:4/912: truncate d11/d13/d82/d2a/ddf/ff7 936641 0 2024-09-13T02:50:54.962 INFO:tasks.workunit.client.1.smithi122.stdout:1/734: rename dc/de/f8d to dc/d38/db1/d72/dd7/d3f/ff8 0 2024-09-13T02:50:54.963 INFO:tasks.workunit.client.1.smithi122.stdout:4/913: truncate d11/d13/d82/f16 891242 0 2024-09-13T02:50:54.963 INFO:tasks.workunit.client.1.smithi122.stdout:4/914: stat d11/f43 0 2024-09-13T02:50:54.963 INFO:tasks.workunit.client.1.smithi122.stdout:4/915: fsync d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/fed 0 2024-09-13T02:50:54.965 INFO:tasks.workunit.client.1.smithi122.stdout:1/735: unlink dc/de/d7a/ld1 0 2024-09-13T02:50:54.965 INFO:tasks.workunit.client.1.smithi122.stdout:1/736: readlink dc/de/d18/d1d/l7e 0 2024-09-13T02:50:54.976 INFO:tasks.workunit.client.1.smithi122.stdout:5/648: dwrite d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:54.976 INFO:tasks.workunit.client.1.smithi122.stdout:5/649: stat d0/da/d8c/d8f/da0 0 2024-09-13T02:50:54.980 INFO:tasks.workunit.client.1.smithi122.stdout:7/655: dwrite d4/d8/d24/d82/fc0 [0,4194304] 0 2024-09-13T02:50:54.982 INFO:tasks.workunit.client.1.smithi122.stdout:5/650: dread d0/d17/d36/d25/d2b/f30 [0,4194304] 0 2024-09-13T02:50:54.982 INFO:tasks.workunit.client.1.smithi122.stdout:5/651: fsync d0/d17/fa4 0 2024-09-13T02:50:54.982 INFO:tasks.workunit.client.1.smithi122.stdout:5/652: read d0/d2/f13 [2864386,17191] 0 2024-09-13T02:50:54.983 INFO:tasks.workunit.client.1.smithi122.stdout:2/585: dwrite d0/d5d/f91 [0,4194304] 0 2024-09-13T02:50:54.984 INFO:tasks.workunit.client.1.smithi122.stdout:5/653: mkdir d0/da/d48/dd3 0 2024-09-13T02:50:54.984 INFO:tasks.workunit.client.1.smithi122.stdout:0/731: dwrite d1/d5/d9/da/d92/d94/f5c [4194304,4194304] 0 2024-09-13T02:50:54.984 INFO:tasks.workunit.client.1.smithi122.stdout:8/619: dwrite d3/d31/d52/f87 [0,4194304] 0 2024-09-13T02:50:54.985 INFO:tasks.workunit.client.1.smithi122.stdout:2/586: rename d0/d5d/f89 to d0/d1e/d2e/d8a/d99/fb8 0 2024-09-13T02:50:54.986 INFO:tasks.workunit.client.1.smithi122.stdout:1/737: dwrite dc/de/d18/d1d/f4e [0,4194304] 0 2024-09-13T02:50:54.987 INFO:tasks.workunit.client.1.smithi122.stdout:8/620: rmdir d3/d31/d52/d89 39 2024-09-13T02:50:54.987 INFO:tasks.workunit.client.1.smithi122.stdout:8/621: write d3/d53/d21/f5e [507814,12424] 0 2024-09-13T02:50:54.988 INFO:tasks.workunit.client.1.smithi122.stdout:2/587: mknod d0/d1e/d2e/d3e/cb9 0 2024-09-13T02:50:54.989 INFO:tasks.workunit.client.1.smithi122.stdout:5/654: getdents d0/d2/d33 0 2024-09-13T02:50:54.989 INFO:tasks.workunit.client.1.smithi122.stdout:1/738: symlink dc/de/lf9 0 2024-09-13T02:50:54.989 INFO:tasks.workunit.client.1.smithi122.stdout:8/622: symlink d3/da6/lba 0 2024-09-13T02:50:54.989 INFO:tasks.workunit.client.1.smithi122.stdout:8/623: readlink d3/d53/d4d/d6d/d76/lb2 0 2024-09-13T02:50:54.990 INFO:tasks.workunit.client.1.smithi122.stdout:8/624: fsync d3/d31/f3b 0 2024-09-13T02:50:54.991 INFO:tasks.workunit.client.1.smithi122.stdout:2/588: mknod d0/d53/cba 0 2024-09-13T02:50:54.991 INFO:tasks.workunit.client.1.smithi122.stdout:2/589: write d0/d1c/fad [634047,25934] 0 2024-09-13T02:50:54.991 INFO:tasks.workunit.client.1.smithi122.stdout:2/590: fsync d0/d1e/d26/d3d/f6f 0 2024-09-13T02:50:54.991 INFO:tasks.workunit.client.1.smithi122.stdout:2/591: fdatasync d0/f18 0 2024-09-13T02:50:54.991 INFO:tasks.workunit.client.1.smithi122.stdout:2/592: chown d0/f18 765 1 2024-09-13T02:50:54.997 INFO:tasks.workunit.client.1.smithi122.stdout:7/656: dread d4/d8/db/f9d [0,4194304] 0 2024-09-13T02:50:54.998 INFO:tasks.workunit.client.1.smithi122.stdout:8/625: write d3/d53/d4d/f62 [6153366,42156] 0 2024-09-13T02:50:54.999 INFO:tasks.workunit.client.1.smithi122.stdout:7/657: mkdir d4/d8/db/d63/dbb/dda 0 2024-09-13T02:50:55.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/626: dread d3/d31/d52/f5b [0,4194304] 0 2024-09-13T02:50:55.003 INFO:tasks.workunit.client.1.smithi122.stdout:5/655: dread d0/d17/d36/f50 [0,4194304] 0 2024-09-13T02:50:55.003 INFO:tasks.workunit.client.1.smithi122.stdout:5/656: creat d0/d17/d36/d3f/fd4 x:0 0 0 2024-09-13T02:50:55.003 INFO:tasks.workunit.client.1.smithi122.stdout:8/627: mkdir d3/d53/d4d/d6d/d76/dbb 0 2024-09-13T02:50:55.003 INFO:tasks.workunit.client.1.smithi122.stdout:8/628: write d3/d31/f61 [1467657,113883] 0 2024-09-13T02:50:55.003 INFO:tasks.workunit.client.1.smithi122.stdout:8/629: stat d3/d53/d34/d94 0 2024-09-13T02:50:55.006 INFO:tasks.workunit.client.1.smithi122.stdout:5/657: creat d0/da/d90/fd5 x:0 0 0 2024-09-13T02:50:55.007 INFO:tasks.workunit.client.1.smithi122.stdout:5/658: chown d0/da/d48/db4/fbe 83692474 1 2024-09-13T02:50:55.007 INFO:tasks.workunit.client.1.smithi122.stdout:5/659: truncate d0/d17/d36/d3f/d4c/f77 767257 0 2024-09-13T02:50:55.008 INFO:tasks.workunit.client.1.smithi122.stdout:8/630: symlink d3/da/lbc 0 2024-09-13T02:50:55.010 INFO:tasks.workunit.client.1.smithi122.stdout:8/631: mknod d3/da6/cbd 0 2024-09-13T02:50:55.010 INFO:tasks.workunit.client.1.smithi122.stdout:5/660: rmdir d0/d17/d36/d3f/d4c/d7f 39 2024-09-13T02:50:55.012 INFO:tasks.workunit.client.1.smithi122.stdout:8/632: mknod d3/d53/d21/cbe 0 2024-09-13T02:50:55.013 INFO:tasks.workunit.client.1.smithi122.stdout:5/661: creat d0/da/fd6 x:0 0 0 2024-09-13T02:50:55.013 INFO:tasks.workunit.client.1.smithi122.stdout:5/662: truncate d0/d17/d36/d99/fb6 836661 0 2024-09-13T02:50:55.014 INFO:tasks.workunit.client.1.smithi122.stdout:8/633: mkdir d3/d53/d34/dbf 0 2024-09-13T02:50:55.014 INFO:tasks.workunit.client.1.smithi122.stdout:8/634: write d3/d31/f61 [2471536,49444] 0 2024-09-13T02:50:55.015 INFO:tasks.workunit.client.1.smithi122.stdout:5/663: creat d0/da/d8c/d8f/da0/dba/fd7 x:0 0 0 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/664: rmdir d0/da/d48/db4/dc8 39 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/665: dread - d0/d17/d36/d3f/d4c/f86 zero size 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/666: fsync d0/d17/d3a/f4f 0 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/667: read - d0/da/d48/db4/fbe zero size 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/668: readlink d0/da/la6 0 2024-09-13T02:50:55.018 INFO:tasks.workunit.client.1.smithi122.stdout:5/669: chown d0/da/d48/d63/d98 11 1 2024-09-13T02:50:55.019 INFO:tasks.workunit.client.1.smithi122.stdout:5/670: unlink d0/d2/d33/f70 0 2024-09-13T02:50:55.020 INFO:tasks.workunit.client.1.smithi122.stdout:5/671: mknod d0/da/d48/db4/dc8/cd8 0 2024-09-13T02:50:55.022 INFO:tasks.workunit.client.1.smithi122.stdout:5/672: rename d0/d17/d36/d99/lc6 to d0/da/d8c/d8f/da0/dba/ld9 0 2024-09-13T02:50:55.024 INFO:tasks.workunit.client.1.smithi122.stdout:1/739: dwrite dc/de/d6e/fc3 [0,4194304] 0 2024-09-13T02:50:55.024 INFO:tasks.workunit.client.1.smithi122.stdout:1/740: fdatasync dc/d38/db1/d72/dd7/d3f/ff8 0 2024-09-13T02:50:55.024 INFO:tasks.workunit.client.1.smithi122.stdout:1/741: write dc/de/d18/f2c [2414461,74684] 0 2024-09-13T02:50:55.027 INFO:tasks.workunit.client.1.smithi122.stdout:1/742: creat dc/de/d18/d22/ffa x:0 0 0 2024-09-13T02:50:55.028 INFO:tasks.workunit.client.1.smithi122.stdout:1/743: truncate dc/de/f27 2126977 0 2024-09-13T02:50:55.029 INFO:tasks.workunit.client.1.smithi122.stdout:1/744: mkdir dc/de/d18/d22/d76/dfb 0 2024-09-13T02:50:55.030 INFO:tasks.workunit.client.1.smithi122.stdout:8/635: write d3/d53/d21/f69 [4903990,11937] 0 2024-09-13T02:50:55.032 INFO:tasks.workunit.client.1.smithi122.stdout:8/636: creat d3/d31/d52/d89/db1/fc0 x:0 0 0 2024-09-13T02:50:55.034 INFO:tasks.workunit.client.1.smithi122.stdout:4/916: dwrite d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/fb7 [0,4194304] 0 2024-09-13T02:50:55.038 INFO:tasks.workunit.client.1.smithi122.stdout:4/917: creat d11/d13/dd8/df1/dfd/f117 x:0 0 0 2024-09-13T02:50:55.038 INFO:tasks.workunit.client.1.smithi122.stdout:4/918: fdatasync d11/d13/d82/f19 0 2024-09-13T02:50:55.039 INFO:tasks.workunit.client.1.smithi122.stdout:1/745: dread dc/de/d18/d1d/d2f/fd5 [0,4194304] 0 2024-09-13T02:50:55.041 INFO:tasks.workunit.client.1.smithi122.stdout:4/919: creat d11/d13/dc9/de3/d8e/dbd/de5/d116/de8/f118 x:0 0 0 2024-09-13T02:50:55.041 INFO:tasks.workunit.client.1.smithi122.stdout:4/920: write d11/d13/d82/f16 [765974,125118] 0 2024-09-13T02:50:55.041 INFO:tasks.workunit.client.1.smithi122.stdout:0/732: dwrite d1/fc9 [0,4194304] 0 2024-09-13T02:50:55.041 INFO:tasks.workunit.client.1.smithi122.stdout:7/658: dwrite d4/d8/db/dc/d1b/d49/fb0 [0,4194304] 0 2024-09-13T02:50:55.042 INFO:tasks.workunit.client.1.smithi122.stdout:5/673: dwrite d0/d17/d36/d25/d2b/f97 [0,4194304] 0 2024-09-13T02:50:55.042 INFO:tasks.workunit.client.1.smithi122.stdout:7/659: creat d4/d77/fdb x:0 0 0 2024-09-13T02:50:55.042 INFO:tasks.workunit.client.1.smithi122.stdout:1/746: getdents dc/de 0 2024-09-13T02:50:55.042 INFO:tasks.workunit.client.1.smithi122.stdout:2/593: dwrite d0/d1e/f38 [0,4194304] 0 2024-09-13T02:50:55.051 INFO:tasks.workunit.client.1.smithi122.stdout:4/921: dread d11/d13/d82/fbe [0,4194304] 0 2024-09-13T02:50:55.052 INFO:tasks.workunit.client.1.smithi122.stdout:2/594: write d0/d1e/f25 [1893194,111985] 0 2024-09-13T02:50:55.053 INFO:tasks.workunit.client.1.smithi122.stdout:7/660: link d4/d6d/d8f/f92 d4/d8/db/dc/d1b/d49/da0/fdc 0 2024-09-13T02:50:55.054 INFO:tasks.workunit.client.1.smithi122.stdout:5/674: creat d0/d17/d36/d25/fda x:0 0 0 2024-09-13T02:50:55.055 INFO:tasks.workunit.client.1.smithi122.stdout:5/675: write d0/d17/d36/d25/d2b/f71 [297535,52653] 0 2024-09-13T02:50:55.055 INFO:tasks.workunit.client.1.smithi122.stdout:5/676: chown d0/d17/d36/d25 4 1 2024-09-13T02:50:55.056 INFO:tasks.workunit.client.1.smithi122.stdout:1/747: mknod dc/de/d18/de4/cfc 0 2024-09-13T02:50:55.058 INFO:tasks.workunit.client.1.smithi122.stdout:8/637: dwrite d3/d31/d52/f5b [0,4194304] 0 2024-09-13T02:50:55.058 INFO:tasks.workunit.client.1.smithi122.stdout:8/638: chown d3/d31/d52/d89/d8b/d5c/f8c 1573092781 1 2024-09-13T02:50:55.058 INFO:tasks.workunit.client.1.smithi122.stdout:8/639: write d3/d31/d52/fb4 [12302,121338] 0 2024-09-13T02:50:55.060 INFO:tasks.workunit.client.1.smithi122.stdout:7/661: dread d4/d8/d24/d82/fc0 [0,4194304] 0 2024-09-13T02:50:55.060 INFO:tasks.workunit.client.1.smithi122.stdout:7/662: readlink d4/d4e/l9c 0 2024-09-13T02:50:55.060 INFO:tasks.workunit.client.1.smithi122.stdout:7/663: fsync d4/d8/db/ff 0 2024-09-13T02:50:55.060 INFO:tasks.workunit.client.1.smithi122.stdout:7/664: read - d4/d8/db7/fd9 zero size 2024-09-13T02:50:55.061 INFO:tasks.workunit.client.1.smithi122.stdout:8/640: write d3/d53/d21/f5e [472815,103364] 0 2024-09-13T02:50:55.062 INFO:tasks.workunit.client.1.smithi122.stdout:5/677: dread d0/f92 [0,4194304] 0 2024-09-13T02:50:55.062 INFO:tasks.workunit.client.1.smithi122.stdout:5/678: dread - d0/d17/d36/d3f/d4c/d7f/fce zero size 2024-09-13T02:50:55.063 INFO:tasks.workunit.client.1.smithi122.stdout:5/679: truncate d0/d17/d36/d25/f65 2301157 0 2024-09-13T02:50:55.068 INFO:tasks.workunit.client.1.smithi122.stdout:1/748: dread dc/de/d18/d22/d1c/d57/f59 [0,4194304] 0 2024-09-13T02:50:55.068 INFO:tasks.workunit.client.1.smithi122.stdout:4/922: creat d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/f119 x:0 0 0 2024-09-13T02:50:55.072 INFO:tasks.workunit.client.1.smithi122.stdout:2/595: creat d0/d1e/d26/d3d/d84/fbb x:0 0 0 2024-09-13T02:50:55.072 INFO:tasks.workunit.client.1.smithi122.stdout:2/596: truncate d0/f10 2697921 0 2024-09-13T02:50:55.079 INFO:tasks.workunit.client.1.smithi122.stdout:2/597: dread d0/d1e/d22/d29/f2b [0,4194304] 0 2024-09-13T02:50:55.079 INFO:tasks.workunit.client.1.smithi122.stdout:1/749: dread dc/de/d18/d22/f55 [0,4194304] 0 2024-09-13T02:50:55.080 INFO:tasks.workunit.client.1.smithi122.stdout:2/598: write d0/d55/f62 [890580,86893] 0 2024-09-13T02:50:55.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/641: dwrite d3/d31/f3b [0,4194304] 0 2024-09-13T02:50:55.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/642: fdatasync d3/da/f9b 0 2024-09-13T02:50:55.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/643: chown d3/da/la5 9985 1 2024-09-13T02:50:55.089 INFO:tasks.workunit.client.1.smithi122.stdout:4/923: dwrite d11/d1b/f45 [4194304,4194304] 0 2024-09-13T02:50:55.108 INFO:tasks.workunit.client.1.smithi122.stdout:2/599: dwrite d0/d1e/d2e/d3e/f46 [4194304,4194304] 0 2024-09-13T02:50:55.108 INFO:tasks.workunit.client.1.smithi122.stdout:2/600: chown d0/f51 9555717 1 2024-09-13T02:50:55.110 INFO:tasks.workunit.client.1.smithi122.stdout:7/665: truncate d4/d8/db/dc/d1b/f34 3576467 0 2024-09-13T02:50:55.113 INFO:tasks.workunit.client.1.smithi122.stdout:0/733: rename d1/d4b/d56 to d1/d5/d2d/db4/ddc/df0 0 2024-09-13T02:50:55.113 INFO:tasks.workunit.client.1.smithi122.stdout:5/680: symlink d0/da/d48/db4/ldb 0 2024-09-13T02:50:55.114 INFO:tasks.workunit.client.1.smithi122.stdout:5/681: fdatasync d0/d2/f20 0 2024-09-13T02:50:55.114 INFO:tasks.workunit.client.1.smithi122.stdout:0/734: dread - d1/d5/d9/f6e zero size 2024-09-13T02:50:55.114 INFO:tasks.workunit.client.1.smithi122.stdout:0/735: chown d1/d5/d2d/db4/ddc/df0/d60/de9/ceb 1892887 1 2024-09-13T02:50:55.125 INFO:tasks.workunit.client.1.smithi122.stdout:1/750: creat dc/de/d6e/df7/ffd x:0 0 0 2024-09-13T02:50:55.127 INFO:tasks.workunit.client.1.smithi122.stdout:8/644: mkdir d3/d31/d52/dc1 0 2024-09-13T02:50:55.127 INFO:tasks.workunit.client.1.smithi122.stdout:0/736: dread d1/d5/d2d/db4/ddc/df0/d81/fae [0,4194304] 0 2024-09-13T02:50:55.132 INFO:tasks.workunit.client.1.smithi122.stdout:5/682: dread d0/da/f2a [0,4194304] 0 2024-09-13T02:50:55.134 INFO:tasks.workunit.client.1.smithi122.stdout:4/924: link d11/dcf/ld9 d11/d13/dd8/d114/l11a 0 2024-09-13T02:50:55.136 INFO:tasks.workunit.client.1.smithi122.stdout:1/751: dread dc/de/d18/d1d/f34 [0,4194304] 0 2024-09-13T02:50:55.136 INFO:tasks.workunit.client.1.smithi122.stdout:1/752: dread - dc/d38/db1/d72/dd7/d3f/ff8 zero size 2024-09-13T02:50:55.136 INFO:tasks.workunit.client.1.smithi122.stdout:1/753: write dc/de/d18/d1d/f73 [333094,29628] 0 2024-09-13T02:50:55.136 INFO:tasks.workunit.client.1.smithi122.stdout:1/754: write dc/d38/db1/d7d/f88 [909041,100091] 0 2024-09-13T02:50:55.142 INFO:tasks.workunit.client.1.smithi122.stdout:4/925: mkdir d11/d13/dc9/de3/d8e/dbd/de5/d116/de8/d11b 0 2024-09-13T02:50:55.143 INFO:tasks.workunit.client.1.smithi122.stdout:1/755: symlink dc/de/d18/d22/d76/lfe 0 2024-09-13T02:50:55.144 INFO:tasks.workunit.client.1.smithi122.stdout:0/737: rename d1/d5/d10/d29/d32/f9b to d1/d5/d9/da/d17/ff1 0 2024-09-13T02:50:55.144 INFO:tasks.workunit.client.1.smithi122.stdout:4/926: mkdir d11/d13/dd8/ddc/d11c 0 2024-09-13T02:50:55.145 INFO:tasks.workunit.client.1.smithi122.stdout:1/756: creat dc/de/d18/fff x:0 0 0 2024-09-13T02:50:55.145 INFO:tasks.workunit.client.1.smithi122.stdout:1/757: write dc/f9c [1007876,30057] 0 2024-09-13T02:50:55.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/738: mknod d1/d5/d10/d29/d32/d83/db3/cf2 0 2024-09-13T02:50:55.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/739: write d1/d5/d10/d29/d32/d83/dd7/fdd [4884250,130323] 0 2024-09-13T02:50:55.149 INFO:tasks.workunit.client.1.smithi122.stdout:1/758: creat dc/de/d18/d86/f100 x:0 0 0 2024-09-13T02:50:55.149 INFO:tasks.workunit.client.1.smithi122.stdout:1/759: write dc/de/d18/f28 [1728624,128198] 0 2024-09-13T02:50:55.149 INFO:tasks.workunit.client.1.smithi122.stdout:1/760: write dc/de/d6e/df7/ffd [556803,90504] 0 2024-09-13T02:50:55.150 INFO:tasks.workunit.client.1.smithi122.stdout:0/740: mkdir d1/d5/d2d/db4/ddc/df0/df3 0 2024-09-13T02:50:55.150 INFO:tasks.workunit.client.1.smithi122.stdout:6/737: sync 2024-09-13T02:50:55.150 INFO:tasks.workunit.client.1.smithi122.stdout:3/764: sync 2024-09-13T02:50:55.151 INFO:tasks.workunit.client.1.smithi122.stdout:0/741: mkdir d1/d5/d10/d29/d32/d83/db3/df4 0 2024-09-13T02:50:55.152 INFO:tasks.workunit.client.1.smithi122.stdout:3/765: mkdir d4/d11/dd/d21/d74/d11b 0 2024-09-13T02:50:55.154 INFO:tasks.workunit.client.1.smithi122.stdout:0/742: mkdir d1/d5/d10/d29/d32/d83/db3/df5 0 2024-09-13T02:50:55.154 INFO:tasks.workunit.client.1.smithi122.stdout:0/743: chown d1/d5/d10/c3c 111 1 2024-09-13T02:50:55.155 INFO:tasks.workunit.client.1.smithi122.stdout:3/766: symlink d4/d6/l11c 0 2024-09-13T02:50:55.155 INFO:tasks.workunit.client.1.smithi122.stdout:3/767: write d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/ff6 [357650,102250] 0 2024-09-13T02:50:55.157 INFO:tasks.workunit.client.1.smithi122.stdout:0/744: creat d1/d5/d2d/db4/ddc/ff6 x:0 0 0 2024-09-13T02:50:55.160 INFO:tasks.workunit.client.1.smithi122.stdout:3/768: rename d4/d11/dd/d21/d2b/d36/d3c/d43/d82/ce8 to d4/d6/de/d41/c11d 0 2024-09-13T02:50:55.161 INFO:tasks.workunit.client.1.smithi122.stdout:0/745: getdents d1/d5/d9 0 2024-09-13T02:50:55.163 INFO:tasks.workunit.client.1.smithi122.stdout:3/769: mknod d4/d4c/d10e/c11e 0 2024-09-13T02:50:55.163 INFO:tasks.workunit.client.1.smithi122.stdout:6/738: dread d5/d3d/d6c/d41/d4e/f88 [0,4194304] 0 2024-09-13T02:50:55.164 INFO:tasks.workunit.client.1.smithi122.stdout:3/770: link d4/d11/dd/d21/d2b/d36/d3c/d43/d82/lac d4/d11/dd/d21/d30/l11f 0 2024-09-13T02:50:55.164 INFO:tasks.workunit.client.1.smithi122.stdout:3/771: dread - d4/d11/dd/d21/d2b/d36/d3c/d43/da3/f116 zero size 2024-09-13T02:50:55.165 INFO:tasks.workunit.client.1.smithi122.stdout:3/772: symlink d4/d6/de/d1f/l120 0 2024-09-13T02:50:55.165 INFO:tasks.workunit.client.1.smithi122.stdout:3/773: chown d4/d11/dd/f65 0 1 2024-09-13T02:50:55.166 INFO:tasks.workunit.client.1.smithi122.stdout:3/774: creat d4/d6/de/f121 x:0 0 0 2024-09-13T02:50:55.168 INFO:tasks.workunit.client.1.smithi122.stdout:2/601: dwrite d0/d1e/d22/d29/f9e [0,4194304] 0 2024-09-13T02:50:55.169 INFO:tasks.workunit.client.1.smithi122.stdout:7/666: dwrite d4/d8/d24/f3e [4194304,4194304] 0 2024-09-13T02:50:55.172 INFO:tasks.workunit.client.1.smithi122.stdout:8/645: dwrite d3/d31/d52/fa8 [0,4194304] 0 2024-09-13T02:50:55.173 INFO:tasks.workunit.client.1.smithi122.stdout:5/683: dwrite d0/d17/d36/d8b/f9d [0,4194304] 0 2024-09-13T02:50:55.177 INFO:tasks.workunit.client.1.smithi122.stdout:2/602: write d0/d1e/d2e/d3e/f4b [7115315,122162] 0 2024-09-13T02:50:55.178 INFO:tasks.workunit.client.1.smithi122.stdout:2/603: fsync d0/d55/f81 0 2024-09-13T02:50:55.178 INFO:tasks.workunit.client.1.smithi122.stdout:7/667: creat d4/d8/d3d/dc2/fdd x:0 0 0 2024-09-13T02:50:55.192 INFO:tasks.workunit.client.1.smithi122.stdout:1/761: dwrite dc/de/d18/f65 [0,4194304] 0 2024-09-13T02:50:55.193 INFO:tasks.workunit.client.1.smithi122.stdout:1/762: fdatasync f2 0 2024-09-13T02:50:55.200 INFO:tasks.workunit.client.1.smithi122.stdout:6/739: dwrite d5/db/d29/fa4 [0,4194304] 0 2024-09-13T02:50:55.207 INFO:tasks.workunit.client.1.smithi122.stdout:8/646: truncate d3/d31/d52/d59/f5f 2406355 0 2024-09-13T02:50:55.212 INFO:tasks.workunit.client.1.smithi122.stdout:5/684: creat d0/da/d8c/d8f/da0/fdc x:0 0 0 2024-09-13T02:50:55.213 INFO:tasks.workunit.client.1.smithi122.stdout:4/927: dwrite d11/d13/d82/d2a/f2b [0,4194304] 0 2024-09-13T02:50:55.214 INFO:tasks.workunit.client.1.smithi122.stdout:3/775: dwrite f3 [4194304,4194304] 0 2024-09-13T02:50:55.214 INFO:tasks.workunit.client.1.smithi122.stdout:3/776: chown d4/d11/dd/d21/cc6 264575 1 2024-09-13T02:50:55.214 INFO:tasks.workunit.client.1.smithi122.stdout:3/777: fsync d4/d11/dd/d21/d4e/dc8/fc9 0 2024-09-13T02:50:55.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/604: unlink d0/d1e/d26/d3d/f56 0 2024-09-13T02:50:55.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/605: fsync d0/d1e/d2e/d3e/f5b 0 2024-09-13T02:50:55.220 INFO:tasks.workunit.client.1.smithi122.stdout:0/746: dwrite d1/d5/d9/da/d17/fbc [0,4194304] 0 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:7/668: mknod d4/d8/d24/cde 0 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:7/669: write d4/d6d/d8c/dc3/f7c [916782,79759] 0 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:7/670: write d4/fc4 [706596,127940] 0 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:7/671: stat d4/d8/db/dc/d46/l59 0 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:7/672: read - d4/d8/d3d/dc2/fdd zero size 2024-09-13T02:50:55.223 INFO:tasks.workunit.client.1.smithi122.stdout:1/763: dwrite dc/de/d18/d22/f55 [0,4194304] 0 2024-09-13T02:50:55.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/740: rename d5/fe to d5/d3d/d6c/d41/d4e/d93/fdf 0 2024-09-13T02:50:55.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/741: read d5/d3d/f77 [650594,54733] 0 2024-09-13T02:50:55.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/742: chown d5/d3d/d6c/d41/d5b/d7d/ddd 1000 0 2024-09-13T02:50:55.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/743: chown d5/d3d/da3/lbf 2 1 2024-09-13T02:50:55.229 INFO:tasks.workunit.client.1.smithi122.stdout:8/647: rmdir d3/d31/d52/d89/d8b/d5c 39 2024-09-13T02:50:55.232 INFO:tasks.workunit.client.1.smithi122.stdout:4/928: dwrite d11/f80 [0,4194304] 0 2024-09-13T02:50:55.232 INFO:tasks.workunit.client.1.smithi122.stdout:4/929: chown d11/d30 9236 1 2024-09-13T02:50:55.236 INFO:tasks.workunit.client.1.smithi122.stdout:3/778: creat d4/d11/dd/df1/f122 x:0 0 0 2024-09-13T02:50:55.236 INFO:tasks.workunit.client.1.smithi122.stdout:9/718: sync 2024-09-13T02:50:55.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/606: mknod d0/d1e/d22/d29/cbc 0 2024-09-13T02:50:55.249 INFO:tasks.workunit.client.1.smithi122.stdout:0/747: creat d1/d5/d9/da/d17/d69/d85/ff7 x:0 0 0 2024-09-13T02:50:55.250 INFO:tasks.workunit.client.1.smithi122.stdout:0/748: creat d1/d5/d9/da/d17/d69/d85/ff8 x:0 0 0 2024-09-13T02:50:55.251 INFO:tasks.workunit.client.1.smithi122.stdout:7/673: link d4/d6d/d8c/f99 d4/d8/d3d/dc2/dca/fdf 0 2024-09-13T02:50:55.252 INFO:tasks.workunit.client.1.smithi122.stdout:7/674: fdatasync d4/d8/db/dc/f3b 0 2024-09-13T02:50:55.252 INFO:tasks.workunit.client.1.smithi122.stdout:7/675: truncate d4/d8/d24/d47/fd6 916176 0 2024-09-13T02:50:55.261 INFO:tasks.workunit.client.1.smithi122.stdout:5/685: rename d0/d2/f13 to d0/da/d48/fdd 0 2024-09-13T02:50:55.263 INFO:tasks.workunit.client.1.smithi122.stdout:8/648: link d3/da/d1e/c74 d3/d31/d52/cc2 0 2024-09-13T02:50:55.265 INFO:tasks.workunit.client.1.smithi122.stdout:4/930: mknod d11/d13/c11d 0 2024-09-13T02:50:55.268 INFO:tasks.workunit.client.1.smithi122.stdout:3/779: getdents d4/d11/dd/d21 0 2024-09-13T02:50:55.268 INFO:tasks.workunit.client.1.smithi122.stdout:3/780: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f123 x:0 0 0 2024-09-13T02:50:55.268 INFO:tasks.workunit.client.1.smithi122.stdout:3/781: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f124 x:0 0 0 2024-09-13T02:50:55.269 INFO:tasks.workunit.client.1.smithi122.stdout:2/607: mkdir d0/d1e/d26/dbd 0 2024-09-13T02:50:55.269 INFO:tasks.workunit.client.1.smithi122.stdout:2/608: chown d0/d1c/d3b/d41/c6c 358204 1 2024-09-13T02:50:55.269 INFO:tasks.workunit.client.1.smithi122.stdout:2/609: chown d0/d1e/d22/d29/fa2 3451 1 2024-09-13T02:50:55.270 INFO:tasks.workunit.client.1.smithi122.stdout:9/719: rmdir d8/d16/d3d/d59/d23/d7b/dc3 0 2024-09-13T02:50:55.270 INFO:tasks.workunit.client.1.smithi122.stdout:9/720: fdatasync d8/d16/d3d/d59/d7d/f9c 0 2024-09-13T02:50:55.272 INFO:tasks.workunit.client.1.smithi122.stdout:7/676: creat d4/d8/db/fe0 x:0 0 0 2024-09-13T02:50:55.273 INFO:tasks.workunit.client.1.smithi122.stdout:1/764: truncate dc/de/d18/d1d/f73 311602 0 2024-09-13T02:50:55.273 INFO:tasks.workunit.client.1.smithi122.stdout:1/765: creat dc/de/d18/f101 x:0 0 0 2024-09-13T02:50:55.273 INFO:tasks.workunit.client.1.smithi122.stdout:1/766: fdatasync dc/de/d6e/ff4 0 2024-09-13T02:50:55.275 INFO:tasks.workunit.client.1.smithi122.stdout:0/749: dwrite d1/d5/d2d/f72 [0,4194304] 0 2024-09-13T02:50:55.275 INFO:tasks.workunit.client.1.smithi122.stdout:0/750: readlink d1/d5/le3 0 2024-09-13T02:50:55.275 INFO:tasks.workunit.client.1.smithi122.stdout:6/744: rename d5/d3d/d6c/d41/d5b/d7a/d9a/lb2 to d5/db/d29/le0 0 2024-09-13T02:50:55.276 INFO:tasks.workunit.client.1.smithi122.stdout:5/686: read d0/d2/f6d [3757867,61174] 0 2024-09-13T02:50:55.277 INFO:tasks.workunit.client.1.smithi122.stdout:8/649: rmdir d3/d53/d34/d94/dad 0 2024-09-13T02:50:55.278 INFO:tasks.workunit.client.1.smithi122.stdout:0/751: write d1/f38 [269381,48781] 0 2024-09-13T02:50:55.279 INFO:tasks.workunit.client.1.smithi122.stdout:4/931: truncate d11/f56 4147717 0 2024-09-13T02:50:55.280 INFO:tasks.workunit.client.1.smithi122.stdout:4/932: chown d11/d13/dd8/ddc 2281 1 2024-09-13T02:50:55.280 INFO:tasks.workunit.client.1.smithi122.stdout:4/933: stat d11/d13/d82/f48 0 2024-09-13T02:50:55.282 INFO:tasks.workunit.client.1.smithi122.stdout:2/610: mknod d0/d1e/d2e/cbe 0 2024-09-13T02:50:55.282 INFO:tasks.workunit.client.1.smithi122.stdout:2/611: chown d0/f1b 0 1 2024-09-13T02:50:55.284 INFO:tasks.workunit.client.1.smithi122.stdout:1/767: creat dc/de/d18/d22/d1c/d57/f102 x:0 0 0 2024-09-13T02:50:55.288 INFO:tasks.workunit.client.1.smithi122.stdout:6/745: dread d5/db/d29/fa4 [0,4194304] 0 2024-09-13T02:50:55.288 INFO:tasks.workunit.client.1.smithi122.stdout:9/721: rename d8/d4a/d64/fb6 to d8/d16/d45/dc4/fde 0 2024-09-13T02:50:55.288 INFO:tasks.workunit.client.1.smithi122.stdout:9/722: stat d8/d16/d3e/c8d 0 2024-09-13T02:50:55.291 INFO:tasks.workunit.client.1.smithi122.stdout:8/650: rename d3/da/la5 to d3/da/lc3 0 2024-09-13T02:50:55.291 INFO:tasks.workunit.client.1.smithi122.stdout:8/651: chown d3/da/d1f 5 1 2024-09-13T02:50:55.292 INFO:tasks.workunit.client.1.smithi122.stdout:5/687: read d0/d17/d36/d3f/d4c/d7f/fc4 [212889,4907] 0 2024-09-13T02:50:55.292 INFO:tasks.workunit.client.1.smithi122.stdout:0/752: link d1/d5/d10/d29/d32/d83/db3/cf2 d1/d5/d9/da/d17/d69/cf9 0 2024-09-13T02:50:55.292 INFO:tasks.workunit.client.1.smithi122.stdout:0/753: fdatasync d1/f73 0 2024-09-13T02:50:55.292 INFO:tasks.workunit.client.1.smithi122.stdout:3/782: dwrite d4/d6/f47 [0,4194304] 0 2024-09-13T02:50:55.296 INFO:tasks.workunit.client.1.smithi122.stdout:2/612: mkdir d0/d1c/d3b/dbf 0 2024-09-13T02:50:55.298 INFO:tasks.workunit.client.1.smithi122.stdout:7/677: dwrite d4/d8/d3d/dc2/fdd [0,4194304] 0 2024-09-13T02:50:55.304 INFO:tasks.workunit.client.1.smithi122.stdout:6/746: truncate d5/d11/d45/f78 2420018 0 2024-09-13T02:50:55.304 INFO:tasks.workunit.client.1.smithi122.stdout:6/747: chown d5/db/d29/d60/dd2 2637 1 2024-09-13T02:50:55.309 INFO:tasks.workunit.client.1.smithi122.stdout:6/748: dread d5/d3d/d6c/d41/fb8 [0,4194304] 0 2024-09-13T02:50:55.309 INFO:tasks.workunit.client.1.smithi122.stdout:1/768: rename dc/de/d6e/df7/ffd to dc/de/d18/d22/d1c/f103 0 2024-09-13T02:50:55.312 INFO:tasks.workunit.client.1.smithi122.stdout:4/934: dwrite d11/d13/dd8/df1/dfd/f117 [0,4194304] 0 2024-09-13T02:50:55.313 INFO:tasks.workunit.client.1.smithi122.stdout:9/723: link d8/d16/d3d/d59/d23/d1f/f54 d8/d16/d3d/d59/d29/d90/db7/fdf 0 2024-09-13T02:50:55.319 INFO:tasks.workunit.client.1.smithi122.stdout:0/754: mkdir d1/d5/d10/d29/d32/d83/db3/df4/dfa 0 2024-09-13T02:50:55.319 INFO:tasks.workunit.client.1.smithi122.stdout:0/755: dread - d1/d5/d2d/db4/fca zero size 2024-09-13T02:50:55.321 INFO:tasks.workunit.client.1.smithi122.stdout:3/783: mknod d4/d11/dd/dca/c125 0 2024-09-13T02:50:55.329 INFO:tasks.workunit.client.1.smithi122.stdout:7/678: mkdir d4/d8/db/dc/de1 0 2024-09-13T02:50:55.331 INFO:tasks.workunit.client.1.smithi122.stdout:6/749: mknod d5/d3d/d6c/d41/d4e/d93/ce1 0 2024-09-13T02:50:55.337 INFO:tasks.workunit.client.1.smithi122.stdout:0/756: symlink d1/d5/d2d/db4/ddc/df0/lfb 0 2024-09-13T02:50:55.339 INFO:tasks.workunit.client.1.smithi122.stdout:3/784: rename d4/d11/dd/d21/d30/l52 to d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/l126 0 2024-09-13T02:50:55.339 INFO:tasks.workunit.client.1.smithi122.stdout:6/750: mknod d5/d3d/d6c/d41/db9/ce2 0 2024-09-13T02:50:55.340 INFO:tasks.workunit.client.1.smithi122.stdout:3/785: mkdir d4/d6/df/d15/d68/d127 0 2024-09-13T02:50:55.342 INFO:tasks.workunit.client.1.smithi122.stdout:3/786: rename d4/d6/de/f121 to d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f128 0 2024-09-13T02:50:55.342 INFO:tasks.workunit.client.1.smithi122.stdout:3/787: chown d4/d11/dd/d21/d74/ldd 308115454 1 2024-09-13T02:50:55.344 INFO:tasks.workunit.client.1.smithi122.stdout:3/788: unlink d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f9f 0 2024-09-13T02:50:55.345 INFO:tasks.workunit.client.1.smithi122.stdout:3/789: truncate d4/d11/dd/d21/d4e/dc8/fc9 3198246 0 2024-09-13T02:50:55.345 INFO:tasks.workunit.client.1.smithi122.stdout:3/790: truncate d4/d11/dd/d21/d2b/d36/f107 106703 0 2024-09-13T02:50:55.345 INFO:tasks.workunit.client.1.smithi122.stdout:3/791: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/fe1 [110807,66168] 0 2024-09-13T02:50:55.347 INFO:tasks.workunit.client.1.smithi122.stdout:8/652: dwrite d3/d31/d52/d89/d8b/d5c/f86 [0,4194304] 0 2024-09-13T02:50:55.348 INFO:tasks.workunit.client.1.smithi122.stdout:5/688: dwrite d0/d17/d36/d8b/f96 [0,4194304] 0 2024-09-13T02:50:55.349 INFO:tasks.workunit.client.1.smithi122.stdout:1/769: dwrite dc/d38/db1/d72/dd7/d3f/f7f [0,4194304] 0 2024-09-13T02:50:55.349 INFO:tasks.workunit.client.1.smithi122.stdout:1/770: creat dc/de/d18/d22/d1c/d57/dc6/f104 x:0 0 0 2024-09-13T02:50:55.350 INFO:tasks.workunit.client.1.smithi122.stdout:8/653: creat d3/da/d91/fc4 x:0 0 0 2024-09-13T02:50:55.354 INFO:tasks.workunit.client.1.smithi122.stdout:5/689: symlink d0/da/d48/db4/dc8/lde 0 2024-09-13T02:50:55.356 INFO:tasks.workunit.client.1.smithi122.stdout:7/679: dwrite d4/d4e/d5d/d6b/f78 [0,4194304] 0 2024-09-13T02:50:55.358 INFO:tasks.workunit.client.1.smithi122.stdout:0/757: dwrite d1/d5/d9/da/d17/f43 [4194304,4194304] 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:2/613: dwrite d0/f2c [0,4194304] 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:1/771: mkdir dc/d38/d51/daf/d105 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:1/772: fsync dc/de/d7a/fa0 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:4/935: dwrite d11/d1b/d32/dc4/f108 [0,4194304] 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:4/936: fsync d11/d13/dd8/df1/dfd/f6b 0 2024-09-13T02:50:55.359 INFO:tasks.workunit.client.1.smithi122.stdout:4/937: write d11/dcf/fca [394446,42999] 0 2024-09-13T02:50:55.361 INFO:tasks.workunit.client.1.smithi122.stdout:8/654: dread d3/d31/d52/d89/d8b/d5c/f8c [0,4194304] 0 2024-09-13T02:50:55.361 INFO:tasks.workunit.client.1.smithi122.stdout:9/724: dwrite f1 [0,4194304] 0 2024-09-13T02:50:55.369 INFO:tasks.workunit.client.1.smithi122.stdout:4/938: dread d11/dcf/fca [0,4194304] 0 2024-09-13T02:50:55.372 INFO:tasks.workunit.client.1.smithi122.stdout:0/758: mknod d1/d5/d10/d29/d32/d83/db3/cfc 0 2024-09-13T02:50:55.373 INFO:tasks.workunit.client.1.smithi122.stdout:2/614: mkdir d0/dc0 0 2024-09-13T02:50:55.374 INFO:tasks.workunit.client.1.smithi122.stdout:1/773: rename dc/de/d18/f30 to dc/de/d18/f106 0 2024-09-13T02:50:55.375 INFO:tasks.workunit.client.1.smithi122.stdout:1/774: dread - dc/de/d18/d22/ffa zero size 2024-09-13T02:50:55.375 INFO:tasks.workunit.client.1.smithi122.stdout:3/792: rename d4/d6/df/d15 to d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129 0 2024-09-13T02:50:55.378 INFO:tasks.workunit.client.1.smithi122.stdout:6/751: truncate d5/db/d29/fa4 300369 0 2024-09-13T02:50:55.380 INFO:tasks.workunit.client.1.smithi122.stdout:5/690: dwrite d0/d2/d33/f52 [0,4194304] 0 2024-09-13T02:50:55.381 INFO:tasks.workunit.client.1.smithi122.stdout:9/725: getdents d8/d16/d3d/d59/d29/d90 0 2024-09-13T02:50:55.383 INFO:tasks.workunit.client.1.smithi122.stdout:7/680: dwrite d4/d8/db/dc/d46/f90 [0,4194304] 0 2024-09-13T02:50:55.388 INFO:tasks.workunit.client.1.smithi122.stdout:8/655: mknod d3/d31/d52/d89/cc5 0 2024-09-13T02:50:55.390 INFO:tasks.workunit.client.1.smithi122.stdout:4/939: getdents d11/d1b/d32/d87 0 2024-09-13T02:50:55.390 INFO:tasks.workunit.client.1.smithi122.stdout:4/940: creat d11/d1b/d32/dc4/f11e x:0 0 0 2024-09-13T02:50:55.392 INFO:tasks.workunit.client.1.smithi122.stdout:2/615: mknod d0/d1c/d3b/d41/d4e/d75/cc1 0 2024-09-13T02:50:55.396 INFO:tasks.workunit.client.1.smithi122.stdout:1/775: unlink dc/de/d18/d22/d1c/d47/fbb 0 2024-09-13T02:50:55.399 INFO:tasks.workunit.client.1.smithi122.stdout:0/759: rename d1/d5/d2d/db4/ddc/df0/d60/f91 to d1/d5/d9/da/d7d/ffd 0 2024-09-13T02:50:55.399 INFO:tasks.workunit.client.1.smithi122.stdout:0/760: write d1/d5/d2d/db4/ddc/df0/d60/faa [3013364,95001] 0 2024-09-13T02:50:55.403 INFO:tasks.workunit.client.1.smithi122.stdout:3/793: link d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f79 d4/d11/dd/df1/f12a 0 2024-09-13T02:50:55.408 INFO:tasks.workunit.client.1.smithi122.stdout:1/776: read dc/f32 [1659920,54227] 0 2024-09-13T02:50:55.408 INFO:tasks.workunit.client.1.smithi122.stdout:5/691: creat d0/d17/d36/d8b/fdf x:0 0 0 2024-09-13T02:50:55.408 INFO:tasks.workunit.client.1.smithi122.stdout:1/777: chown dc/de/d18/d22/d1c/d57/cb8 17 1 2024-09-13T02:50:55.409 INFO:tasks.workunit.client.1.smithi122.stdout:6/752: dwrite d5/d3d/d6c/d41/d5b/d7a/fc2 [0,4194304] 0 2024-09-13T02:50:55.409 INFO:tasks.workunit.client.1.smithi122.stdout:6/753: chown d5/d11 292 1 2024-09-13T02:50:55.410 INFO:tasks.workunit.client.1.smithi122.stdout:9/726: truncate d8/d16/d3d/d59/d49/fc5 3760295 0 2024-09-13T02:50:55.410 INFO:tasks.workunit.client.1.smithi122.stdout:9/727: readlink d8/d16/d3d/d59/d29/d90/la0 0 2024-09-13T02:50:55.412 INFO:tasks.workunit.client.1.smithi122.stdout:7/681: rmdir d4/d8/db/d63/dbb 39 2024-09-13T02:50:55.414 INFO:tasks.workunit.client.1.smithi122.stdout:2/616: symlink d0/d1c/d3b/dbf/lc2 0 2024-09-13T02:50:55.417 INFO:tasks.workunit.client.1.smithi122.stdout:5/692: link d0/da/d8c/lc0 d0/d2/d33/le0 0 2024-09-13T02:50:55.417 INFO:tasks.workunit.client.1.smithi122.stdout:5/693: truncate d0/da/f16 2259850 0 2024-09-13T02:50:55.417 INFO:tasks.workunit.client.1.smithi122.stdout:5/694: stat d0/da/d48/db4/lb9 0 2024-09-13T02:50:55.419 INFO:tasks.workunit.client.1.smithi122.stdout:7/682: rename d4/d8/db/d63/c9f to d4/d8/db/dc/d1b/d49/da0/ce2 0 2024-09-13T02:50:55.420 INFO:tasks.workunit.client.1.smithi122.stdout:2/617: truncate d0/d1e/d22/f37 1197538 0 2024-09-13T02:50:55.423 INFO:tasks.workunit.client.1.smithi122.stdout:2/618: mkdir d0/d1e/dc3 0 2024-09-13T02:50:55.427 INFO:tasks.workunit.client.1.smithi122.stdout:0/761: dread d1/d4b/fde [0,4194304] 0 2024-09-13T02:50:55.429 INFO:tasks.workunit.client.1.smithi122.stdout:2/619: link d0/d1c/d3b/d41/c6c d0/d1c/cc4 0 2024-09-13T02:50:55.429 INFO:tasks.workunit.client.1.smithi122.stdout:2/620: chown d0/d1e/d26 50440 1 2024-09-13T02:50:55.429 INFO:tasks.workunit.client.1.smithi122.stdout:2/621: chown d0/d1e/d26/d3d/d84 4055448 1 2024-09-13T02:50:55.429 INFO:tasks.workunit.client.1.smithi122.stdout:2/622: truncate d0/d1e/d92/f93 380944 0 2024-09-13T02:50:55.430 INFO:tasks.workunit.client.1.smithi122.stdout:6/754: dread d5/db/d29/fa4 [0,4194304] 0 2024-09-13T02:50:55.431 INFO:tasks.workunit.client.1.smithi122.stdout:6/755: read d5/d40/dcd/fce [1628555,56453] 0 2024-09-13T02:50:55.433 INFO:tasks.workunit.client.1.smithi122.stdout:2/623: mknod d0/d1e/d26/d3d/cc5 0 2024-09-13T02:50:55.434 INFO:tasks.workunit.client.1.smithi122.stdout:6/756: mknod d5/d3d/d6c/d41/ce3 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:7/683: write d4/f7d [2998942,111448] 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:8/656: dwrite d3/d31/f6e [0,4194304] 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:7/684: mknod d4/d6d/da6/dbf/ce3 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:7/685: write d4/d8/db/dc/d46/f4f [5115416,58393] 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:7/686: write d4/d4e/d5d/d6b/fd0 [946514,111607] 0 2024-09-13T02:50:55.440 INFO:tasks.workunit.client.1.smithi122.stdout:7/687: truncate d4/d8/db/f9d 5118673 0 2024-09-13T02:50:55.447 INFO:tasks.workunit.client.1.smithi122.stdout:4/941: dwrite d11/dcf/fca [0,4194304] 0 2024-09-13T02:50:55.447 INFO:tasks.workunit.client.1.smithi122.stdout:4/942: stat d11/d13/dd8/ddc/f10b 0 2024-09-13T02:50:55.449 INFO:tasks.workunit.client.1.smithi122.stdout:8/657: dread d3/d53/d4d/f6b [4194304,4194304] 0 2024-09-13T02:50:55.452 INFO:tasks.workunit.client.1.smithi122.stdout:6/757: dread d5/f8 [0,4194304] 0 2024-09-13T02:50:55.458 INFO:tasks.workunit.client.1.smithi122.stdout:9/728: dwrite d8/d88/d65/faf [0,4194304] 0 2024-09-13T02:50:55.459 INFO:tasks.workunit.client.1.smithi122.stdout:5/695: dwrite d0/da/d48/d63/d98/fad [4194304,4194304] 0 2024-09-13T02:50:55.461 INFO:tasks.workunit.client.1.smithi122.stdout:8/658: dread d3/d53/d34/f55 [0,4194304] 0 2024-09-13T02:50:55.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/778: dwrite dc/d38/db1/d72/dd7/d46/f81 [0,4194304] 0 2024-09-13T02:50:55.463 INFO:tasks.workunit.client.1.smithi122.stdout:5/696: rename d0/d17/d36/f50 to d0/d17/d36/d3f/fe1 0 2024-09-13T02:50:55.464 INFO:tasks.workunit.client.1.smithi122.stdout:6/758: dread d5/d3d/d6c/d41/d4e/d93/fa9 [0,4194304] 0 2024-09-13T02:50:55.466 INFO:tasks.workunit.client.1.smithi122.stdout:0/762: dwrite d1/d5/d9/da/d92/d94/f5c [0,4194304] 0 2024-09-13T02:50:55.466 INFO:tasks.workunit.client.1.smithi122.stdout:7/688: dwrite d4/d8/d3d/dc2/fdd [0,4194304] 0 2024-09-13T02:50:55.466 INFO:tasks.workunit.client.1.smithi122.stdout:7/689: write d4/d4e/d5d/f5e [4866551,57079] 0 2024-09-13T02:50:55.466 INFO:tasks.workunit.client.1.smithi122.stdout:7/690: readlink d4/d8/d24/l33 0 2024-09-13T02:50:55.469 INFO:tasks.workunit.client.1.smithi122.stdout:9/729: write d8/d16/d3d/d59/d23/d1f/d36/fa8 [3039471,3423] 0 2024-09-13T02:50:55.473 INFO:tasks.workunit.client.1.smithi122.stdout:9/730: dread d8/d16/d3d/d59/d7d/f78 [0,4194304] 0 2024-09-13T02:50:55.473 INFO:tasks.workunit.client.1.smithi122.stdout:9/731: truncate d8/d16/d3d/d59/d23/d1f/f54 1809979 0 2024-09-13T02:50:55.473 INFO:tasks.workunit.client.1.smithi122.stdout:6/759: dread d5/db/d29/fb6 [0,4194304] 0 2024-09-13T02:50:55.504 INFO:tasks.workunit.client.1.smithi122.stdout:8/659: symlink d3/d31/lc6 0 2024-09-13T02:50:55.506 INFO:tasks.workunit.client.1.smithi122.stdout:5/697: symlink d0/d2/d33/le2 0 2024-09-13T02:50:55.508 INFO:tasks.workunit.client.1.smithi122.stdout:7/691: symlink d4/d4e/le4 0 2024-09-13T02:50:55.508 INFO:tasks.workunit.client.1.smithi122.stdout:7/692: chown d4/d6d/da6/dbf/db1/f93 80 1 2024-09-13T02:50:55.511 INFO:tasks.workunit.client.1.smithi122.stdout:9/732: dwrite d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:55.511 INFO:tasks.workunit.client.1.smithi122.stdout:9/733: write d8/d16/d3d/d59/d23/d1f/d36/f4c [5385861,57942] 0 2024-09-13T02:50:55.512 INFO:tasks.workunit.client.1.smithi122.stdout:9/734: fdatasync d8/d16/d3d/d59/f8c 0 2024-09-13T02:50:55.512 INFO:tasks.workunit.client.1.smithi122.stdout:9/735: creat d8/d88/fe0 x:0 0 0 2024-09-13T02:50:55.512 INFO:tasks.workunit.client.1.smithi122.stdout:8/660: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:55.529 INFO:tasks.workunit.client.1.smithi122.stdout:1/779: rmdir dc/de/d18/d22/d76 39 2024-09-13T02:50:55.529 INFO:tasks.workunit.client.1.smithi122.stdout:1/780: fdatasync dc/de/d18/d22/d1c/fba 0 2024-09-13T02:50:55.530 INFO:tasks.workunit.client.1.smithi122.stdout:1/781: getdents dc/d38/db1/d72/dd7/d3f/dc1/dcf 0 2024-09-13T02:50:55.530 INFO:tasks.workunit.client.1.smithi122.stdout:1/782: dread - dc/de/d18/d1d/d2f/fb5 zero size 2024-09-13T02:50:55.531 INFO:tasks.workunit.client.1.smithi122.stdout:7/693: mknod d4/d4e/d5d/d6b/db4/ce5 0 2024-09-13T02:50:55.532 INFO:tasks.workunit.client.1.smithi122.stdout:6/760: getdents d5/d3d/d6c/d41/d4e/d5f 0 2024-09-13T02:50:55.538 INFO:tasks.workunit.client.1.smithi122.stdout:1/783: mknod dc/d38/db1/d72/c107 0 2024-09-13T02:50:55.539 INFO:tasks.workunit.client.1.smithi122.stdout:5/698: rmdir d0/d17/d36/d3f 39 2024-09-13T02:50:55.540 INFO:tasks.workunit.client.1.smithi122.stdout:7/694: getdents d4/d4e 0 2024-09-13T02:50:55.541 INFO:tasks.workunit.client.1.smithi122.stdout:7/695: chown d4/d8/db/dc/d36/l81 157 1 2024-09-13T02:50:55.541 INFO:tasks.workunit.client.1.smithi122.stdout:7/696: fsync d4/d8/d3d/dc2/dca/fdf 0 2024-09-13T02:50:55.542 INFO:tasks.workunit.client.1.smithi122.stdout:6/761: symlink d5/d3d/d48/le4 0 2024-09-13T02:50:55.543 INFO:tasks.workunit.client.1.smithi122.stdout:8/661: truncate d3/da/d1f/f27 630981 0 2024-09-13T02:50:55.545 INFO:tasks.workunit.client.1.smithi122.stdout:1/784: creat dc/de/d18/d22/d1c/f108 x:0 0 0 2024-09-13T02:50:55.545 INFO:tasks.workunit.client.1.smithi122.stdout:1/785: readlink dc/d38/db1/d72/dd7/d3f/l6f 0 2024-09-13T02:50:55.547 INFO:tasks.workunit.client.1.smithi122.stdout:7/697: truncate d4/f35 8661396 0 2024-09-13T02:50:55.550 INFO:tasks.workunit.client.1.smithi122.stdout:6/762: mknod d5/d3d/d82/dcf/ce5 0 2024-09-13T02:50:55.551 INFO:tasks.workunit.client.1.smithi122.stdout:8/662: symlink d3/d53/d21/lc7 0 2024-09-13T02:50:55.551 INFO:tasks.workunit.client.1.smithi122.stdout:1/786: stat dc/de/d18/d22/d1c/d57/dc6/le7 0 2024-09-13T02:50:55.554 INFO:tasks.workunit.client.1.smithi122.stdout:6/763: mknod d5/d3d/d6c/d41/db9/ce6 0 2024-09-13T02:50:55.555 INFO:tasks.workunit.client.1.smithi122.stdout:6/764: stat d5/la 0 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:8/663: rmdir d3/d31/d65 39 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:7/698: dread d4/d8/db/dc/f3b [0,4194304] 0 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:6/765: creat d5/d3d/d6c/d41/d4e/fe7 x:0 0 0 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:7/699: write d4/d77/fd7 [383844,63441] 0 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:6/766: write d5/d11/fc1 [966862,84829] 0 2024-09-13T02:50:55.561 INFO:tasks.workunit.client.1.smithi122.stdout:6/767: fdatasync d5/f5a 0 2024-09-13T02:50:55.563 INFO:tasks.workunit.client.1.smithi122.stdout:7/700: write d4/d4e/d5d/d6b/fd0 [725018,21926] 0 2024-09-13T02:50:55.563 INFO:tasks.workunit.client.1.smithi122.stdout:7/701: write d4/d8/d24/f37 [4548760,98930] 0 2024-09-13T02:50:55.564 INFO:tasks.workunit.client.1.smithi122.stdout:8/664: rename d3/d31/lc6 to d3/d31/d52/dc1/lc8 0 2024-09-13T02:50:55.564 INFO:tasks.workunit.client.1.smithi122.stdout:8/665: chown d3/d31/f85 0 1 2024-09-13T02:50:55.565 INFO:tasks.workunit.client.1.smithi122.stdout:6/768: creat d5/d3d/d6c/d41/d5b/d7d/ddd/d26/fe8 x:0 0 0 2024-09-13T02:50:55.570 INFO:tasks.workunit.client.1.smithi122.stdout:7/702: creat d4/d8/d3d/d7e/fe6 x:0 0 0 2024-09-13T02:50:55.571 INFO:tasks.workunit.client.1.smithi122.stdout:6/769: creat d5/db/d29/d60/dac/fe9 x:0 0 0 2024-09-13T02:50:55.577 INFO:tasks.workunit.client.1.smithi122.stdout:1/787: dwrite dc/de/d18/d22/d1c/d57/dc6/f104 [0,4194304] 0 2024-09-13T02:50:55.578 INFO:tasks.workunit.client.1.smithi122.stdout:1/788: truncate dc/f9e 308407 0 2024-09-13T02:50:55.580 INFO:tasks.workunit.client.1.smithi122.stdout:1/789: symlink dc/d38/db1/d72/l109 0 2024-09-13T02:50:55.580 INFO:tasks.workunit.client.1.smithi122.stdout:1/790: dread - dc/de/d18/d1d/d2f/fb5 zero size 2024-09-13T02:50:55.580 INFO:tasks.workunit.client.1.smithi122.stdout:9/736: dwrite d8/d16/d3d/d59/d23/d1f/f54 [0,4194304] 0 2024-09-13T02:50:55.582 INFO:tasks.workunit.client.1.smithi122.stdout:1/791: rename dc/d38/db1/d72/df2 to dc/de/d18/d22/d10a 0 2024-09-13T02:50:55.584 INFO:tasks.workunit.client.1.smithi122.stdout:9/737: creat d8/d16/d3e/d57/fe1 x:0 0 0 2024-09-13T02:50:55.585 INFO:tasks.workunit.client.1.smithi122.stdout:1/792: symlink dc/de/d7a/l10b 0 2024-09-13T02:50:55.587 INFO:tasks.workunit.client.1.smithi122.stdout:9/738: mknod d8/d16/d3d/d59/ce2 0 2024-09-13T02:50:55.587 INFO:tasks.workunit.client.1.smithi122.stdout:8/666: dread d3/da/d1f/f7f [0,4194304] 0 2024-09-13T02:50:55.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/739: creat d8/d16/d3d/d59/d7d/d83/fe3 x:0 0 0 2024-09-13T02:50:55.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/740: chown d8/d16/d3d/d59/d23/d1f 6715 1 2024-09-13T02:50:55.589 INFO:tasks.workunit.client.1.smithi122.stdout:7/703: write d4/d8/d3d/f44 [3834789,126626] 0 2024-09-13T02:50:55.589 INFO:tasks.workunit.client.1.smithi122.stdout:8/667: mknod d3/da/d1e/cc9 0 2024-09-13T02:50:55.591 INFO:tasks.workunit.client.1.smithi122.stdout:7/704: rename d4/d8/db/dc/d36/dc8 to d4/d6d/d8f/de7 0 2024-09-13T02:50:55.591 INFO:tasks.workunit.client.1.smithi122.stdout:7/705: creat d4/d77/fe8 x:0 0 0 2024-09-13T02:50:55.591 INFO:tasks.workunit.client.1.smithi122.stdout:7/706: truncate d4/d8/d24/daa/fae 671277 0 2024-09-13T02:50:55.591 INFO:tasks.workunit.client.1.smithi122.stdout:7/707: truncate d4/d8/d24/d47/f7a 126234 0 2024-09-13T02:50:55.592 INFO:tasks.workunit.client.1.smithi122.stdout:8/668: link d3/da/lbc d3/d31/lca 0 2024-09-13T02:50:55.593 INFO:tasks.workunit.client.1.smithi122.stdout:1/793: dread dc/de/d18/d1d/d2f/f4b [0,4194304] 0 2024-09-13T02:50:55.595 INFO:tasks.workunit.client.1.smithi122.stdout:6/770: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d46/f8f [0,4194304] 0 2024-09-13T02:50:55.595 INFO:tasks.workunit.client.1.smithi122.stdout:8/669: rename d3/d53/d4d/d6d to d3/d53/d34/dbf/dcb 0 2024-09-13T02:50:55.596 INFO:tasks.workunit.client.1.smithi122.stdout:8/670: chown d3/d31/d65/f54 383936 1 2024-09-13T02:50:55.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/771: mknod d5/d3d/d6c/d41/d4e/d93/cea 0 2024-09-13T02:50:55.598 INFO:tasks.workunit.client.1.smithi122.stdout:6/772: fdatasync d5/d11/d45/d21/f90 0 2024-09-13T02:50:55.599 INFO:tasks.workunit.client.1.smithi122.stdout:8/671: link d3/da/d1e/f8f d3/d53/d21/d92/fcc 0 2024-09-13T02:50:55.600 INFO:tasks.workunit.client.1.smithi122.stdout:9/741: write d8/d16/d45/f63 [8262867,61912] 0 2024-09-13T02:50:55.600 INFO:tasks.workunit.client.1.smithi122.stdout:7/708: dread d4/d6d/da6/dbf/db1/f9b [0,4194304] 0 2024-09-13T02:50:55.604 INFO:tasks.workunit.client.1.smithi122.stdout:9/742: rmdir d8/d88/d65 39 2024-09-13T02:50:55.604 INFO:tasks.workunit.client.1.smithi122.stdout:9/743: chown d8/d16/d3d/d59/d29/d90/la0 42832 1 2024-09-13T02:50:55.604 INFO:tasks.workunit.client.1.smithi122.stdout:9/744: getdents d8/d16/d3d/d59/d29/d90/db7/dbc 0 2024-09-13T02:50:55.604 INFO:tasks.workunit.client.1.smithi122.stdout:9/745: read d8/d16/f62 [1391007,91491] 0 2024-09-13T02:50:55.606 INFO:tasks.workunit.client.1.smithi122.stdout:9/746: link d8/d16/d3d/d59/d23/d1f/d36/cae d8/d16/d3d/d59/d7d/d83/ce4 0 2024-09-13T02:50:55.606 INFO:tasks.workunit.client.1.smithi122.stdout:1/794: dread dc/f32 [8388608,4194304] 0 2024-09-13T02:50:55.606 INFO:tasks.workunit.client.1.smithi122.stdout:1/795: readlink dc/d38/db1/d72/dd7/d46/ldc 0 2024-09-13T02:50:55.608 INFO:tasks.workunit.client.1.smithi122.stdout:1/796: mknod dc/d38/d51/c10c 0 2024-09-13T02:50:55.609 INFO:tasks.workunit.client.1.smithi122.stdout:1/797: mkdir dc/de/d18/d22/d1c/d10d 0 2024-09-13T02:50:55.629 INFO:tasks.workunit.client.1.smithi122.stdout:6/773: dwrite d5/d11/d45/f78 [0,4194304] 0 2024-09-13T02:50:55.629 INFO:tasks.workunit.client.1.smithi122.stdout:1/798: dread dc/d38/db1/d72/dd7/f5e [4194304,4194304] 0 2024-09-13T02:50:55.629 INFO:tasks.workunit.client.1.smithi122.stdout:6/774: symlink d5/leb 0 2024-09-13T02:50:55.630 INFO:tasks.workunit.client.1.smithi122.stdout:8/672: dwrite d3/d31/f61 [0,4194304] 0 2024-09-13T02:50:55.630 INFO:tasks.workunit.client.1.smithi122.stdout:8/673: write d3/d53/d21/f98 [833196,114307] 0 2024-09-13T02:50:55.632 INFO:tasks.workunit.client.1.smithi122.stdout:8/674: truncate d3/d31/d52/d89/d8b/d5c/f83 453162 0 2024-09-13T02:50:55.632 INFO:tasks.workunit.client.1.smithi122.stdout:9/747: dwrite d8/d16/d3d/d59/d23/d1f/f2a [0,4194304] 0 2024-09-13T02:50:55.636 INFO:tasks.workunit.client.1.smithi122.stdout:7/709: getdents d4/d6d/d8f 0 2024-09-13T02:50:55.636 INFO:tasks.workunit.client.1.smithi122.stdout:7/710: read - d4/d6d/da6/dbf/db1/da3/fb9 zero size 2024-09-13T02:50:55.636 INFO:tasks.workunit.client.1.smithi122.stdout:7/711: dread - d4/d8/d3d/d7e/fbc zero size 2024-09-13T02:50:55.636 INFO:tasks.workunit.client.1.smithi122.stdout:7/712: creat d4/d4e/d5d/d6b/fe9 x:0 0 0 2024-09-13T02:50:55.637 INFO:tasks.workunit.client.1.smithi122.stdout:8/675: dread d3/da/d1e/f8f [0,4194304] 0 2024-09-13T02:50:55.637 INFO:tasks.workunit.client.1.smithi122.stdout:8/676: creat d3/d53/d34/fcd x:0 0 0 2024-09-13T02:50:55.640 INFO:tasks.workunit.client.1.smithi122.stdout:9/748: rmdir d8/d16/d3d/d59/d49 39 2024-09-13T02:50:55.643 INFO:tasks.workunit.client.1.smithi122.stdout:8/677: symlink d3/d31/d52/d89/db1/lce 0 2024-09-13T02:50:55.645 INFO:tasks.workunit.client.1.smithi122.stdout:8/678: mknod d3/d53/d34/dbf/ccf 0 2024-09-13T02:50:55.645 INFO:tasks.workunit.client.1.smithi122.stdout:8/679: chown d3/d53/d21/c75 2488 1 2024-09-13T02:50:55.645 INFO:tasks.workunit.client.1.smithi122.stdout:7/713: write d4/d8/db/dc/f22 [1871998,101275] 0 2024-09-13T02:50:55.646 INFO:tasks.workunit.client.1.smithi122.stdout:6/775: dwrite d5/db/f44 [4194304,4194304] 0 2024-09-13T02:50:55.647 INFO:tasks.workunit.client.1.smithi122.stdout:8/680: unlink d3/d31/d52/dc1/lc8 0 2024-09-13T02:50:55.647 INFO:tasks.workunit.client.1.smithi122.stdout:8/681: chown d3/d53/d34/f38 27234493 1 2024-09-13T02:50:55.647 INFO:tasks.workunit.client.1.smithi122.stdout:8/682: creat d3/d31/d52/d89/db1/fd0 x:0 0 0 2024-09-13T02:50:55.651 INFO:tasks.workunit.client.1.smithi122.stdout:8/683: symlink d3/d53/d34/dbf/dcb/d76/ld1 0 2024-09-13T02:50:55.656 INFO:tasks.workunit.client.1.smithi122.stdout:9/749: dwrite d8/d16/d3d/d59/d23/d1f/f54 [0,4194304] 0 2024-09-13T02:50:55.667 INFO:tasks.workunit.client.1.smithi122.stdout:9/750: dread d8/d16/d3d/d59/d29/f76 [0,4194304] 0 2024-09-13T02:50:55.667 INFO:tasks.workunit.client.1.smithi122.stdout:9/751: read d8/d16/d3d/d59/d23/d1f/d36/fa8 [570407,4306] 0 2024-09-13T02:50:55.668 INFO:tasks.workunit.client.1.smithi122.stdout:9/752: symlink d8/d88/d65/le5 0 2024-09-13T02:50:55.668 INFO:tasks.workunit.client.1.smithi122.stdout:9/753: write d8/d16/d3d/d59/d7d/d83/fda [146757,115303] 0 2024-09-13T02:50:55.670 INFO:tasks.workunit.client.1.smithi122.stdout:9/754: creat d8/d16/d3d/d59/d7d/fe6 x:0 0 0 2024-09-13T02:50:55.670 INFO:tasks.workunit.client.1.smithi122.stdout:9/755: read d8/f2e [2772024,38912] 0 2024-09-13T02:50:55.673 INFO:tasks.workunit.client.1.smithi122.stdout:6/776: dwrite d5/d11/d45/f81 [4194304,4194304] 0 2024-09-13T02:50:55.674 INFO:tasks.workunit.client.1.smithi122.stdout:6/777: getdents d5/d3d/d6c/d41/d4e/d93 0 2024-09-13T02:50:55.674 INFO:tasks.workunit.client.1.smithi122.stdout:6/778: write d5/d3d/d6c/d41/d4e/d93/fa9 [5061943,120774] 0 2024-09-13T02:50:55.675 INFO:tasks.workunit.client.1.smithi122.stdout:6/779: chown d5/d3d/d82/db1 0 1 2024-09-13T02:50:55.676 INFO:tasks.workunit.client.1.smithi122.stdout:7/714: dwrite d4/d4e/d5d/d6b/fe9 [0,4194304] 0 2024-09-13T02:50:55.676 INFO:tasks.workunit.client.1.smithi122.stdout:7/715: chown d4/d6d/d8f/cab 24207123 1 2024-09-13T02:50:55.676 INFO:tasks.workunit.client.1.smithi122.stdout:7/716: truncate d4/d8/db/f42 1897028 0 2024-09-13T02:50:55.677 INFO:tasks.workunit.client.1.smithi122.stdout:8/684: dwrite d3/d53/d34/f38 [0,4194304] 0 2024-09-13T02:50:55.677 INFO:tasks.workunit.client.1.smithi122.stdout:6/780: unlink d5/d3d/d6c/d41/d5b/cd5 0 2024-09-13T02:50:55.677 INFO:tasks.workunit.client.1.smithi122.stdout:6/781: readlink d5/d3d/d82/db1/lc7 0 2024-09-13T02:50:55.677 INFO:tasks.workunit.client.1.smithi122.stdout:6/782: chown d5/d3d/d6c/d41/l80 22 1 2024-09-13T02:50:55.679 INFO:tasks.workunit.client.1.smithi122.stdout:7/717: rename d4/d6d/d8c/dc3/c5c to d4/d8/db/dc/d46/cea 0 2024-09-13T02:50:55.680 INFO:tasks.workunit.client.1.smithi122.stdout:8/685: mknod d3/da/cd2 0 2024-09-13T02:50:55.682 INFO:tasks.workunit.client.1.smithi122.stdout:6/783: symlink d5/db/d29/d60/lec 0 2024-09-13T02:50:55.682 INFO:tasks.workunit.client.1.smithi122.stdout:6/784: chown d5/d11/f4f 401 1 2024-09-13T02:50:55.684 INFO:tasks.workunit.client.1.smithi122.stdout:7/718: unlink d4/d8/d24/d47/l52 0 2024-09-13T02:50:55.684 INFO:tasks.workunit.client.1.smithi122.stdout:7/719: write d4/d8/d3d/dc2/dca/fdf [4291339,123183] 0 2024-09-13T02:50:55.686 INFO:tasks.workunit.client.1.smithi122.stdout:7/720: symlink d4/d4e/d5d/d6b/leb 0 2024-09-13T02:50:55.686 INFO:tasks.workunit.client.1.smithi122.stdout:7/721: stat d4/d4e/d5d/f5e 0 2024-09-13T02:50:55.689 INFO:tasks.workunit.client.1.smithi122.stdout:9/756: dwrite d8/d16/d3e/fd6 [0,4194304] 0 2024-09-13T02:50:55.693 INFO:tasks.workunit.client.1.smithi122.stdout:9/757: mknod d8/d88/d65/ce7 0 2024-09-13T02:50:55.695 INFO:tasks.workunit.client.1.smithi122.stdout:6/785: write d5/d3d/d6c/d41/d5b/d7d/ddd/d46/f5d [2885959,130569] 0 2024-09-13T02:50:55.697 INFO:tasks.workunit.client.1.smithi122.stdout:6/786: creat d5/d3d/d48/dd7/fed x:0 0 0 2024-09-13T02:50:55.700 INFO:tasks.workunit.client.1.smithi122.stdout:6/787: symlink d5/d11/d3a/lee 0 2024-09-13T02:50:55.700 INFO:tasks.workunit.client.1.smithi122.stdout:7/722: dwrite d4/f29 [0,4194304] 0 2024-09-13T02:50:55.700 INFO:tasks.workunit.client.1.smithi122.stdout:7/723: chown d4/d8/d3d/d7e 1 1 2024-09-13T02:50:55.702 INFO:tasks.workunit.client.1.smithi122.stdout:9/758: read d8/d16/d3e/f6b [3913102,83942] 0 2024-09-13T02:50:55.703 INFO:tasks.workunit.client.1.smithi122.stdout:9/759: write d8/d16/d3d/d59/d23/d7b/d82/f95 [3498491,101108] 0 2024-09-13T02:50:55.703 INFO:tasks.workunit.client.1.smithi122.stdout:9/760: read d8/d16/d3d/d59/d29/f76 [1245727,38572] 0 2024-09-13T02:50:55.708 INFO:tasks.workunit.client.1.smithi122.stdout:7/724: mknod d4/d8/db/dc/d1b/d49/da0/cec 0 2024-09-13T02:50:55.708 INFO:tasks.workunit.client.1.smithi122.stdout:7/725: truncate d4/d8/db/d63/fb6 560070 0 2024-09-13T02:50:55.708 INFO:tasks.workunit.client.1.smithi122.stdout:7/726: chown d4/d8/d24 4 1 2024-09-13T02:50:55.709 INFO:tasks.workunit.client.1.smithi122.stdout:7/727: mknod d4/d8/d3d/ced 0 2024-09-13T02:50:55.735 INFO:tasks.workunit.client.1.smithi122.stdout:6/788: dwrite d5/d40/dcd/fce [0,4194304] 0 2024-09-13T02:50:55.735 INFO:tasks.workunit.client.1.smithi122.stdout:9/761: dwrite d8/d16/d3d/d59/d23/d7b/fd3 [0,4194304] 0 2024-09-13T02:50:55.735 INFO:tasks.workunit.client.1.smithi122.stdout:7/728: dwrite d4/d6d/da6/dbf/db1/f93 [0,4194304] 0 2024-09-13T02:50:55.743 INFO:tasks.workunit.client.1.smithi122.stdout:9/762: dread d8/d16/d3d/d59/d23/d1f/d36/fa8 [0,4194304] 0 2024-09-13T02:50:55.746 INFO:tasks.workunit.client.1.smithi122.stdout:6/789: dread d5/db/f44 [0,4194304] 0 2024-09-13T02:50:55.746 INFO:tasks.workunit.client.1.smithi122.stdout:6/790: chown d5/d3d/d6c/d41/d4e/d5f/lb3 75 1 2024-09-13T02:50:55.746 INFO:tasks.workunit.client.1.smithi122.stdout:6/791: chown d5/d3d/d6c/f7f 96577 1 2024-09-13T02:50:55.746 INFO:tasks.workunit.client.1.smithi122.stdout:7/729: dread d4/d8/d24/f37 [0,4194304] 0 2024-09-13T02:50:55.747 INFO:tasks.workunit.client.1.smithi122.stdout:7/730: chown d4/d8/db/dc/d1b/d49/da0/ce2 403 1 2024-09-13T02:50:55.747 INFO:tasks.workunit.client.1.smithi122.stdout:7/731: creat d4/d8/d24/daa/fee x:0 0 0 2024-09-13T02:50:55.747 INFO:tasks.workunit.client.1.smithi122.stdout:6/792: truncate d5/d3d/d6c/d41/d5b/d7d/ddd/d26/f5c 286509 0 2024-09-13T02:50:55.751 INFO:tasks.workunit.client.1.smithi122.stdout:9/763: dread d8/d16/d3d/d59/d23/d7b/fd3 [0,4194304] 0 2024-09-13T02:50:55.751 INFO:tasks.workunit.client.1.smithi122.stdout:9/764: write d8/d88/d65/fc7 [457067,94528] 0 2024-09-13T02:50:55.751 INFO:tasks.workunit.client.1.smithi122.stdout:9/765: readlink d8/d4a/d64/lca 0 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:7/732: write d4/d6d/da6/dbf/db1/f87 [3041902,123182] 0 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:5/699: sync 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:2/624: sync 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:3/794: sync 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:0/763: sync 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:4/943: sync 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:2/625: read d0/d1e/d22/f24 [1632356,123108] 0 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:7/733: write d4/d8/d24/d47/f7a [61712,95490] 0 2024-09-13T02:50:55.756 INFO:tasks.workunit.client.1.smithi122.stdout:7/734: truncate d4/d4e/d5d/f5e 5058210 0 2024-09-13T02:50:55.762 INFO:tasks.workunit.client.1.smithi122.stdout:3/795: mknod d4/d11/dd/d21/d2b/c12b 0 2024-09-13T02:50:55.762 INFO:tasks.workunit.client.1.smithi122.stdout:3/796: chown d4/d11/dd/dca/c125 29846 1 2024-09-13T02:50:55.762 INFO:tasks.workunit.client.1.smithi122.stdout:3/797: chown d4/d11/dd/d21/d2b/c77 13720 1 2024-09-13T02:50:55.763 INFO:tasks.workunit.client.1.smithi122.stdout:0/764: creat d1/d5/d10/d29/d32/d83/db3/df4/dfa/ffe x:0 0 0 2024-09-13T02:50:55.763 INFO:tasks.workunit.client.1.smithi122.stdout:0/765: stat d1/d5/d2d/db4/ddc/df0/d60/f8c 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/766: read d1/d5/d9/da/d7d/fa2 [67571,935] 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/767: write d1/d5/d9/da/d7d/fab [897149,7155] 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/768: readlink d1/d5/d2d/ld5 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/769: write d1/d5/d2d/f44 [383,15032] 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/770: fsync d1/d5/f1e 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/771: chown d1/d5/d2d/db4/ddc/df0/d81/dc5 217449 1 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/772: write d1/d5/d9/da/d92/d94/fd9 [545002,63733] 0 2024-09-13T02:50:55.765 INFO:tasks.workunit.client.1.smithi122.stdout:0/773: write d1/d5/d10/f7b [1189635,121952] 0 2024-09-13T02:50:55.766 INFO:tasks.workunit.client.1.smithi122.stdout:2/626: mkdir d0/d53/dc6 0 2024-09-13T02:50:55.766 INFO:tasks.workunit.client.1.smithi122.stdout:2/627: creat d0/d1e/d26/fc7 x:0 0 0 2024-09-13T02:50:55.766 INFO:tasks.workunit.client.1.smithi122.stdout:2/628: truncate d0/d1c/d3b/d41/d8c/fab 167717 0 2024-09-13T02:50:55.766 INFO:tasks.workunit.client.1.smithi122.stdout:7/735: truncate d4/d8/db/f11 204370 0 2024-09-13T02:50:55.768 INFO:tasks.workunit.client.1.smithi122.stdout:3/798: link d4/fb7 d4/d11/dd/d21/d2b/dcf/d117/f12c 0 2024-09-13T02:50:55.770 INFO:tasks.workunit.client.1.smithi122.stdout:4/944: write d11/d1b/f1c [1230848,75410] 0 2024-09-13T02:50:55.770 INFO:tasks.workunit.client.1.smithi122.stdout:4/945: chown d11/d1b/d32 1 1 2024-09-13T02:50:55.771 INFO:tasks.workunit.client.1.smithi122.stdout:3/799: truncate d4/d11/f2d 1610259 0 2024-09-13T02:50:55.779 INFO:tasks.workunit.client.1.smithi122.stdout:0/774: read d1/d5/d2d/db4/ddc/df0/dba/f87 [1520852,63739] 0 2024-09-13T02:50:55.779 INFO:tasks.workunit.client.1.smithi122.stdout:0/775: fdatasync d1/d5/d9/da/d92/d94/fa9 0 2024-09-13T02:50:55.781 INFO:tasks.workunit.client.1.smithi122.stdout:3/800: write d4/d11/dd/d21/f75 [693180,71851] 0 2024-09-13T02:50:55.781 INFO:tasks.workunit.client.1.smithi122.stdout:0/776: mkdir d1/d5/d2d/db4/dff 0 2024-09-13T02:50:55.784 INFO:tasks.workunit.client.1.smithi122.stdout:3/801: link d4/d11/dd/d21/d2b/d36/d3c/l8c d4/d4c/d10e/l12d 0 2024-09-13T02:50:55.785 INFO:tasks.workunit.client.1.smithi122.stdout:6/793: dwrite d5/d11/d45/d21/f73 [0,4194304] 0 2024-09-13T02:50:55.786 INFO:tasks.workunit.client.1.smithi122.stdout:6/794: truncate d5/d40/fc8 4950190 0 2024-09-13T02:50:55.786 INFO:tasks.workunit.client.1.smithi122.stdout:6/795: truncate d5/d11/d45/f22 1321301 0 2024-09-13T02:50:55.786 INFO:tasks.workunit.client.1.smithi122.stdout:6/796: readlink d5/leb 0 2024-09-13T02:50:55.786 INFO:tasks.workunit.client.1.smithi122.stdout:0/777: symlink d1/d5/d9/da/d92/d94/dbf/l100 0 2024-09-13T02:50:55.790 INFO:tasks.workunit.client.1.smithi122.stdout:7/736: write d4/d8/db/f38 [4664489,83160] 0 2024-09-13T02:50:55.791 INFO:tasks.workunit.client.1.smithi122.stdout:6/797: getdents d5/db/d29/d60/dac 0 2024-09-13T02:50:55.793 INFO:tasks.workunit.client.1.smithi122.stdout:7/737: mknod d4/d8/db/dc/de1/cef 0 2024-09-13T02:50:55.799 INFO:tasks.workunit.client.1.smithi122.stdout:7/738: rename d4/d8/db/dc/d36/l50 to d4/d4e/d5d/d6b/lf0 0 2024-09-13T02:50:55.799 INFO:tasks.workunit.client.1.smithi122.stdout:7/739: chown d4/d8/d3d/dc2 1036903 1 2024-09-13T02:50:55.800 INFO:tasks.workunit.client.1.smithi122.stdout:7/740: write d4/d6d/d8f/f92 [985192,34856] 0 2024-09-13T02:50:55.800 INFO:tasks.workunit.client.1.smithi122.stdout:9/766: dwrite d8/f28 [4194304,4194304] 0 2024-09-13T02:50:55.800 INFO:tasks.workunit.client.1.smithi122.stdout:9/767: fsync d8/d16/d3d/d59/d49/f89 0 2024-09-13T02:50:55.800 INFO:tasks.workunit.client.1.smithi122.stdout:9/768: fsync d8/d16/d3d/d59/d49/f7a 0 2024-09-13T02:50:55.801 INFO:tasks.workunit.client.1.smithi122.stdout:9/769: getdents d8/d16/d3d/d59/d29/d90/db7/dd1 0 2024-09-13T02:50:55.802 INFO:tasks.workunit.client.1.smithi122.stdout:7/741: getdents d4/d8/d3d/dcd 0 2024-09-13T02:50:55.803 INFO:tasks.workunit.client.1.smithi122.stdout:2/629: dwrite d0/d1c/d3b/d41/f3f [0,4194304] 0 2024-09-13T02:50:55.803 INFO:tasks.workunit.client.1.smithi122.stdout:2/630: write d0/d55/d70/d59/f6e [1249885,112427] 0 2024-09-13T02:50:55.805 INFO:tasks.workunit.client.1.smithi122.stdout:3/802: truncate d4/d11/d38/f70 4458802 0 2024-09-13T02:50:55.806 INFO:tasks.workunit.client.1.smithi122.stdout:7/742: link d4/d6d/da6/dbf/db1/f9b d4/d6d/d8c/ff1 0 2024-09-13T02:50:55.809 INFO:tasks.workunit.client.1.smithi122.stdout:2/631: link d0/d1c/d3b/d41/d4e/d75/d95/la3 d0/dc0/lc8 0 2024-09-13T02:50:55.810 INFO:tasks.workunit.client.1.smithi122.stdout:2/632: read d0/d1c/d3b/d41/d4e/d75/faa [843092,23757] 0 2024-09-13T02:50:55.810 INFO:tasks.workunit.client.1.smithi122.stdout:3/803: link d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f124 d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f12e 0 2024-09-13T02:50:55.812 INFO:tasks.workunit.client.1.smithi122.stdout:5/700: dwrite d0/d17/d36/d3f/d4c/d7f/fce [0,4194304] 0 2024-09-13T02:50:55.812 INFO:tasks.workunit.client.1.smithi122.stdout:5/701: creat d0/d17/d36/d25/fe3 x:0 0 0 2024-09-13T02:50:55.812 INFO:tasks.workunit.client.1.smithi122.stdout:2/633: mknod d0/d1e/d2e/cc9 0 2024-09-13T02:50:55.813 INFO:tasks.workunit.client.1.smithi122.stdout:2/634: fdatasync d0/d1e/d2e/d3e/f4b 0 2024-09-13T02:50:55.813 INFO:tasks.workunit.client.1.smithi122.stdout:2/635: fsync d0/d1e/d26/d3d/d84/fbb 0 2024-09-13T02:50:55.813 INFO:tasks.workunit.client.1.smithi122.stdout:2/636: read - d0/d1c/d3b/d41/d4e/d75/d95/f9a zero size 2024-09-13T02:50:55.814 INFO:tasks.workunit.client.1.smithi122.stdout:3/804: rename d4/d11/dd/c23 to d4/d11/c12f 0 2024-09-13T02:50:55.815 INFO:tasks.workunit.client.1.smithi122.stdout:4/946: dwrite f10 [0,4194304] 0 2024-09-13T02:50:55.817 INFO:tasks.workunit.client.1.smithi122.stdout:6/798: dwrite d5/d11/d45/d21/f57 [0,4194304] 0 2024-09-13T02:50:55.817 INFO:tasks.workunit.client.1.smithi122.stdout:7/743: write d4/d8/db/dc/d46/f90 [919638,103683] 0 2024-09-13T02:50:55.818 INFO:tasks.workunit.client.1.smithi122.stdout:9/770: dwrite d8/d16/d3d/d59/d23/d1f/f2a [4194304,4194304] 0 2024-09-13T02:50:55.818 INFO:tasks.workunit.client.1.smithi122.stdout:5/702: symlink d0/d17/d3a/le4 0 2024-09-13T02:50:55.818 INFO:tasks.workunit.client.1.smithi122.stdout:5/703: read - d0/d1d/fbd zero size 2024-09-13T02:50:55.818 INFO:tasks.workunit.client.1.smithi122.stdout:5/704: stat d0/cb1 0 2024-09-13T02:50:55.821 INFO:tasks.workunit.client.1.smithi122.stdout:2/637: creat d0/d1c/fca x:0 0 0 2024-09-13T02:50:55.821 INFO:tasks.workunit.client.1.smithi122.stdout:2/638: fsync d0/d1e/d26/d3d/d84/fbb 0 2024-09-13T02:50:55.821 INFO:tasks.workunit.client.1.smithi122.stdout:2/639: fsync d0/fc 0 2024-09-13T02:50:55.828 INFO:tasks.workunit.client.1.smithi122.stdout:2/640: dread d0/d1e/d26/f30 [4194304,4194304] 0 2024-09-13T02:50:55.828 INFO:tasks.workunit.client.1.smithi122.stdout:3/805: unlink d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f12e 0 2024-09-13T02:50:55.828 INFO:tasks.workunit.client.1.smithi122.stdout:3/806: write d4/d11/dd/d21/d4e/f8b [708622,118015] 0 2024-09-13T02:50:55.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/641: dread d0/d1c/d3b/d41/d6a/f57 [0,4194304] 0 2024-09-13T02:50:55.845 INFO:tasks.workunit.client.1.smithi122.stdout:4/947: creat d11/d13/dc9/de3/f11f x:0 0 0 2024-09-13T02:50:55.849 INFO:tasks.workunit.client.1.smithi122.stdout:6/799: unlink d5/d3d/d6c/d41/d5b/d7d/ddd/f13 0 2024-09-13T02:50:55.849 INFO:tasks.workunit.client.1.smithi122.stdout:6/800: dread - d5/db/d29/d60/dac/fe9 zero size 2024-09-13T02:50:55.849 INFO:tasks.workunit.client.1.smithi122.stdout:6/801: chown d5/d11/d45/d21 8158 1 2024-09-13T02:50:55.851 INFO:tasks.workunit.client.1.smithi122.stdout:7/744: mkdir d4/d6d/da6/df2 0 2024-09-13T02:50:55.852 INFO:tasks.workunit.client.1.smithi122.stdout:9/771: creat d8/d16/d3d/d59/d29/d90/dc8/fe8 x:0 0 0 2024-09-13T02:50:55.853 INFO:tasks.workunit.client.1.smithi122.stdout:5/705: mknod d0/d17/d36/d3f/ce5 0 2024-09-13T02:50:55.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/706: truncate d0/d17/d36/d3f/fae 4799333 0 2024-09-13T02:50:55.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/707: dread - d0/da/d8c/d8f/da0/fdc zero size 2024-09-13T02:50:55.854 INFO:tasks.workunit.client.1.smithi122.stdout:5/708: fdatasync d0/da/d48/db4/fbe 0 2024-09-13T02:50:55.855 INFO:tasks.workunit.client.1.smithi122.stdout:3/807: rename d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/l119 to d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9/l130 0 2024-09-13T02:50:55.855 INFO:tasks.workunit.client.1.smithi122.stdout:3/808: chown d4/d11/dd/dca/d100 4521755 1 2024-09-13T02:50:55.855 INFO:tasks.workunit.client.1.smithi122.stdout:3/809: write d4/d11/dd/d21/d4e/f8b [237787,121971] 0 2024-09-13T02:50:55.857 INFO:tasks.workunit.client.1.smithi122.stdout:2/642: unlink d0/d1c/d3b/d41/d4e/d75/l9f 0 2024-09-13T02:50:55.857 INFO:tasks.workunit.client.1.smithi122.stdout:2/643: read d0/d1e/f25 [1144047,19964] 0 2024-09-13T02:50:55.858 INFO:tasks.workunit.client.1.smithi122.stdout:4/948: mknod d11/d1b/c120 0 2024-09-13T02:50:55.858 INFO:tasks.workunit.client.1.smithi122.stdout:4/949: write d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/fd1 [5222919,63736] 0 2024-09-13T02:50:55.858 INFO:tasks.workunit.client.1.smithi122.stdout:4/950: write d11/d13/dc9/de3/d8e/dbd/de5/d116/f109 [977722,79828] 0 2024-09-13T02:50:55.859 INFO:tasks.workunit.client.1.smithi122.stdout:6/802: mkdir d5/d11/d45/d21/def 0 2024-09-13T02:50:55.860 INFO:tasks.workunit.client.1.smithi122.stdout:9/772: creat d8/d16/d3d/db5/fe9 x:0 0 0 2024-09-13T02:50:55.860 INFO:tasks.workunit.client.1.smithi122.stdout:9/773: dread - d8/d16/d3d/d59/d7d/f9c zero size 2024-09-13T02:50:55.860 INFO:tasks.workunit.client.1.smithi122.stdout:9/774: stat d8/d16/d3d/d59/d7d/c73 0 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:1/799: sync 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:1/800: fdatasync dc/d38/db1/db2/fdb 0 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:1/801: fsync dc/de/f8e 0 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:5/709: truncate d0/f5a 1035188 0 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:5/710: chown d0/d2/d33/fcf 219142 1 2024-09-13T02:50:55.862 INFO:tasks.workunit.client.1.smithi122.stdout:3/810: symlink d4/d4c/d10e/l131 0 2024-09-13T02:50:55.865 INFO:tasks.workunit.client.1.smithi122.stdout:6/803: getdents d5/d40/dcd 0 2024-09-13T02:50:55.865 INFO:tasks.workunit.client.1.smithi122.stdout:6/804: write d5/d3d/d48/f6b [1420226,25628] 0 2024-09-13T02:50:55.865 INFO:tasks.workunit.client.1.smithi122.stdout:6/805: stat d5/d3d/d82/db1 0 2024-09-13T02:50:55.866 INFO:tasks.workunit.client.1.smithi122.stdout:9/775: symlink d8/d16/d45/lea 0 2024-09-13T02:50:55.867 INFO:tasks.workunit.client.1.smithi122.stdout:7/745: dwrite d4/d8/d3d/f44 [0,4194304] 0 2024-09-13T02:50:55.867 INFO:tasks.workunit.client.1.smithi122.stdout:7/746: write d4/d8/db/dc/d46/f90 [3288338,40357] 0 2024-09-13T02:50:55.868 INFO:tasks.workunit.client.1.smithi122.stdout:1/802: rename dc/de/d18/d1d/fc8 to dc/de/d7a/f10e 0 2024-09-13T02:50:55.868 INFO:tasks.workunit.client.1.smithi122.stdout:1/803: chown dc/de/d18/d22/d1c/lcc 0 1 2024-09-13T02:50:55.868 INFO:tasks.workunit.client.1.smithi122.stdout:1/804: readlink dc/de/d18/d1d/l49 0 2024-09-13T02:50:55.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/805: creat dc/d38/db1/d72/f10f x:0 0 0 2024-09-13T02:50:55.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/806: write fa [1274254,108739] 0 2024-09-13T02:50:55.869 INFO:tasks.workunit.client.1.smithi122.stdout:1/807: dread - dc/de/d18/d22/d76/fd4 zero size 2024-09-13T02:50:55.869 INFO:tasks.workunit.client.1.smithi122.stdout:5/711: mknod d0/d17/d36/d25/ce6 0 2024-09-13T02:50:55.870 INFO:tasks.workunit.client.1.smithi122.stdout:3/811: creat d4/d6/de/f132 x:0 0 0 2024-09-13T02:50:55.872 INFO:tasks.workunit.client.1.smithi122.stdout:4/951: dread d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/fed [0,4194304] 0 2024-09-13T02:50:55.872 INFO:tasks.workunit.client.1.smithi122.stdout:4/952: chown d11/d13/f68 222526552 1 2024-09-13T02:50:55.873 INFO:tasks.workunit.client.1.smithi122.stdout:2/644: symlink d0/d1c/lcb 0 2024-09-13T02:50:55.878 INFO:tasks.workunit.client.1.smithi122.stdout:7/747: mkdir d4/d8/db/d63/dbb/df3 0 2024-09-13T02:50:55.879 INFO:tasks.workunit.client.1.smithi122.stdout:3/812: dread d4/d11/dd/d21/d2b/d36/f66 [0,4194304] 0 2024-09-13T02:50:55.879 INFO:tasks.workunit.client.1.smithi122.stdout:3/813: write d4/d11/dd/d21/d6c/ff8 [494238,29013] 0 2024-09-13T02:50:55.884 INFO:tasks.workunit.client.1.smithi122.stdout:5/712: mkdir d0/d17/d36/d3f/de7 0 2024-09-13T02:50:55.884 INFO:tasks.workunit.client.1.smithi122.stdout:5/713: creat d0/d2/fe8 x:0 0 0 2024-09-13T02:50:55.884 INFO:tasks.workunit.client.1.smithi122.stdout:5/714: chown d0/f53 6 1 2024-09-13T02:50:55.884 INFO:tasks.workunit.client.1.smithi122.stdout:5/715: chown d0/d17/d36/d3f/fae 114571 1 2024-09-13T02:50:55.886 INFO:tasks.workunit.client.1.smithi122.stdout:4/953: symlink d11/d13/d82/d2a/d40/l121 0 2024-09-13T02:50:55.886 INFO:tasks.workunit.client.1.smithi122.stdout:4/954: chown d11/d13/dd8/df1 164555231 1 2024-09-13T02:50:55.888 INFO:tasks.workunit.client.1.smithi122.stdout:9/776: dwrite d8/f1a [0,4194304] 0 2024-09-13T02:50:55.889 INFO:tasks.workunit.client.1.smithi122.stdout:1/808: dwrite dc/d38/db1/d72/f10f [0,4194304] 0 2024-09-13T02:50:55.889 INFO:tasks.workunit.client.1.smithi122.stdout:1/809: creat dc/de/d18/d22/d1c/d47/f110 x:0 0 0 2024-09-13T02:50:55.890 INFO:tasks.workunit.client.1.smithi122.stdout:2/645: getdents d0/dc0 0 2024-09-13T02:50:55.890 INFO:tasks.workunit.client.1.smithi122.stdout:2/646: fdatasync d0/f5 0 2024-09-13T02:50:55.890 INFO:tasks.workunit.client.1.smithi122.stdout:2/647: truncate d0/d1e/f9b 561185 0 2024-09-13T02:50:55.892 INFO:tasks.workunit.client.1.smithi122.stdout:6/806: rmdir d5/d3d/d6c/d41/d5b/d7d/ddd 39 2024-09-13T02:50:55.899 INFO:tasks.workunit.client.1.smithi122.stdout:9/777: write d8/f33 [7860997,41644] 0 2024-09-13T02:50:55.900 INFO:tasks.workunit.client.1.smithi122.stdout:6/807: dread d5/d11/d2f/f74 [0,4194304] 0 2024-09-13T02:50:55.901 INFO:tasks.workunit.client.1.smithi122.stdout:6/808: readlink d5/d3d/l94 0 2024-09-13T02:50:55.901 INFO:tasks.workunit.client.1.smithi122.stdout:6/809: chown d5/d11/d45/d21/d8a/l98 326808 1 2024-09-13T02:50:55.902 INFO:tasks.workunit.client.1.smithi122.stdout:7/748: symlink d4/d8/db/dc/lf4 0 2024-09-13T02:50:55.907 INFO:tasks.workunit.client.1.smithi122.stdout:3/814: rename d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/fbe to d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/d109/f133 0 2024-09-13T02:50:55.907 INFO:tasks.workunit.client.1.smithi122.stdout:3/815: readlink d4/d11/dd/d21/d30/l11f 0 2024-09-13T02:50:55.908 INFO:tasks.workunit.client.1.smithi122.stdout:9/778: dread d8/d16/f2b [0,4194304] 0 2024-09-13T02:50:55.910 INFO:tasks.workunit.client.1.smithi122.stdout:6/810: dread d5/d3d/d6c/d41/d4e/d93/fdf [4194304,4194304] 0 2024-09-13T02:50:55.911 INFO:tasks.workunit.client.1.smithi122.stdout:1/810: dwrite dc/de/d18/f2c [4194304,4194304] 0 2024-09-13T02:50:55.911 INFO:tasks.workunit.client.1.smithi122.stdout:1/811: stat dc/de/d18/d22/d1c/d57/cb8 0 2024-09-13T02:50:55.911 INFO:tasks.workunit.client.1.smithi122.stdout:1/812: dread - dc/de/d18/d1d/d2f/fb5 zero size 2024-09-13T02:50:55.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/749: write d4/f83 [2679562,102906] 0 2024-09-13T02:50:55.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/750: write d4/d77/fa2 [1347023,64647] 0 2024-09-13T02:50:55.913 INFO:tasks.workunit.client.1.smithi122.stdout:5/716: unlink d0/d1d/f7d 0 2024-09-13T02:50:55.913 INFO:tasks.workunit.client.1.smithi122.stdout:5/717: write d0/d17/d36/d8b/fa5 [675779,120113] 0 2024-09-13T02:50:55.913 INFO:tasks.workunit.client.1.smithi122.stdout:5/718: fdatasync d0/d2/f6d 0 2024-09-13T02:50:55.917 INFO:tasks.workunit.client.1.smithi122.stdout:4/955: link d11/d13/d82/d2a/ddf/ff5 d11/d13/dc9/f122 0 2024-09-13T02:50:55.919 INFO:tasks.workunit.client.1.smithi122.stdout:5/719: dread d0/d17/d36/d25/f74 [0,4194304] 0 2024-09-13T02:50:55.920 INFO:tasks.workunit.client.1.smithi122.stdout:2/648: creat d0/d1e/d2e/d8a/d99/fcc x:0 0 0 2024-09-13T02:50:55.920 INFO:tasks.workunit.client.1.smithi122.stdout:2/649: chown d0/d1e/d22 23568 1 2024-09-13T02:50:55.921 INFO:tasks.workunit.client.1.smithi122.stdout:9/779: link d8/d16/d3d/d59/d23/cc2 d8/d16/d3e/d57/ceb 0 2024-09-13T02:50:55.922 INFO:tasks.workunit.client.1.smithi122.stdout:6/811: mkdir d5/d3d/d82/dcf/df0 0 2024-09-13T02:50:55.924 INFO:tasks.workunit.client.1.smithi122.stdout:1/813: creat dc/d38/db1/d72/dd7/d46/f111 x:0 0 0 2024-09-13T02:50:55.924 INFO:tasks.workunit.client.1.smithi122.stdout:1/814: truncate dc/de/d18/d22/f55 5019103 0 2024-09-13T02:50:55.924 INFO:tasks.workunit.client.1.smithi122.stdout:1/815: chown dc/de/d18/d22/d1c/c3e 0 1 2024-09-13T02:50:55.924 INFO:tasks.workunit.client.1.smithi122.stdout:1/816: chown dc/de/d18/d22/d1c/d57/dc6/fd3 22818 1 2024-09-13T02:50:55.934 INFO:tasks.workunit.client.1.smithi122.stdout:7/751: dwrite d4/d8/db/fe0 [0,4194304] 0 2024-09-13T02:50:55.935 INFO:tasks.workunit.client.1.smithi122.stdout:4/956: symlink d11/d1b/l123 0 2024-09-13T02:50:55.939 INFO:tasks.workunit.client.1.smithi122.stdout:5/720: creat d0/da/d48/db4/dc8/fe9 x:0 0 0 2024-09-13T02:50:55.940 INFO:tasks.workunit.client.1.smithi122.stdout:2/650: mknod d0/d1e/d26/dbd/ccd 0 2024-09-13T02:50:55.941 INFO:tasks.workunit.client.1.smithi122.stdout:2/651: truncate d0/d1c/d3b/d41/d4e/d75/faa 1525848 0 2024-09-13T02:50:55.953 INFO:tasks.workunit.client.1.smithi122.stdout:6/812: truncate d5/d11/d45/f22 328934 0 2024-09-13T02:50:55.955 INFO:tasks.workunit.client.1.smithi122.stdout:1/817: symlink dc/d38/d51/daf/de3/l112 0 2024-09-13T02:50:55.965 INFO:tasks.workunit.client.1.smithi122.stdout:7/752: creat d4/d8/db/d63/dbb/ff5 x:0 0 0 2024-09-13T02:50:55.968 INFO:tasks.workunit.client.1.smithi122.stdout:4/957: creat d11/d13/dc9/de3/d8e/dbd/de5/d116/d8f/da2/f124 x:0 0 0 2024-09-13T02:50:55.969 INFO:tasks.workunit.client.1.smithi122.stdout:5/721: rmdir d0/d17/d36/d3f/d4c 39 2024-09-13T02:50:55.971 INFO:tasks.workunit.client.1.smithi122.stdout:6/813: dwrite d5/d3d/d6c/d41/d5b/fbe [0,4194304] 0 2024-09-13T02:50:55.971 INFO:tasks.workunit.client.1.smithi122.stdout:6/814: creat d5/d3d/d6c/d41/d5b/ff1 x:0 0 0 2024-09-13T02:50:55.971 INFO:tasks.workunit.client.1.smithi122.stdout:2/652: rename d0/d1c/d3b/d41/d4e/c85 to d0/dc0/cce 0 2024-09-13T02:50:55.972 INFO:tasks.workunit.client.1.smithi122.stdout:2/653: dread d0/d1e/d2e/d8a/d99/fb8 [0,4194304] 0 2024-09-13T02:50:55.974 INFO:tasks.workunit.client.1.smithi122.stdout:9/780: rmdir d8/d16/d3d/d59/d23/d7b 39 2024-09-13T02:50:55.975 INFO:tasks.workunit.client.1.smithi122.stdout:4/958: dread d11/f49 [0,4194304] 0 2024-09-13T02:50:55.979 INFO:tasks.workunit.client.1.smithi122.stdout:7/753: creat d4/d8/db/dc/ff6 x:0 0 0 2024-09-13T02:50:55.980 INFO:tasks.workunit.client.1.smithi122.stdout:5/722: link d0/d17/d36/d3f/fae d0/d17/d36/d3f/d4c/d7f/dd1/fea 0 2024-09-13T02:50:55.980 INFO:tasks.workunit.client.1.smithi122.stdout:5/723: read d0/d17/f28 [1449485,61717] 0 2024-09-13T02:50:55.985 INFO:tasks.workunit.client.1.smithi122.stdout:8/686: sync 2024-09-13T02:50:55.986 INFO:tasks.workunit.client.1.smithi122.stdout:6/815: mknod d5/d3d/da3/dcb/cf2 0 2024-09-13T02:50:55.986 INFO:tasks.workunit.client.1.smithi122.stdout:6/816: write d5/d3d/d6c/d41/d4e/f88 [2634037,75726] 0 2024-09-13T02:50:55.987 INFO:tasks.workunit.client.1.smithi122.stdout:2/654: mkdir d0/d1e/d2e/d8a/d99/dcf 0 2024-09-13T02:50:55.989 INFO:tasks.workunit.client.1.smithi122.stdout:4/959: mknod d11/d1b/d32/c125 0 2024-09-13T02:50:55.989 INFO:tasks.workunit.client.1.smithi122.stdout:1/818: getdents dc/d38/db1/d7d 0 2024-09-13T02:50:55.990 INFO:tasks.workunit.client.1.smithi122.stdout:1/819: fsync dc/de/d18/d22/d1c/f87 0 2024-09-13T02:50:55.991 INFO:tasks.workunit.client.1.smithi122.stdout:7/754: mknod d4/d8/d24/d82/cf7 0 2024-09-13T02:50:55.993 INFO:tasks.workunit.client.1.smithi122.stdout:8/687: truncate d3/d31/d65/f54 296132 0 2024-09-13T02:50:55.993 INFO:tasks.workunit.client.1.smithi122.stdout:7/755: getdents d4/d8/d3d 0 2024-09-13T02:50:55.994 INFO:tasks.workunit.client.1.smithi122.stdout:7/756: fsync d4/d8/d3d/f44 0 2024-09-13T02:50:55.996 INFO:tasks.workunit.client.1.smithi122.stdout:7/757: rename d4/d4e/d5d/f5e to d4/d8/d3d/dc2/dca/ff8 0 2024-09-13T02:50:55.997 INFO:tasks.workunit.client.1.smithi122.stdout:7/758: dread d4/d8/db/d63/fb6 [0,4194304] 0 2024-09-13T02:50:55.998 INFO:tasks.workunit.client.1.smithi122.stdout:2/655: dread d0/fc [0,4194304] 0 2024-09-13T02:50:55.998 INFO:tasks.workunit.client.1.smithi122.stdout:7/759: mkdir d4/d8/d24/d82/df9 0 2024-09-13T02:50:56.000 INFO:tasks.workunit.client.1.smithi122.stdout:6/817: write d5/d3d/d6c/f7f [3751317,42249] 0 2024-09-13T02:50:56.000 INFO:tasks.workunit.client.1.smithi122.stdout:7/760: symlink d4/d8/db/dc/d46/lfa 0 2024-09-13T02:50:56.001 INFO:tasks.workunit.client.1.smithi122.stdout:6/818: truncate d5/db/f44 3383565 0 2024-09-13T02:50:56.002 INFO:tasks.workunit.client.1.smithi122.stdout:9/781: dwrite d8/ff [0,4194304] 0 2024-09-13T02:50:56.002 INFO:tasks.workunit.client.1.smithi122.stdout:5/724: dwrite d0/da/d48/db4/dc8/fe9 [0,4194304] 0 2024-09-13T02:50:56.004 INFO:tasks.workunit.client.1.smithi122.stdout:6/819: rename d5/db/dc/l7b to d5/d3d/d82/dc9/lf3 0 2024-09-13T02:50:56.007 INFO:tasks.workunit.client.1.smithi122.stdout:5/725: mknod d0/d17/d36/d3f/d4c/ceb 0 2024-09-13T02:50:56.008 INFO:tasks.workunit.client.1.smithi122.stdout:9/782: rename d8/d16/d3d/d59/d23/d1f/d36/cae to d8/d16/d3d/cec 0 2024-09-13T02:50:56.010 INFO:tasks.workunit.client.1.smithi122.stdout:8/688: dread d3/d31/d52/d89/d8b/d5c/f86 [0,4194304] 0 2024-09-13T02:50:56.011 INFO:tasks.workunit.client.1.smithi122.stdout:9/783: creat d8/d16/d45/fed x:0 0 0 2024-09-13T02:50:56.011 INFO:tasks.workunit.client.1.smithi122.stdout:9/784: truncate d8/d16/d3d/d59/d29/d90/dc8/fe8 891082 0 2024-09-13T02:50:56.011 INFO:tasks.workunit.client.1.smithi122.stdout:2/656: dread d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:56.012 INFO:tasks.workunit.client.1.smithi122.stdout:6/820: getdents d5/db/d29/d60 0 2024-09-13T02:50:56.013 INFO:tasks.workunit.client.1.smithi122.stdout:8/689: creat d3/d31/d52/d89/d8b/fd3 x:0 0 0 2024-09-13T02:50:56.013 INFO:tasks.workunit.client.1.smithi122.stdout:8/690: chown d3/da6/fb3 17520 1 2024-09-13T02:50:56.014 INFO:tasks.workunit.client.1.smithi122.stdout:2/657: mknod d0/d1e/d2e/d3e/cd0 0 2024-09-13T02:50:56.014 INFO:tasks.workunit.client.1.smithi122.stdout:5/726: dread d0/d17/d36/d25/d2b/f30 [0,4194304] 0 2024-09-13T02:50:56.015 INFO:tasks.workunit.client.1.smithi122.stdout:6/821: creat d5/d3d/d6c/d41/d4e/d93/dd4/ff4 x:0 0 0 2024-09-13T02:50:56.015 INFO:tasks.workunit.client.1.smithi122.stdout:6/822: write d5/f69 [4508610,34347] 0 2024-09-13T02:50:56.015 INFO:tasks.workunit.client.1.smithi122.stdout:6/823: fsync d5/d40/f67 0 2024-09-13T02:50:56.016 INFO:tasks.workunit.client.1.smithi122.stdout:8/691: creat d3/da/fd4 x:0 0 0 2024-09-13T02:50:56.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/727: mknod d0/d2/d33/cec 0 2024-09-13T02:50:56.017 INFO:tasks.workunit.client.1.smithi122.stdout:5/728: creat d0/da/d48/fed x:0 0 0 2024-09-13T02:50:56.022 INFO:tasks.workunit.client.1.smithi122.stdout:7/761: dread d4/d8/db/dc/d46/f4f [0,4194304] 0 2024-09-13T02:50:56.023 INFO:tasks.workunit.client.1.smithi122.stdout:4/960: dwrite d11/d13/f66 [0,4194304] 0 2024-09-13T02:50:56.023 INFO:tasks.workunit.client.1.smithi122.stdout:1/820: dwrite dc/f44 [0,4194304] 0 2024-09-13T02:50:56.023 INFO:tasks.workunit.client.1.smithi122.stdout:6/824: rename d5/d11/d3a/lca to d5/d3d/d48/dd7/lf5 0 2024-09-13T02:50:56.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/762: dread d4/d6d/d8c/dc3/f7f [0,4194304] 0 2024-09-13T02:50:56.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/763: stat d4/d4e/d5d/d6b/fe9 0 2024-09-13T02:50:56.034 INFO:tasks.workunit.client.1.smithi122.stdout:1/821: mknod dc/de/d18/d22/d1c/d10d/c113 0 2024-09-13T02:50:56.035 INFO:tasks.workunit.client.1.smithi122.stdout:5/729: getdents d0/d17/d36/d3f/d4c 0 2024-09-13T02:50:56.035 INFO:tasks.workunit.client.1.smithi122.stdout:5/730: dread - d0/d17/d36/d3f/f8a zero size 2024-09-13T02:50:56.035 INFO:tasks.workunit.client.1.smithi122.stdout:5/731: fsync d0/d17/d36/d25/fa9 0 2024-09-13T02:50:56.036 INFO:tasks.workunit.client.1.smithi122.stdout:7/764: rmdir d4/d8/d24 39 2024-09-13T02:50:56.040 INFO:tasks.workunit.client.1.smithi122.stdout:4/961: rename d11/d13/dd8/df1/dfd to d11/d13/d82/d126 0 2024-09-13T02:50:56.040 INFO:tasks.workunit.client.1.smithi122.stdout:4/962: dread - d11/d13/dc9/de3/d8e/dbd/de5/d116/f10c zero size 2024-09-13T02:50:56.054 INFO:tasks.workunit.client.1.smithi122.stdout:8/692: dwrite d3/da/d1e/f47 [4194304,4194304] 0 2024-09-13T02:50:56.055 INFO:tasks.workunit.client.1.smithi122.stdout:8/693: creat d3/da/d7d/fd5 x:0 0 0 2024-09-13T02:50:56.055 INFO:tasks.workunit.client.1.smithi122.stdout:8/694: chown d3/da/d1f/f7f 16004 1 2024-09-13T02:50:56.056 INFO:tasks.workunit.client.1.smithi122.stdout:5/732: rmdir d0/da/d48 39 2024-09-13T02:50:56.056 INFO:tasks.workunit.client.1.smithi122.stdout:1/822: dread dc/d38/d51/f79 [0,4194304] 0 2024-09-13T02:50:56.056 INFO:tasks.workunit.client.1.smithi122.stdout:2/658: dwrite d0/d1e/d2e/d8a/d99/fcc [0,4194304] 0 2024-09-13T02:50:56.056 INFO:tasks.workunit.client.1.smithi122.stdout:2/659: readlink d0/d1e/d22/d29/l8b 0 2024-09-13T02:50:56.056 INFO:tasks.workunit.client.1.smithi122.stdout:6/825: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d46/f8f [0,4194304] 0 2024-09-13T02:50:56.057 INFO:tasks.workunit.client.1.smithi122.stdout:6/826: fsync d5/d3d/d6c/d41/d5b/ff1 0 2024-09-13T02:50:56.061 INFO:tasks.workunit.client.1.smithi122.stdout:4/963: write d11/d13/d82/f19 [6658844,121020] 0 2024-09-13T02:50:56.072 INFO:tasks.workunit.client.1.smithi122.stdout:1/823: creat dc/d38/d51/daf/de3/f114 x:0 0 0 2024-09-13T02:50:56.077 INFO:tasks.workunit.client.1.smithi122.stdout:4/964: rename d11/d13/d82/d126/f117 to d11/d13/dc9/de3/f127 0 2024-09-13T02:50:56.077 INFO:tasks.workunit.client.1.smithi122.stdout:4/965: readlink d11/d13/dc9/ldb 0 2024-09-13T02:50:56.081 INFO:tasks.workunit.client.1.smithi122.stdout:0/778: sync 2024-09-13T02:50:56.082 INFO:tasks.workunit.client.1.smithi122.stdout:3/816: sync 2024-09-13T02:50:56.088 INFO:tasks.workunit.client.1.smithi122.stdout:3/817: dread d4/d4c/f51 [0,4194304] 0 2024-09-13T02:50:56.088 INFO:tasks.workunit.client.1.smithi122.stdout:3/818: readlink d4/d11/dd/d21/d2b/d36/lba 0 2024-09-13T02:50:56.089 INFO:tasks.workunit.client.1.smithi122.stdout:3/819: symlink d4/d11/d38/l134 0 2024-09-13T02:50:56.089 INFO:tasks.workunit.client.1.smithi122.stdout:3/820: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/d135 0 2024-09-13T02:50:56.091 INFO:tasks.workunit.client.1.smithi122.stdout:3/821: creat d4/d11/dd/d21/d30/f136 x:0 0 0 2024-09-13T02:50:56.091 INFO:tasks.workunit.client.1.smithi122.stdout:6/827: dwrite d5/d3d/d6c/d41/d5b/d7a/fc2 [0,4194304] 0 2024-09-13T02:50:56.091 INFO:tasks.workunit.client.1.smithi122.stdout:6/828: stat d5/d11/d2f/l53 0 2024-09-13T02:50:56.094 INFO:tasks.workunit.client.1.smithi122.stdout:8/695: dwrite d3/d31/d52/f5b [0,4194304] 0 2024-09-13T02:50:56.094 INFO:tasks.workunit.client.1.smithi122.stdout:2/660: dwrite d0/d1e/d22/f32 [4194304,4194304] 0 2024-09-13T02:50:56.094 INFO:tasks.workunit.client.1.smithi122.stdout:3/822: rename d4/d6/df/f98 to d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/f137 0 2024-09-13T02:50:56.095 INFO:tasks.workunit.client.1.smithi122.stdout:3/823: stat d4/d11/dd/d21/d2b/dcf/f106 0 2024-09-13T02:50:56.095 INFO:tasks.workunit.client.1.smithi122.stdout:0/779: dread d1/d5/f1e [0,4194304] 0 2024-09-13T02:50:56.095 INFO:tasks.workunit.client.1.smithi122.stdout:0/780: fsync d1/f73 0 2024-09-13T02:50:56.097 INFO:tasks.workunit.client.1.smithi122.stdout:3/824: creat d4/d6/de/d1f/f138 x:0 0 0 2024-09-13T02:50:56.100 INFO:tasks.workunit.client.1.smithi122.stdout:3/825: mknod d4/d6/de/d1f/d33/c139 0 2024-09-13T02:50:56.101 INFO:tasks.workunit.client.1.smithi122.stdout:3/826: mknod d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/c13a 0 2024-09-13T02:50:56.102 INFO:tasks.workunit.client.1.smithi122.stdout:3/827: creat d4/d6/de/d1f/f13b x:0 0 0 2024-09-13T02:50:56.113 INFO:tasks.workunit.client.1.smithi122.stdout:0/781: read d1/d5/d9/da/d92/d94/fd3 [2488919,15498] 0 2024-09-13T02:50:56.115 INFO:tasks.workunit.client.1.smithi122.stdout:0/782: truncate d1/d5/d9/da/d92/d94/f5c 6531812 0 2024-09-13T02:50:56.122 INFO:tasks.workunit.client.1.smithi122.stdout:2/661: dwrite d0/d1c/d3b/d41/d4e/d75/d95/fac [0,4194304] 0 2024-09-13T02:50:56.123 INFO:tasks.workunit.client.1.smithi122.stdout:8/696: dwrite d3/f9 [0,4194304] 0 2024-09-13T02:50:56.124 INFO:tasks.workunit.client.1.smithi122.stdout:3/828: dwrite d4/f5d [0,4194304] 0 2024-09-13T02:50:56.125 INFO:tasks.workunit.client.1.smithi122.stdout:2/662: write d0/d1c/d3b/d41/d6a/f49 [2157704,112292] 0 2024-09-13T02:50:56.127 INFO:tasks.workunit.client.1.smithi122.stdout:8/697: rename d3/da/d1e/fb8 to d3/d53/fd6 0 2024-09-13T02:50:56.128 INFO:tasks.workunit.client.1.smithi122.stdout:2/663: dread d0/d1c/f7a [0,4194304] 0 2024-09-13T02:50:56.130 INFO:tasks.workunit.client.1.smithi122.stdout:3/829: mkdir d4/d4c/dd3/d13c 0 2024-09-13T02:50:56.130 INFO:tasks.workunit.client.1.smithi122.stdout:8/698: symlink d3/d53/d4d/ld7 0 2024-09-13T02:50:56.132 INFO:tasks.workunit.client.1.smithi122.stdout:2/664: symlink d0/ld1 0 2024-09-13T02:50:56.133 INFO:tasks.workunit.client.1.smithi122.stdout:2/665: rmdir d0/d1c/d3b/d41/d6a 39 2024-09-13T02:50:56.133 INFO:tasks.workunit.client.1.smithi122.stdout:3/830: getdents d4/d6/de 0 2024-09-13T02:50:56.134 INFO:tasks.workunit.client.1.smithi122.stdout:2/666: dread d0/d1e/d2e/d8a/d99/fb8 [0,4194304] 0 2024-09-13T02:50:56.136 INFO:tasks.workunit.client.1.smithi122.stdout:3/831: link d4/d11/dd/d21/d30/l64 d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/l13d 0 2024-09-13T02:50:56.138 INFO:tasks.workunit.client.1.smithi122.stdout:2/667: unlink d0/d1c/d3b/f7b 0 2024-09-13T02:50:56.139 INFO:tasks.workunit.client.1.smithi122.stdout:3/832: rmdir d4/d6/de 39 2024-09-13T02:50:56.139 INFO:tasks.workunit.client.1.smithi122.stdout:3/833: fsync d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/ff3 0 2024-09-13T02:50:56.139 INFO:tasks.workunit.client.1.smithi122.stdout:3/834: read d4/fb7 [1901623,75784] 0 2024-09-13T02:50:56.140 INFO:tasks.workunit.client.1.smithi122.stdout:2/668: mkdir d0/d55/d70/d59/dd2 0 2024-09-13T02:50:56.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/699: read d3/d53/d4d/f62 [3318831,105123] 0 2024-09-13T02:50:56.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/700: creat d3/da/d91/fd8 x:0 0 0 2024-09-13T02:50:56.140 INFO:tasks.workunit.client.1.smithi122.stdout:8/701: readlink d3/d31/d52/d59/l64 0 2024-09-13T02:50:56.141 INFO:tasks.workunit.client.1.smithi122.stdout:3/835: link d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/f61 d4/d11/dd/d21/d2b/f13e 0 2024-09-13T02:50:56.141 INFO:tasks.workunit.client.1.smithi122.stdout:2/669: read d0/d1c/fad [569341,25770] 0 2024-09-13T02:50:56.143 INFO:tasks.workunit.client.1.smithi122.stdout:3/836: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/f13f x:0 0 0 2024-09-13T02:50:56.146 INFO:tasks.workunit.client.1.smithi122.stdout:3/837: link d4/d11/dd/d21/d2b/d36/d3c/l4b d4/d6/df/l140 0 2024-09-13T02:50:56.149 INFO:tasks.workunit.client.1.smithi122.stdout:8/702: write d3/d31/f61 [3243258,26649] 0 2024-09-13T02:50:56.149 INFO:tasks.workunit.client.1.smithi122.stdout:8/703: readlink d3/d53/d34/dbf/dcb/d76/la4 0 2024-09-13T02:50:56.149 INFO:tasks.workunit.client.1.smithi122.stdout:3/838: mknod d4/d11/dd/c141 0 2024-09-13T02:50:56.149 INFO:tasks.workunit.client.1.smithi122.stdout:3/839: write d4/d11/dd/fd9 [187629,111110] 0 2024-09-13T02:50:56.150 INFO:tasks.workunit.client.1.smithi122.stdout:3/840: truncate d4/d11/dd/d21/d2b/d36/f107 779920 0 2024-09-13T02:50:56.150 INFO:tasks.workunit.client.1.smithi122.stdout:3/841: fsync d4/d11/dd/d21/f28 0 2024-09-13T02:50:56.152 INFO:tasks.workunit.client.1.smithi122.stdout:8/704: symlink d3/d31/d52/dc1/ld9 0 2024-09-13T02:50:56.153 INFO:tasks.workunit.client.1.smithi122.stdout:8/705: dread - d3/d31/d52/d89/db1/fd0 zero size 2024-09-13T02:50:56.155 INFO:tasks.workunit.client.1.smithi122.stdout:3/842: dread d4/d4c/dd3/f95 [0,4194304] 0 2024-09-13T02:50:56.155 INFO:tasks.workunit.client.1.smithi122.stdout:3/843: chown d4/d11/dd/d21/d2b/d36/d3c/d43/d82/cf2 1512 1 2024-09-13T02:50:56.159 INFO:tasks.workunit.client.1.smithi122.stdout:2/670: dwrite d0/d1c/d3b/d41/f3f [0,4194304] 0 2024-09-13T02:50:56.159 INFO:tasks.workunit.client.1.smithi122.stdout:2/671: fdatasync d0/d1c/d3b/d41/d4e/d75/d95/fac 0 2024-09-13T02:50:56.159 INFO:tasks.workunit.client.1.smithi122.stdout:2/672: fsync d0/d1e/d26/fc7 0 2024-09-13T02:50:56.161 INFO:tasks.workunit.client.1.smithi122.stdout:3/844: dread d4/d11/dd/d21/d2b/f13e [0,4194304] 0 2024-09-13T02:50:56.161 INFO:tasks.workunit.client.1.smithi122.stdout:2/673: truncate d0/d1e/d22/d29/f9e 2857573 0 2024-09-13T02:50:56.161 INFO:tasks.workunit.client.1.smithi122.stdout:2/674: fdatasync d0/d1e/d2e/f97 0 2024-09-13T02:50:56.162 INFO:tasks.workunit.client.1.smithi122.stdout:2/675: chown d0/d1c/d3b/dbf/lc2 8268728 1 2024-09-13T02:50:56.164 INFO:tasks.workunit.client.1.smithi122.stdout:2/676: mkdir d0/d1e/d2e/d8a/d99/dcf/dd3 0 2024-09-13T02:50:56.164 INFO:tasks.workunit.client.1.smithi122.stdout:2/677: chown d0/d55/daf 1 1 2024-09-13T02:50:56.166 INFO:tasks.workunit.client.1.smithi122.stdout:3/845: dread d4/ffd [0,4194304] 0 2024-09-13T02:50:56.166 INFO:tasks.workunit.client.1.smithi122.stdout:3/846: write d4/d11/dd/fcd [262825,99254] 0 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/847: creat d4/d11/da9/f142 x:0 0 0 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/848: write d4/d11/f105 [68323,120539] 0 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/849: chown d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f91 3116066 1 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/850: read d4/d11/dd/fcd [357138,96841] 0 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/851: truncate d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/f137 301424 0 2024-09-13T02:50:56.167 INFO:tasks.workunit.client.1.smithi122.stdout:3/852: fdatasync d4/d11/dd/d21/d6c/fb1 0 2024-09-13T02:50:56.169 INFO:tasks.workunit.client.1.smithi122.stdout:3/853: creat d4/d11/dd/d21/d2b/f143 x:0 0 0 2024-09-13T02:50:56.172 INFO:tasks.workunit.client.1.smithi122.stdout:3/854: truncate d4/d11/dd/d21/d2b/d36/d3c/f10 369930 0 2024-09-13T02:50:56.173 INFO:tasks.workunit.client.1.smithi122.stdout:3/855: truncate d4/d11/dd/d21/f96 1808227 0 2024-09-13T02:50:56.173 INFO:tasks.workunit.client.1.smithi122.stdout:3/856: fdatasync d4/d11/dd/d21/d2b/d36/fd6 0 2024-09-13T02:50:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: Standby manager daemon smithi100.lhjyck started 2024-09-13T02:50:56.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/crt"}]: dispatch 2024-09-13T02:50:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:50:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/key"}]: dispatch 2024-09-13T02:50:56.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:55 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:50:56.181 INFO:tasks.workunit.client.1.smithi122.stdout:2/678: dwrite d0/d1e/d2e/d3e/f5b [0,4194304] 0 2024-09-13T02:50:56.184 INFO:tasks.workunit.client.1.smithi122.stdout:2/679: read d0/d1e/d22/f37 [1032156,56579] 0 2024-09-13T02:50:56.186 INFO:tasks.workunit.client.1.smithi122.stdout:2/680: read d0/d1e/d22/d29/f2b [634179,46839] 0 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: pgmap v6: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: Standby manager daemon smithi100.lhjyck started 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/crt"}]: dispatch 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/key"}]: dispatch 2024-09-13T02:50:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:55 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2978115856' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:50:56.192 INFO:tasks.workunit.client.1.smithi122.stdout:2/681: mkdir d0/d1c/d3b/d41/d4e/d75/d95/dd4 0 2024-09-13T02:50:56.193 INFO:tasks.workunit.client.1.smithi122.stdout:0/783: truncate d1/d5/d9/da/d92/d94/f5c 2864744 0 2024-09-13T02:50:56.194 INFO:tasks.workunit.client.1.smithi122.stdout:8/706: rmdir d3/d31/d52/dc1 39 2024-09-13T02:50:56.194 INFO:tasks.workunit.client.1.smithi122.stdout:8/707: getdents d3/d53/d34/dbf/dcb/d76/dbb 0 2024-09-13T02:50:56.194 INFO:tasks.workunit.client.1.smithi122.stdout:8/708: dread - d3/da/d7d/fd5 zero size 2024-09-13T02:50:56.195 INFO:tasks.workunit.client.1.smithi122.stdout:2/682: rmdir d0/d1e/dc3 0 2024-09-13T02:50:56.195 INFO:tasks.workunit.client.1.smithi122.stdout:2/683: fdatasync d0/d1e/f25 0 2024-09-13T02:50:56.196 INFO:tasks.workunit.client.1.smithi122.stdout:2/684: mkdir d0/d1e/d2e/d8a/d99/dcf/dd5 0 2024-09-13T02:50:56.197 INFO:tasks.workunit.client.1.smithi122.stdout:2/685: creat d0/d1e/d2e/d5a/fd6 x:0 0 0 2024-09-13T02:50:56.198 INFO:tasks.workunit.client.1.smithi122.stdout:2/686: mkdir d0/d1c/d3b/d41/d4e/dd7 0 2024-09-13T02:50:56.200 INFO:tasks.workunit.client.1.smithi122.stdout:0/784: write d1/d5/d10/d29/f34 [1919205,21426] 0 2024-09-13T02:50:56.200 INFO:tasks.workunit.client.1.smithi122.stdout:0/785: creat d1/d5/d9/da/d92/d94/f101 x:0 0 0 2024-09-13T02:50:56.200 INFO:tasks.workunit.client.1.smithi122.stdout:0/786: truncate d1/d5/d9/da/d17/ff1 336724 0 2024-09-13T02:50:56.200 INFO:tasks.workunit.client.1.smithi122.stdout:2/687: link d0/d1e/d22/c71 d0/d1c/d3b/d41/d4e/d90/cd8 0 2024-09-13T02:50:56.203 INFO:tasks.workunit.client.1.smithi122.stdout:0/787: link d1/d5/d10/d29/d32/f5d d1/d5/d10/d29/d32/f102 0 2024-09-13T02:50:56.203 INFO:tasks.workunit.client.1.smithi122.stdout:0/788: getdents d1/d5/d9/da/d92/dbb 0 2024-09-13T02:50:56.203 INFO:tasks.workunit.client.1.smithi122.stdout:0/789: chown d1/d5/d9/da/d17/f1b 173291708 1 2024-09-13T02:50:56.204 INFO:tasks.workunit.client.1.smithi122.stdout:2/688: link d0/d1c/d3b/d41/d4e/d75/d95/fa1 d0/dc0/fd9 0 2024-09-13T02:50:56.213 INFO:tasks.workunit.client.1.smithi122.stdout:8/709: dwrite d3/da/d91/fc4 [0,4194304] 0 2024-09-13T02:50:56.215 INFO:tasks.workunit.client.1.smithi122.stdout:8/710: mknod d3/da/cda 0 2024-09-13T02:50:56.215 INFO:tasks.workunit.client.1.smithi122.stdout:8/711: chown d3/d31/lca 6615 1 2024-09-13T02:50:56.216 INFO:tasks.workunit.client.1.smithi122.stdout:8/712: stat d3/d53/d34/d94/caf 0 2024-09-13T02:50:56.216 INFO:tasks.workunit.client.1.smithi122.stdout:0/790: write d1/d5/d2d/f72 [1301983,130868] 0 2024-09-13T02:50:56.216 INFO:tasks.workunit.client.1.smithi122.stdout:0/791: write d1/d5/d2d/db4/ddc/df0/d60/faa [584517,118416] 0 2024-09-13T02:50:56.216 INFO:tasks.workunit.client.1.smithi122.stdout:2/689: dread d0/d1e/d2e/d3e/f4b [0,4194304] 0 2024-09-13T02:50:56.217 INFO:tasks.workunit.client.1.smithi122.stdout:8/713: link d3/da/f8e d3/d31/fdb 0 2024-09-13T02:50:56.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/690: mknod d0/d1e/d2e/d5a/cda 0 2024-09-13T02:50:56.218 INFO:tasks.workunit.client.1.smithi122.stdout:2/691: read d0/d1e/d22/f37 [958076,90098] 0 2024-09-13T02:50:56.238 INFO:tasks.workunit.client.1.smithi122.stdout:8/714: dwrite d3/da/d91/fd8 [0,4194304] 0 2024-09-13T02:50:56.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/692: dwrite d0/d1c/d3b/d41/d6a/f96 [0,4194304] 0 2024-09-13T02:50:56.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/693: dread - d0/d1c/d3b/d41/d4e/d75/d95/f9a zero size 2024-09-13T02:50:56.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/694: dread - d0/dc0/fd9 zero size 2024-09-13T02:50:56.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/695: fsync d0/d1e/d22/f47 0 2024-09-13T02:50:56.245 INFO:tasks.workunit.client.1.smithi122.stdout:8/715: creat d3/d53/d34/dbf/dcb/fdc x:0 0 0 2024-09-13T02:50:56.259 INFO:tasks.workunit.client.1.smithi122.stdout:2/696: mkdir d0/d1e/d26/d3d/d84/ddb 0 2024-09-13T02:50:56.260 INFO:tasks.workunit.client.1.smithi122.stdout:0/792: rmdir d1/d5/d10/d29 39 2024-09-13T02:50:56.263 INFO:tasks.workunit.client.1.smithi122.stdout:8/716: mknod d3/d53/d21/cdd 0 2024-09-13T02:50:56.263 INFO:tasks.workunit.client.1.smithi122.stdout:8/717: chown d3/d53/d34 904099726 1 2024-09-13T02:50:56.265 INFO:tasks.workunit.client.1.smithi122.stdout:8/718: getdents d3/d53/d34/dbf/dcb/d76 0 2024-09-13T02:50:56.267 INFO:tasks.workunit.client.1.smithi122.stdout:2/697: mknod d0/d5d/cdc 0 2024-09-13T02:50:56.268 INFO:tasks.workunit.client.1.smithi122.stdout:2/698: rename d0/d53/dc6 to d0/d53/dc6/ddd 22 2024-09-13T02:50:56.284 INFO:tasks.workunit.client.1.smithi122.stdout:6/829: sync 2024-09-13T02:50:56.284 INFO:tasks.workunit.client.1.smithi122.stdout:4/966: sync 2024-09-13T02:50:56.284 INFO:tasks.workunit.client.1.smithi122.stdout:1/824: sync 2024-09-13T02:50:56.284 INFO:tasks.workunit.client.1.smithi122.stdout:5/733: sync 2024-09-13T02:50:56.284 INFO:tasks.workunit.client.1.smithi122.stdout:5/734: write d0/d2/d33/fcf [4300152,91786] 0 2024-09-13T02:50:56.287 INFO:tasks.workunit.client.1.smithi122.stdout:6/830: creat d5/d3d/ff6 x:0 0 0 2024-09-13T02:50:56.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/825: creat dc/d38/db1/deb/f115 x:0 0 0 2024-09-13T02:50:56.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/826: chown dc/de/ld8 234805062 1 2024-09-13T02:50:56.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/827: write dc/d38/db1/db2/fdb [236205,98946] 0 2024-09-13T02:50:56.288 INFO:tasks.workunit.client.1.smithi122.stdout:1/828: write dc/d38/db1/d72/dd7/d46/f92 [384470,123415] 0 2024-09-13T02:50:56.289 INFO:tasks.workunit.client.1.smithi122.stdout:5/735: dread d0/da/f19 [0,4194304] 0 2024-09-13T02:50:56.289 INFO:tasks.workunit.client.1.smithi122.stdout:9/785: sync 2024-09-13T02:50:56.289 INFO:tasks.workunit.client.1.smithi122.stdout:3/857: sync 2024-09-13T02:50:56.290 INFO:tasks.workunit.client.1.smithi122.stdout:7/765: sync 2024-09-13T02:50:56.291 INFO:tasks.workunit.client.1.smithi122.stdout:7/766: creat d4/d8/d24/d82/ffb x:0 0 0 2024-09-13T02:50:56.294 INFO:tasks.workunit.client.1.smithi122.stdout:2/699: dread d0/d1c/d3b/d41/d6a/f49 [0,4194304] 0 2024-09-13T02:50:56.294 INFO:tasks.workunit.client.1.smithi122.stdout:9/786: symlink d8/d16/lee 0 2024-09-13T02:50:56.294 INFO:tasks.workunit.client.1.smithi122.stdout:9/787: dread - d8/fb1 zero size 2024-09-13T02:50:56.294 INFO:tasks.workunit.client.1.smithi122.stdout:9/788: write d8/d16/d45/f81 [179331,79070] 0 2024-09-13T02:50:56.295 INFO:tasks.workunit.client.1.smithi122.stdout:4/967: write d11/d1b/d32/f73 [3595241,122488] 0 2024-09-13T02:50:56.295 INFO:tasks.workunit.client.1.smithi122.stdout:3/858: creat d4/d6/de/f144 x:0 0 0 2024-09-13T02:50:56.300 INFO:tasks.workunit.client.1.smithi122.stdout:9/789: dread d8/d16/d3d/d59/d23/d1f/d36/fa8 [0,4194304] 0 2024-09-13T02:50:56.303 INFO:tasks.workunit.client.1.smithi122.stdout:7/767: mkdir d4/d6d/da6/df2/dfc 0 2024-09-13T02:50:56.303 INFO:tasks.workunit.client.1.smithi122.stdout:6/831: rmdir d5/d11/d45/d21 39 2024-09-13T02:50:56.304 INFO:tasks.workunit.client.1.smithi122.stdout:6/832: write d5/db/d29/fa4 [247071,9409] 0 2024-09-13T02:50:56.304 INFO:tasks.workunit.client.1.smithi122.stdout:6/833: fsync d5/d40/f35 0 2024-09-13T02:50:56.307 INFO:tasks.workunit.client.1.smithi122.stdout:2/700: rmdir d0/d1e/d26/dbd 39 2024-09-13T02:50:56.309 INFO:tasks.workunit.client.1.smithi122.stdout:8/719: dwrite d3/d53/d34/dbf/dcb/fdc [0,4194304] 0 2024-09-13T02:50:56.309 INFO:tasks.workunit.client.1.smithi122.stdout:8/720: write d3/d53/d34/f49 [5371779,95767] 0 2024-09-13T02:50:56.311 INFO:tasks.workunit.client.1.smithi122.stdout:3/859: mknod d4/d11/dd/d21/d4e/dc8/c145 0 2024-09-13T02:50:56.311 INFO:tasks.workunit.client.1.smithi122.stdout:6/834: dread d5/d3d/d82/fdb [0,4194304] 0 2024-09-13T02:50:56.313 INFO:tasks.workunit.client.1.smithi122.stdout:4/968: creat d11/d13/d82/d126/d55/f128 x:0 0 0 2024-09-13T02:50:56.316 INFO:tasks.workunit.client.1.smithi122.stdout:9/790: rename d8/d16/d3d/d59/d23/d7b/d82/lcb to d8/d16/d3d/d59/d29/lef 0 2024-09-13T02:50:56.318 INFO:tasks.workunit.client.1.smithi122.stdout:8/721: symlink d3/d31/lde 0 2024-09-13T02:50:56.319 INFO:tasks.workunit.client.1.smithi122.stdout:4/969: rmdir d11/d13/dc9/de3/d8e/dbd 39 2024-09-13T02:50:56.322 INFO:tasks.workunit.client.1.smithi122.stdout:3/860: dread d4/d11/dd/d21/d2b/dcf/f104 [0,4194304] 0 2024-09-13T02:50:56.322 INFO:tasks.workunit.client.1.smithi122.stdout:3/861: fsync d4/ffd 0 2024-09-13T02:50:56.323 INFO:tasks.workunit.client.1.smithi122.stdout:3/862: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee 4092 1 2024-09-13T02:50:56.324 INFO:tasks.workunit.client.1.smithi122.stdout:5/736: dwrite d0/d17/d3a/faa [0,4194304] 0 2024-09-13T02:50:56.324 INFO:tasks.workunit.client.1.smithi122.stdout:5/737: write d0/d17/f54 [560949,102630] 0 2024-09-13T02:50:56.326 INFO:tasks.workunit.client.1.smithi122.stdout:4/970: symlink d11/d3d/l129 0 2024-09-13T02:50:56.326 INFO:tasks.workunit.client.1.smithi122.stdout:4/971: chown d11/d1b/d32/c33 58 1 2024-09-13T02:50:56.326 INFO:tasks.workunit.client.1.smithi122.stdout:5/738: read d0/da/f73 [70429,88171] 0 2024-09-13T02:50:56.328 INFO:tasks.workunit.client.1.smithi122.stdout:1/829: dwrite dc/d38/db1/d72/dd7/d46/f111 [0,4194304] 0 2024-09-13T02:50:56.328 INFO:tasks.workunit.client.1.smithi122.stdout:1/830: readlink dc/l61 0 2024-09-13T02:50:56.328 INFO:tasks.workunit.client.1.smithi122.stdout:1/831: write dc/de/d18/f66 [277122,124111] 0 2024-09-13T02:50:56.330 INFO:tasks.workunit.client.1.smithi122.stdout:3/863: creat d4/d6/de/d41/f146 x:0 0 0 2024-09-13T02:50:56.334 INFO:tasks.workunit.client.1.smithi122.stdout:9/791: rmdir d8/d16/d3e 39 2024-09-13T02:50:56.334 INFO:tasks.workunit.client.1.smithi122.stdout:8/722: write d3/d53/d21/f90 [514863,123843] 0 2024-09-13T02:50:56.335 INFO:tasks.workunit.client.1.smithi122.stdout:2/701: dwrite d0/d1e/d2e/d8a/d99/fcc [0,4194304] 0 2024-09-13T02:50:56.335 INFO:tasks.workunit.client.1.smithi122.stdout:7/768: dwrite d4/d6d/da6/dbf/db1/f93 [0,4194304] 0 2024-09-13T02:50:56.335 INFO:tasks.workunit.client.1.smithi122.stdout:3/864: write d4/d11/dd/fd9 [22918,76761] 0 2024-09-13T02:50:56.335 INFO:tasks.workunit.client.1.smithi122.stdout:3/865: getdents d4/d4c/dd3/d13c 0 2024-09-13T02:50:56.336 INFO:tasks.workunit.client.1.smithi122.stdout:4/972: mkdir d11/d13/dc9/de3/d8e/dbd/de5/d116/d8f/da2/dc8/d12a 0 2024-09-13T02:50:56.336 INFO:tasks.workunit.client.1.smithi122.stdout:4/973: chown d11/d13/dc9/de3/d8e/dbd/de5/d116/de8/d11b 1 1 2024-09-13T02:50:56.337 INFO:tasks.workunit.client.1.smithi122.stdout:5/739: mknod d0/cee 0 2024-09-13T02:50:56.347 INFO:tasks.workunit.client.1.smithi122.stdout:9/792: mknod d8/d16/d3d/cf0 0 2024-09-13T02:50:56.347 INFO:tasks.workunit.client.1.smithi122.stdout:9/793: chown d8/d16 64 1 2024-09-13T02:50:56.347 INFO:tasks.workunit.client.1.smithi122.stdout:9/794: write d8/d16/d3d/d59/d49/fc5 [606006,42241] 0 2024-09-13T02:50:56.347 INFO:tasks.workunit.client.1.smithi122.stdout:8/723: mknod d3/d53/d34/dbf/dcb/d76/dbb/cdf 0 2024-09-13T02:50:56.347 INFO:tasks.workunit.client.1.smithi122.stdout:1/832: dwrite dc/f9c [0,4194304] 0 2024-09-13T02:50:56.348 INFO:tasks.workunit.client.1.smithi122.stdout:2/702: mkdir d0/dc0/dde 0 2024-09-13T02:50:56.348 INFO:tasks.workunit.client.1.smithi122.stdout:7/769: creat d4/d6d/ffd x:0 0 0 2024-09-13T02:50:56.351 INFO:tasks.workunit.client.1.smithi122.stdout:3/866: rename d4/d6/df/f7b to d4/d11/dd/df1/f147 0 2024-09-13T02:50:56.351 INFO:tasks.workunit.client.1.smithi122.stdout:3/867: chown d4/d6/f4a 10522017 1 2024-09-13T02:50:56.351 INFO:tasks.workunit.client.1.smithi122.stdout:2/703: dread d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:50:56.351 INFO:tasks.workunit.client.1.smithi122.stdout:4/974: dwrite d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/fed [0,4194304] 0 2024-09-13T02:50:56.355 INFO:tasks.workunit.client.1.smithi122.stdout:9/795: link d8/d16/d3d/d59/d23/d7b/d82/da3/da7/fc6 d8/d16/d3d/d59/d7d/ff1 0 2024-09-13T02:50:56.358 INFO:tasks.workunit.client.1.smithi122.stdout:5/740: unlink d0/d17/d36/d3f/ce5 0 2024-09-13T02:50:56.359 INFO:tasks.workunit.client.1.smithi122.stdout:5/741: write d0/da/d48/d63/f82 [1875821,113278] 0 2024-09-13T02:50:56.362 INFO:tasks.workunit.client.1.smithi122.stdout:1/833: creat dc/d38/db1/d72/dd7/d3f/dc1/f116 x:0 0 0 2024-09-13T02:50:56.365 INFO:tasks.workunit.client.1.smithi122.stdout:8/724: rename d3/d31/d52/l5d to d3/d53/d34/dbf/dcb/le0 0 2024-09-13T02:50:56.366 INFO:tasks.workunit.client.1.smithi122.stdout:8/725: write d3/da/d1f/f7f [4858580,47213] 0 2024-09-13T02:50:56.366 INFO:tasks.workunit.client.1.smithi122.stdout:8/726: chown d3/da/d1f/f7f 31 1 2024-09-13T02:50:56.366 INFO:tasks.workunit.client.1.smithi122.stdout:3/868: mknod d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/d135/c148 0 2024-09-13T02:50:56.370 INFO:tasks.workunit.client.1.smithi122.stdout:2/704: symlink d0/ldf 0 2024-09-13T02:50:56.371 INFO:tasks.workunit.client.1.smithi122.stdout:4/975: truncate d11/d13/d82/d2a/d83/f95 3518296 0 2024-09-13T02:50:56.374 INFO:tasks.workunit.client.1.smithi122.stdout:8/727: dread d3/d31/d52/d59/f39 [4194304,4194304] 0 2024-09-13T02:50:56.374 INFO:tasks.workunit.client.1.smithi122.stdout:8/728: readlink d3/d53/d4d/l9a 0 2024-09-13T02:50:56.376 INFO:tasks.workunit.client.1.smithi122.stdout:1/834: symlink dc/d38/d51/l117 0 2024-09-13T02:50:56.379 INFO:tasks.workunit.client.1.smithi122.stdout:7/770: rename d4/d4e/d5d/d6b/f78 to d4/d8/d24/d47/ffe 0 2024-09-13T02:50:56.379 INFO:tasks.workunit.client.1.smithi122.stdout:7/771: chown d4/d6d/da6/dbf/db1/f93 4858 1 2024-09-13T02:50:56.379 INFO:tasks.workunit.client.1.smithi122.stdout:7/772: fsync d4/d6d/d8f/f92 0 2024-09-13T02:50:56.380 INFO:tasks.workunit.client.1.smithi122.stdout:7/773: read d4/d8/db/dc/f5f [5798,19189] 0 2024-09-13T02:50:56.386 INFO:tasks.workunit.client.1.smithi122.stdout:2/705: unlink d0/d1c/fad 0 2024-09-13T02:50:56.386 INFO:tasks.workunit.client.1.smithi122.stdout:2/706: readlink d0/d55/l77 0 2024-09-13T02:50:56.389 INFO:tasks.workunit.client.1.smithi122.stdout:1/835: dwrite dc/de/d18/d22/d76/fd4 [0,4194304] 0 2024-09-13T02:50:56.390 INFO:tasks.workunit.client.1.smithi122.stdout:8/729: creat d3/d53/d34/dbf/dcb/d76/dbb/fe1 x:0 0 0 2024-09-13T02:50:56.392 INFO:tasks.workunit.client.1.smithi122.stdout:9/796: rmdir d8/d16/d3d/db5 39 2024-09-13T02:50:56.395 INFO:tasks.workunit.client.1.smithi122.stdout:5/742: rename d0/d17/d36/d3f/d4c/f66 to d0/da/fef 0 2024-09-13T02:50:56.398 INFO:tasks.workunit.client.1.smithi122.stdout:7/774: unlink d4/d8/d24/fad 0 2024-09-13T02:50:56.398 INFO:tasks.workunit.client.1.smithi122.stdout:7/775: creat d4/d8/d3d/dc2/fff x:0 0 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:8/730: dread d3/d53/d4d/fb5 [0,4194304] 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:8/731: creat d3/da6/fe2 x:0 0 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:8/732: creat d3/d31/d52/fe3 x:0 0 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:9/797: dread d8/d16/d3d/d59/d7d/d83/fda [0,4194304] 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:2/707: mkdir d0/d1e/d92/de0 0 2024-09-13T02:50:56.400 INFO:tasks.workunit.client.1.smithi122.stdout:2/708: chown d0/d55/f62 154 1 2024-09-13T02:50:56.401 INFO:tasks.workunit.client.1.smithi122.stdout:4/976: getdents d11/d1b 0 2024-09-13T02:50:56.401 INFO:tasks.workunit.client.1.smithi122.stdout:4/977: stat d11/d1b/d32/d98/la7 0 2024-09-13T02:50:56.407 INFO:tasks.workunit.client.1.smithi122.stdout:5/743: symlink d0/da/d48/d63/d98/lf0 0 2024-09-13T02:50:56.409 INFO:tasks.workunit.client.1.smithi122.stdout:7/776: mknod d4/d8/d3d/dc2/dca/c100 0 2024-09-13T02:50:56.413 INFO:tasks.workunit.client.1.smithi122.stdout:8/733: mkdir d3/d31/d65/de4 0 2024-09-13T02:50:56.416 INFO:tasks.workunit.client.1.smithi122.stdout:9/798: creat d8/d16/d3d/db5/ff2 x:0 0 0 2024-09-13T02:50:56.416 INFO:tasks.workunit.client.1.smithi122.stdout:9/799: fdatasync d8/d16/d3d/d59/d49/f7a 0 2024-09-13T02:50:56.417 INFO:tasks.workunit.client.1.smithi122.stdout:2/709: creat d0/d1e/fe1 x:0 0 0 2024-09-13T02:50:56.419 INFO:tasks.workunit.client.1.smithi122.stdout:4/978: truncate d11/d13/d82/d2a/d40/f4d 3017729 0 2024-09-13T02:50:56.425 INFO:tasks.workunit.client.1.smithi122.stdout:1/836: rmdir dc/d38/db1/d72 39 2024-09-13T02:50:56.425 INFO:tasks.workunit.client.1.smithi122.stdout:1/837: chown dc/de/d18/d22/d1c/d47 47265519 1 2024-09-13T02:50:56.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/777: rename d4/f35 to d4/d8/d3d/f101 0 2024-09-13T02:50:56.428 INFO:tasks.workunit.client.1.smithi122.stdout:7/778: fdatasync d4/d8/d24/d47/ffe 0 2024-09-13T02:50:56.429 INFO:tasks.workunit.client.1.smithi122.stdout:8/734: symlink d3/d53/d34/dbf/dcb/d76/le5 0 2024-09-13T02:50:56.433 INFO:tasks.workunit.client.1.smithi122.stdout:2/710: link d0/cb d0/d1c/d3b/d41/d4e/d90/ce2 0 2024-09-13T02:50:56.433 INFO:tasks.workunit.client.1.smithi122.stdout:2/711: dread - d0/d1e/d2e/d5a/fd6 zero size 2024-09-13T02:50:56.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/979: truncate d11/d13/d82/d126/f7f 4140863 0 2024-09-13T02:50:56.434 INFO:tasks.workunit.client.1.smithi122.stdout:4/980: write d11/d62/ffa [469592,84591] 0 2024-09-13T02:50:56.437 INFO:tasks.workunit.client.1.smithi122.stdout:2/712: dread d0/d1c/f31 [0,4194304] 0 2024-09-13T02:50:56.437 INFO:tasks.workunit.client.1.smithi122.stdout:2/713: write d0/dc0/fd9 [535062,99746] 0 2024-09-13T02:50:56.437 INFO:tasks.workunit.client.1.smithi122.stdout:2/714: write d0/d55/f9d [675862,80626] 0 2024-09-13T02:50:56.437 INFO:tasks.workunit.client.1.smithi122.stdout:1/838: rename dc/de/d18/d1d/l49 to dc/d38/db1/d72/dd7/d3f/dc1/l118 0 2024-09-13T02:50:56.444 INFO:tasks.workunit.client.1.smithi122.stdout:7/779: rename d4/d8/d24/d82 to d4/d8/db7/d102 0 2024-09-13T02:50:56.445 INFO:tasks.workunit.client.1.smithi122.stdout:4/981: dread d11/d13/d82/d126/fb8 [0,4194304] 0 2024-09-13T02:50:56.445 INFO:tasks.workunit.client.1.smithi122.stdout:9/800: dwrite d8/d16/d3d/d59/d23/d1f/f2d [0,4194304] 0 2024-09-13T02:50:56.446 INFO:tasks.workunit.client.1.smithi122.stdout:7/780: mkdir d4/d8/d3d/dc2/d103 0 2024-09-13T02:50:56.446 INFO:tasks.workunit.client.1.smithi122.stdout:8/735: dwrite d3/d31/f3b [4194304,4194304] 0 2024-09-13T02:50:56.450 INFO:tasks.workunit.client.1.smithi122.stdout:4/982: link d11/d13/lf6 d11/d13/d82/d126/l12b 0 2024-09-13T02:50:56.450 INFO:tasks.workunit.client.1.smithi122.stdout:2/715: dread d0/d55/d70/d59/f6e [0,4194304] 0 2024-09-13T02:50:56.450 INFO:tasks.workunit.client.1.smithi122.stdout:5/744: dwrite d0/da/fef [0,4194304] 0 2024-09-13T02:50:56.457 INFO:tasks.workunit.client.1.smithi122.stdout:9/801: link d8/d4a/d64/ld5 d8/d16/d3d/d59/d29/d90/db7/dbc/lf3 0 2024-09-13T02:50:56.460 INFO:tasks.workunit.client.1.smithi122.stdout:7/781: mknod d4/d6d/d8f/de7/c104 0 2024-09-13T02:50:56.461 INFO:tasks.workunit.client.1.smithi122.stdout:1/839: dwrite dc/d38/db1/d72/f10f [4194304,4194304] 0 2024-09-13T02:50:56.461 INFO:tasks.workunit.client.1.smithi122.stdout:4/983: creat d11/f12c x:0 0 0 2024-09-13T02:50:56.464 INFO:tasks.workunit.client.1.smithi122.stdout:2/716: write d0/d1e/d2e/f97 [2715534,37260] 0 2024-09-13T02:50:56.466 INFO:tasks.workunit.client.1.smithi122.stdout:5/745: mkdir d0/d1d/df1 0 2024-09-13T02:50:56.467 INFO:tasks.workunit.client.1.smithi122.stdout:8/736: dwrite d3/d53/d21/d92/fcc [0,4194304] 0 2024-09-13T02:50:56.469 INFO:tasks.workunit.client.1.smithi122.stdout:9/802: mkdir d8/d16/d45/df4 0 2024-09-13T02:50:56.476 INFO:tasks.workunit.client.1.smithi122.stdout:1/840: rename dc/d38/db1/d72/dd7/d3f/dc1/l118 to dc/d38/d51/daf/d105/l119 0 2024-09-13T02:50:56.477 INFO:tasks.workunit.client.1.smithi122.stdout:4/984: dwrite d11/d13/d82/d126/d55/f67 [0,4194304] 0 2024-09-13T02:50:56.477 INFO:tasks.workunit.client.1.smithi122.stdout:2/717: unlink d0/d1c/d3b/d41/d6a/ca5 0 2024-09-13T02:50:56.478 INFO:tasks.workunit.client.1.smithi122.stdout:5/746: mknod d0/d17/cf2 0 2024-09-13T02:50:56.480 INFO:tasks.workunit.client.1.smithi122.stdout:8/737: unlink d3/d53/d34/dbf/dcb/le0 0 2024-09-13T02:50:56.481 INFO:tasks.workunit.client.1.smithi122.stdout:9/803: unlink d8/d16/d3d/cf0 0 2024-09-13T02:50:56.481 INFO:tasks.workunit.client.1.smithi122.stdout:9/804: write d8/d16/d3d/d59/d49/fc5 [1510683,63321] 0 2024-09-13T02:50:56.481 INFO:tasks.workunit.client.1.smithi122.stdout:9/805: chown d8/d88/c6f 404052 1 2024-09-13T02:50:56.481 INFO:tasks.workunit.client.1.smithi122.stdout:9/806: chown d8/d16/d3d/d59/d49 1259 1 2024-09-13T02:50:56.481 INFO:tasks.workunit.client.1.smithi122.stdout:9/807: write d8/d16/d3d/d59/d23/d1f/d36/f52 [1466967,13787] 0 2024-09-13T02:50:56.483 INFO:tasks.workunit.client.1.smithi122.stdout:4/985: truncate d11/f43 2736575 0 2024-09-13T02:50:56.485 INFO:tasks.workunit.client.1.smithi122.stdout:2/718: symlink d0/d1e/d26/d3d/le3 0 2024-09-13T02:50:56.485 INFO:tasks.workunit.client.1.smithi122.stdout:2/719: creat d0/d1c/d3b/d41/d4e/fe4 x:0 0 0 2024-09-13T02:50:56.490 INFO:tasks.workunit.client.1.smithi122.stdout:5/747: write d0/d17/d3a/faa [1806790,32654] 0 2024-09-13T02:50:56.490 INFO:tasks.workunit.client.1.smithi122.stdout:5/748: read - d0/da/d90/fd5 zero size 2024-09-13T02:50:56.490 INFO:tasks.workunit.client.1.smithi122.stdout:9/808: mkdir d8/d16/d3e/d57/df5 0 2024-09-13T02:50:56.493 INFO:tasks.workunit.client.1.smithi122.stdout:1/841: write dc/d38/db1/d72/dd7/d3f/f7f [2484780,5111] 0 2024-09-13T02:50:56.494 INFO:tasks.workunit.client.1.smithi122.stdout:5/749: mkdir d0/da/d48/db4/df3 0 2024-09-13T02:50:56.494 INFO:tasks.workunit.client.1.smithi122.stdout:5/750: creat d0/d17/d36/d8b/ff4 x:0 0 0 2024-09-13T02:50:56.508 INFO:tasks.workunit.client.1.smithi122.stdout:1/842: write dc/de/d18/f2c [6465512,33339] 0 2024-09-13T02:50:56.508 INFO:tasks.workunit.client.1.smithi122.stdout:1/843: write dc/de/f8e [565768,112500] 0 2024-09-13T02:50:56.509 INFO:tasks.workunit.client.1.smithi122.stdout:1/844: stat dc/d38/db1/d7d 0 2024-09-13T02:50:56.509 INFO:tasks.workunit.client.1.smithi122.stdout:1/845: stat dc/d38/db1/d7d/f83 0 2024-09-13T02:50:56.509 INFO:tasks.workunit.client.1.smithi122.stdout:1/846: rename dc to dc/de/d18/d22/d11a 22 2024-09-13T02:50:56.510 INFO:tasks.workunit.client.1.smithi122.stdout:1/847: rename dc/de/d18/d22/d1c/d57/dc6/f104 to dc/de/d18/d86/f11b 0 2024-09-13T02:50:56.510 INFO:tasks.workunit.client.1.smithi122.stdout:5/751: read d0/d17/d36/f9e [636740,130220] 0 2024-09-13T02:50:56.520 INFO:tasks.workunit.client.1.smithi122.stdout:8/738: dwrite d3/d31/d52/fa8 [0,4194304] 0 2024-09-13T02:50:56.520 INFO:tasks.workunit.client.1.smithi122.stdout:8/739: chown d3/d31/d52/cc2 5 1 2024-09-13T02:50:56.522 INFO:tasks.workunit.client.1.smithi122.stdout:1/848: dread dc/de/d18/faa [0,4194304] 0 2024-09-13T02:50:56.522 INFO:tasks.workunit.client.1.smithi122.stdout:1/849: chown dc/de/d18/d22/d1c/d57/fdd 17969 1 2024-09-13T02:50:56.522 INFO:tasks.workunit.client.1.smithi122.stdout:8/740: unlink d3/da/d1e/l81 0 2024-09-13T02:50:56.523 INFO:tasks.workunit.client.1.smithi122.stdout:8/741: symlink d3/da6/le6 0 2024-09-13T02:50:56.523 INFO:tasks.workunit.client.1.smithi122.stdout:8/742: chown d3/da/d1e/cc9 0 1 2024-09-13T02:50:56.525 INFO:tasks.workunit.client.1.smithi122.stdout:2/720: dwrite d0/d1e/d22/d29/f2b [0,4194304] 0 2024-09-13T02:50:56.525 INFO:tasks.workunit.client.1.smithi122.stdout:2/721: write d0/d1e/d26/fc7 [880226,53651] 0 2024-09-13T02:50:56.525 INFO:tasks.workunit.client.1.smithi122.stdout:2/722: fdatasync d0/d1e/d2e/d5a/fd6 0 2024-09-13T02:50:56.526 INFO:tasks.workunit.client.1.smithi122.stdout:4/986: dwrite d11/d13/dc9/de3/d8e/dbd/de5/d116/d8f/da2/fb3 [0,4194304] 0 2024-09-13T02:50:56.527 INFO:tasks.workunit.client.1.smithi122.stdout:9/809: dwrite d8/f33 [4194304,4194304] 0 2024-09-13T02:50:56.527 INFO:tasks.workunit.client.1.smithi122.stdout:9/810: readlink d8/d16/d45/l72 0 2024-09-13T02:50:56.527 INFO:tasks.workunit.client.1.smithi122.stdout:5/752: dwrite d0/d17/d3a/f9f [0,4194304] 0 2024-09-13T02:50:56.529 INFO:tasks.workunit.client.1.smithi122.stdout:2/723: creat d0/d55/d70/fe5 x:0 0 0 2024-09-13T02:50:56.529 INFO:tasks.workunit.client.1.smithi122.stdout:2/724: write d0/d1c/d3b/d41/d4e/d75/faa [2350641,9005] 0 2024-09-13T02:50:56.531 INFO:tasks.workunit.client.1.smithi122.stdout:4/987: symlink d11/d1b/d32/d87/l12d 0 2024-09-13T02:50:56.536 INFO:tasks.workunit.client.1.smithi122.stdout:2/725: mkdir d0/d55/d70/d59/dd2/de6 0 2024-09-13T02:50:56.536 INFO:tasks.workunit.client.1.smithi122.stdout:4/988: mkdir d11/d13/d82/d126/d12e 0 2024-09-13T02:50:56.537 INFO:tasks.workunit.client.1.smithi122.stdout:4/989: fdatasync d11/d13/dd8/df1/ffc 0 2024-09-13T02:50:56.538 INFO:tasks.workunit.client.1.smithi122.stdout:2/726: link d0/l4a d0/d1e/d26/le7 0 2024-09-13T02:50:56.548 INFO:tasks.workunit.client.1.smithi122.stdout:5/753: dread d0/d2/f20 [0,4194304] 0 2024-09-13T02:50:56.550 INFO:tasks.workunit.client.1.smithi122.stdout:5/754: unlink d0/d17/d36/d25/d2b/f71 0 2024-09-13T02:50:56.550 INFO:tasks.workunit.client.1.smithi122.stdout:5/755: stat d0/d17/d36/d25/d2b/c39 0 2024-09-13T02:50:56.551 INFO:tasks.workunit.client.1.smithi122.stdout:5/756: chown d0/d17/d36/d25/f65 7174 1 2024-09-13T02:50:56.553 INFO:tasks.workunit.client.1.smithi122.stdout:5/757: link d0/fc9 d0/d17/d36/d99/ff5 0 2024-09-13T02:50:56.554 INFO:tasks.workunit.client.1.smithi122.stdout:5/758: stat d0/d17/d36/d3f/d4c/c62 0 2024-09-13T02:50:56.554 INFO:tasks.workunit.client.1.smithi122.stdout:5/759: dread - d0/da/d48/fed zero size 2024-09-13T02:50:56.555 INFO:tasks.workunit.client.1.smithi122.stdout:5/760: truncate d0/da/d48/d63/f82 2042875 0 2024-09-13T02:50:56.561 INFO:tasks.workunit.client.1.smithi122.stdout:9/811: dwrite d8/f28 [0,4194304] 0 2024-09-13T02:50:56.563 INFO:tasks.workunit.client.1.smithi122.stdout:9/812: getdents d8/d88/d65 0 2024-09-13T02:50:56.563 INFO:tasks.workunit.client.1.smithi122.stdout:9/813: write d8/d16/d3d/d59/d7d/d83/fe3 [744080,52063] 0 2024-09-13T02:50:56.565 INFO:tasks.workunit.client.1.smithi122.stdout:9/814: mknod d8/d16/d3d/d59/d23/d7b/d82/cf6 0 2024-09-13T02:50:56.567 INFO:tasks.workunit.client.1.smithi122.stdout:9/815: creat d8/d16/d45/dc4/ff7 x:0 0 0 2024-09-13T02:50:56.567 INFO:tasks.workunit.client.1.smithi122.stdout:9/816: rmdir d8/d16/d3e/d57 39 2024-09-13T02:50:56.567 INFO:tasks.workunit.client.1.smithi122.stdout:9/817: stat d8/c22 0 2024-09-13T02:50:56.580 INFO:tasks.workunit.client.1.smithi122.stdout:8/743: dwrite d3/d53/d34/fb7 [0,4194304] 0 2024-09-13T02:50:56.580 INFO:tasks.workunit.client.1.smithi122.stdout:4/990: dwrite d11/d13/d82/d126/fc2 [0,4194304] 0 2024-09-13T02:50:56.580 INFO:tasks.workunit.client.1.smithi122.stdout:4/991: fdatasync d11/d13/dc9/f122 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:1/850: dwrite dc/de/d7a/fa0 [0,4194304] 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:1/851: write dc/de/d18/d1d/d2f/fe8 [532726,127154] 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:1/852: write dc/d38/db1/d7d/f84 [588218,43408] 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:2/727: dwrite d0/d55/f9d [0,4194304] 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:5/761: dwrite d0/d2/f6e [0,4194304] 0 2024-09-13T02:50:56.581 INFO:tasks.workunit.client.1.smithi122.stdout:2/728: fdatasync d0/d1c/f31 0 2024-09-13T02:50:56.588 INFO:tasks.workunit.client.1.smithi122.stdout:9/818: dwrite d8/d16/d3d/d59/d7d/d83/fda [0,4194304] 0 2024-09-13T02:50:56.589 INFO:tasks.workunit.client.1.smithi122.stdout:4/992: symlink d11/d13/dc9/de3/d8e/l12f 0 2024-09-13T02:50:56.618 INFO:tasks.workunit.client.1.smithi122.stdout:4/993: symlink d11/d13/dc9/de3/d8e/dbd/de5/d116/d6e/de4/l130 0 2024-09-13T02:50:56.620 INFO:tasks.workunit.client.1.smithi122.stdout:4/994: creat d11/d30/f131 x:0 0 0 2024-09-13T02:50:56.620 INFO:tasks.workunit.client.1.smithi122.stdout:4/995: write d11/d62/faa [374432,42972] 0 2024-09-13T02:50:56.623 INFO:tasks.workunit.client.1.smithi122.stdout:5/762: dwrite d0/d1d/f1f [4194304,4194304] 0 2024-09-13T02:50:56.624 INFO:tasks.workunit.client.1.smithi122.stdout:2/729: dwrite d0/f5 [0,4194304] 0 2024-09-13T02:50:56.624 INFO:tasks.workunit.client.1.smithi122.stdout:8/744: dwrite d3/d53/d34/f3a [0,4194304] 0 2024-09-13T02:50:56.624 INFO:tasks.workunit.client.1.smithi122.stdout:9/819: dwrite d8/d16/d3d/d59/d7d/fe6 [0,4194304] 0 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:5/763: symlink d0/d17/d36/d3f/d4c/d7f/dd1/lf6 0 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:4/996: dread d11/d13/d82/d126/d55/f58 [0,4194304] 0 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:5/764: chown d0/d2/f91 71 1 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:4/997: fdatasync d11/d62/ffa 0 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:5/765: read - d0/d17/d36/d25/fda zero size 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:5/766: chown d0/d17/d36/d3f/fe1 1 1 2024-09-13T02:50:56.626 INFO:tasks.workunit.client.1.smithi122.stdout:2/730: mknod d0/d1c/d3b/d41/d8c/ce8 0 2024-09-13T02:50:56.634 INFO:tasks.workunit.client.1.smithi122.stdout:4/998: write d11/d13/d82/d126/fc2 [105711,67945] 0 2024-09-13T02:50:56.636 INFO:tasks.workunit.client.1.smithi122.stdout:9/820: creat d8/d16/ff8 x:0 0 0 2024-09-13T02:50:56.638 INFO:tasks.workunit.client.1.smithi122.stdout:2/731: dread d0/f51 [4194304,4194304] 0 2024-09-13T02:50:56.639 INFO:tasks.workunit.client.1.smithi122.stdout:5/767: mkdir d0/da/d8c/d8f/df7 0 2024-09-13T02:50:56.639 INFO:tasks.workunit.client.1.smithi122.stdout:5/768: fdatasync d0/d17/d36/d8b/f96 0 2024-09-13T02:50:56.642 INFO:tasks.workunit.client.1.smithi122.stdout:8/745: getdents d3/d31/d52/d89/db1 0 2024-09-13T02:50:56.644 INFO:tasks.workunit.client.1.smithi122.stdout:8/746: dread d3/da/d1f/f63 [0,4194304] 0 2024-09-13T02:50:56.644 INFO:tasks.workunit.client.1.smithi122.stdout:9/821: truncate d8/d16/d3d/d59/d23/d7b/d82/fbb 264138 0 2024-09-13T02:50:56.650 INFO:tasks.workunit.client.1.smithi122.stdout:9/822: mkdir d8/d16/d45/df9 0 2024-09-13T02:50:56.650 INFO:tasks.workunit.client.1.smithi122.stdout:9/823: chown d8/d88/d65/faf 14 1 2024-09-13T02:50:56.650 INFO:tasks.workunit.client.1.smithi122.stdout:9/824: dread - d8/d16/d3d/d59/d23/d7b/d82/da3/da7/fc6 zero size 2024-09-13T02:50:56.650 INFO:tasks.workunit.client.1.smithi122.stdout:9/825: readlink d8/d16/d3d/d59/d23/d1f/l69 0 2024-09-13T02:50:56.661 INFO:tasks.workunit.client.1.smithi122.stdout:8/747: write d3/f9 [455269,47334] 0 2024-09-13T02:50:56.671 INFO:tasks.workunit.client.1.smithi122.stdout:2/732: dwrite d0/d1c/d3b/d41/d6a/f49 [0,4194304] 0 2024-09-13T02:50:56.671 INFO:tasks.workunit.client.1.smithi122.stdout:2/733: chown d0/d55/d70/d59 14458787 1 2024-09-13T02:50:56.671 INFO:tasks.workunit.client.1.smithi122.stdout:5/769: dwrite d0/d17/d36/d8b/fa5 [0,4194304] 0 2024-09-13T02:50:56.672 INFO:tasks.workunit.client.1.smithi122.stdout:4/999: dwrite d11/f80 [4194304,4194304] 0 2024-09-13T02:50:56.672 INFO:tasks.workunit.client.1.smithi122.stdout:9/826: dwrite d8/d16/ff8 [0,4194304] 0 2024-09-13T02:50:56.673 INFO:tasks.workunit.client.1.smithi122.stdout:2/734: unlink d0/d1e/d2e/d8a/lb7 0 2024-09-13T02:50:56.674 INFO:tasks.workunit.client.1.smithi122.stdout:5/770: creat d0/da/d48/dd3/ff8 x:0 0 0 2024-09-13T02:50:56.677 INFO:tasks.workunit.client.1.smithi122.stdout:9/827: unlink d8/d88/lb4 0 2024-09-13T02:50:56.677 INFO:tasks.workunit.client.1.smithi122.stdout:2/735: truncate d0/d1e/d26/fc7 66586 0 2024-09-13T02:50:56.679 INFO:tasks.workunit.client.1.smithi122.stdout:9/828: unlink d8/d16/d3d/cec 0 2024-09-13T02:50:56.680 INFO:tasks.workunit.client.1.smithi122.stdout:8/748: dwrite d3/d53/fd6 [0,4194304] 0 2024-09-13T02:50:56.681 INFO:tasks.workunit.client.1.smithi122.stdout:9/829: rename d8/d16/d3d/d59/d23/d7b/d82/da3/cc1 to d8/d16/d3d/d59/d23/cfa 0 2024-09-13T02:50:56.685 INFO:tasks.workunit.client.1.smithi122.stdout:5/771: write d0/d17/d36/d3f/fe1 [6031944,96118] 0 2024-09-13T02:50:56.685 INFO:tasks.workunit.client.1.smithi122.stdout:9/830: rmdir d8/d16/d3d/d59/d49 39 2024-09-13T02:50:56.687 INFO:tasks.workunit.client.1.smithi122.stdout:5/772: getdents d0/da/d48/d63/d98 0 2024-09-13T02:50:56.687 INFO:tasks.workunit.client.1.smithi122.stdout:5/773: truncate d0/d17/d3a/f9c 661445 0 2024-09-13T02:50:56.687 INFO:tasks.workunit.client.1.smithi122.stdout:5/774: getdents d0/da/d8c/d8f/df7 0 2024-09-13T02:50:56.690 INFO:tasks.workunit.client.1.smithi122.stdout:5/775: symlink d0/d1d/df1/lf9 0 2024-09-13T02:50:56.691 INFO:tasks.workunit.client.1.smithi122.stdout:8/749: write d3/d53/d21/d92/fcc [2583656,22147] 0 2024-09-13T02:50:56.696 INFO:tasks.workunit.client.1.smithi122.stdout:8/750: fdatasync d3/d53/d21/d92/fcc 0 2024-09-13T02:50:56.696 INFO:tasks.workunit.client.1.smithi122.stdout:8/751: fsync d3/d53/d21/d92/fcc 0 2024-09-13T02:50:56.696 INFO:tasks.workunit.client.1.smithi122.stdout:8/752: fdatasync d3/da/d1f/f27 0 2024-09-13T02:50:56.696 INFO:tasks.workunit.client.1.smithi122.stdout:2/736: dwrite d0/d1e/d22/f45 [0,4194304] 0 2024-09-13T02:50:56.699 INFO:tasks.workunit.client.1.smithi122.stdout:9/831: rmdir d8/d16/d3d 39 2024-09-13T02:50:56.699 INFO:tasks.workunit.client.1.smithi122.stdout:9/832: chown d8/d16/d45/df9 2811 1 2024-09-13T02:50:56.702 INFO:tasks.workunit.client.1.smithi122.stdout:5/776: symlink d0/da/d48/dd3/lfa 0 2024-09-13T02:50:56.702 INFO:tasks.workunit.client.1.smithi122.stdout:5/777: write d0/f7 [967952,15839] 0 2024-09-13T02:50:56.708 INFO:tasks.workunit.client.1.smithi122.stdout:5/778: creat d0/d1d/df1/ffb x:0 0 0 2024-09-13T02:50:56.708 INFO:tasks.workunit.client.1.smithi122.stdout:5/779: dread - d0/d17/d36/d3f/fb2 zero size 2024-09-13T02:50:56.709 INFO:tasks.workunit.client.1.smithi122.stdout:5/780: creat d0/da/d8c/d8f/ffc x:0 0 0 2024-09-13T02:50:56.712 INFO:tasks.workunit.client.1.smithi122.stdout:5/781: mknod d0/d17/cfd 0 2024-09-13T02:50:56.712 INFO:tasks.workunit.client.1.smithi122.stdout:5/782: write d0/d17/d36/d3f/fb2 [471819,97147] 0 2024-09-13T02:50:56.712 INFO:tasks.workunit.client.1.smithi122.stdout:5/783: chown d0/d2/f6d 129541 1 2024-09-13T02:50:56.713 INFO:tasks.workunit.client.1.smithi122.stdout:0/793: sync 2024-09-13T02:50:56.713 INFO:tasks.workunit.client.1.smithi122.stdout:6/835: sync 2024-09-13T02:50:56.713 INFO:tasks.workunit.client.1.smithi122.stdout:7/782: sync 2024-09-13T02:50:56.713 INFO:tasks.workunit.client.1.smithi122.stdout:3/869: sync 2024-09-13T02:50:56.714 INFO:tasks.workunit.client.1.smithi122.stdout:2/737: dwrite d0/d1c/fca [0,4194304] 0 2024-09-13T02:50:56.715 INFO:tasks.workunit.client.1.smithi122.stdout:5/784: dread d0/d17/d36/d25/fa9 [0,4194304] 0 2024-09-13T02:50:56.715 INFO:tasks.workunit.client.1.smithi122.stdout:5/785: dread - d0/fc9 zero size 2024-09-13T02:50:56.715 INFO:tasks.workunit.client.1.smithi122.stdout:6/836: link d5/d40/fc8 d5/d3d/d6c/d41/ff7 0 2024-09-13T02:50:56.716 INFO:tasks.workunit.client.1.smithi122.stdout:3/870: dread d4/d11/dd/d21/fc7 [0,4194304] 0 2024-09-13T02:50:56.716 INFO:tasks.workunit.client.1.smithi122.stdout:3/871: readlink d4/d11/dd/d21/d30/l64 0 2024-09-13T02:50:56.716 INFO:tasks.workunit.client.1.smithi122.stdout:3/872: fdatasync d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f124 0 2024-09-13T02:50:56.720 INFO:tasks.workunit.client.1.smithi122.stdout:9/833: dwrite d8/d16/d3d/db5/ff2 [0,4194304] 0 2024-09-13T02:50:56.720 INFO:tasks.workunit.client.1.smithi122.stdout:2/738: symlink d0/d53/le9 0 2024-09-13T02:50:56.721 INFO:tasks.workunit.client.1.smithi122.stdout:7/783: dread d4/d8/d3d/dc2/dca/fdf [0,4194304] 0 2024-09-13T02:50:56.725 INFO:tasks.workunit.client.1.smithi122.stdout:5/786: creat d0/d17/d36/d3f/d4c/d7f/dcb/ffe x:0 0 0 2024-09-13T02:50:56.726 INFO:tasks.workunit.client.1.smithi122.stdout:6/837: unlink d5/d40/f67 0 2024-09-13T02:50:56.726 INFO:tasks.workunit.client.1.smithi122.stdout:2/739: write d0/f16 [4183566,68252] 0 2024-09-13T02:50:56.727 INFO:tasks.workunit.client.1.smithi122.stdout:3/873: symlink d4/d6/de/d1f/l149 0 2024-09-13T02:50:56.734 INFO:tasks.workunit.client.1.smithi122.stdout:3/874: write d4/d4c/dd3/f81 [114796,21769] 0 2024-09-13T02:50:56.735 INFO:tasks.workunit.client.1.smithi122.stdout:9/834: mkdir d8/d16/dfb 0 2024-09-13T02:50:56.735 INFO:tasks.workunit.client.1.smithi122.stdout:9/835: chown d8/d16/d45/c50 71080257 1 2024-09-13T02:50:56.737 INFO:tasks.workunit.client.1.smithi122.stdout:7/784: rmdir d4/d8/db/d63/dbb/dda 0 2024-09-13T02:50:56.738 INFO:tasks.workunit.client.1.smithi122.stdout:7/785: fdatasync d4/d8/d3d/dc2/fff 0 2024-09-13T02:50:56.739 INFO:tasks.workunit.client.1.smithi122.stdout:5/787: creat d0/d17/d36/d3f/d4c/d7f/fff x:0 0 0 2024-09-13T02:50:56.740 INFO:tasks.workunit.client.1.smithi122.stdout:2/740: mkdir d0/d1e/d26/d3d/dea 0 2024-09-13T02:50:56.741 INFO:tasks.workunit.client.1.smithi122.stdout:9/836: write f1 [1833507,50528] 0 2024-09-13T02:50:56.741 INFO:tasks.workunit.client.1.smithi122.stdout:9/837: fsync d8/f9f 0 2024-09-13T02:50:56.741 INFO:tasks.workunit.client.1.smithi122.stdout:2/741: read d0/d1e/f9b [269094,10920] 0 2024-09-13T02:50:56.743 INFO:tasks.workunit.client.1.smithi122.stdout:3/875: symlink d4/d11/d38/l14a 0 2024-09-13T02:50:56.744 INFO:tasks.workunit.client.1.smithi122.stdout:3/876: fsync d4/d11/dd/d21/d4e/dc8/fdc 0 2024-09-13T02:50:56.745 INFO:tasks.workunit.client.1.smithi122.stdout:7/786: unlink d4/f9a 0 2024-09-13T02:50:56.746 INFO:tasks.workunit.client.1.smithi122.stdout:6/838: dwrite d5/d11/d45/fcc [0,4194304] 0 2024-09-13T02:50:56.748 INFO:tasks.workunit.client.1.smithi122.stdout:5/788: unlink d0/f5a 0 2024-09-13T02:50:56.748 INFO:tasks.workunit.client.1.smithi122.stdout:5/789: readlink d0/da/la6 0 2024-09-13T02:50:56.749 INFO:tasks.workunit.client.1.smithi122.stdout:5/790: stat d0/d2/f6e 0 2024-09-13T02:50:56.749 INFO:tasks.workunit.client.1.smithi122.stdout:2/742: dread d0/d1e/d2e/d3e/f46 [0,4194304] 0 2024-09-13T02:50:56.753 INFO:tasks.workunit.client.1.smithi122.stdout:7/787: link d4/d6d/d8c/ff1 d4/d6d/d8c/f105 0 2024-09-13T02:50:56.754 INFO:tasks.workunit.client.1.smithi122.stdout:7/788: chown d4/d8/db/dc/d1b/c3a 87956978 1 2024-09-13T02:50:56.756 INFO:tasks.workunit.client.1.smithi122.stdout:6/839: mkdir d5/d3d/d6c/d41/d4e/d5f/df8 0 2024-09-13T02:50:56.757 INFO:tasks.workunit.client.1.smithi122.stdout:6/840: fsync d5/db/d29/fb6 0 2024-09-13T02:50:56.758 INFO:tasks.workunit.client.1.smithi122.stdout:5/791: creat d0/d17/d36/d3f/de7/f100 x:0 0 0 2024-09-13T02:50:56.759 INFO:tasks.workunit.client.1.smithi122.stdout:9/838: rename d8/d16/d3d/d59/d7d/d83/fd7 to d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe/ffc 0 2024-09-13T02:50:56.761 INFO:tasks.workunit.client.1.smithi122.stdout:6/841: mkdir d5/db/d29/df9 0 2024-09-13T02:50:56.762 INFO:tasks.workunit.client.1.smithi122.stdout:9/839: mknod d8/d4a/d64/cfd 0 2024-09-13T02:50:56.764 INFO:tasks.workunit.client.1.smithi122.stdout:6/842: rename d5/d3d/d6c/d41/d5b/d7d/ddd/d26/fe8 to d5/d3d/d6c/d41/d5b/d7d/ddd/d26/ffa 0 2024-09-13T02:50:56.770 INFO:tasks.workunit.client.1.smithi122.stdout:5/792: dread d0/d17/d36/d25/fb5 [0,4194304] 0 2024-09-13T02:50:56.773 INFO:tasks.workunit.client.1.smithi122.stdout:5/793: getdents d0/d17/d36 0 2024-09-13T02:50:56.774 INFO:tasks.workunit.client.1.smithi122.stdout:6/843: dread d5/d3d/d6c/d41/d5b/d7d/ddd/d46/f5d [4194304,4194304] 0 2024-09-13T02:50:56.777 INFO:tasks.workunit.client.1.smithi122.stdout:6/844: rename d5/d3d/d82/dcf/fde to d5/d3d/d82/db1/ffb 0 2024-09-13T02:50:56.777 INFO:tasks.workunit.client.1.smithi122.stdout:6/845: fsync d5/d3d/d6c/d41/d5b/ff1 0 2024-09-13T02:50:56.777 INFO:tasks.workunit.client.1.smithi122.stdout:6/846: chown d5/d11/d3a 101071 1 2024-09-13T02:50:56.777 INFO:tasks.workunit.client.1.smithi122.stdout:6/847: chown d5/d3d/d6c/d41/d4e 529673343 1 2024-09-13T02:50:56.779 INFO:tasks.workunit.client.1.smithi122.stdout:9/840: write d8/d4a/f5c [662346,8638] 0 2024-09-13T02:50:56.782 INFO:tasks.workunit.client.1.smithi122.stdout:7/789: dwrite d4/d8/d24/f37 [0,4194304] 0 2024-09-13T02:50:56.782 INFO:tasks.workunit.client.1.smithi122.stdout:2/743: dwrite d0/d1e/d22/d29/f7d [0,4194304] 0 2024-09-13T02:50:56.785 INFO:tasks.workunit.client.1.smithi122.stdout:2/744: rename d0/d53/le9 to d0/d55/daf/leb 0 2024-09-13T02:50:56.785 INFO:tasks.workunit.client.1.smithi122.stdout:2/745: write d0/d1e/d22/f37 [1753367,15713] 0 2024-09-13T02:50:56.785 INFO:tasks.workunit.client.1.smithi122.stdout:2/746: chown d0/d1e/d2e 486 1 2024-09-13T02:50:56.786 INFO:tasks.workunit.client.1.smithi122.stdout:3/877: dwrite d4/d11/dd/d21/d4e/dc8/fc9 [0,4194304] 0 2024-09-13T02:50:56.786 INFO:tasks.workunit.client.1.smithi122.stdout:7/790: creat d4/d8/d24/f106 x:0 0 0 2024-09-13T02:50:56.786 INFO:tasks.workunit.client.1.smithi122.stdout:3/878: creat d4/d11/dd/d21/d2b/dcf/f14b x:0 0 0 2024-09-13T02:50:56.794 INFO:tasks.workunit.client.1.smithi122.stdout:2/747: rename d0/d1c/d3b/d41/d4e/d90/cd8 to d0/d1e/d26/d3d/cec 0 2024-09-13T02:50:56.795 INFO:tasks.workunit.client.1.smithi122.stdout:7/791: write d4/d8/db/fe0 [3963,23633] 0 2024-09-13T02:50:56.798 INFO:tasks.workunit.client.1.smithi122.stdout:9/841: dread d8/f9 [0,4194304] 0 2024-09-13T02:50:56.798 INFO:tasks.workunit.client.1.smithi122.stdout:5/794: dwrite d0/d17/d36/d8b/fdf [0,4194304] 0 2024-09-13T02:50:56.798 INFO:tasks.workunit.client.1.smithi122.stdout:9/842: dread d8/d16/d3d/d59/d29/d90/dc8/fe8 [0,4194304] 0 2024-09-13T02:50:56.798 INFO:tasks.workunit.client.1.smithi122.stdout:9/843: chown d8/d16/d3d/d59/d23/d1f/l80 8730543 1 2024-09-13T02:50:56.799 INFO:tasks.workunit.client.1.smithi122.stdout:9/844: readlink d8/d16/l9e 0 2024-09-13T02:50:56.799 INFO:tasks.workunit.client.1.smithi122.stdout:3/879: dread d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/f137 [0,4194304] 0 2024-09-13T02:50:56.803 INFO:tasks.workunit.client.1.smithi122.stdout:2/748: mknod d0/dc0/dde/ced 0 2024-09-13T02:50:56.805 INFO:tasks.workunit.client.1.smithi122.stdout:6/848: dwrite d5/d11/d45/f81 [0,4194304] 0 2024-09-13T02:50:56.818 INFO:tasks.workunit.client.1.smithi122.stdout:7/792: dwrite d4/d8/db/dc/d1b/d49/fa8 [4194304,4194304] 0 2024-09-13T02:50:56.818 INFO:tasks.workunit.client.1.smithi122.stdout:7/793: dread - d4/d8/db/dc/f72 zero size 2024-09-13T02:50:56.818 INFO:tasks.workunit.client.1.smithi122.stdout:7/794: dread - d4/d8/d3d/dc2/fff zero size 2024-09-13T02:50:56.818 INFO:tasks.workunit.client.1.smithi122.stdout:9/845: dwrite d8/d88/d65/faf [0,4194304] 0 2024-09-13T02:50:56.818 INFO:tasks.workunit.client.1.smithi122.stdout:9/846: write d8/d16/d3d/db5/ff2 [4632094,26345] 0 2024-09-13T02:50:56.819 INFO:tasks.workunit.client.1.smithi122.stdout:5/795: creat d0/da/d8c/d8f/df7/f101 x:0 0 0 2024-09-13T02:50:56.821 INFO:tasks.workunit.client.1.smithi122.stdout:9/847: dread d8/d16/d3d/d59/d23/f8e [0,4194304] 0 2024-09-13T02:50:56.822 INFO:tasks.workunit.client.1.smithi122.stdout:2/749: link d0/d55/daf/leb d0/d53/dc6/lee 0 2024-09-13T02:50:56.822 INFO:tasks.workunit.client.1.smithi122.stdout:6/849: truncate d5/d11/d45/fcc 3551468 0 2024-09-13T02:50:56.826 INFO:tasks.workunit.client.1.smithi122.stdout:7/795: mkdir d4/d4e/d5d/d107 0 2024-09-13T02:50:56.827 INFO:tasks.workunit.client.1.smithi122.stdout:5/796: mkdir d0/da/d8c/d8f/df7/d102 0 2024-09-13T02:50:56.827 INFO:tasks.workunit.client.1.smithi122.stdout:5/797: fsync d0/d1d/df1/ffb 0 2024-09-13T02:50:56.827 INFO:tasks.workunit.client.1.smithi122.stdout:3/880: getdents d4/d11/dd/d21/d2b/d36/d3c/d9e 0 2024-09-13T02:50:56.832 INFO:tasks.workunit.client.1.smithi122.stdout:9/848: mkdir d8/d16/dfe 0 2024-09-13T02:50:56.834 INFO:tasks.workunit.client.1.smithi122.stdout:6/850: symlink d5/d40/lfc 0 2024-09-13T02:50:56.837 INFO:tasks.workunit.client.1.smithi122.stdout:7/796: mkdir d4/d77/d108 0 2024-09-13T02:50:56.838 INFO:tasks.workunit.client.1.smithi122.stdout:5/798: rename d0/da/c15 to d0/da/d8c/d8f/df7/d102/c103 0 2024-09-13T02:50:56.842 INFO:tasks.workunit.client.1.smithi122.stdout:9/849: creat d8/d16/d3d/fff x:0 0 0 2024-09-13T02:50:56.842 INFO:tasks.workunit.client.1.smithi122.stdout:9/850: write d8/d16/d3e/f75 [3849788,4476] 0 2024-09-13T02:50:56.843 INFO:tasks.workunit.client.1.smithi122.stdout:3/881: dwrite d4/d11/d38/f9c [4194304,4194304] 0 2024-09-13T02:50:56.844 INFO:tasks.workunit.client.1.smithi122.stdout:6/851: write d5/d3d/d6c/d41/d5b/d7a/fc2 [811857,7848] 0 2024-09-13T02:50:56.844 INFO:tasks.workunit.client.1.smithi122.stdout:6/852: fdatasync d5/db/d29/d60/fd6 0 2024-09-13T02:50:56.844 INFO:tasks.workunit.client.1.smithi122.stdout:6/853: read d5/d3d/d6c/d41/d4e/f88 [2186779,5013] 0 2024-09-13T02:50:56.845 INFO:tasks.workunit.client.1.smithi122.stdout:5/799: symlink d0/d17/l104 0 2024-09-13T02:50:56.857 INFO:tasks.workunit.client.1.smithi122.stdout:6/854: mknod d5/d3d/d6c/d41/d5b/d7d/ddd/cfd 0 2024-09-13T02:50:56.858 INFO:tasks.workunit.client.1.smithi122.stdout:3/882: dwrite d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f91 [0,4194304] 0 2024-09-13T02:50:56.858 INFO:tasks.workunit.client.1.smithi122.stdout:7/797: getdents d4/d6d 0 2024-09-13T02:50:56.861 INFO:tasks.workunit.client.1.smithi122.stdout:6/855: rename d5/d11/d45/d21/f90 to d5/db/d29/ffe 0 2024-09-13T02:50:56.865 INFO:tasks.workunit.client.1.smithi122.stdout:7/798: rmdir d4/d4e/d5d/d107 0 2024-09-13T02:50:56.865 INFO:tasks.workunit.client.1.smithi122.stdout:7/799: chown d4/d8/db7/d102/df9 382983 1 2024-09-13T02:50:56.867 INFO:tasks.workunit.client.1.smithi122.stdout:5/800: dread d0/d17/d36/d25/f60 [0,4194304] 0 2024-09-13T02:50:56.868 INFO:tasks.workunit.client.1.smithi122.stdout:3/883: rename d4/d11/dd/d21/d2b/d36/lba to d4/d11/dd/d21/d2b/d36/d3c/d43/l14c 0 2024-09-13T02:50:56.869 INFO:tasks.workunit.client.1.smithi122.stdout:6/856: dread d5/d11/d45/f78 [0,4194304] 0 2024-09-13T02:50:56.869 INFO:tasks.workunit.client.1.smithi122.stdout:6/857: stat d5/d11/d45/d21/d8a 0 2024-09-13T02:50:56.872 INFO:tasks.workunit.client.1.smithi122.stdout:7/800: mknod d4/d8/d24/daa/c109 0 2024-09-13T02:50:56.873 INFO:tasks.workunit.client.1.smithi122.stdout:5/801: chown d0/d17/d36/d25/f74 5917 1 2024-09-13T02:50:56.876 INFO:tasks.workunit.client.1.smithi122.stdout:5/802: rmdir d0/da/d48/d63 39 2024-09-13T02:50:56.878 INFO:tasks.workunit.client.1.smithi122.stdout:3/884: getdents d4/d11 0 2024-09-13T02:50:56.878 INFO:tasks.workunit.client.1.smithi122.stdout:7/801: dread d4/d77/fa2 [0,4194304] 0 2024-09-13T02:50:56.878 INFO:tasks.workunit.client.1.smithi122.stdout:7/802: dread - d4/d6d/ffd zero size 2024-09-13T02:50:56.881 INFO:tasks.workunit.client.1.smithi122.stdout:3/885: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/d14d 0 2024-09-13T02:50:56.881 INFO:tasks.workunit.client.1.smithi122.stdout:3/886: truncate d4/d11/dd/d21/d2b/d36/d3c/ffb 1031889 0 2024-09-13T02:50:56.883 INFO:tasks.workunit.client.1.smithi122.stdout:1/853: sync 2024-09-13T02:50:56.883 INFO:tasks.workunit.client.1.smithi122.stdout:1/854: truncate dc/de/d18/d86/f11b 4692683 0 2024-09-13T02:50:56.883 INFO:tasks.workunit.client.1.smithi122.stdout:1/855: chown dc/d38/d51/daf/d105 0 1 2024-09-13T02:50:56.884 INFO:tasks.workunit.client.1.smithi122.stdout:1/856: getdents dc/de/d18/de4 0 2024-09-13T02:50:56.886 INFO:tasks.workunit.client.1.smithi122.stdout:6/858: dwrite d5/d11/d45/d21/f3f [0,4194304] 0 2024-09-13T02:50:56.886 INFO:tasks.workunit.client.1.smithi122.stdout:6/859: fsync d5/db/d29/fb6 0 2024-09-13T02:50:56.886 INFO:tasks.workunit.client.1.smithi122.stdout:6/860: stat d5/d3d/d6c/c76 0 2024-09-13T02:50:56.887 INFO:tasks.workunit.client.1.smithi122.stdout:6/861: fsync d5/db/f44 0 2024-09-13T02:50:56.888 INFO:tasks.workunit.client.1.smithi122.stdout:7/803: write d4/d4e/d5d/d6b/fe9 [2510854,26126] 0 2024-09-13T02:50:56.890 INFO:tasks.workunit.client.1.smithi122.stdout:6/862: creat d5/db/d29/d60/fff x:0 0 0 2024-09-13T02:50:56.892 INFO:tasks.workunit.client.1.smithi122.stdout:7/804: creat d4/d4e/d5d/d6b/db4/f10a x:0 0 0 2024-09-13T02:50:56.894 INFO:tasks.workunit.client.1.smithi122.stdout:7/805: rmdir d4/d8/d24/d47 39 2024-09-13T02:50:56.894 INFO:tasks.workunit.client.1.smithi122.stdout:7/806: stat d4/d8/d3d/dc2/dca/ff8 0 2024-09-13T02:50:56.894 INFO:tasks.workunit.client.1.smithi122.stdout:7/807: truncate d4/d8/db/dc/d1b/d49/fa8 8996919 0 2024-09-13T02:50:56.896 INFO:tasks.workunit.client.1.smithi122.stdout:7/808: mknod d4/d8/c10b 0 2024-09-13T02:50:56.896 INFO:tasks.workunit.client.1.smithi122.stdout:7/809: fsync d4/d6d/da6/dbf/db1/f87 0 2024-09-13T02:50:56.899 INFO:tasks.workunit.client.1.smithi122.stdout:7/810: rename d4/d6d/d8c/dc3/l80 to d4/d6d/da6/df2/dfc/l10c 0 2024-09-13T02:50:56.900 INFO:tasks.workunit.client.1.smithi122.stdout:6/863: read d5/d40/dcd/fce [4188675,65977] 0 2024-09-13T02:50:56.902 INFO:tasks.workunit.client.1.smithi122.stdout:6/864: mkdir d5/db/d29/d60/d100 0 2024-09-13T02:50:56.902 INFO:tasks.workunit.client.1.smithi122.stdout:6/865: dread - d5/d3d/d6c/d41/d5b/ff1 zero size 2024-09-13T02:50:56.903 INFO:tasks.workunit.client.1.smithi122.stdout:6/866: creat d5/d3d/d6c/d41/d5b/d7a/f101 x:0 0 0 2024-09-13T02:50:56.903 INFO:tasks.workunit.client.1.smithi122.stdout:6/867: fdatasync d5/f5a 0 2024-09-13T02:50:56.905 INFO:tasks.workunit.client.1.smithi122.stdout:3/887: dwrite d4/d6/de/d41/f146 [0,4194304] 0 2024-09-13T02:50:56.906 INFO:tasks.workunit.client.1.smithi122.stdout:1/857: dwrite dc/de/d18/d1d/f23 [0,4194304] 0 2024-09-13T02:50:56.911 INFO:tasks.workunit.client.1.smithi122.stdout:3/888: creat d4/d11/dd/d21/d74/d11b/f14e x:0 0 0 2024-09-13T02:50:56.912 INFO:tasks.workunit.client.1.smithi122.stdout:3/889: creat d4/d11/dd/d21/d2b/dcf/f14f x:0 0 0 2024-09-13T02:50:56.912 INFO:tasks.workunit.client.1.smithi122.stdout:7/811: write d4/d8/d24/f53 [3216963,70214] 0 2024-09-13T02:50:56.914 INFO:tasks.workunit.client.1.smithi122.stdout:3/890: rename d4/d11/cb4 to d4/d6/de/d1f/c150 0 2024-09-13T02:50:56.915 INFO:tasks.workunit.client.1.smithi122.stdout:3/891: symlink d4/d11/dd/d21/d2b/d36/l151 0 2024-09-13T02:50:56.916 INFO:tasks.workunit.client.1.smithi122.stdout:3/892: symlink d4/d6/de/d1f/d33/l152 0 2024-09-13T02:50:56.923 INFO:tasks.workunit.client.1.smithi122.stdout:3/893: dread d4/d11/dd/fd9 [0,4194304] 0 2024-09-13T02:50:56.923 INFO:tasks.workunit.client.1.smithi122.stdout:6/868: dwrite d5/d11/d2f/f74 [8388608,4194304] 0 2024-09-13T02:50:56.923 INFO:tasks.workunit.client.1.smithi122.stdout:1/858: dwrite dc/d38/db1/d72/dd7/f5e [0,4194304] 0 2024-09-13T02:50:56.924 INFO:tasks.workunit.client.1.smithi122.stdout:6/869: dread d5/d11/d45/d21/f87 [0,4194304] 0 2024-09-13T02:50:56.924 INFO:tasks.workunit.client.1.smithi122.stdout:3/894: unlink d4/d4c/l84 0 2024-09-13T02:50:56.925 INFO:tasks.workunit.client.1.smithi122.stdout:3/895: dread - d4/d11/da9/f142 zero size 2024-09-13T02:50:56.925 INFO:tasks.workunit.client.1.smithi122.stdout:1/859: rename dc/d38/db1/d72/dd7/d3f/ff8 to dc/de/d18/d22/f11c 0 2024-09-13T02:50:56.928 INFO:tasks.workunit.client.1.smithi122.stdout:3/896: truncate d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f79 210928 0 2024-09-13T02:50:56.929 INFO:tasks.workunit.client.1.smithi122.stdout:1/860: mknod dc/de/d18/d1d/d2f/d94/d98/c11d 0 2024-09-13T02:50:56.929 INFO:tasks.workunit.client.1.smithi122.stdout:1/861: write dc/de/d18/d22/d1c/f108 [844034,31873] 0 2024-09-13T02:50:56.929 INFO:tasks.workunit.client.1.smithi122.stdout:3/897: dread d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/f137 [0,4194304] 0 2024-09-13T02:50:56.930 INFO:tasks.workunit.client.1.smithi122.stdout:7/812: read d4/d8/db/dc/f61 [2481921,119574] 0 2024-09-13T02:50:56.930 INFO:tasks.workunit.client.1.smithi122.stdout:7/813: creat d4/d8/d24/daa/f10d x:0 0 0 2024-09-13T02:50:56.930 INFO:tasks.workunit.client.1.smithi122.stdout:1/862: mknod dc/de/d18/d1d/c11e 0 2024-09-13T02:50:56.933 INFO:tasks.workunit.client.1.smithi122.stdout:7/814: link d4/d8/d24/f106 d4/d8/db/dc/d46/f10e 0 2024-09-13T02:50:56.935 INFO:tasks.workunit.client.1.smithi122.stdout:1/863: creat dc/d38/db1/d72/dd7/d3f/dc1/dcf/f11f x:0 0 0 2024-09-13T02:50:56.936 INFO:tasks.workunit.client.1.smithi122.stdout:7/815: mknod d4/d6d/da6/df2/dfc/c10f 0 2024-09-13T02:50:56.937 INFO:tasks.workunit.client.1.smithi122.stdout:1/864: mknod dc/d38/d51/daf/de3/c120 0 2024-09-13T02:50:56.938 INFO:tasks.workunit.client.1.smithi122.stdout:7/816: rmdir d4/d8/db/dc/d46 39 2024-09-13T02:50:56.940 INFO:tasks.workunit.client.1.smithi122.stdout:7/817: mkdir d4/d4e/d110 0 2024-09-13T02:50:56.941 INFO:tasks.workunit.client.1.smithi122.stdout:7/818: mkdir d4/d8/db/dc/d1b/d49/da0/d111 0 2024-09-13T02:50:56.941 INFO:tasks.workunit.client.1.smithi122.stdout:7/819: read - d4/d4e/d5d/d6b/db4/f10a zero size 2024-09-13T02:50:56.941 INFO:tasks.workunit.client.1.smithi122.stdout:7/820: write d4/d8/d24/d47/f7a [180677,15797] 0 2024-09-13T02:50:56.942 INFO:tasks.workunit.client.1.smithi122.stdout:7/821: write d4/d8/d24/f3e [6732492,65543] 0 2024-09-13T02:50:56.942 INFO:tasks.workunit.client.1.smithi122.stdout:7/822: chown d4/d6d/d8f/c95 0 1 2024-09-13T02:50:56.943 INFO:tasks.workunit.client.1.smithi122.stdout:7/823: write d4/d77/fa2 [847022,81083] 0 2024-09-13T02:50:56.944 INFO:tasks.workunit.client.1.smithi122.stdout:1/865: dread dc/de/d18/f2c [4194304,4194304] 0 2024-09-13T02:50:56.949 INFO:tasks.workunit.client.1.smithi122.stdout:6/870: dwrite d5/d40/fc8 [0,4194304] 0 2024-09-13T02:50:56.949 INFO:tasks.workunit.client.1.smithi122.stdout:6/871: chown d5/d3d/d6c/d41/d5b/fbe 10 1 2024-09-13T02:50:56.951 INFO:tasks.workunit.client.1.smithi122.stdout:3/898: dwrite d4/d11/dd/d21/d2b/dcf/f14b [0,4194304] 0 2024-09-13T02:50:56.957 INFO:tasks.workunit.client.1.smithi122.stdout:7/824: dread d4/d8/db/f1f [0,4194304] 0 2024-09-13T02:50:56.957 INFO:tasks.workunit.client.1.smithi122.stdout:7/825: read - d4/d8/d3d/dcd/fd2 zero size 2024-09-13T02:50:56.961 INFO:tasks.workunit.client.1.smithi122.stdout:6/872: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d26/ffa [0,4194304] 0 2024-09-13T02:50:56.966 INFO:tasks.workunit.client.1.smithi122.stdout:3/899: rename d4/d4c/d10e/c11e to d4/d4c/d10e/c153 0 2024-09-13T02:50:56.967 INFO:tasks.workunit.client.1.smithi122.stdout:7/826: creat d4/d8/db/d63/dbb/df3/f112 x:0 0 0 2024-09-13T02:50:56.972 INFO:tasks.workunit.client.1.smithi122.stdout:6/873: rmdir d5/d11/d45/d21 39 2024-09-13T02:50:56.974 INFO:tasks.workunit.client.1.smithi122.stdout:7/827: dread d4/f29 [0,4194304] 0 2024-09-13T02:50:56.974 INFO:tasks.workunit.client.1.smithi122.stdout:3/900: mkdir d4/d11/d38/d154 0 2024-09-13T02:50:56.974 INFO:tasks.workunit.client.1.smithi122.stdout:3/901: fdatasync d4/d11/dd/d21/d2b/d36/f107 0 2024-09-13T02:50:56.975 INFO:tasks.workunit.client.1.smithi122.stdout:6/874: mknod d5/d3d/d6c/c102 0 2024-09-13T02:50:56.977 INFO:tasks.workunit.client.1.smithi122.stdout:7/828: creat d4/d6d/da6/dbf/db1/f113 x:0 0 0 2024-09-13T02:50:56.978 INFO:tasks.workunit.client.1.smithi122.stdout:6/875: mknod d5/d3d/da3/c103 0 2024-09-13T02:50:56.978 INFO:tasks.workunit.client.1.smithi122.stdout:6/876: write d5/d3d/d6c/d41/d5b/ff1 [777693,111125] 0 2024-09-13T02:50:56.978 INFO:tasks.workunit.client.1.smithi122.stdout:0/794: sync 2024-09-13T02:50:56.978 INFO:tasks.workunit.client.1.smithi122.stdout:8/753: sync 2024-09-13T02:50:56.979 INFO:tasks.workunit.client.1.smithi122.stdout:7/829: mkdir d4/d8/d24/d47/d114 0 2024-09-13T02:50:56.981 INFO:tasks.workunit.client.1.smithi122.stdout:6/877: creat d5/d3d/d48/f104 x:0 0 0 2024-09-13T02:50:56.984 INFO:tasks.workunit.client.1.smithi122.stdout:0/795: rename d1/d5/d2d/lbe to d1/d5/d2d/db4/ddc/df0/d60/l103 0 2024-09-13T02:50:56.986 INFO:tasks.workunit.client.1.smithi122.stdout:7/830: link d4/d6d/d8c/dc3/l8b d4/d8/db/d63/l115 0 2024-09-13T02:50:56.986 INFO:tasks.workunit.client.1.smithi122.stdout:7/831: stat d4/d6d/d8c/dc3/c69 0 2024-09-13T02:50:56.987 INFO:tasks.workunit.client.1.smithi122.stdout:6/878: creat d5/db/f105 x:0 0 0 2024-09-13T02:50:56.989 INFO:tasks.workunit.client.1.smithi122.stdout:0/796: truncate d1/d5/f1e 1571866 0 2024-09-13T02:50:56.990 INFO:tasks.workunit.client.1.smithi122.stdout:7/832: creat d4/d8/db/dc/d36/f116 x:0 0 0 2024-09-13T02:50:56.990 INFO:tasks.workunit.client.1.smithi122.stdout:7/833: chown d4/d8/db7/d102/fc0 223 1 2024-09-13T02:50:56.990 INFO:tasks.workunit.client.1.smithi122.stdout:0/797: symlink d1/d5/d2d/db4/ddc/df0/d81/dc5/l104 0 2024-09-13T02:50:56.991 INFO:tasks.workunit.client.1.smithi122.stdout:0/798: creat d1/d5/d9/da/d7d/f105 x:0 0 0 2024-09-13T02:50:56.998 INFO:tasks.workunit.client.1.smithi122.stdout:7/834: dread d4/d8/db7/d102/fc0 [0,4194304] 0 2024-09-13T02:50:57.000 INFO:tasks.workunit.client.1.smithi122.stdout:3/902: dwrite d4/d4c/dd3/fde [0,4194304] 0 2024-09-13T02:50:57.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/754: dwrite d3/d53/d21/f5e [0,4194304] 0 2024-09-13T02:50:57.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/755: chown d3/da/d7d 17700895 1 2024-09-13T02:50:57.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/756: chown d3/d53/d21/c75 31 1 2024-09-13T02:50:57.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/757: creat d3/d53/d34/fe7 x:0 0 0 2024-09-13T02:50:57.002 INFO:tasks.workunit.client.1.smithi122.stdout:6/879: write d5/d11/d45/f81 [1813128,26367] 0 2024-09-13T02:50:57.002 INFO:tasks.workunit.client.1.smithi122.stdout:7/835: rename d4/d4e/d5d/d6b/leb to d4/d8/db/dc/d1b/l117 0 2024-09-13T02:50:57.006 INFO:tasks.workunit.client.1.smithi122.stdout:0/799: dread d1/d5/d10/d29/d32/f6f [0,4194304] 0 2024-09-13T02:50:57.006 INFO:tasks.workunit.client.1.smithi122.stdout:0/800: write d1/d5/d9/da/d92/d94/f5c [2293546,16033] 0 2024-09-13T02:50:57.006 INFO:tasks.workunit.client.1.smithi122.stdout:0/801: fsync d1/d5/d9/da/d92/d94/fdf 0 2024-09-13T02:50:57.008 INFO:tasks.workunit.client.1.smithi122.stdout:0/802: write d1/d5/d9/da/d92/d94/fd9 [55884,16625] 0 2024-09-13T02:50:57.013 INFO:tasks.workunit.client.1.smithi122.stdout:6/880: unlink d5/f8 0 2024-09-13T02:50:57.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/836: dread d4/d8/db/f9d [0,4194304] 0 2024-09-13T02:50:57.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/837: creat d4/d4e/d5d/d6b/db4/f118 x:0 0 0 2024-09-13T02:50:57.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/838: stat d4/f7d 0 2024-09-13T02:50:57.013 INFO:tasks.workunit.client.1.smithi122.stdout:7/839: write d4/d6d/ffd [925199,34195] 0 2024-09-13T02:50:57.014 INFO:tasks.workunit.client.1.smithi122.stdout:7/840: write d4/d8/db/dc/f72 [949205,52230] 0 2024-09-13T02:50:57.014 INFO:tasks.workunit.client.1.smithi122.stdout:7/841: truncate d4/d8/db/dc/ff6 923534 0 2024-09-13T02:50:57.014 INFO:tasks.workunit.client.1.smithi122.stdout:7/842: creat d4/d8/db/d63/dbb/df3/f119 x:0 0 0 2024-09-13T02:50:57.016 INFO:tasks.workunit.client.1.smithi122.stdout:0/803: rename d1/d5/d10/d29/d32/d5f/f48 to d1/d5/d9/da/f106 0 2024-09-13T02:50:57.016 INFO:tasks.workunit.client.1.smithi122.stdout:0/804: write d1/d5/d9/da/d17/f79 [1044943,120432] 0 2024-09-13T02:50:57.017 INFO:tasks.workunit.client.1.smithi122.stdout:8/758: dread d3/d53/d34/dbf/dcb/d76/f7b [0,4194304] 0 2024-09-13T02:50:57.021 INFO:tasks.workunit.client.1.smithi122.stdout:7/843: creat d4/d8/db/dc/d1b/f11a x:0 0 0 2024-09-13T02:50:57.021 INFO:tasks.workunit.client.1.smithi122.stdout:7/844: stat d4/d8/db/dc/f1d 0 2024-09-13T02:50:57.022 INFO:tasks.workunit.client.1.smithi122.stdout:3/903: dwrite d4/d11/dd/d21/d2b/dcf/f106 [0,4194304] 0 2024-09-13T02:50:57.023 INFO:tasks.workunit.client.1.smithi122.stdout:3/904: dread d4/d11/dd/fd9 [0,4194304] 0 2024-09-13T02:50:57.023 INFO:tasks.workunit.client.1.smithi122.stdout:3/905: dread - d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f128 zero size 2024-09-13T02:50:57.024 INFO:tasks.workunit.client.1.smithi122.stdout:3/906: dread d4/d6/f102 [0,4194304] 0 2024-09-13T02:50:57.024 INFO:tasks.workunit.client.1.smithi122.stdout:3/907: chown d4/d11/dd/d21/d2b/d55/l80 61682 1 2024-09-13T02:50:57.024 INFO:tasks.workunit.client.1.smithi122.stdout:0/805: creat d1/f107 x:0 0 0 2024-09-13T02:50:57.025 INFO:tasks.workunit.client.1.smithi122.stdout:8/759: symlink d3/d53/le8 0 2024-09-13T02:50:57.025 INFO:tasks.workunit.client.1.smithi122.stdout:8/760: truncate d3/da/fd4 177905 0 2024-09-13T02:50:57.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/845: truncate d4/d8/db/dc/d46/f90 2726457 0 2024-09-13T02:50:57.031 INFO:tasks.workunit.client.1.smithi122.stdout:3/908: creat d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f155 x:0 0 0 2024-09-13T02:50:57.033 INFO:tasks.workunit.client.1.smithi122.stdout:7/846: rename d4/d8/db/dc/d46/cea to d4/d6d/da6/df2/dfc/c11b 0 2024-09-13T02:50:57.034 INFO:tasks.workunit.client.1.smithi122.stdout:3/909: mkdir d4/d11/dd/d21/d74/d156 0 2024-09-13T02:50:57.034 INFO:tasks.workunit.client.1.smithi122.stdout:6/881: dwrite d5/d3d/d6c/d41/ff7 [0,4194304] 0 2024-09-13T02:50:57.036 INFO:tasks.workunit.client.1.smithi122.stdout:7/847: symlink d4/d4e/d5d/d6b/db4/l11c 0 2024-09-13T02:50:57.038 INFO:tasks.workunit.client.1.smithi122.stdout:0/806: dread d1/d5/d9/da/d92/d94/fdf [0,4194304] 0 2024-09-13T02:50:57.038 INFO:tasks.workunit.client.1.smithi122.stdout:0/807: truncate d1/d5/d10/d29/d32/d83/db3/df4/dfa/ffe 628659 0 2024-09-13T02:50:57.038 INFO:tasks.workunit.client.1.smithi122.stdout:0/808: write d1/d5/d9/da/d17/d69/d85/fb9 [1037282,54643] 0 2024-09-13T02:50:57.038 INFO:tasks.workunit.client.1.smithi122.stdout:0/809: chown d1/d5/d9/da/d92/d94/f2c 673 1 2024-09-13T02:50:57.039 INFO:tasks.workunit.client.1.smithi122.stdout:8/761: dread d3/da/d1f/f7f [0,4194304] 0 2024-09-13T02:50:57.039 INFO:tasks.workunit.client.1.smithi122.stdout:8/762: write d3/d53/d21/f98 [1777232,69958] 0 2024-09-13T02:50:57.053 INFO:tasks.workunit.client.1.smithi122.stdout:6/882: truncate d5/d11/d2f/f39 3097185 0 2024-09-13T02:50:57.053 INFO:tasks.workunit.client.1.smithi122.stdout:6/883: chown d5/db/d29/ffe 73886091 1 2024-09-13T02:50:57.053 INFO:tasks.workunit.client.1.smithi122.stdout:7/848: symlink d4/d8/d24/daa/l11d 0 2024-09-13T02:50:57.054 INFO:tasks.workunit.client.1.smithi122.stdout:8/763: creat d3/d31/d52/d89/db1/fe9 x:0 0 0 2024-09-13T02:50:57.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/884: rename d5/d11/d45/f81 to d5/d3d/d82/dcf/f106 0 2024-09-13T02:50:57.058 INFO:tasks.workunit.client.1.smithi122.stdout:6/885: dread - d5/d3d/d48/f104 zero size 2024-09-13T02:50:57.059 INFO:tasks.workunit.client.1.smithi122.stdout:7/849: mkdir d4/d4e/d5d/d6b/db4/d11e 0 2024-09-13T02:50:57.059 INFO:tasks.workunit.client.1.smithi122.stdout:7/850: write d4/d8/f7 [2673192,34426] 0 2024-09-13T02:50:57.059 INFO:tasks.workunit.client.1.smithi122.stdout:7/851: truncate d4/d8/db/d63/dbb/df3/f119 817678 0 2024-09-13T02:50:57.060 INFO:tasks.workunit.client.1.smithi122.stdout:8/764: mknod d3/d31/d52/dc1/cea 0 2024-09-13T02:50:57.062 INFO:tasks.workunit.client.1.smithi122.stdout:6/886: unlink d5/d3d/d48/dd7/fed 0 2024-09-13T02:50:57.064 INFO:tasks.workunit.client.1.smithi122.stdout:3/910: dwrite d4/d11/dd/f65 [0,4194304] 0 2024-09-13T02:50:57.066 INFO:tasks.workunit.client.1.smithi122.stdout:3/911: symlink d4/d11/dd/dca/d100/l157 0 2024-09-13T02:50:57.073 INFO:tasks.workunit.client.1.smithi122.stdout:0/810: dwrite d1/d5/d9/da/f9c [0,4194304] 0 2024-09-13T02:50:57.073 INFO:tasks.workunit.client.1.smithi122.stdout:0/811: stat d1/d5/d9/da/d7d/d95/le2 0 2024-09-13T02:50:57.073 INFO:tasks.workunit.client.1.smithi122.stdout:0/812: chown d1/d5/d9/da/f9c 4050 1 2024-09-13T02:50:57.073 INFO:tasks.workunit.client.1.smithi122.stdout:0/813: chown d1/d5/d9/da/d17/l45 29947715 1 2024-09-13T02:50:57.077 INFO:tasks.workunit.client.1.smithi122.stdout:6/887: write d5/d3d/d6c/d41/d5b/d7d/ddd/d26/f5c [99849,45977] 0 2024-09-13T02:50:57.077 INFO:tasks.workunit.client.1.smithi122.stdout:0/814: mkdir d1/d5/d9/da/d92/d94/dbf/d108 0 2024-09-13T02:50:57.077 INFO:tasks.workunit.client.1.smithi122.stdout:0/815: fsync d1/d5/d10/d29/f34 0 2024-09-13T02:50:57.080 INFO:tasks.workunit.client.1.smithi122.stdout:0/816: symlink d1/d5/d2d/db4/ddc/df0/da1/l109 0 2024-09-13T02:50:57.082 INFO:tasks.workunit.client.1.smithi122.stdout:3/912: write d4/d11/dd/d21/d2b/d36/d3c/f101 [6365806,27284] 0 2024-09-13T02:50:57.087 INFO:tasks.workunit.client.1.smithi122.stdout:0/817: rmdir d1/d5/d2d/db4/ddc/df0/d81/dc5 39 2024-09-13T02:50:57.089 INFO:tasks.workunit.client.1.smithi122.stdout:2/750: sync 2024-09-13T02:50:57.092 INFO:tasks.workunit.client.1.smithi122.stdout:3/913: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9/l158 0 2024-09-13T02:50:57.092 INFO:tasks.workunit.client.1.smithi122.stdout:3/914: stat d4/d11/dd/d21/d74/d11b 0 2024-09-13T02:50:57.092 INFO:tasks.workunit.client.1.smithi122.stdout:3/915: read d4/d11/dd/d21/d2b/f13e [118476,49512] 0 2024-09-13T02:50:57.098 INFO:tasks.workunit.client.1.smithi122.stdout:0/818: truncate d1/d5/d9/da/d17/ff1 770434 0 2024-09-13T02:50:57.099 INFO:tasks.workunit.client.1.smithi122.stdout:2/751: symlink d0/d1e/d2e/d8a/d99/lef 0 2024-09-13T02:50:57.100 INFO:tasks.workunit.client.1.smithi122.stdout:7/852: dwrite d4/d6d/d8c/f105 [0,4194304] 0 2024-09-13T02:50:57.101 INFO:tasks.workunit.client.1.smithi122.stdout:7/853: fsync d4/d8/db/f38 0 2024-09-13T02:50:57.101 INFO:tasks.workunit.client.1.smithi122.stdout:3/916: symlink d4/l159 0 2024-09-13T02:50:57.101 INFO:tasks.workunit.client.1.smithi122.stdout:3/917: stat d4/d6/de/d41 0 2024-09-13T02:50:57.101 INFO:tasks.workunit.client.1.smithi122.stdout:3/918: fsync d4/d6/f85 0 2024-09-13T02:50:57.102 INFO:tasks.workunit.client.1.smithi122.stdout:8/765: dwrite d3/d53/d4d/f62 [0,4194304] 0 2024-09-13T02:50:57.102 INFO:tasks.workunit.client.1.smithi122.stdout:6/888: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d26/ffa [0,4194304] 0 2024-09-13T02:50:57.102 INFO:tasks.workunit.client.1.smithi122.stdout:6/889: read d5/d40/f35 [12326,24796] 0 2024-09-13T02:50:57.103 INFO:tasks.workunit.client.1.smithi122.stdout:0/819: symlink d1/d5/d9/da/d92/d94/l10a 0 2024-09-13T02:50:57.109 INFO:tasks.workunit.client.1.smithi122.stdout:3/919: mkdir d4/d11/dd/d21/d2b/dcf/d15a 0 2024-09-13T02:50:57.109 INFO:tasks.workunit.client.1.smithi122.stdout:3/920: write d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/f61 [989682,122688] 0 2024-09-13T02:50:57.110 INFO:tasks.workunit.client.1.smithi122.stdout:3/921: getdents d4/d11/d38/d154 0 2024-09-13T02:50:57.114 INFO:tasks.workunit.client.1.smithi122.stdout:8/766: mkdir d3/d53/d34/d94/deb 0 2024-09-13T02:50:57.114 INFO:tasks.workunit.client.1.smithi122.stdout:8/767: creat d3/fec x:0 0 0 2024-09-13T02:50:57.116 INFO:tasks.workunit.client.1.smithi122.stdout:0/820: creat d1/d5/d10/d29/d32/d83/db3/df4/f10b x:0 0 0 2024-09-13T02:50:57.121 INFO:tasks.workunit.client.1.smithi122.stdout:3/922: truncate d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f10f 4298871 0 2024-09-13T02:50:57.124 INFO:tasks.workunit.client.1.smithi122.stdout:0/821: creat d1/d5/d2d/db4/ddc/df0/d60/de9/f10c x:0 0 0 2024-09-13T02:50:57.126 INFO:tasks.workunit.client.1.smithi122.stdout:0/822: mkdir d1/d5/d9/da/d92/d94/d10d 0 2024-09-13T02:50:57.126 INFO:tasks.workunit.client.1.smithi122.stdout:0/823: fsync d1/d5/d9/da/f106 0 2024-09-13T02:50:57.127 INFO:tasks.workunit.client.1.smithi122.stdout:0/824: fsync d1/f38 0 2024-09-13T02:50:57.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/803: sync 2024-09-13T02:50:57.131 INFO:tasks.workunit.client.1.smithi122.stdout:9/851: sync 2024-09-13T02:50:57.131 INFO:tasks.workunit.client.1.smithi122.stdout:5/804: chown d0/d17/d36/d8b/ff4 32633910 1 2024-09-13T02:50:57.132 INFO:tasks.workunit.client.1.smithi122.stdout:9/852: symlink d8/d16/d45/df9/l100 0 2024-09-13T02:50:57.134 INFO:tasks.workunit.client.1.smithi122.stdout:2/752: dwrite d0/d1e/f9c [0,4194304] 0 2024-09-13T02:50:57.135 INFO:tasks.workunit.client.1.smithi122.stdout:7/854: dwrite d4/d8/db7/d102/ffb [0,4194304] 0 2024-09-13T02:50:57.135 INFO:tasks.workunit.client.1.smithi122.stdout:6/890: dwrite d5/db/f44 [0,4194304] 0 2024-09-13T02:50:57.139 INFO:tasks.workunit.client.1.smithi122.stdout:0/825: dread d1/d5/d9/da/ff [0,4194304] 0 2024-09-13T02:50:57.140 INFO:tasks.workunit.client.1.smithi122.stdout:2/753: stat d0/d1c/d3b/d41/d4e/d90/ce2 0 2024-09-13T02:50:57.149 INFO:tasks.workunit.client.1.smithi122.stdout:6/891: symlink d5/d3d/d6c/d41/d4e/d93/l107 0 2024-09-13T02:50:57.151 INFO:tasks.workunit.client.1.smithi122.stdout:0/826: link d1/d5/d9/da/d92/d94/ce8 d1/d5/d10/d29/c10e 0 2024-09-13T02:50:57.154 INFO:tasks.workunit.client.1.smithi122.stdout:2/754: mkdir d0/df0 0 2024-09-13T02:50:57.156 INFO:tasks.workunit.client.1.smithi122.stdout:6/892: creat d5/db/d29/d60/d100/f108 x:0 0 0 2024-09-13T02:50:57.156 INFO:tasks.workunit.client.1.smithi122.stdout:6/893: chown d5/d3d/d6c/d41/d5b/d7d/ddd/d26/lc4 50805711 1 2024-09-13T02:50:57.157 INFO:tasks.workunit.client.1.smithi122.stdout:2/755: creat d0/d53/dc6/ff1 x:0 0 0 2024-09-13T02:50:57.158 INFO:tasks.workunit.client.1.smithi122.stdout:5/805: dwrite d0/da/f23 [0,4194304] 0 2024-09-13T02:50:57.158 INFO:tasks.workunit.client.1.smithi122.stdout:5/806: fdatasync d0/da/d90/fd5 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:9/853: dwrite d8/d16/d3d/d59/d23/d7b/fd3 [0,4194304] 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:9/854: write d8/d16/d3d/d59/d7d/f9c [329599,45479] 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:9/855: chown d8/d16/d3d/d59/d49 3956675 1 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/894: symlink d5/db/d29/d60/dd2/l109 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/895: write d5/d40/dcd/fce [1859068,6762] 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/896: getdents d5/d11/d45/d21/def 0 2024-09-13T02:50:57.160 INFO:tasks.workunit.client.1.smithi122.stdout:6/897: stat d5/f69 0 2024-09-13T02:50:57.161 INFO:tasks.workunit.client.1.smithi122.stdout:2/756: symlink d0/d1e/d22/d29/lf2 0 2024-09-13T02:50:57.161 INFO:tasks.workunit.client.1.smithi122.stdout:5/807: mkdir d0/d17/d36/d8b/daf/d105 0 2024-09-13T02:50:57.163 INFO:tasks.workunit.client.1.smithi122.stdout:6/898: mkdir d5/d11/d45/d21/def/d10a 0 2024-09-13T02:50:57.163 INFO:tasks.workunit.client.1.smithi122.stdout:6/899: write d5/db/dc/fb4 [697448,119713] 0 2024-09-13T02:50:57.164 INFO:tasks.workunit.client.1.smithi122.stdout:2/757: mknod d0/d55/d70/d59/cf3 0 2024-09-13T02:50:57.164 INFO:tasks.workunit.client.1.smithi122.stdout:0/827: dwrite d1/d5/d9/da/d17/d69/d85/fc1 [0,4194304] 0 2024-09-13T02:50:57.164 INFO:tasks.workunit.client.1.smithi122.stdout:9/856: dread d8/d16/d3d/d59/d7d/d83/fe3 [0,4194304] 0 2024-09-13T02:50:57.165 INFO:tasks.workunit.client.1.smithi122.stdout:5/808: mkdir d0/da/d48/dd3/d106 0 2024-09-13T02:50:57.166 INFO:tasks.workunit.client.1.smithi122.stdout:6/900: symlink d5/d3d/d6c/d41/d4e/d5f/df8/l10b 0 2024-09-13T02:50:57.169 INFO:tasks.workunit.client.1.smithi122.stdout:9/857: dread d8/d16/d3d/d59/d7d/f9c [0,4194304] 0 2024-09-13T02:50:57.169 INFO:tasks.workunit.client.1.smithi122.stdout:9/858: stat d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dd9 0 2024-09-13T02:50:57.170 INFO:tasks.workunit.client.1.smithi122.stdout:0/828: rename d1/f107 to d1/d5/d9/da/d92/f10f 0 2024-09-13T02:50:57.170 INFO:tasks.workunit.client.1.smithi122.stdout:5/809: mkdir d0/da/d8c/d8f/da0/d107 0 2024-09-13T02:50:57.172 INFO:tasks.workunit.client.1.smithi122.stdout:6/901: mkdir d5/db/dc/d10c 0 2024-09-13T02:50:57.173 INFO:tasks.workunit.client.1.smithi122.stdout:2/758: rmdir d0/d1e/d26/d3d/d84 39 2024-09-13T02:50:57.175 INFO:tasks.workunit.client.1.smithi122.stdout:9/859: mkdir d8/d16/d3d/d59/d23/d7b/d101 0 2024-09-13T02:50:57.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/829: mkdir d1/d5/d9/da/d92/dbb/d110 0 2024-09-13T02:50:57.177 INFO:tasks.workunit.client.1.smithi122.stdout:5/810: symlink d0/d17/d36/d8b/l108 0 2024-09-13T02:50:57.178 INFO:tasks.workunit.client.1.smithi122.stdout:2/759: truncate d0/d1e/d22/f45 1172024 0 2024-09-13T02:50:57.181 INFO:tasks.workunit.client.1.smithi122.stdout:9/860: unlink d8/d16/d45/f63 0 2024-09-13T02:50:57.182 INFO:tasks.workunit.client.1.smithi122.stdout:9/861: creat d8/d16/d45/dc4/f102 x:0 0 0 2024-09-13T02:50:57.182 INFO:tasks.workunit.client.1.smithi122.stdout:9/862: stat d8/d16/d45/df4 0 2024-09-13T02:50:57.182 INFO:tasks.workunit.client.1.smithi122.stdout:9/863: fdatasync d8/d16/d3d/d59/d23/d1f/d36/f52 0 2024-09-13T02:50:57.182 INFO:tasks.workunit.client.1.smithi122.stdout:5/811: symlink d0/d17/d36/d3f/de7/l109 0 2024-09-13T02:50:57.183 INFO:tasks.workunit.client.1.smithi122.stdout:2/760: unlink d0/d1e/d22/d29/f9e 0 2024-09-13T02:50:57.184 INFO:tasks.workunit.client.1.smithi122.stdout:2/761: symlink d0/d1e/d26/d3d/d84/ddb/lf4 0 2024-09-13T02:50:57.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:56 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:50:57.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:56 smithi122 ceph-mon[34559]: mgrmap e24: smithi122.ptcenr(active, since 7s), standbys: smithi100.lhjyck 2024-09-13T02:50:57.190 INFO:tasks.workunit.client.1.smithi122.stdout:0/830: dwrite d1/d5/d9/da/d17/d69/d85/ff8 [0,4194304] 0 2024-09-13T02:50:57.195 INFO:tasks.workunit.client.1.smithi122.stdout:0/831: creat d1/d5/d10/d29/d32/d83/dd7/f111 x:0 0 0 2024-09-13T02:50:57.196 INFO:tasks.workunit.client.1.smithi122.stdout:9/864: write d8/d16/d3d/d59/d49/fb9 [2306420,35367] 0 2024-09-13T02:50:57.197 INFO:tasks.workunit.client.1.smithi122.stdout:0/832: dread d1/d5/d9/da/f2b [0,4194304] 0 2024-09-13T02:50:57.198 INFO:tasks.workunit.client.1.smithi122.stdout:9/865: truncate d8/d16/d3d/d59/f4d 5346576 0 2024-09-13T02:50:57.198 INFO:tasks.workunit.client.1.smithi122.stdout:9/866: fsync d8/d16/d3d/d59/d23/d7b/d82/da3/fcc 0 2024-09-13T02:50:57.199 INFO:tasks.workunit.client.1.smithi122.stdout:0/833: link d1/d5/d9/da/d17/ld6 d1/d5/d9/da/d92/dbb/l112 0 2024-09-13T02:50:57.201 INFO:tasks.workunit.client.1.smithi122.stdout:2/762: dwrite d0/d1e/d2e/d5a/fd6 [0,4194304] 0 2024-09-13T02:50:57.204 INFO:tasks.workunit.client.1.smithi122.stdout:9/867: symlink d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe/l103 0 2024-09-13T02:50:57.204 INFO:tasks.workunit.client.1.smithi122.stdout:9/868: stat d8/d88/la9 0 2024-09-13T02:50:57.205 INFO:tasks.workunit.client.1.smithi122.stdout:0/834: creat d1/d5/d9/dce/f113 x:0 0 0 2024-09-13T02:50:57.209 INFO:tasks.workunit.client.1.smithi122.stdout:2/763: symlink d0/d55/d70/d59/dd2/de6/lf5 0 2024-09-13T02:50:57.225 INFO:tasks.workunit.client.1.smithi122.stdout:0/835: rename d1/d5/d9/da/d7d/d95/cb7 to d1/d5/d9/da/d92/dbb/c114 0 2024-09-13T02:50:57.225 INFO:tasks.workunit.client.1.smithi122.stdout:0/836: creat d1/d5/d2d/db4/ddc/f115 x:0 0 0 2024-09-13T02:50:57.227 INFO:tasks.workunit.client.1.smithi122.stdout:0/837: dread d1/d5/d10/d29/d32/f102 [0,4194304] 0 2024-09-13T02:50:57.228 INFO:tasks.workunit.client.1.smithi122.stdout:2/764: rmdir d0/d1e/d2e/d8a/d99/dcf/dd3 0 2024-09-13T02:50:57.228 INFO:tasks.workunit.client.1.smithi122.stdout:2/765: truncate d0/f10 3210949 0 2024-09-13T02:50:57.234 INFO:tasks.workunit.client.1.smithi122.stdout:2/766: link d0/d1e/d92/f93 d0/d1e/d26/dbd/ff6 0 2024-09-13T02:50:57.237 INFO:tasks.workunit.client.1.smithi122.stdout:2/767: rename d0/d1e/fa9 to d0/d1c/d3b/d41/d4e/d75/d95/dd4/ff7 0 2024-09-13T02:50:57.239 INFO:tasks.workunit.client.1.smithi122.stdout:0/838: dread d1/d5/d2d/f4e [0,4194304] 0 2024-09-13T02:50:57.239 INFO:tasks.workunit.client.1.smithi122.stdout:2/768: creat d0/d55/d70/d59/dd2/de6/ff8 x:0 0 0 2024-09-13T02:50:57.239 INFO:tasks.workunit.client.1.smithi122.stdout:0/839: rmdir d1/d5/d9/da 39 2024-09-13T02:50:57.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:56 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:50:57.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:56 smithi100 ceph-mon[27894]: mgrmap e24: smithi122.ptcenr(active, since 7s), standbys: smithi100.lhjyck 2024-09-13T02:50:57.240 INFO:tasks.workunit.client.1.smithi122.stdout:0/840: creat d1/d5/f116 x:0 0 0 2024-09-13T02:50:57.241 INFO:tasks.workunit.client.1.smithi122.stdout:0/841: creat d1/d5/d9/da/f117 x:0 0 0 2024-09-13T02:50:57.243 INFO:tasks.workunit.client.1.smithi122.stdout:9/869: dwrite d8/d16/d3d/d59/d7d/d83/fda [4194304,4194304] 0 2024-09-13T02:50:57.246 INFO:tasks.workunit.client.1.smithi122.stdout:9/870: mkdir d8/d16/d3d/d59/d29/d90/db7/dbc/d104 0 2024-09-13T02:50:57.248 INFO:tasks.workunit.client.1.smithi122.stdout:9/871: symlink d8/d16/d3d/d59/d29/d90/db7/dbc/l105 0 2024-09-13T02:50:57.248 INFO:tasks.workunit.client.1.smithi122.stdout:9/872: stat d8/d16/c3b 0 2024-09-13T02:50:57.252 INFO:tasks.workunit.client.1.smithi122.stdout:9/873: unlink d8/d88/d65/fc7 0 2024-09-13T02:50:57.256 INFO:tasks.workunit.client.1.smithi122.stdout:9/874: rmdir d8/d16/d3e 39 2024-09-13T02:50:57.256 INFO:tasks.workunit.client.1.smithi122.stdout:9/875: mknod d8/d16/d3d/d59/d23/d1f/c106 0 2024-09-13T02:50:57.263 INFO:tasks.workunit.client.1.smithi122.stdout:2/769: dwrite d0/d1e/f9b [0,4194304] 0 2024-09-13T02:50:57.263 INFO:tasks.workunit.client.1.smithi122.stdout:0/842: dwrite d1/f38 [0,4194304] 0 2024-09-13T02:50:57.270 INFO:tasks.workunit.client.1.smithi122.stdout:1/866: sync 2024-09-13T02:50:57.271 INFO:tasks.workunit.client.1.smithi122.stdout:9/876: write d8/d16/d3d/db5/ff2 [2498827,108008] 0 2024-09-13T02:50:57.271 INFO:tasks.workunit.client.1.smithi122.stdout:9/877: stat d8/d16/d3d/d59/d49/f7a 0 2024-09-13T02:50:57.271 INFO:tasks.workunit.client.1.smithi122.stdout:0/843: rename d1/d5/d9/da/d17 to d1/d5/d10/d29/d118 0 2024-09-13T02:50:57.273 INFO:tasks.workunit.client.1.smithi122.stdout:9/878: mkdir d8/d16/d3d/d59/d29/d90/db7/d107 0 2024-09-13T02:50:57.273 INFO:tasks.workunit.client.1.smithi122.stdout:9/879: creat d8/d16/f108 x:0 0 0 2024-09-13T02:50:57.274 INFO:tasks.workunit.client.1.smithi122.stdout:0/844: mkdir d1/d5/d10/d29/d32/d83/db3/d119 0 2024-09-13T02:50:57.281 INFO:tasks.workunit.client.1.smithi122.stdout:0/845: rename d1/d5/d9 to d1/d11a 0 2024-09-13T02:50:57.285 INFO:tasks.workunit.client.1.smithi122.stdout:9/880: write d8/d16/d3e/fd6 [1759847,84217] 0 2024-09-13T02:50:57.285 INFO:tasks.workunit.client.1.smithi122.stdout:9/881: chown d8/d16 1891 1 2024-09-13T02:50:57.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/846: symlink d1/d5/d10/d29/d32/d83/db3/df4/l11b 0 2024-09-13T02:50:57.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/847: mkdir d1/d5/d10/d29/d32/d83/db3/df5/d11c 0 2024-09-13T02:50:57.285 INFO:tasks.workunit.client.1.smithi122.stdout:2/770: dwrite d0/d1e/d26/f30 [0,4194304] 0 2024-09-13T02:50:57.314 INFO:tasks.workunit.client.1.smithi122.stdout:9/882: dwrite d8/d16/d3d/d59/d23/d7b/fd3 [0,4194304] 0 2024-09-13T02:50:57.314 INFO:tasks.workunit.client.1.smithi122.stdout:2/771: dwrite d0/d1e/d22/d29/fa2 [0,4194304] 0 2024-09-13T02:50:57.327 INFO:tasks.workunit.client.1.smithi122.stdout:9/883: write d8/f1a [1849284,40751] 0 2024-09-13T02:50:57.328 INFO:tasks.workunit.client.1.smithi122.stdout:9/884: write d8/d16/d3d/d59/d7d/d83/fe3 [438686,109549] 0 2024-09-13T02:50:57.331 INFO:tasks.workunit.client.1.smithi122.stdout:2/772: dwrite d0/d55/d70/d59/f6e [4194304,4194304] 0 2024-09-13T02:50:57.331 INFO:tasks.workunit.client.1.smithi122.stdout:2/773: stat d0/d1c/f31 0 2024-09-13T02:50:57.331 INFO:tasks.workunit.client.1.smithi122.stdout:9/885: link d8/d16/d3d/d59/d49/fc5 d8/d16/d3d/f109 0 2024-09-13T02:50:57.331 INFO:tasks.workunit.client.1.smithi122.stdout:9/886: write d8/d16/d3d/d59/d7d/d83/fe3 [1698391,94675] 0 2024-09-13T02:50:57.332 INFO:tasks.workunit.client.1.smithi122.stdout:2/774: unlink d0/d1c/d3b/d41/d6a/f96 0 2024-09-13T02:50:57.333 INFO:tasks.workunit.client.1.smithi122.stdout:9/887: mkdir d8/d16/d3d/d59/d29/d90/db7/dd1/d10a 0 2024-09-13T02:50:57.333 INFO:tasks.workunit.client.1.smithi122.stdout:2/775: mkdir d0/d1c/d3b/d41/d4e/d90/df9 0 2024-09-13T02:50:57.334 INFO:tasks.workunit.client.1.smithi122.stdout:9/888: unlink d8/d16/d3d/d59/d23/d7b/d82/da3/la2 0 2024-09-13T02:50:57.337 INFO:tasks.workunit.client.1.smithi122.stdout:9/889: truncate d8/d16/d3d/d59/d7d/d83/fda 8119284 0 2024-09-13T02:50:57.338 INFO:tasks.workunit.client.1.smithi122.stdout:9/890: symlink d8/d16/d45/df9/l10b 0 2024-09-13T02:50:57.339 INFO:tasks.workunit.client.1.smithi122.stdout:9/891: mkdir d8/d16/d3d/d59/d29/d90/db7/dbc/d10c 0 2024-09-13T02:50:57.348 INFO:tasks.workunit.client.1.smithi122.stdout:2/776: dwrite d0/d1e/d26/d3d/f6f [0,4194304] 0 2024-09-13T02:50:57.348 INFO:tasks.workunit.client.1.smithi122.stdout:2/777: write d0/d1c/d3b/d41/d4e/d90/fa6 [699838,91572] 0 2024-09-13T02:50:57.348 INFO:tasks.workunit.client.1.smithi122.stdout:2/778: chown d0/dc0 34161 1 2024-09-13T02:50:57.352 INFO:tasks.workunit.client.1.smithi122.stdout:9/892: write d8/d16/d3d/d59/d23/d1f/d36/fa8 [920352,34438] 0 2024-09-13T02:50:57.352 INFO:tasks.workunit.client.1.smithi122.stdout:9/893: dread - d8/d88/fc9 zero size 2024-09-13T02:50:57.353 INFO:tasks.workunit.client.1.smithi122.stdout:2/779: creat d0/d1e/d26/d3d/dea/ffa x:0 0 0 2024-09-13T02:50:57.354 INFO:tasks.workunit.client.1.smithi122.stdout:9/894: creat d8/d4a/d64/f10d x:0 0 0 2024-09-13T02:50:57.357 INFO:tasks.workunit.client.1.smithi122.stdout:2/780: mkdir d0/d53/dc6/dfb 0 2024-09-13T02:50:57.357 INFO:tasks.workunit.client.1.smithi122.stdout:2/781: fdatasync d0/d1e/d26/fa0 0 2024-09-13T02:50:57.357 INFO:tasks.workunit.client.1.smithi122.stdout:2/782: truncate d0/d1e/d2e/d8a/d99/fb8 1602744 0 2024-09-13T02:50:57.358 INFO:tasks.workunit.client.1.smithi122.stdout:9/895: truncate d8/d16/d3d/d59/d49/fc5 928917 0 2024-09-13T02:50:57.359 INFO:tasks.workunit.client.1.smithi122.stdout:2/783: mknod d0/d1c/d3b/d41/d4e/d75/cfc 0 2024-09-13T02:50:57.359 INFO:tasks.workunit.client.1.smithi122.stdout:9/896: dread d8/d16/d3d/d59/f7f [0,4194304] 0 2024-09-13T02:50:57.361 INFO:tasks.workunit.client.1.smithi122.stdout:9/897: mknod d8/d16/c10e 0 2024-09-13T02:50:57.361 INFO:tasks.workunit.client.1.smithi122.stdout:9/898: fdatasync d8/d16/d45/fed 0 2024-09-13T02:50:57.370 INFO:tasks.workunit.client.1.smithi122.stdout:2/784: dread d0/d55/f81 [0,4194304] 0 2024-09-13T02:50:57.370 INFO:tasks.workunit.client.1.smithi122.stdout:2/785: fsync d0/f2c 0 2024-09-13T02:50:57.370 INFO:tasks.workunit.client.1.smithi122.stdout:2/786: write d0/d1c/d3b/d41/d4e/fe4 [6159,28087] 0 2024-09-13T02:50:57.372 INFO:tasks.workunit.client.1.smithi122.stdout:2/787: creat d0/d53/ffd x:0 0 0 2024-09-13T02:50:57.374 INFO:tasks.workunit.client.1.smithi122.stdout:8/768: sync 2024-09-13T02:50:57.374 INFO:tasks.workunit.client.1.smithi122.stdout:2/788: mkdir d0/d55/d70/d59/dfe 0 2024-09-13T02:50:57.374 INFO:tasks.workunit.client.1.smithi122.stdout:2/789: mknod d0/d1c/d3b/dbf/cff 0 2024-09-13T02:50:57.377 INFO:tasks.workunit.client.1.smithi122.stdout:2/790: getdents d0/d1e/d2e/d5a 0 2024-09-13T02:50:57.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/791: symlink d0/d1e/d2e/d8a/d99/l100 0 2024-09-13T02:50:57.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/792: creat d0/d1c/d3b/d41/d4e/d90/f101 x:0 0 0 2024-09-13T02:50:57.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/793: creat d0/d1c/d3b/f102 x:0 0 0 2024-09-13T02:50:57.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/794: chown d0/d1e/d22/f32 20018 1 2024-09-13T02:50:57.380 INFO:tasks.workunit.client.1.smithi122.stdout:9/899: dwrite d8/f2e [4194304,4194304] 0 2024-09-13T02:50:57.384 INFO:tasks.workunit.client.1.smithi122.stdout:2/795: mknod d0/d1e/d26/dbd/c103 0 2024-09-13T02:50:57.386 INFO:tasks.workunit.client.1.smithi122.stdout:8/769: dread d3/da/d91/fc4 [0,4194304] 0 2024-09-13T02:50:57.387 INFO:tasks.workunit.client.1.smithi122.stdout:8/770: write d3/d31/d52/d89/db1/fe9 [559521,77934] 0 2024-09-13T02:50:57.387 INFO:tasks.workunit.client.1.smithi122.stdout:8/771: truncate d3/d31/d65/f54 558729 0 2024-09-13T02:50:57.389 INFO:tasks.workunit.client.1.smithi122.stdout:8/772: creat d3/d53/d34/d94/fed x:0 0 0 2024-09-13T02:50:57.390 INFO:tasks.workunit.client.1.smithi122.stdout:8/773: readlink d3/d31/lca 0 2024-09-13T02:50:57.408 INFO:tasks.workunit.client.1.smithi122.stdout:9/900: dwrite d8/d16/d3d/d59/d23/d1f/f54 [4194304,4194304] 0 2024-09-13T02:50:57.408 INFO:tasks.workunit.client.1.smithi122.stdout:8/774: dwrite d3/d31/d52/d89/d8b/d5c/f8c [0,4194304] 0 2024-09-13T02:50:57.408 INFO:tasks.workunit.client.1.smithi122.stdout:8/775: creat d3/da/d1e/fee x:0 0 0 2024-09-13T02:50:57.409 INFO:tasks.workunit.client.1.smithi122.stdout:8/776: chown d3/da/c8d 18311529 1 2024-09-13T02:50:57.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/796: dwrite d0/d1c/d3b/d41/f3f [0,4194304] 0 2024-09-13T02:50:57.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/797: write d0/f5 [5343175,102036] 0 2024-09-13T02:50:57.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/798: write d0/d1c/f5e [663109,125708] 0 2024-09-13T02:50:57.422 INFO:tasks.workunit.client.1.smithi122.stdout:9/901: write d8/d16/d3d/d59/d23/d7b/fd3 [287641,108945] 0 2024-09-13T02:50:57.422 INFO:tasks.workunit.client.1.smithi122.stdout:9/902: write d8/d16/d3d/d59/f7f [306916,75791] 0 2024-09-13T02:50:57.423 INFO:tasks.workunit.client.1.smithi122.stdout:8/777: read d3/d53/fd6 [3454282,124302] 0 2024-09-13T02:50:57.427 INFO:tasks.workunit.client.1.smithi122.stdout:2/799: dread d0/d1e/d22/d29/fa2 [0,4194304] 0 2024-09-13T02:50:57.427 INFO:tasks.workunit.client.1.smithi122.stdout:9/903: unlink d8/d16/d3d/d59/d23/d1f/d36/fa8 0 2024-09-13T02:50:57.431 INFO:tasks.workunit.client.1.smithi122.stdout:2/800: mknod d0/dc0/dde/c104 0 2024-09-13T02:50:57.432 INFO:tasks.workunit.client.1.smithi122.stdout:9/904: mkdir d8/d16/d3d/d59/d10f 0 2024-09-13T02:50:57.432 INFO:tasks.workunit.client.1.smithi122.stdout:8/778: dread d3/d31/d52/d89/d8b/d5c/f8c [0,4194304] 0 2024-09-13T02:50:57.432 INFO:tasks.workunit.client.1.smithi122.stdout:8/779: readlink d3/d31/d52/d59/l64 0 2024-09-13T02:50:57.432 INFO:tasks.workunit.client.1.smithi122.stdout:8/780: fsync d3/d53/d4d/fb5 0 2024-09-13T02:50:57.433 INFO:tasks.workunit.client.1.smithi122.stdout:9/905: truncate d8/f1a 2991291 0 2024-09-13T02:50:57.434 INFO:tasks.workunit.client.1.smithi122.stdout:9/906: write d8/d88/f68 [1449290,94311] 0 2024-09-13T02:50:57.434 INFO:tasks.workunit.client.1.smithi122.stdout:9/907: truncate d8/d4a/d64/f10d 523480 0 2024-09-13T02:50:57.434 INFO:tasks.workunit.client.1.smithi122.stdout:2/801: dread d0/d1e/d22/f37 [0,4194304] 0 2024-09-13T02:50:57.435 INFO:tasks.workunit.client.1.smithi122.stdout:2/802: write d0/d1e/d2e/d3e/f5b [5210966,74946] 0 2024-09-13T02:50:57.435 INFO:tasks.workunit.client.1.smithi122.stdout:9/908: mknod d8/d16/d3d/d59/d23/d1f/c110 0 2024-09-13T02:50:57.435 INFO:tasks.workunit.client.1.smithi122.stdout:9/909: write d8/d88/fe0 [703998,88288] 0 2024-09-13T02:50:57.437 INFO:tasks.workunit.client.1.smithi122.stdout:9/910: creat d8/d16/d3d/d59/d29/d90/db7/d107/f111 x:0 0 0 2024-09-13T02:50:57.437 INFO:tasks.workunit.client.1.smithi122.stdout:6/902: sync 2024-09-13T02:50:57.437 INFO:tasks.workunit.client.1.smithi122.stdout:3/923: sync 2024-09-13T02:50:57.437 INFO:tasks.workunit.client.1.smithi122.stdout:7/855: sync 2024-09-13T02:50:57.437 INFO:tasks.workunit.client.1.smithi122.stdout:7/856: write d4/d8/db/dc/f61 [5210907,986] 0 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:1/867: sync 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:0/848: sync 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:0/849: fsync d1/d5/d2d/db4/ddc/df0/d81/dc5/fda 0 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:5/812: sync 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:6/903: symlink d5/db/d29/d60/dd2/l10d 0 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:6/904: stat d5/d11/f4f 0 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:6/905: chown d5/d3d/d6c/d41/d5b/fbe 8 1 2024-09-13T02:50:57.439 INFO:tasks.workunit.client.1.smithi122.stdout:6/906: write d5/f5a [520589,66382] 0 2024-09-13T02:50:57.440 INFO:tasks.workunit.client.1.smithi122.stdout:3/924: link d4/d11/dd/d21/d2b/d36/d3c/c37 d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/dd5/c15b 0 2024-09-13T02:50:57.443 INFO:tasks.workunit.client.1.smithi122.stdout:2/803: write d0/d1e/d26/fa0 [2651228,103798] 0 2024-09-13T02:50:57.444 INFO:tasks.workunit.client.1.smithi122.stdout:7/857: rename d4/d6d/d8c/dc3/cd4 to d4/d77/c11f 0 2024-09-13T02:50:57.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/868: mknod dc/d38/db1/d72/c121 0 2024-09-13T02:50:57.448 INFO:tasks.workunit.client.1.smithi122.stdout:0/850: mkdir d1/d11a/da/d11d 0 2024-09-13T02:50:57.448 INFO:tasks.workunit.client.1.smithi122.stdout:0/851: truncate d1/d4b/f7c 2275676 0 2024-09-13T02:50:57.449 INFO:tasks.workunit.client.1.smithi122.stdout:5/813: creat d0/d2/d33/f10a x:0 0 0 2024-09-13T02:50:57.450 INFO:tasks.workunit.client.1.smithi122.stdout:8/781: dwrite d3/d31/f85 [0,4194304] 0 2024-09-13T02:50:57.450 INFO:tasks.workunit.client.1.smithi122.stdout:9/911: read f1 [5076968,102379] 0 2024-09-13T02:50:57.451 INFO:tasks.workunit.client.1.smithi122.stdout:2/804: mkdir d0/dc0/dde/d105 0 2024-09-13T02:50:57.452 INFO:tasks.workunit.client.1.smithi122.stdout:6/907: dread d5/f5a [0,4194304] 0 2024-09-13T02:50:57.453 INFO:tasks.workunit.client.1.smithi122.stdout:2/805: read d0/d1c/d3b/d41/d8c/fab [126338,126531] 0 2024-09-13T02:50:57.453 INFO:tasks.workunit.client.1.smithi122.stdout:3/925: rename d4/d11/dd/d21/d2b/f13e to d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f15c 0 2024-09-13T02:50:57.455 INFO:tasks.workunit.client.1.smithi122.stdout:1/869: unlink dc/de/d18/d22/cf0 0 2024-09-13T02:50:57.459 INFO:tasks.workunit.client.1.smithi122.stdout:0/852: symlink d1/d5/d2d/db4/l11e 0 2024-09-13T02:50:57.463 INFO:tasks.workunit.client.1.smithi122.stdout:5/814: link d0/d17/d3a/f4f d0/d17/d36/d3f/d4c/d7f/dcb/f10b 0 2024-09-13T02:50:57.470 INFO:tasks.workunit.client.1.smithi122.stdout:7/858: dwrite d4/d8/d3d/d7e/fe6 [0,4194304] 0 2024-09-13T02:50:57.470 INFO:tasks.workunit.client.1.smithi122.stdout:9/912: dwrite d8/d4a/d64/f10d [0,4194304] 0 2024-09-13T02:50:57.470 INFO:tasks.workunit.client.1.smithi122.stdout:8/782: symlink d3/d53/d34/dbf/dcb/lef 0 2024-09-13T02:50:57.471 INFO:tasks.workunit.client.1.smithi122.stdout:8/783: fsync d3/da/d1e/f47 0 2024-09-13T02:50:57.473 INFO:tasks.workunit.client.1.smithi122.stdout:2/806: mkdir d0/d55/d70/d59/dd2/d106 0 2024-09-13T02:50:57.473 INFO:tasks.workunit.client.1.smithi122.stdout:2/807: stat d0/d55/d70/d59/cf3 0 2024-09-13T02:50:57.477 INFO:tasks.workunit.client.1.smithi122.stdout:1/870: unlink dc/de/c45 0 2024-09-13T02:50:57.477 INFO:tasks.workunit.client.1.smithi122.stdout:1/871: write dc/de/d18/d1d/d2f/fb5 [519123,78857] 0 2024-09-13T02:50:57.477 INFO:tasks.workunit.client.1.smithi122.stdout:1/872: write dc/d38/db1/d72/dd7/d3f/ff6 [759904,106052] 0 2024-09-13T02:50:57.479 INFO:tasks.workunit.client.1.smithi122.stdout:0/853: symlink d1/d5/d2d/db4/ddc/df0/dba/l11f 0 2024-09-13T02:50:57.479 INFO:tasks.workunit.client.1.smithi122.stdout:0/854: dread - d1/d11a/dce/f113 zero size 2024-09-13T02:50:57.479 INFO:tasks.workunit.client.1.smithi122.stdout:0/855: stat d1/d5/d10/d29/d118/fbc 0 2024-09-13T02:50:57.479 INFO:tasks.workunit.client.1.smithi122.stdout:0/856: truncate d1/d5/d10/d29/d32/f102 1418457 0 2024-09-13T02:50:57.482 INFO:tasks.workunit.client.1.smithi122.stdout:7/859: rename d4/d8/db/dc/d1b/d49/fb0 to d4/d6d/f120 0 2024-09-13T02:50:57.485 INFO:tasks.workunit.client.1.smithi122.stdout:9/913: creat d8/d16/d3d/d59/d7d/d83/f112 x:0 0 0 2024-09-13T02:50:57.485 INFO:tasks.workunit.client.1.smithi122.stdout:9/914: readlink d8/d16/d3d/d59/d29/d90/db7/dbc/lf3 0 2024-09-13T02:50:57.489 INFO:tasks.workunit.client.1.smithi122.stdout:8/784: link d3/da/f8e d3/d31/d52/d89/db1/ff0 0 2024-09-13T02:50:57.489 INFO:tasks.workunit.client.1.smithi122.stdout:6/908: link d5/d3d/d6c/d41/d4e/d93/cea d5/db/c10e 0 2024-09-13T02:50:57.489 INFO:tasks.workunit.client.1.smithi122.stdout:6/909: fsync d5/d3d/d6c/d41/d4e/d93/fdf 0 2024-09-13T02:50:57.489 INFO:tasks.workunit.client.1.smithi122.stdout:2/808: symlink d0/d1e/d92/de0/l107 0 2024-09-13T02:50:57.489 INFO:tasks.workunit.client.1.smithi122.stdout:1/873: rename dc/de/d18/d1d/l71 to dc/d38/db1/d72/l122 0 2024-09-13T02:50:57.490 INFO:tasks.workunit.client.1.smithi122.stdout:1/874: chown dc/de/d18/d22/d1c/d47/fdf 1329066571 1 2024-09-13T02:50:57.490 INFO:tasks.workunit.client.1.smithi122.stdout:5/815: dwrite d0/d17/d36/d8b/fdf [4194304,4194304] 0 2024-09-13T02:50:57.490 INFO:tasks.workunit.client.1.smithi122.stdout:5/816: readlink d0/da/d90/la8 0 2024-09-13T02:50:57.490 INFO:tasks.workunit.client.1.smithi122.stdout:7/860: mkdir d4/d6d/da6/dbf/db1/da3/d121 0 2024-09-13T02:50:57.494 INFO:tasks.workunit.client.1.smithi122.stdout:8/785: link d3/d31/f61 d3/d53/d34/ff1 0 2024-09-13T02:50:57.496 INFO:tasks.workunit.client.1.smithi122.stdout:0/857: symlink d1/d5/d10/d29/d118/l120 0 2024-09-13T02:50:57.496 INFO:tasks.workunit.client.1.smithi122.stdout:0/858: dread - d1/d5/d2d/fe0 zero size 2024-09-13T02:50:57.496 INFO:tasks.workunit.client.1.smithi122.stdout:0/859: dread - d1/d11a/da/f117 zero size 2024-09-13T02:50:57.498 INFO:tasks.workunit.client.1.smithi122.stdout:1/875: mkdir dc/d38/db1/d72/d123 0 2024-09-13T02:50:57.505 INFO:tasks.workunit.client.1.smithi122.stdout:9/915: rmdir d8/d88 39 2024-09-13T02:50:57.505 INFO:tasks.workunit.client.1.smithi122.stdout:9/916: stat d8/f9f 0 2024-09-13T02:50:57.520 INFO:tasks.workunit.client.1.smithi122.stdout:3/926: dwrite d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/f137 [0,4194304] 0 2024-09-13T02:50:57.526 INFO:tasks.workunit.client.1.smithi122.stdout:5/817: write d0/da/f2a [1543131,37020] 0 2024-09-13T02:50:57.561 INFO:tasks.workunit.client.1.smithi122.stdout:2/809: dwrite d0/d1c/d3b/f102 [0,4194304] 0 2024-09-13T02:50:57.562 INFO:tasks.workunit.client.1.smithi122.stdout:2/810: chown d0/d1e/d26/d3d 2 1 2024-09-13T02:50:57.562 INFO:tasks.workunit.client.1.smithi122.stdout:0/860: dwrite d1/d5/d10/d29/d32/d5f/f50 [4194304,4194304] 0 2024-09-13T02:50:57.562 INFO:tasks.workunit.client.1.smithi122.stdout:0/861: chown d1/d11a/da/d92/d94/c5b 3 1 2024-09-13T02:50:57.562 INFO:tasks.workunit.client.1.smithi122.stdout:8/786: dwrite d3/da/d1f/f7f [0,4194304] 0 2024-09-13T02:50:57.563 INFO:tasks.workunit.client.1.smithi122.stdout:6/910: dwrite d5/d3d/d6c/d41/d4e/d93/fdf [0,4194304] 0 2024-09-13T02:50:57.563 INFO:tasks.workunit.client.1.smithi122.stdout:7/861: dwrite d4/d6d/da6/dbf/db1/da3/fb9 [0,4194304] 0 2024-09-13T02:50:57.563 INFO:tasks.workunit.client.1.smithi122.stdout:7/862: write d4/d8/db/f42 [102911,11559] 0 2024-09-13T02:50:57.563 INFO:tasks.workunit.client.1.smithi122.stdout:5/818: dwrite d0/da/d48/d63/f81 [0,4194304] 0 2024-09-13T02:50:57.567 INFO:tasks.workunit.client.1.smithi122.stdout:0/862: creat d1/d11a/da/f121 x:0 0 0 2024-09-13T02:50:57.569 INFO:tasks.workunit.client.1.smithi122.stdout:6/911: dread d5/d3d/d6c/d41/d5b/d7d/ddd/d46/f5d [0,4194304] 0 2024-09-13T02:50:57.570 INFO:tasks.workunit.client.1.smithi122.stdout:8/787: link d3/fec d3/d31/d52/d89/ff2 0 2024-09-13T02:50:57.570 INFO:tasks.workunit.client.1.smithi122.stdout:8/788: fdatasync d3/d31/d52/fb4 0 2024-09-13T02:50:57.573 INFO:tasks.workunit.client.1.smithi122.stdout:2/811: write d0/d1e/d2e/d3e/f5b [3840888,960] 0 2024-09-13T02:50:57.574 INFO:tasks.workunit.client.1.smithi122.stdout:2/812: creat d0/d1c/d3b/d41/d4e/f108 x:0 0 0 2024-09-13T02:50:57.574 INFO:tasks.workunit.client.1.smithi122.stdout:2/813: stat d0/f5 0 2024-09-13T02:50:57.574 INFO:tasks.workunit.client.1.smithi122.stdout:2/814: write d0/d1c/d3b/d41/d4e/d90/f101 [714690,91907] 0 2024-09-13T02:50:57.574 INFO:tasks.workunit.client.1.smithi122.stdout:2/815: write d0/d55/f62 [4547081,61776] 0 2024-09-13T02:50:57.584 INFO:tasks.workunit.client.1.smithi122.stdout:7/863: mknod d4/d8/db/d63/dbb/df3/c122 0 2024-09-13T02:50:57.584 INFO:tasks.workunit.client.1.smithi122.stdout:8/789: dwrite d3/da/d1f/f63 [0,4194304] 0 2024-09-13T02:50:57.586 INFO:tasks.workunit.client.1.smithi122.stdout:5/819: mknod d0/da/d8c/d8f/da0/d107/c10c 0 2024-09-13T02:50:57.587 INFO:tasks.workunit.client.1.smithi122.stdout:0/863: rename d1/d5/d2d/f44 to d1/d5/d2d/db4/ddc/df0/df3/f122 0 2024-09-13T02:50:57.589 INFO:tasks.workunit.client.1.smithi122.stdout:6/912: mkdir d5/d3d/d6c/d41/db9/d10f 0 2024-09-13T02:50:57.593 INFO:tasks.workunit.client.1.smithi122.stdout:7/864: creat d4/d8/db7/d102/df9/f123 x:0 0 0 2024-09-13T02:50:57.596 INFO:tasks.workunit.client.1.smithi122.stdout:8/790: symlink d3/da/d7d/lf3 0 2024-09-13T02:50:57.598 INFO:tasks.workunit.client.1.smithi122.stdout:5/820: creat d0/da/d48/db4/f10d x:0 0 0 2024-09-13T02:50:57.602 INFO:tasks.workunit.client.1.smithi122.stdout:2/816: rename d0/d1e/l65 to d0/d53/dc6/l109 0 2024-09-13T02:50:57.603 INFO:tasks.workunit.client.1.smithi122.stdout:6/913: write d5/db/d29/f1d [6036276,1055] 0 2024-09-13T02:50:57.604 INFO:tasks.workunit.client.1.smithi122.stdout:6/914: write d5/db/d29/f7c [248652,22166] 0 2024-09-13T02:50:57.604 INFO:tasks.workunit.client.1.smithi122.stdout:0/864: mknod d1/d5/d10/d29/d32/d83/db3/df4/dfa/c123 0 2024-09-13T02:50:57.604 INFO:tasks.workunit.client.1.smithi122.stdout:0/865: fsync d1/d5/d2d/db4/ddc/df0/dba/f87 0 2024-09-13T02:50:57.606 INFO:tasks.workunit.client.1.smithi122.stdout:6/915: dread d5/d3d/d6c/d41/d4e/d93/fa9 [4194304,4194304] 0 2024-09-13T02:50:57.607 INFO:tasks.workunit.client.1.smithi122.stdout:7/865: truncate d4/f29 3433240 0 2024-09-13T02:50:57.608 INFO:tasks.workunit.client.1.smithi122.stdout:8/791: mknod d3/d53/cf4 0 2024-09-13T02:50:57.617 INFO:tasks.workunit.client.1.smithi122.stdout:7/866: write d4/d6d/da6/dbf/db1/da3/fb9 [162702,96794] 0 2024-09-13T02:50:57.617 INFO:tasks.workunit.client.1.smithi122.stdout:8/792: write d3/d53/d21/f98 [162726,53309] 0 2024-09-13T02:50:57.641 INFO:tasks.workunit.client.1.smithi122.stdout:5/821: symlink d0/da/d8c/d8f/df7/d102/l10e 0 2024-09-13T02:50:57.645 INFO:tasks.workunit.client.1.smithi122.stdout:0/866: symlink d1/d11a/dce/l124 0 2024-09-13T02:50:57.645 INFO:tasks.workunit.client.1.smithi122.stdout:0/867: stat d1/d5/d2d/db4 0 2024-09-13T02:50:57.648 INFO:tasks.workunit.client.1.smithi122.stdout:6/916: unlink d5/d3d/d6c/la5 0 2024-09-13T02:50:57.649 INFO:tasks.workunit.client.1.smithi122.stdout:5/822: dread d0/d17/d36/d8b/f96 [0,4194304] 0 2024-09-13T02:50:57.652 INFO:tasks.workunit.client.1.smithi122.stdout:7/867: creat d4/d6d/da6/df2/f124 x:0 0 0 2024-09-13T02:50:57.655 INFO:tasks.workunit.client.1.smithi122.stdout:0/868: dread d1/d5/f13 [0,4194304] 0 2024-09-13T02:50:57.655 INFO:tasks.workunit.client.1.smithi122.stdout:8/793: getdents d3/d53/d34/dbf 0 2024-09-13T02:50:57.656 INFO:tasks.workunit.client.1.smithi122.stdout:8/794: fsync d3/d53/d34/f48 0 2024-09-13T02:50:57.659 INFO:tasks.workunit.client.1.smithi122.stdout:6/917: dread d5/d40/fc8 [0,4194304] 0 2024-09-13T02:50:57.659 INFO:tasks.workunit.client.1.smithi122.stdout:6/918: fsync d5/d11/d45/f78 0 2024-09-13T02:50:57.660 INFO:tasks.workunit.client.1.smithi122.stdout:8/795: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:57.660 INFO:tasks.workunit.client.1.smithi122.stdout:8/796: fdatasync d3/d53/d21/f69 0 2024-09-13T02:50:57.685 INFO:tasks.workunit.client.1.smithi122.stdout:0/869: dwrite d1/d11a/da/d92/d94/f101 [0,4194304] 0 2024-09-13T02:50:57.685 INFO:tasks.workunit.client.1.smithi122.stdout:0/870: stat d1/d11a/da/d7d/c9d 0 2024-09-13T02:50:57.685 INFO:tasks.workunit.client.1.smithi122.stdout:6/919: dwrite d5/db/f44 [0,4194304] 0 2024-09-13T02:50:57.701 INFO:tasks.workunit.client.1.smithi122.stdout:6/920: dwrite d5/d3d/d6c/d41/d5b/ff1 [0,4194304] 0 2024-09-13T02:50:57.723 INFO:tasks.workunit.client.1.smithi122.stdout:7/868: link d4/d8/db/dc/d1b/d49/fa8 d4/d8/d3d/dc2/f125 0 2024-09-13T02:50:57.739 INFO:tasks.workunit.client.1.smithi122.stdout:5/823: unlink d0/d17/d36/d3f/fcd 0 2024-09-13T02:50:57.741 INFO:tasks.workunit.client.1.smithi122.stdout:5/824: dread d0/da/f73 [0,4194304] 0 2024-09-13T02:50:57.741 INFO:tasks.workunit.client.1.smithi122.stdout:5/825: creat d0/d17/d36/d8b/f10f x:0 0 0 2024-09-13T02:50:57.741 INFO:tasks.workunit.client.1.smithi122.stdout:6/921: mkdir d5/db/dc/d10c/d110 0 2024-09-13T02:50:57.744 INFO:tasks.workunit.client.1.smithi122.stdout:7/869: mknod d4/d8/d3d/dc2/d103/c126 0 2024-09-13T02:50:57.746 INFO:tasks.workunit.client.1.smithi122.stdout:5/826: mknod d0/da/d48/d63/d98/c110 0 2024-09-13T02:50:57.748 INFO:tasks.workunit.client.1.smithi122.stdout:6/922: mkdir d5/d3d/d48/d111 0 2024-09-13T02:50:57.750 INFO:tasks.workunit.client.1.smithi122.stdout:5/827: link d0/da/d48/fc5 d0/da/d8c/d8f/da0/d107/f111 0 2024-09-13T02:50:57.753 INFO:tasks.workunit.client.1.smithi122.stdout:6/923: creat d5/d3d/d6c/d41/d5b/d7d/ddd/d26/f112 x:0 0 0 2024-09-13T02:50:57.756 INFO:tasks.workunit.client.1.smithi122.stdout:5/828: symlink d0/da/d48/dd3/l112 0 2024-09-13T02:50:57.758 INFO:tasks.workunit.client.1.smithi122.stdout:6/924: mknod d5/d3d/d6c/db5/c113 0 2024-09-13T02:50:57.760 INFO:tasks.workunit.client.1.smithi122.stdout:2/817: symlink d0/d55/d70/l10a 0 2024-09-13T02:50:57.761 INFO:tasks.workunit.client.1.smithi122.stdout:6/925: symlink d5/d3d/d48/dd7/l114 0 2024-09-13T02:50:57.763 INFO:tasks.workunit.client.1.smithi122.stdout:2/818: mknod d0/d1c/d3b/d41/d8c/c10b 0 2024-09-13T02:50:57.763 INFO:tasks.workunit.client.1.smithi122.stdout:2/819: chown d0/d1e/d22/f32 0 1 2024-09-13T02:50:57.765 INFO:tasks.workunit.client.1.smithi122.stdout:5/829: write d0/d17/fa4 [2901536,10446] 0 2024-09-13T02:50:57.769 INFO:tasks.workunit.client.1.smithi122.stdout:5/830: truncate d0/d17/f6f 6854813 0 2024-09-13T02:50:57.772 INFO:tasks.workunit.client.1.smithi122.stdout:5/831: rename d0/d1d/df1 to d0/d17/d36/d3f/d4c/d113 0 2024-09-13T02:50:57.773 INFO:tasks.workunit.client.1.smithi122.stdout:5/832: truncate d0/da/d48/db4/d95/fbc 183817 0 2024-09-13T02:50:57.773 INFO:tasks.workunit.client.1.smithi122.stdout:5/833: mknod d0/da/d48/db4/c114 0 2024-09-13T02:50:57.774 INFO:tasks.workunit.client.1.smithi122.stdout:7/870: getdents d4/d8/d3d/dc2 0 2024-09-13T02:50:57.775 INFO:tasks.workunit.client.1.smithi122.stdout:0/871: creat d1/d5/f125 x:0 0 0 2024-09-13T02:50:57.776 INFO:tasks.workunit.client.1.smithi122.stdout:0/872: mkdir d1/d5/d10/d29/d32/d83/db3/d119/d126 0 2024-09-13T02:50:57.776 INFO:tasks.workunit.client.1.smithi122.stdout:0/873: creat d1/d5/d10/d29/d32/d83/dd7/f127 x:0 0 0 2024-09-13T02:50:57.776 INFO:tasks.workunit.client.1.smithi122.stdout:0/874: chown d1/d5/d2d/db4 7938758 1 2024-09-13T02:50:57.776 INFO:tasks.workunit.client.1.smithi122.stdout:0/875: chown d1/d5/d10/d29/d32/d83/db3/df4/dfa 153181018 1 2024-09-13T02:50:57.777 INFO:tasks.workunit.client.1.smithi122.stdout:0/876: creat d1/d5/d2d/f128 x:0 0 0 2024-09-13T02:50:57.777 INFO:tasks.workunit.client.1.smithi122.stdout:0/877: write d1/d5/d2d/db4/ddc/df0/fcd [174572,102003] 0 2024-09-13T02:50:57.781 INFO:tasks.workunit.client.1.smithi122.stdout:7/871: dread d4/d8/f19 [4194304,4194304] 0 2024-09-13T02:50:57.781 INFO:tasks.workunit.client.1.smithi122.stdout:7/872: readlink d4/d8/db/dc/d46/lfa 0 2024-09-13T02:50:57.782 INFO:tasks.workunit.client.1.smithi122.stdout:0/878: mknod d1/d5/d10/d29/d32/d83/db3/df4/dfa/c129 0 2024-09-13T02:50:57.783 INFO:tasks.workunit.client.1.smithi122.stdout:7/873: creat d4/d8/db/dc/d46/f127 x:0 0 0 2024-09-13T02:50:57.783 INFO:tasks.workunit.client.1.smithi122.stdout:7/874: creat d4/d8/d3d/d7e/f128 x:0 0 0 2024-09-13T02:50:57.784 INFO:tasks.workunit.client.1.smithi122.stdout:5/834: write d0/da/fef [4098662,129858] 0 2024-09-13T02:50:57.784 INFO:tasks.workunit.client.1.smithi122.stdout:5/835: truncate d0/da/d48/db4/dc8/fd2 77030 0 2024-09-13T02:50:57.784 INFO:tasks.workunit.client.1.smithi122.stdout:5/836: chown d0/d2/l59 820220125 1 2024-09-13T02:50:57.784 INFO:tasks.workunit.client.1.smithi122.stdout:6/926: dwrite d5/d3d/d48/f6b [0,4194304] 0 2024-09-13T02:50:57.785 INFO:tasks.workunit.client.1.smithi122.stdout:7/875: rmdir d4/d8/db/dc/d1b/d49/da0/d111 0 2024-09-13T02:50:57.786 INFO:tasks.workunit.client.1.smithi122.stdout:0/879: symlink d1/d5/d10/d29/d32/d5f/l12a 0 2024-09-13T02:50:57.786 INFO:tasks.workunit.client.1.smithi122.stdout:0/880: readlink d1/d5/d10/d29/d118/l45 0 2024-09-13T02:50:57.787 INFO:tasks.workunit.client.1.smithi122.stdout:8/797: creat d3/ff5 x:0 0 0 2024-09-13T02:50:57.791 INFO:tasks.workunit.client.1.smithi122.stdout:6/927: symlink d5/d3d/da3/l115 0 2024-09-13T02:50:57.794 INFO:tasks.workunit.client.1.smithi122.stdout:7/876: mkdir d4/d8/d3d/dc2/d129 0 2024-09-13T02:50:57.794 INFO:tasks.workunit.client.1.smithi122.stdout:7/877: dread - d4/d8/db/dc/d46/f127 zero size 2024-09-13T02:50:57.794 INFO:tasks.workunit.client.1.smithi122.stdout:6/928: dread d5/d3d/d6c/d41/d5b/d7d/ddd/d26/f5c [0,4194304] 0 2024-09-13T02:50:57.795 INFO:tasks.workunit.client.1.smithi122.stdout:7/878: truncate d4/d8/f7 3791189 0 2024-09-13T02:50:57.795 INFO:tasks.workunit.client.1.smithi122.stdout:7/879: write d4/d8/db/f11 [93934,100524] 0 2024-09-13T02:50:57.797 INFO:tasks.workunit.client.1.smithi122.stdout:6/929: unlink d5/d3d/d6c/d41/lc5 0 2024-09-13T02:50:57.797 INFO:tasks.workunit.client.1.smithi122.stdout:6/930: creat d5/d3d/d6c/d41/d4e/f116 x:0 0 0 2024-09-13T02:50:57.798 INFO:tasks.workunit.client.1.smithi122.stdout:0/881: dread d1/d4b/fde [0,4194304] 0 2024-09-13T02:50:57.798 INFO:tasks.workunit.client.1.smithi122.stdout:0/882: stat d1/f73 0 2024-09-13T02:50:57.801 INFO:tasks.workunit.client.1.smithi122.stdout:8/798: read d3/d53/d4d/fb5 [3586219,97183] 0 2024-09-13T02:50:57.803 INFO:tasks.workunit.client.1.smithi122.stdout:0/883: rename d1/d5/d10/d29/d118/f79 to d1/d5/d10/f12b 0 2024-09-13T02:50:57.804 INFO:tasks.workunit.client.1.smithi122.stdout:5/837: dwrite d0/da/d48/db4/f10d [0,4194304] 0 2024-09-13T02:50:57.804 INFO:tasks.workunit.client.1.smithi122.stdout:5/838: getdents d0/da/dbf 0 2024-09-13T02:50:57.804 INFO:tasks.workunit.client.1.smithi122.stdout:8/799: link d3/d31/d52/fb4 d3/da/d1e/ff6 0 2024-09-13T02:50:57.805 INFO:tasks.workunit.client.1.smithi122.stdout:0/884: creat d1/d11a/da/d92/d94/f12c x:0 0 0 2024-09-13T02:50:57.809 INFO:tasks.workunit.client.1.smithi122.stdout:7/880: dread d4/d6d/d8c/f105 [0,4194304] 0 2024-09-13T02:50:57.809 INFO:tasks.workunit.client.1.smithi122.stdout:7/881: readlink d4/d4e/d5d/ld8 0 2024-09-13T02:50:57.811 INFO:tasks.workunit.client.1.smithi122.stdout:2/820: symlink d0/d1c/l10c 0 2024-09-13T02:50:57.812 INFO:tasks.workunit.client.1.smithi122.stdout:2/821: fdatasync d0/d1e/d2e/d5a/f94 0 2024-09-13T02:50:57.814 INFO:tasks.workunit.client.1.smithi122.stdout:7/882: mkdir d4/d4e/d110/d12a 0 2024-09-13T02:50:57.820 INFO:tasks.workunit.client.1.smithi122.stdout:8/800: dread f2 [0,4194304] 0 2024-09-13T02:50:57.822 INFO:tasks.workunit.client.1.smithi122.stdout:0/885: dread d1/d11a/da/f75 [0,4194304] 0 2024-09-13T02:50:57.822 INFO:tasks.workunit.client.1.smithi122.stdout:8/801: mkdir d3/d31/d65/de4/df7 0 2024-09-13T02:50:57.823 INFO:tasks.workunit.client.1.smithi122.stdout:2/822: dread d0/f51 [0,4194304] 0 2024-09-13T02:50:57.826 INFO:tasks.workunit.client.1.smithi122.stdout:0/886: symlink d1/d5/d10/d29/d32/d83/db3/df4/dfa/l12d 0 2024-09-13T02:50:57.830 INFO:tasks.workunit.client.1.smithi122.stdout:8/802: mknod d3/da/d1e/cf8 0 2024-09-13T02:50:57.830 INFO:tasks.workunit.client.1.smithi122.stdout:8/803: creat d3/d53/d21/ff9 x:0 0 0 2024-09-13T02:50:57.831 INFO:tasks.workunit.client.1.smithi122.stdout:2/823: unlink d0/d55/f62 0 2024-09-13T02:50:57.832 INFO:tasks.workunit.client.1.smithi122.stdout:5/839: dwrite d0/d17/d36/d25/d2b/f2c [0,4194304] 0 2024-09-13T02:50:57.832 INFO:tasks.workunit.client.1.smithi122.stdout:7/883: dwrite d4/d4e/f73 [0,4194304] 0 2024-09-13T02:50:57.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/824: symlink d0/d1e/d92/l10d 0 2024-09-13T02:50:57.836 INFO:tasks.workunit.client.1.smithi122.stdout:0/887: read d1/d11a/da/d92/d94/f1f [839377,26459] 0 2024-09-13T02:50:57.836 INFO:tasks.workunit.client.1.smithi122.stdout:9/917: sync 2024-09-13T02:50:57.837 INFO:tasks.workunit.client.1.smithi122.stdout:1/876: sync 2024-09-13T02:50:57.837 INFO:tasks.workunit.client.1.smithi122.stdout:3/927: sync 2024-09-13T02:50:57.837 INFO:tasks.workunit.client.1.smithi122.stdout:1/877: chown dc/de/d18/d22/d1c/f87 3066 1 2024-09-13T02:50:57.837 INFO:tasks.workunit.client.1.smithi122.stdout:3/928: write d4/d4c/f51 [1687076,40615] 0 2024-09-13T02:50:57.837 INFO:tasks.workunit.client.1.smithi122.stdout:5/840: dread - d0/d17/d36/d25/fe3 zero size 2024-09-13T02:50:57.841 INFO:tasks.workunit.client.1.smithi122.stdout:7/884: mknod d4/d4e/d5d/d6b/db4/c12b 0 2024-09-13T02:50:57.845 INFO:tasks.workunit.client.1.smithi122.stdout:0/888: creat d1/d5/d10/d29/d118/d69/d85/f12e x:0 0 0 2024-09-13T02:50:57.849 INFO:tasks.workunit.client.1.smithi122.stdout:9/918: creat d8/d16/d3d/d59/f113 x:0 0 0 2024-09-13T02:50:57.851 INFO:tasks.workunit.client.1.smithi122.stdout:3/929: stat d4/d11/dd/d21/d2b/d36/d3c/d43/d60/f79 0 2024-09-13T02:50:57.852 INFO:tasks.workunit.client.1.smithi122.stdout:5/841: creat d0/da/dbf/f115 x:0 0 0 2024-09-13T02:50:57.855 INFO:tasks.workunit.client.1.smithi122.stdout:1/878: dwrite dc/de/d18/d1d/f53 [4194304,4194304] 0 2024-09-13T02:50:57.855 INFO:tasks.workunit.client.1.smithi122.stdout:7/885: unlink d4/d8/d3d/dc2/fff 0 2024-09-13T02:50:57.855 INFO:tasks.workunit.client.1.smithi122.stdout:7/886: fdatasync d4/d6d/d8c/dc3/f7f 0 2024-09-13T02:50:57.856 INFO:tasks.workunit.client.1.smithi122.stdout:0/889: creat d1/d11a/da/d92/f12f x:0 0 0 2024-09-13T02:50:57.856 INFO:tasks.workunit.client.1.smithi122.stdout:0/890: chown d1/d11a/da/d92/d94/c5b 7 1 2024-09-13T02:50:57.857 INFO:tasks.workunit.client.1.smithi122.stdout:9/919: mkdir d8/d16/d3d/d114 0 2024-09-13T02:50:57.859 INFO:tasks.workunit.client.1.smithi122.stdout:3/930: link d4/d6/df/l8e d4/d11/dd/d21/d2b/dcf/l15d 0 2024-09-13T02:50:57.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/842: creat d0/da/d48/db4/dc8/f116 x:0 0 0 2024-09-13T02:50:57.862 INFO:tasks.workunit.client.1.smithi122.stdout:2/825: dwrite d0/d1e/d2e/d3e/f5b [4194304,4194304] 0 2024-09-13T02:50:57.862 INFO:tasks.workunit.client.1.smithi122.stdout:7/887: symlink d4/d8/db7/d102/dcb/l12c 0 2024-09-13T02:50:57.862 INFO:tasks.workunit.client.1.smithi122.stdout:7/888: creat d4/d8/db7/f12d x:0 0 0 2024-09-13T02:50:57.862 INFO:tasks.workunit.client.1.smithi122.stdout:7/889: truncate d4/d8/d3d/d7e/f128 198550 0 2024-09-13T02:50:57.863 INFO:tasks.workunit.client.1.smithi122.stdout:0/891: creat d1/d5/d2d/db4/ddc/df0/dba/f130 x:0 0 0 2024-09-13T02:50:57.867 INFO:tasks.workunit.client.1.smithi122.stdout:5/843: rename d0/da/d48/d63/d98/lf0 to d0/da/d48/dd3/d106/l117 0 2024-09-13T02:50:57.867 INFO:tasks.workunit.client.1.smithi122.stdout:5/844: fsync d0/d17/d36/d3f/fae 0 2024-09-13T02:50:57.869 INFO:tasks.workunit.client.1.smithi122.stdout:7/890: creat d4/d4e/d110/d12a/f12e x:0 0 0 2024-09-13T02:50:57.870 INFO:tasks.workunit.client.1.smithi122.stdout:3/931: write d4/d11/dd/d21/f28 [366301,75768] 0 2024-09-13T02:50:57.871 INFO:tasks.workunit.client.1.smithi122.stdout:0/892: rmdir d1/d5/d2d/db4/ddc/df0/d60/de9 39 2024-09-13T02:50:57.871 INFO:tasks.workunit.client.1.smithi122.stdout:0/893: fsync d1/d5/f13 0 2024-09-13T02:50:57.872 INFO:tasks.workunit.client.1.smithi122.stdout:3/932: unlink d4/d4c/dd3/lcc 0 2024-09-13T02:50:57.872 INFO:tasks.workunit.client.1.smithi122.stdout:3/933: chown d4/d11/dd/d21/d2b/d36/d3c 5693127 1 2024-09-13T02:50:57.872 INFO:tasks.workunit.client.1.smithi122.stdout:3/934: stat d4/d11/dd/d21/d74/d11b 0 2024-09-13T02:50:57.873 INFO:tasks.workunit.client.1.smithi122.stdout:3/935: unlink d4/d11/dd/d21/f4d 0 2024-09-13T02:50:57.874 INFO:tasks.workunit.client.1.smithi122.stdout:2/826: dread d0/d1e/d2e/f97 [0,4194304] 0 2024-09-13T02:50:57.876 INFO:tasks.workunit.client.1.smithi122.stdout:2/827: creat d0/d1e/d2e/d8a/f10e x:0 0 0 2024-09-13T02:50:57.876 INFO:tasks.workunit.client.1.smithi122.stdout:7/891: dread d4/d6d/d8c/f105 [0,4194304] 0 2024-09-13T02:50:57.876 INFO:tasks.workunit.client.1.smithi122.stdout:7/892: fsync d4/d77/fdb 0 2024-09-13T02:50:57.879 INFO:tasks.workunit.client.1.smithi122.stdout:7/893: mknod d4/d6d/da6/df2/c12f 0 2024-09-13T02:50:57.882 INFO:tasks.workunit.client.1.smithi122.stdout:2/828: rename d0/d53 to d0/d1e/d26/d3d/d84/ddb/d10f 0 2024-09-13T02:50:57.884 INFO:tasks.workunit.client.1.smithi122.stdout:2/829: mknod d0/d55/d70/d59/dd2/c110 0 2024-09-13T02:50:57.887 INFO:tasks.workunit.client.1.smithi122.stdout:2/830: truncate d0/d55/d70/d59/f6e 5213464 0 2024-09-13T02:50:57.892 INFO:tasks.workunit.client.1.smithi122.stdout:9/920: dwrite d8/d16/f108 [0,4194304] 0 2024-09-13T02:50:57.893 INFO:tasks.workunit.client.1.smithi122.stdout:1/879: dwrite dc/d38/d51/f79 [0,4194304] 0 2024-09-13T02:50:57.893 INFO:tasks.workunit.client.1.smithi122.stdout:1/880: readlink dc/d38/d51/l7c 0 2024-09-13T02:50:57.893 INFO:tasks.workunit.client.1.smithi122.stdout:1/881: readlink dc/d38/db1/d72/dd7/d3f/l41 0 2024-09-13T02:50:57.896 INFO:tasks.workunit.client.1.smithi122.stdout:9/921: getdents d8/d16/d3e/d57 0 2024-09-13T02:50:57.896 INFO:tasks.workunit.client.1.smithi122.stdout:9/922: dread - d8/d16/d3d/d59/d23/d7b/d82/da3/fcc zero size 2024-09-13T02:50:57.897 INFO:tasks.workunit.client.1.smithi122.stdout:1/882: dread dc/d38/db1/d7d/f84 [0,4194304] 0 2024-09-13T02:50:57.900 INFO:tasks.workunit.client.1.smithi122.stdout:9/923: rmdir d8/d16/d3d/d59/d23/d7b/d82/da3 39 2024-09-13T02:50:57.900 INFO:tasks.workunit.client.1.smithi122.stdout:9/924: write d8/d88/fe0 [809788,85252] 0 2024-09-13T02:50:57.900 INFO:tasks.workunit.client.1.smithi122.stdout:9/925: stat d8/d16/d3d/d59/f113 0 2024-09-13T02:50:57.902 INFO:tasks.workunit.client.1.smithi122.stdout:2/831: write d0/d1c/d3b/d41/d6a/f49 [2311097,59379] 0 2024-09-13T02:50:57.902 INFO:tasks.workunit.client.1.smithi122.stdout:9/926: mkdir d8/d115 0 2024-09-13T02:50:57.905 INFO:tasks.workunit.client.1.smithi122.stdout:3/936: dwrite d4/d11/d38/f9c [4194304,4194304] 0 2024-09-13T02:50:57.905 INFO:tasks.workunit.client.1.smithi122.stdout:0/894: dwrite d1/d11a/da/f9c [0,4194304] 0 2024-09-13T02:50:57.905 INFO:tasks.workunit.client.1.smithi122.stdout:0/895: fdatasync d1/d5/d10/d29/d118/ff1 0 2024-09-13T02:50:57.905 INFO:tasks.workunit.client.1.smithi122.stdout:0/896: stat d1/d5/d2d/db4/ddc/df0/d81/l96 0 2024-09-13T02:50:57.907 INFO:tasks.workunit.client.1.smithi122.stdout:7/894: dwrite d4/d6d/d8c/f105 [0,4194304] 0 2024-09-13T02:50:57.907 INFO:tasks.workunit.client.1.smithi122.stdout:2/832: creat d0/d1c/d3b/d41/d4e/d75/d95/dd4/f111 x:0 0 0 2024-09-13T02:50:57.908 INFO:tasks.workunit.client.1.smithi122.stdout:9/927: rmdir d8/d16 39 2024-09-13T02:50:57.908 INFO:tasks.workunit.client.1.smithi122.stdout:9/928: chown d8/d16 1 1 2024-09-13T02:50:57.909 INFO:tasks.workunit.client.1.smithi122.stdout:3/937: dread d4/d11/dd/d21/d6c/fc3 [0,4194304] 0 2024-09-13T02:50:57.911 INFO:tasks.workunit.client.1.smithi122.stdout:0/897: creat d1/d5/d10/d29/d32/d83/db3/df5/f131 x:0 0 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:7/895: link d4/d8/l9 d4/d4e/d110/l130 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:7/896: chown d4/d77 1707 1 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:7/897: read d4/d8/db/dc/f3b [1806753,80333] 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:7/898: creat d4/d4e/d110/d12a/f131 x:0 0 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:7/899: fdatasync d4/d8/db/dc/d1b/d49/fa8 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:2/833: symlink d0/d55/daf/l112 0 2024-09-13T02:50:57.915 INFO:tasks.workunit.client.1.smithi122.stdout:2/834: truncate d0/d1c/d3b/d41/f3f 4496775 0 2024-09-13T02:50:57.916 INFO:tasks.workunit.client.1.smithi122.stdout:9/929: creat d8/d16/d3d/d59/d29/d90/dc8/f116 x:0 0 0 2024-09-13T02:50:57.916 INFO:tasks.workunit.client.1.smithi122.stdout:9/930: write d8/d16/d3d/d59/d23/d7b/d82/f95 [314428,114039] 0 2024-09-13T02:50:57.918 INFO:tasks.workunit.client.1.smithi122.stdout:3/938: unlink d4/d11/f105 0 2024-09-13T02:50:57.919 INFO:tasks.workunit.client.1.smithi122.stdout:1/883: dwrite dc/de/d18/f75 [0,4194304] 0 2024-09-13T02:50:57.921 INFO:tasks.workunit.client.1.smithi122.stdout:2/835: unlink d0/d55/lae 0 2024-09-13T02:50:57.921 INFO:tasks.workunit.client.1.smithi122.stdout:2/836: write d0/f18 [1331400,11603] 0 2024-09-13T02:50:57.921 INFO:tasks.workunit.client.1.smithi122.stdout:9/931: mknod d8/d16/d3e/c117 0 2024-09-13T02:50:57.922 INFO:tasks.workunit.client.1.smithi122.stdout:9/932: chown d8/c5e 274970 1 2024-09-13T02:50:57.923 INFO:tasks.workunit.client.1.smithi122.stdout:3/939: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/l15e 0 2024-09-13T02:50:57.923 INFO:tasks.workunit.client.1.smithi122.stdout:3/940: fsync d4/f73 0 2024-09-13T02:50:57.926 INFO:tasks.workunit.client.1.smithi122.stdout:2/837: rename d0/d1e/d22/c71 to d0/d1e/d26/d3d/d84/ddb/d10f/dc6/dfb/c113 0 2024-09-13T02:50:57.926 INFO:tasks.workunit.client.1.smithi122.stdout:0/898: dread d1/d5/d10/d29/d118/f1b [0,4194304] 0 2024-09-13T02:50:57.926 INFO:tasks.workunit.client.1.smithi122.stdout:9/933: mkdir d8/d16/d3d/d59/d23/d7b/d82/da3/d118 0 2024-09-13T02:50:57.928 INFO:tasks.workunit.client.1.smithi122.stdout:2/838: mkdir d0/d1e/d26/d3d/d114 0 2024-09-13T02:50:57.931 INFO:tasks.workunit.client.1.smithi122.stdout:2/839: rename d0/d1c/d3b/dbf to d0/d55/d70/d59/dfe/d115 0 2024-09-13T02:50:57.932 INFO:tasks.workunit.client.1.smithi122.stdout:1/884: dread dc/de/d18/d1d/f52 [0,4194304] 0 2024-09-13T02:50:57.933 INFO:tasks.workunit.client.1.smithi122.stdout:2/840: mkdir d0/d1e/d2e/d3e/d116 0 2024-09-13T02:50:57.935 INFO:tasks.workunit.client.1.smithi122.stdout:7/900: dwrite d4/d8/db/f38 [0,4194304] 0 2024-09-13T02:50:57.936 INFO:tasks.workunit.client.1.smithi122.stdout:1/885: unlink dc/d38/db1/f8c 0 2024-09-13T02:50:57.937 INFO:tasks.workunit.client.1.smithi122.stdout:2/841: mkdir d0/d1c/d3b/d41/d4e/d75/d117 0 2024-09-13T02:50:57.937 INFO:tasks.workunit.client.1.smithi122.stdout:9/934: read d8/d16/f2b [737996,19474] 0 2024-09-13T02:50:57.937 INFO:tasks.workunit.client.1.smithi122.stdout:1/886: dread dc/de/d18/d1d/f85 [0,4194304] 0 2024-09-13T02:50:57.939 INFO:tasks.workunit.client.1.smithi122.stdout:7/901: symlink d4/l132 0 2024-09-13T02:50:57.939 INFO:tasks.workunit.client.1.smithi122.stdout:7/902: chown d4/d8/d3d/ca5 63786 1 2024-09-13T02:50:57.940 INFO:tasks.workunit.client.1.smithi122.stdout:9/935: mknod d8/d16/d3d/c119 0 2024-09-13T02:50:57.940 INFO:tasks.workunit.client.1.smithi122.stdout:9/936: write d8/d16/d3d/d59/d23/d7b/d82/da3/da7/fc6 [414847,24819] 0 2024-09-13T02:50:57.952 INFO:tasks.workunit.client.1.smithi122.stdout:2/842: write d0/d1e/f38 [1679109,40056] 0 2024-09-13T02:50:57.952 INFO:tasks.workunit.client.1.smithi122.stdout:0/899: dwrite d1/d5/d10/f5e [0,4194304] 0 2024-09-13T02:50:57.953 INFO:tasks.workunit.client.1.smithi122.stdout:1/887: dread dc/f9c [0,4194304] 0 2024-09-13T02:50:57.953 INFO:tasks.workunit.client.1.smithi122.stdout:1/888: chown dc/de/d18/d1d/f85 0 1 2024-09-13T02:50:57.953 INFO:tasks.workunit.client.1.smithi122.stdout:0/900: chown d1/d11a/da/d7d 7969102 1 2024-09-13T02:50:57.954 INFO:tasks.workunit.client.1.smithi122.stdout:2/843: unlink d0/d1c/d3b/d41/d4e/d75/cfc 0 2024-09-13T02:50:57.954 INFO:tasks.workunit.client.1.smithi122.stdout:2/844: write d0/f1b [2887813,96896] 0 2024-09-13T02:50:57.955 INFO:tasks.workunit.client.1.smithi122.stdout:3/941: dwrite d4/d11/dd/d21/d4e/df7/ffc [0,4194304] 0 2024-09-13T02:50:57.955 INFO:tasks.workunit.client.1.smithi122.stdout:3/942: truncate d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/f10a 736914 0 2024-09-13T02:50:57.958 INFO:tasks.workunit.client.1.smithi122.stdout:2/845: symlink d0/d1e/d2e/d3e/d116/l118 0 2024-09-13T02:50:57.961 INFO:tasks.workunit.client.1.smithi122.stdout:0/901: dread d1/d5/d10/f7b [0,4194304] 0 2024-09-13T02:50:57.962 INFO:tasks.workunit.client.1.smithi122.stdout:3/943: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f112 [621558,124642] 0 2024-09-13T02:50:57.971 INFO:tasks.workunit.client.1.smithi122.stdout:0/902: write d1/d11a/da/ff [2617881,8427] 0 2024-09-13T02:50:57.971 INFO:tasks.workunit.client.1.smithi122.stdout:0/903: chown d1/d5/d2d/db4/ddc/df0/d60/faa 54450 1 2024-09-13T02:50:57.972 INFO:tasks.workunit.client.1.smithi122.stdout:2/846: write d0/d1e/d26/f30 [2458846,111834] 0 2024-09-13T02:50:57.973 INFO:tasks.workunit.client.1.smithi122.stdout:7/903: dwrite d4/d8/db7/fd9 [0,4194304] 0 2024-09-13T02:50:57.973 INFO:tasks.workunit.client.1.smithi122.stdout:9/937: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T02:50:57.973 INFO:tasks.workunit.client.1.smithi122.stdout:9/938: write d8/d16/d3d/d59/d23/d7b/d82/fbb [35519,19821] 0 2024-09-13T02:50:57.974 INFO:tasks.workunit.client.1.smithi122.stdout:1/889: dwrite dc/de/f27 [0,4194304] 0 2024-09-13T02:50:57.975 INFO:tasks.workunit.client.1.smithi122.stdout:0/904: rmdir d1/d5/d2d/db4/ddc 39 2024-09-13T02:50:57.975 INFO:tasks.workunit.client.1.smithi122.stdout:3/944: read d4/d6/f47 [1517121,111405] 0 2024-09-13T02:50:57.985 INFO:tasks.workunit.client.1.smithi122.stdout:7/904: truncate d4/d8/f7 2172773 0 2024-09-13T02:50:57.988 INFO:tasks.workunit.client.1.smithi122.stdout:9/939: mknod d8/d16/d3d/d59/d49/c11a 0 2024-09-13T02:50:57.991 INFO:tasks.workunit.client.1.smithi122.stdout:0/905: creat d1/d4b/f132 x:0 0 0 2024-09-13T02:50:57.993 INFO:tasks.workunit.client.1.smithi122.stdout:7/905: symlink d4/d6d/d8f/l133 0 2024-09-13T02:50:58.000 INFO:tasks.workunit.client.1.smithi122.stdout:2/847: dwrite d0/d1e/d26/dbd/ff6 [0,4194304] 0 2024-09-13T02:50:58.000 INFO:tasks.workunit.client.1.smithi122.stdout:3/945: dwrite d4/d11/d38/f70 [0,4194304] 0 2024-09-13T02:50:58.003 INFO:tasks.workunit.client.1.smithi122.stdout:9/940: creat d8/d16/d3d/d59/d23/d1f/d36/f11b x:0 0 0 2024-09-13T02:50:58.005 INFO:tasks.workunit.client.1.smithi122.stdout:1/890: getdents dc/d38/db1/db2 0 2024-09-13T02:50:58.005 INFO:tasks.workunit.client.1.smithi122.stdout:1/891: stat dc/de/d18/d22/f31 0 2024-09-13T02:50:58.008 INFO:tasks.workunit.client.1.smithi122.stdout:7/906: creat d4/d8/f134 x:0 0 0 2024-09-13T02:50:58.008 INFO:tasks.workunit.client.1.smithi122.stdout:7/907: truncate d4/d77/fa2 1719796 0 2024-09-13T02:50:58.010 INFO:tasks.workunit.client.1.smithi122.stdout:7/908: dread d4/d4e/d5d/d6b/f8d [0,4194304] 0 2024-09-13T02:50:58.010 INFO:tasks.workunit.client.1.smithi122.stdout:7/909: chown d4/d8/db7/d102/df9/f123 0 1 2024-09-13T02:50:58.013 INFO:tasks.workunit.client.1.smithi122.stdout:2/848: unlink d0/d1c/f5e 0 2024-09-13T02:50:58.013 INFO:tasks.workunit.client.1.smithi122.stdout:2/849: dread - d0/d1e/d26/d3d/d84/fbb zero size 2024-09-13T02:50:58.014 INFO:tasks.workunit.client.1.smithi122.stdout:2/850: fsync d0/d1e/d22/f32 0 2024-09-13T02:50:58.014 INFO:tasks.workunit.client.1.smithi122.stdout:2/851: chown d0/d1e/d26/d3d/l67 16227606 1 2024-09-13T02:50:58.016 INFO:tasks.workunit.client.1.smithi122.stdout:9/941: dwrite d8/d16/d3d/d59/d23/d1f/d36/f11b [0,4194304] 0 2024-09-13T02:50:58.018 INFO:tasks.workunit.client.1.smithi122.stdout:3/946: getdents d4/d6 0 2024-09-13T02:50:58.029 INFO:tasks.workunit.client.1.smithi122.stdout:1/892: symlink dc/de/d18/d22/d1c/l124 0 2024-09-13T02:50:58.030 INFO:tasks.workunit.client.1.smithi122.stdout:1/893: getdents dc/de/dd0 0 2024-09-13T02:50:58.030 INFO:tasks.workunit.client.1.smithi122.stdout:1/894: write dc/de/d18/d22/f31 [578909,98127] 0 2024-09-13T02:50:58.031 INFO:tasks.workunit.client.1.smithi122.stdout:7/910: mkdir d4/d4e/d5d/d6b/db4/d135 0 2024-09-13T02:50:58.034 INFO:tasks.workunit.client.1.smithi122.stdout:2/852: dwrite d0/d1e/d26/dbd/ff6 [0,4194304] 0 2024-09-13T02:50:58.036 INFO:tasks.workunit.client.1.smithi122.stdout:3/947: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/f15f x:0 0 0 2024-09-13T02:50:58.037 INFO:tasks.workunit.client.1.smithi122.stdout:3/948: dread d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/f10a [0,4194304] 0 2024-09-13T02:50:58.037 INFO:tasks.workunit.client.1.smithi122.stdout:1/895: mkdir dc/de/d18/d1d/d2f/d94/d98/d125 0 2024-09-13T02:50:58.038 INFO:tasks.workunit.client.1.smithi122.stdout:1/896: dread dc/de/d18/d1d/f73 [0,4194304] 0 2024-09-13T02:50:58.038 INFO:tasks.workunit.client.1.smithi122.stdout:7/911: write d4/d6d/f120 [3868203,70514] 0 2024-09-13T02:50:58.039 INFO:tasks.workunit.client.1.smithi122.stdout:2/853: rmdir d0 39 2024-09-13T02:50:58.041 INFO:tasks.workunit.client.1.smithi122.stdout:3/949: mknod d4/d11/dd/d21/d2b/d36/c160 0 2024-09-13T02:50:58.043 INFO:tasks.workunit.client.1.smithi122.stdout:1/897: creat dc/f126 x:0 0 0 2024-09-13T02:50:58.043 INFO:tasks.workunit.client.1.smithi122.stdout:1/898: write dc/d38/db1/db2/fdb [536829,106976] 0 2024-09-13T02:50:58.043 INFO:tasks.workunit.client.1.smithi122.stdout:1/899: write dc/de/d18/d22/f11c [86941,22576] 0 2024-09-13T02:50:58.043 INFO:tasks.workunit.client.1.smithi122.stdout:1/900: creat dc/de/d18/d22/f127 x:0 0 0 2024-09-13T02:50:58.047 INFO:tasks.workunit.client.1.smithi122.stdout:1/901: creat dc/d38/db1/d72/f128 x:0 0 0 2024-09-13T02:50:58.048 INFO:tasks.workunit.client.1.smithi122.stdout:2/854: dread d0/d1c/f31 [0,4194304] 0 2024-09-13T02:50:58.049 INFO:tasks.workunit.client.1.smithi122.stdout:2/855: creat d0/d1c/d3b/d41/d8c/f119 x:0 0 0 2024-09-13T02:50:58.058 INFO:tasks.workunit.client.1.smithi122.stdout:3/950: dwrite d4/d11/dd/d21/d2b/d36/d3c/d9e/f13f [0,4194304] 0 2024-09-13T02:50:58.059 INFO:tasks.workunit.client.1.smithi122.stdout:3/951: chown d4/d4c/dd3/lae 1733 1 2024-09-13T02:50:58.061 INFO:tasks.workunit.client.1.smithi122.stdout:3/952: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/d161 0 2024-09-13T02:50:58.061 INFO:tasks.workunit.client.1.smithi122.stdout:3/953: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/fa5 194014 1 2024-09-13T02:50:58.061 INFO:tasks.workunit.client.1.smithi122.stdout:3/954: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/l162 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:3/955: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d90/d163 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:1/902: write dc/de/d18/d86/f11b [3544826,15833] 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:1/903: stat dc/de/d18/d86/f11b 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:7/912: dwrite d4/d77/fd7 [0,4194304] 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:3/956: mknod d4/d11/dd/d21/d2b/dcf/d15a/c164 0 2024-09-13T02:50:58.063 INFO:tasks.workunit.client.1.smithi122.stdout:1/904: mkdir dc/de/d18/d1d/d129 0 2024-09-13T02:50:58.066 INFO:tasks.workunit.client.1.smithi122.stdout:2/856: dwrite d0/d1e/d2e/d5a/fd6 [4194304,4194304] 0 2024-09-13T02:50:58.067 INFO:tasks.workunit.client.1.smithi122.stdout:2/857: readlink d0/d1c/l35 0 2024-09-13T02:50:58.067 INFO:tasks.workunit.client.1.smithi122.stdout:7/913: truncate d4/d8/db/dc/d46/f4f 4987370 0 2024-09-13T02:50:58.069 INFO:tasks.workunit.client.1.smithi122.stdout:1/905: unlink dc/d38/d51/f8f 0 2024-09-13T02:50:58.069 INFO:tasks.workunit.client.1.smithi122.stdout:1/906: fsync dc/de/d18/d1d/f53 0 2024-09-13T02:50:58.073 INFO:tasks.workunit.client.1.smithi122.stdout:2/858: creat d0/d55/daf/f11a x:0 0 0 2024-09-13T02:50:58.073 INFO:tasks.workunit.client.1.smithi122.stdout:2/859: dread - d0/d55/d70/fe5 zero size 2024-09-13T02:50:58.073 INFO:tasks.workunit.client.1.smithi122.stdout:7/914: truncate d4/d8/db/dc/d46/f90 214088 0 2024-09-13T02:50:58.073 INFO:tasks.workunit.client.1.smithi122.stdout:7/915: fsync d4/d8/d3d/d7e/f128 0 2024-09-13T02:50:58.074 INFO:tasks.workunit.client.1.smithi122.stdout:7/916: chown d4/d8/db/dc/c12 4036691 1 2024-09-13T02:50:58.074 INFO:tasks.workunit.client.1.smithi122.stdout:1/907: truncate dc/de/f11 882552 0 2024-09-13T02:50:58.078 INFO:tasks.workunit.client.1.smithi122.stdout:7/917: unlink d4/d8/db/dc/d46/l4c 0 2024-09-13T02:50:58.080 INFO:tasks.workunit.client.1.smithi122.stdout:3/957: dwrite d4/d4c/dd3/f6b [0,4194304] 0 2024-09-13T02:50:58.085 INFO:tasks.workunit.client.1.smithi122.stdout:7/918: unlink d4/d77/la7 0 2024-09-13T02:50:58.085 INFO:tasks.workunit.client.1.smithi122.stdout:7/919: write d4/d8/db/dc/f22 [1542760,37460] 0 2024-09-13T02:50:58.087 INFO:tasks.workunit.client.1.smithi122.stdout:3/958: truncate d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f112 653927 0 2024-09-13T02:50:58.089 INFO:tasks.workunit.client.1.smithi122.stdout:1/908: dread dc/d38/db1/d72/dd7/d46/f70 [0,4194304] 0 2024-09-13T02:50:58.089 INFO:tasks.workunit.client.1.smithi122.stdout:1/909: truncate dc/d38/db1/d72/dd7/d46/f92 978097 0 2024-09-13T02:50:58.089 INFO:tasks.workunit.client.1.smithi122.stdout:1/910: dread - dc/de/d18/d22/ffa zero size 2024-09-13T02:50:58.090 INFO:tasks.workunit.client.1.smithi122.stdout:2/860: rename d0/d1e/d2e/d8a/d99 to d0/d1e/d22/d29/d11b 0 2024-09-13T02:50:58.096 INFO:tasks.workunit.client.1.smithi122.stdout:3/959: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/d109/l165 0 2024-09-13T02:50:58.096 INFO:tasks.workunit.client.1.smithi122.stdout:3/960: chown d4/d11/dd/d21/d30 54167 1 2024-09-13T02:50:58.098 INFO:tasks.workunit.client.1.smithi122.stdout:1/911: creat dc/de/d18/df1/f12a x:0 0 0 2024-09-13T02:50:58.102 INFO:tasks.workunit.client.1.smithi122.stdout:7/920: rename d4/d4e/d5d/d6b/db4/c12b to d4/d8/db/dc/d1b/c136 0 2024-09-13T02:50:58.104 INFO:tasks.workunit.client.1.smithi122.stdout:2/861: dwrite d0/d1e/d26/f30 [12582912,4194304] 0 2024-09-13T02:50:58.105 INFO:tasks.workunit.client.1.smithi122.stdout:3/961: symlink d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/d14d/l166 0 2024-09-13T02:50:58.107 INFO:tasks.workunit.client.1.smithi122.stdout:1/912: unlink dc/de/d18/df1/f12a 0 2024-09-13T02:50:58.110 INFO:tasks.workunit.client.1.smithi122.stdout:7/921: rmdir d4/d8/db/dc/d1b/d49/da0 39 2024-09-13T02:50:58.111 INFO:tasks.workunit.client.1.smithi122.stdout:2/862: creat d0/d1e/d92/de0/f11c x:0 0 0 2024-09-13T02:50:58.113 INFO:tasks.workunit.client.1.smithi122.stdout:3/962: getdents d4/d4c 0 2024-09-13T02:50:58.113 INFO:tasks.workunit.client.1.smithi122.stdout:3/963: read d4/d11/dd/d21/f28 [1029429,16035] 0 2024-09-13T02:50:58.116 INFO:tasks.workunit.client.1.smithi122.stdout:7/922: mknod d4/d8/d3d/dc2/d103/c137 0 2024-09-13T02:50:58.117 INFO:tasks.workunit.client.1.smithi122.stdout:7/923: chown d4/d6d/d8f/f9e 5021631 1 2024-09-13T02:50:58.117 INFO:tasks.workunit.client.1.smithi122.stdout:2/863: symlink d0/d1e/d2e/d3e/d116/l11d 0 2024-09-13T02:50:58.117 INFO:tasks.workunit.client.1.smithi122.stdout:2/864: write d0/d1c/f7a [521975,44962] 0 2024-09-13T02:50:58.117 INFO:tasks.workunit.client.1.smithi122.stdout:2/865: fsync d0/d1e/d2e/d3e/f5b 0 2024-09-13T02:50:58.123 INFO:tasks.workunit.client.1.smithi122.stdout:3/964: read d4/d11/dd/f65 [888636,1410] 0 2024-09-13T02:50:58.125 INFO:tasks.workunit.client.1.smithi122.stdout:1/913: dwrite dc/de/d18/d1d/d2f/fe8 [0,4194304] 0 2024-09-13T02:50:58.128 INFO:tasks.workunit.client.1.smithi122.stdout:7/924: creat d4/d8/db/dc/d1b/d49/da0/f138 x:0 0 0 2024-09-13T02:50:58.129 INFO:tasks.workunit.client.1.smithi122.stdout:2/866: unlink d0/d1e/d22/l2a 0 2024-09-13T02:50:58.131 INFO:tasks.workunit.client.1.smithi122.stdout:1/914: rmdir dc/d38/db1/d72/dd7/d46 39 2024-09-13T02:50:58.133 INFO:tasks.workunit.client.1.smithi122.stdout:2/867: unlink d0/d1e/f9b 0 2024-09-13T02:50:58.135 INFO:tasks.workunit.client.1.smithi122.stdout:3/965: dread d4/d4c/dd3/f6b [0,4194304] 0 2024-09-13T02:50:58.135 INFO:tasks.workunit.client.1.smithi122.stdout:3/966: chown d4/d11/l1d 866 1 2024-09-13T02:50:58.135 INFO:tasks.workunit.client.1.smithi122.stdout:1/915: rmdir dc/d38/db1/d72/dd7 39 2024-09-13T02:50:58.136 INFO:tasks.workunit.client.1.smithi122.stdout:1/916: creat dc/de/d18/d1d/d129/f12b x:0 0 0 2024-09-13T02:50:58.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/925: dread d4/d8/db7/d102/ffb [0,4194304] 0 2024-09-13T02:50:58.140 INFO:tasks.workunit.client.1.smithi122.stdout:7/926: chown d4/d8/d24/lac 92297071 1 2024-09-13T02:50:58.144 INFO:tasks.workunit.client.1.smithi122.stdout:1/917: rename dc/de/d18/d86/da7 to dc/de/d7a/d12c 0 2024-09-13T02:50:58.144 INFO:tasks.workunit.client.1.smithi122.stdout:1/918: readlink dc/d38/db1/d72/dd7/d46/db7/lbf 0 2024-09-13T02:50:58.150 INFO:tasks.workunit.client.1.smithi122.stdout:7/927: rename d4/d8/db/dc/d1b/d49/da0/f138 to d4/d8/d24/f139 0 2024-09-13T02:50:58.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/928: rmdir d4/d8/db/dc/d1b 39 2024-09-13T02:50:58.154 INFO:tasks.workunit.client.1.smithi122.stdout:7/929: creat d4/d8/d24/d47/f13a x:0 0 0 2024-09-13T02:50:58.163 INFO:tasks.workunit.client.1.smithi122.stdout:3/967: dwrite d4/d11/dd/d21/d2b/d36/d3c/d43/da3/f116 [0,4194304] 0 2024-09-13T02:50:58.167 INFO:tasks.workunit.client.1.smithi122.stdout:1/919: dwrite dc/de/d18/fb3 [0,4194304] 0 2024-09-13T02:50:58.168 INFO:tasks.workunit.client.1.smithi122.stdout:3/968: rename d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/f128 to d4/d11/dd/df1/f167 0 2024-09-13T02:50:58.168 INFO:tasks.workunit.client.1.smithi122.stdout:3/969: chown d4/d6/de/d41/f7d 947 1 2024-09-13T02:50:58.169 INFO:tasks.workunit.client.1.smithi122.stdout:3/970: write d4/d11/dd/d21/d2b/d36/d3c/ffb [597822,123149] 0 2024-09-13T02:50:58.173 INFO:tasks.workunit.client.1.smithi122.stdout:3/971: link d4/d11/dd/f65 d4/d6/f168 0 2024-09-13T02:50:58.176 INFO:tasks.workunit.client.1.smithi122.stdout:7/930: dwrite d4/d8/db/dc/f72 [0,4194304] 0 2024-09-13T02:50:58.182 INFO:tasks.workunit.client.1.smithi122.stdout:1/920: dwrite dc/de/d18/d1d/f85 [0,4194304] 0 2024-09-13T02:50:58.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:57 smithi122 ceph-mon[34559]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 152 MiB/s rd, 179 MiB/s wr, 312 op/s 2024-09-13T02:50:58.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:57 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:58.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:57 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:58.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/804: sync 2024-09-13T02:50:58.191 INFO:tasks.workunit.client.1.smithi122.stdout:5/845: sync 2024-09-13T02:50:58.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/805: chown d3/d31/d52/d89/lb0 114 1 2024-09-13T02:50:58.191 INFO:tasks.workunit.client.1.smithi122.stdout:8/806: read d3/d53/d4d/fb5 [3271078,20270] 0 2024-09-13T02:50:58.192 INFO:tasks.workunit.client.1.smithi122.stdout:5/846: creat d0/da/d8c/d8f/da0/dba/f118 x:0 0 0 2024-09-13T02:50:58.192 INFO:tasks.workunit.client.1.smithi122.stdout:6/931: sync 2024-09-13T02:50:58.193 INFO:tasks.workunit.client.1.smithi122.stdout:5/847: dread d0/d17/d36/d25/d2b/f30 [0,4194304] 0 2024-09-13T02:50:58.194 INFO:tasks.workunit.client.1.smithi122.stdout:6/932: mknod d5/d3d/d6c/d41/d4e/d93/c117 0 2024-09-13T02:50:58.194 INFO:tasks.workunit.client.1.smithi122.stdout:6/933: write d5/d11/f75 [578558,36753] 0 2024-09-13T02:50:58.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/934: creat d5/d40/f118 x:0 0 0 2024-09-13T02:50:58.195 INFO:tasks.workunit.client.1.smithi122.stdout:6/935: write d5/d3d/f77 [1458796,33711] 0 2024-09-13T02:50:58.196 INFO:tasks.workunit.client.1.smithi122.stdout:6/936: mknod d5/db/dc/d10c/c119 0 2024-09-13T02:50:58.197 INFO:tasks.workunit.client.1.smithi122.stdout:6/937: link d5/d11/d3a/lee d5/d3d/d6c/d41/d5b/d97/l11a 0 2024-09-13T02:50:58.197 INFO:tasks.workunit.client.1.smithi122.stdout:6/938: dread - d5/db/d29/d60/fff zero size 2024-09-13T02:50:58.197 INFO:tasks.workunit.client.1.smithi122.stdout:6/939: dread - d5/d3d/d6c/d41/d4e/d93/dd4/ff4 zero size 2024-09-13T02:50:58.198 INFO:tasks.workunit.client.1.smithi122.stdout:6/940: mkdir d5/d11/d45/d21/d11b 0 2024-09-13T02:50:58.200 INFO:tasks.workunit.client.1.smithi122.stdout:6/941: truncate d5/d3d/d6c/d41/ff7 3121772 0 2024-09-13T02:50:58.200 INFO:tasks.workunit.client.1.smithi122.stdout:6/942: readlink d5/leb 0 2024-09-13T02:50:58.200 INFO:tasks.workunit.client.1.smithi122.stdout:6/943: chown d5/f5a 1133670814 1 2024-09-13T02:50:58.200 INFO:tasks.workunit.client.1.smithi122.stdout:6/944: dread - d5/db/d29/d60/dac/fe9 zero size 2024-09-13T02:50:58.203 INFO:tasks.workunit.client.1.smithi122.stdout:8/807: read d3/da/d1e/f47 [4771461,66720] 0 2024-09-13T02:50:58.203 INFO:tasks.workunit.client.1.smithi122.stdout:8/808: chown d3/d31/d65/de4/df7 657679109 1 2024-09-13T02:50:58.203 INFO:tasks.workunit.client.1.smithi122.stdout:8/809: chown d3/d31/d52/d59/f3c 1830 1 2024-09-13T02:50:58.205 INFO:tasks.workunit.client.1.smithi122.stdout:8/810: link d3/da6/lba d3/d31/d52/lfa 0 2024-09-13T02:50:58.205 INFO:tasks.workunit.client.1.smithi122.stdout:8/811: chown d3/da/d1f/f29 205764 1 2024-09-13T02:50:58.206 INFO:tasks.workunit.client.1.smithi122.stdout:8/812: rmdir d3/d31/d65/de4 39 2024-09-13T02:50:58.208 INFO:tasks.workunit.client.1.smithi122.stdout:8/813: mknod d3/d53/d4d/cfb 0 2024-09-13T02:50:58.210 INFO:tasks.workunit.client.1.smithi122.stdout:8/814: link d3/d53/d34/d94/ca2 d3/d53/d34/dbf/dcb/d76/cfc 0 2024-09-13T02:50:58.214 INFO:tasks.workunit.client.1.smithi122.stdout:5/848: read d0/d17/d36/d8b/f9d [2590484,125856] 0 2024-09-13T02:50:58.216 INFO:tasks.workunit.client.1.smithi122.stdout:5/849: symlink d0/d17/d36/d99/l119 0 2024-09-13T02:50:58.216 INFO:tasks.workunit.client.1.smithi122.stdout:5/850: creat d0/d17/d36/d3f/de7/f11a x:0 0 0 2024-09-13T02:50:58.217 INFO:tasks.workunit.client.1.smithi122.stdout:3/972: dwrite d4/d11/dd/d21/d2b/d36/fd6 [0,4194304] 0 2024-09-13T02:50:58.219 INFO:tasks.workunit.client.1.smithi122.stdout:1/921: dwrite dc/d38/db1/d7d/f83 [0,4194304] 0 2024-09-13T02:50:58.219 INFO:tasks.workunit.client.1.smithi122.stdout:7/931: dwrite d4/d8/db/f38 [4194304,4194304] 0 2024-09-13T02:50:58.219 INFO:tasks.workunit.client.1.smithi122.stdout:7/932: fdatasync d4/d8/db/f38 0 2024-09-13T02:50:58.220 INFO:tasks.workunit.client.1.smithi122.stdout:6/945: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d26/ffa [0,4194304] 0 2024-09-13T02:50:58.220 INFO:tasks.workunit.client.1.smithi122.stdout:5/851: mkdir d0/d17/d36/d3f/d4c/d113/d11b 0 2024-09-13T02:50:58.225 INFO:tasks.workunit.client.1.smithi122.stdout:3/973: mkdir d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d169 0 2024-09-13T02:50:58.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/946: creat d5/d3d/d6c/d41/d5b/f11c x:0 0 0 2024-09-13T02:50:58.228 INFO:tasks.workunit.client.1.smithi122.stdout:6/947: stat d5/d3d/d6c/d41 0 2024-09-13T02:50:58.229 INFO:tasks.workunit.client.1.smithi122.stdout:3/974: getdents d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9 0 2024-09-13T02:50:58.229 INFO:tasks.workunit.client.1.smithi122.stdout:3/975: creat d4/d11/dd/d21/d2b/d36/d3c/f16a x:0 0 0 2024-09-13T02:50:58.229 INFO:tasks.workunit.client.1.smithi122.stdout:3/976: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d90/fa7 0 1 2024-09-13T02:50:58.229 INFO:tasks.workunit.client.1.smithi122.stdout:3/977: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/f16b x:0 0 0 2024-09-13T02:50:58.229 INFO:tasks.workunit.client.1.smithi122.stdout:7/933: getdents d4/d8/d24/daa 0 2024-09-13T02:50:58.230 INFO:tasks.workunit.client.1.smithi122.stdout:6/948: creat d5/d11/d45/d21/f11d x:0 0 0 2024-09-13T02:50:58.232 INFO:tasks.workunit.client.1.smithi122.stdout:7/934: getdents d4/d8/db7/d102/dcb 0 2024-09-13T02:50:58.232 INFO:tasks.workunit.client.1.smithi122.stdout:7/935: chown d4/d6d/d8f/f92 217606 1 2024-09-13T02:50:58.233 INFO:tasks.workunit.client.1.smithi122.stdout:6/949: link d5/d11/d45/f78 d5/d3d/d6c/d41/d4e/d5f/df8/f11e 0 2024-09-13T02:50:58.234 INFO:tasks.workunit.client.1.smithi122.stdout:6/950: fsync d5/d3d/d6c/f7f 0 2024-09-13T02:50:58.248 INFO:tasks.workunit.client.1.smithi122.stdout:3/978: dread d4/fb7 [0,4194304] 0 2024-09-13T02:50:58.248 INFO:tasks.workunit.client.1.smithi122.stdout:3/979: write d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/ff6 [1021613,59606] 0 2024-09-13T02:50:58.248 INFO:tasks.workunit.client.1.smithi122.stdout:3/980: chown d4/d6/de/d1f/c78 14440 1 2024-09-13T02:50:58.248 INFO:tasks.workunit.client.1.smithi122.stdout:3/981: chown d4/d4c/dd3/fde 31337 1 2024-09-13T02:50:58.250 INFO:tasks.workunit.client.1.smithi122.stdout:3/982: unlink d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/c10b 0 2024-09-13T02:50:58.268 INFO:tasks.workunit.client.1.smithi122.stdout:7/936: dread d4/d8/d3d/dc2/fdd [0,4194304] 0 2024-09-13T02:50:58.270 INFO:tasks.workunit.client.1.smithi122.stdout:7/937: getdents d4/d8/db/dc/d46 0 2024-09-13T02:50:58.271 INFO:tasks.workunit.client.1.smithi122.stdout:7/938: rename d4/d8/l58 to d4/d8/d3d/dc2/d103/l13b 0 2024-09-13T02:50:58.271 INFO:tasks.workunit.client.1.smithi122.stdout:7/939: readlink d4/d8/db/dc/d46/lfa 0 2024-09-13T02:50:58.275 INFO:tasks.workunit.client.1.smithi122.stdout:1/922: dwrite dc/de/f27 [0,4194304] 0 2024-09-13T02:50:58.276 INFO:tasks.workunit.client.1.smithi122.stdout:5/852: dwrite d0/d17/d36/d3f/de7/f11a [0,4194304] 0 2024-09-13T02:50:58.276 INFO:tasks.workunit.client.1.smithi122.stdout:5/853: chown d0/da/d8c/d8f/df7/d102/l10e 35342 1 2024-09-13T02:50:58.276 INFO:tasks.workunit.client.1.smithi122.stdout:1/923: creat dc/de/d18/d1d/d129/f12d x:0 0 0 2024-09-13T02:50:58.276 INFO:tasks.workunit.client.1.smithi122.stdout:1/924: write dc/de/d18/d22/d1c/d57/f102 [1003834,126319] 0 2024-09-13T02:50:58.276 INFO:tasks.workunit.client.1.smithi122.stdout:1/925: truncate dc/de/d18/d86/f100 528403 0 2024-09-13T02:50:58.278 INFO:tasks.workunit.client.1.smithi122.stdout:8/815: dwrite d3/d31/d52/d89/db1/fc0 [0,4194304] 0 2024-09-13T02:50:58.278 INFO:tasks.workunit.client.1.smithi122.stdout:6/951: dwrite d5/db/dc/fb4 [0,4194304] 0 2024-09-13T02:50:58.279 INFO:tasks.workunit.client.1.smithi122.stdout:3/983: write d4/d11/dd/d21/d2b/d36/d3c/d43/d82/f10f [5412284,34339] 0 2024-09-13T02:50:58.280 INFO:tasks.workunit.client.1.smithi122.stdout:5/854: symlink d0/da/d48/db4/df3/l11c 0 2024-09-13T02:50:58.282 INFO:tasks.workunit.client.1.smithi122.stdout:1/926: mkdir dc/de/d7a/d12e 0 2024-09-13T02:50:58.293 INFO:tasks.workunit.client.1.smithi122.stdout:8/816: truncate d3/d53/d21/d92/fcc 3134299 0 2024-09-13T02:50:58.297 INFO:tasks.workunit.client.1.smithi122.stdout:6/952: link d5/d40/f35 d5/d40/dcd/f11f 0 2024-09-13T02:50:58.298 INFO:tasks.workunit.client.1.smithi122.stdout:6/953: write d5/db/d29/ffe [682827,66859] 0 2024-09-13T02:50:58.298 INFO:tasks.workunit.client.1.smithi122.stdout:3/984: creat d4/d11/dd/d21/f16c x:0 0 0 2024-09-13T02:50:58.299 INFO:tasks.workunit.client.1.smithi122.stdout:5/855: mknod d0/da/d8c/d8f/c11d 0 2024-09-13T02:50:58.300 INFO:tasks.workunit.client.1.smithi122.stdout:7/940: dwrite d4/d6d/d8c/dc3/f7f [0,4194304] 0 2024-09-13T02:50:58.301 INFO:tasks.workunit.client.1.smithi122.stdout:6/954: creat d5/d3d/da3/dcb/f120 x:0 0 0 2024-09-13T02:50:58.302 INFO:tasks.workunit.client.1.smithi122.stdout:3/985: mknod d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/df9/c16d 0 2024-09-13T02:50:58.302 INFO:tasks.workunit.client.1.smithi122.stdout:3/986: chown d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/fa5 4928 1 2024-09-13T02:50:58.302 INFO:tasks.workunit.client.1.smithi122.stdout:3/987: fsync d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/f10a 0 2024-09-13T02:50:58.303 INFO:tasks.workunit.client.1.smithi122.stdout:1/927: dwrite dc/de/d18/d22/d1c/fba [0,4194304] 0 2024-09-13T02:50:58.303 INFO:tasks.workunit.client.1.smithi122.stdout:5/856: mkdir d0/d17/d36/d3f/d11e 0 2024-09-13T02:50:58.303 INFO:tasks.workunit.client.1.smithi122.stdout:5/857: fdatasync d0/d17/d36/d8b/fa5 0 2024-09-13T02:50:58.303 INFO:tasks.workunit.client.1.smithi122.stdout:5/858: truncate d0/d2/f1b 5801385 0 2024-09-13T02:50:58.309 INFO:tasks.workunit.client.1.smithi122.stdout:7/941: unlink d4/d6d/d8f/de7/c104 0 2024-09-13T02:50:58.309 INFO:tasks.workunit.client.1.smithi122.stdout:6/955: mknod d5/d11/d45/d21/d8a/c121 0 2024-09-13T02:50:58.309 INFO:tasks.workunit.client.1.smithi122.stdout:6/956: truncate d5/db/f105 758666 0 2024-09-13T02:50:58.309 INFO:tasks.workunit.client.1.smithi122.stdout:3/988: creat d4/d11/dd/d21/d2b/d55/f16e x:0 0 0 2024-09-13T02:50:58.311 INFO:tasks.workunit.client.1.smithi122.stdout:1/928: symlink dc/de/d18/d22/d1c/d10d/l12f 0 2024-09-13T02:50:58.311 INFO:tasks.workunit.client.1.smithi122.stdout:1/929: chown dc/d38/d51/daf 1237847 1 2024-09-13T02:50:58.313 INFO:tasks.workunit.client.1.smithi122.stdout:5/859: rename d0/da/d8c/d8f/df7/f101 to d0/d17/d36/d3f/d4c/d113/d11b/f11f 0 2024-09-13T02:50:58.317 INFO:tasks.workunit.client.1.smithi122.stdout:7/942: mknod d4/d8/db/dc/d36/c13c 0 2024-09-13T02:50:58.317 INFO:tasks.workunit.client.1.smithi122.stdout:1/930: rename dc/de/d7a/d12e to dc/d38/db1/d72/d123/d130 0 2024-09-13T02:50:58.319 INFO:tasks.workunit.client.1.smithi122.stdout:8/817: dwrite f2 [0,4194304] 0 2024-09-13T02:50:58.321 INFO:tasks.workunit.client.1.smithi122.stdout:1/931: creat dc/d38/db1/d72/dd7/f131 x:0 0 0 2024-09-13T02:50:58.329 INFO:tasks.workunit.client.1.smithi122.stdout:5/860: write d0/d17/d36/d3f/de7/f11a [4729960,99711] 0 2024-09-13T02:50:58.331 INFO:tasks.workunit.client.1.smithi122.stdout:5/861: getdents d0/d17/d36/d25 0 2024-09-13T02:50:58.331 INFO:tasks.workunit.client.1.smithi122.stdout:5/862: dread - d0/d17/d36/d3f/d4c/d113/d11b/f11f zero size 2024-09-13T02:50:58.332 INFO:tasks.workunit.client.1.smithi122.stdout:1/932: rename dc/de/d18/d1d to dc/d38/db1/deb/d132 0 2024-09-13T02:50:58.335 INFO:tasks.workunit.client.1.smithi122.stdout:7/943: dread d4/d6d/d8c/f99 [0,4194304] 0 2024-09-13T02:50:58.335 INFO:tasks.workunit.client.1.smithi122.stdout:7/944: chown d4/d8/d24/cde 3819022 1 2024-09-13T02:50:58.337 INFO:tasks.workunit.client.1.smithi122.stdout:7/945: unlink d4/d6d/ffd 0 2024-09-13T02:50:58.337 INFO:tasks.workunit.client.1.smithi122.stdout:7/946: fdatasync d4/d4e/d5d/d6b/db4/f10a 0 2024-09-13T02:50:58.338 INFO:tasks.workunit.client.1.smithi122.stdout:3/989: dwrite d4/d11/dd/d21/d2b/f143 [0,4194304] 0 2024-09-13T02:50:58.340 INFO:tasks.workunit.client.1.smithi122.stdout:6/957: dwrite d5/d3d/d6c/d41/d5b/d7d/ddd/d26/f5c [0,4194304] 0 2024-09-13T02:50:58.351 INFO:tasks.workunit.client.1.smithi122.stdout:5/863: write d0/d2/f6d [2075363,114296] 0 2024-09-13T02:50:58.351 INFO:tasks.workunit.client.1.smithi122.stdout:5/864: stat d0/d17/d36/d25/fb5 0 2024-09-13T02:50:58.353 INFO:tasks.workunit.client.1.smithi122.stdout:8/818: dwrite d3/d53/d34/f49 [0,4194304] 0 2024-09-13T02:50:58.353 INFO:tasks.workunit.client.1.smithi122.stdout:8/819: chown d3/d53/d34/lb9 624 1 2024-09-13T02:50:58.357 INFO:tasks.workunit.client.1.smithi122.stdout:8/820: symlink d3/d31/d52/d89/db1/lfd 0 2024-09-13T02:50:58.357 INFO:tasks.workunit.client.1.smithi122.stdout:8/821: chown d3/da/d1e/f47 227 1 2024-09-13T02:50:58.358 INFO:tasks.workunit.client.1.smithi122.stdout:8/822: stat d3/d31/f99 0 2024-09-13T02:50:58.358 INFO:tasks.workunit.client.1.smithi122.stdout:8/823: write d3/d53/d4d/fb5 [3177378,6749] 0 2024-09-13T02:50:58.358 INFO:tasks.workunit.client.1.smithi122.stdout:8/824: write d3/da/f9b [669662,130467] 0 2024-09-13T02:50:58.362 INFO:tasks.workunit.client.1.smithi122.stdout:0/906: sync 2024-09-13T02:50:58.362 INFO:tasks.workunit.client.1.smithi122.stdout:9/942: sync 2024-09-13T02:50:58.362 INFO:tasks.workunit.client.1.smithi122.stdout:8/825: mkdir d3/d31/d52/d89/d8b/d5c/dfe 0 2024-09-13T02:50:58.364 INFO:tasks.workunit.client.1.smithi122.stdout:9/943: truncate f1 8323097 0 2024-09-13T02:50:58.367 INFO:tasks.workunit.client.1.smithi122.stdout:0/907: creat d1/d11a/da/f133 x:0 0 0 2024-09-13T02:50:58.367 INFO:tasks.workunit.client.1.smithi122.stdout:2/868: sync 2024-09-13T02:50:58.369 INFO:tasks.workunit.client.1.smithi122.stdout:8/826: getdents d3/d53/d34/dbf/dcb/d76 0 2024-09-13T02:50:58.372 INFO:tasks.workunit.client.1.smithi122.stdout:0/908: truncate d1/d11a/da/d92/d94/fd3 7363680 0 2024-09-13T02:50:58.376 INFO:tasks.workunit.client.1.smithi122.stdout:0/909: creat d1/d5/d10/d29/d32/d5f/f134 x:0 0 0 2024-09-13T02:50:58.376 INFO:tasks.workunit.client.1.smithi122.stdout:0/910: chown d1/d5/d10/la5 203 1 2024-09-13T02:50:58.379 INFO:tasks.workunit.client.1.smithi122.stdout:0/911: creat d1/d5/d10/d29/d118/f135 x:0 0 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:2/869: dread d0/d1c/d3b/d41/d4e/fe4 [0,4194304] 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:2/870: getdents d0/d1c/d3b/d41/d4e/d75/d117 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:2/871: write d0/d1c/f7a [1338972,89655] 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:7/947: dwrite d4/d8/db/d63/dbb/ff5 [0,4194304] 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:2/872: write d0/d1e/d22/f45 [2111455,76731] 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:3/990: dwrite d4/d6/de/d1f/f138 [0,4194304] 0 2024-09-13T02:50:58.380 INFO:tasks.workunit.client.1.smithi122.stdout:3/991: creat d4/d11/dd/d21/d4e/df7/f16f x:0 0 0 2024-09-13T02:50:58.381 INFO:tasks.workunit.client.1.smithi122.stdout:1/933: dwrite dc/d38/db1/d72/dd7/f9a [4194304,4194304] 0 2024-09-13T02:50:58.381 INFO:tasks.workunit.client.1.smithi122.stdout:6/958: dwrite d5/d3d/d48/f6b [0,4194304] 0 2024-09-13T02:50:58.382 INFO:tasks.workunit.client.1.smithi122.stdout:0/912: mkdir d1/d5/d10/d29/d32/d83/db3/df5/d11c/d136 0 2024-09-13T02:50:58.385 INFO:tasks.workunit.client.1.smithi122.stdout:5/865: getdents d0/da/d8c/d8f/df7 0 2024-09-13T02:50:58.385 INFO:tasks.workunit.client.1.smithi122.stdout:5/866: readlink d0/d2/l59 0 2024-09-13T02:50:58.387 INFO:tasks.workunit.client.1.smithi122.stdout:2/873: mkdir d0/d1c/d3b/d41/d4e/d75/d95/dd4/d11e 0 2024-09-13T02:50:58.388 INFO:tasks.workunit.client.1.smithi122.stdout:2/874: chown d0/d1c/d3b/f102 31 1 2024-09-13T02:50:58.393 INFO:tasks.workunit.client.1.smithi122.stdout:7/948: write d4/d6d/da6/dbf/db1/f9b [1674060,93234] 0 2024-09-13T02:50:58.394 INFO:tasks.workunit.client.1.smithi122.stdout:9/944: dwrite d8/d16/f2b [4194304,4194304] 0 2024-09-13T02:50:58.396 INFO:tasks.workunit.client.1.smithi122.stdout:3/992: mknod d4/c170 0 2024-09-13T02:50:58.400 INFO:tasks.workunit.client.1.smithi122.stdout:1/934: symlink dc/de/d18/d22/d1c/d10d/l133 0 2024-09-13T02:50:58.403 INFO:tasks.workunit.client.1.smithi122.stdout:1/935: dread dc/d38/db1/d72/dd7/d3f/f7f [0,4194304] 0 2024-09-13T02:50:58.403 INFO:tasks.workunit.client.1.smithi122.stdout:1/936: creat dc/de/d18/f134 x:0 0 0 2024-09-13T02:50:58.406 INFO:tasks.workunit.client.1.smithi122.stdout:5/867: mknod d0/da/c120 0 2024-09-13T02:50:58.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/875: readlink d0/d5d/l74 0 2024-09-13T02:50:58.417 INFO:tasks.workunit.client.1.smithi122.stdout:8/827: dwrite d3/d31/d52/d89/db1/fd0 [0,4194304] 0 2024-09-13T02:50:58.418 INFO:tasks.workunit.client.1.smithi122.stdout:9/945: rmdir d8/d115 0 2024-09-13T02:50:58.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:57 smithi100 ceph-mon[27894]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 152 MiB/s rd, 179 MiB/s wr, 312 op/s 2024-09-13T02:50:58.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:57 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:58.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:57 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:50:58.428 INFO:tasks.workunit.client.1.smithi122.stdout:2/876: mknod d0/d1e/d22/d29/d11b/dcf/c11f 0 2024-09-13T02:50:58.438 INFO:tasks.workunit.client.1.smithi122.stdout:3/993: rmdir d4/d11/dd/df1 39 2024-09-13T02:50:58.439 INFO:tasks.workunit.client.1.smithi122.stdout:7/949: dwrite d4/d6d/da6/df2/f124 [0,4194304] 0 2024-09-13T02:50:58.440 INFO:tasks.workunit.client.1.smithi122.stdout:0/913: rename d1/d5/d2d to d1/d11a/da/d92/d94/d137 0 2024-09-13T02:50:58.444 INFO:tasks.workunit.client.1.smithi122.stdout:7/950: write d4/d8/d3d/dc2/dca/fdf [2349242,59268] 0 2024-09-13T02:50:58.446 INFO:tasks.workunit.client.1.smithi122.stdout:1/937: dwrite dc/d38/f6a [0,4194304] 0 2024-09-13T02:50:58.447 INFO:tasks.workunit.client.1.smithi122.stdout:1/938: dread - dc/de/d7a/f10e zero size 2024-09-13T02:50:58.447 INFO:tasks.workunit.client.1.smithi122.stdout:9/946: dwrite d8/d16/d45/dc4/fde [0,4194304] 0 2024-09-13T02:50:58.447 INFO:tasks.workunit.client.1.smithi122.stdout:8/828: dwrite d3/da/f10 [0,4194304] 0 2024-09-13T02:50:58.447 INFO:tasks.workunit.client.1.smithi122.stdout:8/829: fdatasync d3/d53/d21/f98 0 2024-09-13T02:50:58.447 INFO:tasks.workunit.client.1.smithi122.stdout:5/868: rename d0/d17/d3a/f9f to d0/da/d8c/f121 0 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/914: symlink d1/d5/d10/d29/d32/d83/db3/d119/l138 0 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/915: chown d1/d11a/f25 1594 1 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/916: write d1/d11a/da/d92/d94/fd3 [8275771,90848] 0 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/917: write d1/d11a/da/d92/d94/d137/db4/ddc/df0/d81/f89 [644992,112081] 0 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/918: truncate d1/d5/d10/d29/d118/d69/d85/ff7 401112 0 2024-09-13T02:50:58.453 INFO:tasks.workunit.client.1.smithi122.stdout:0/919: stat d1/d11a/da/d92/d94/d137/db4 0 2024-09-13T02:50:58.454 INFO:tasks.workunit.client.1.smithi122.stdout:3/994: getdents d4/d6/de 0 2024-09-13T02:50:58.461 INFO:tasks.workunit.client.1.smithi122.stdout:3/995: dread d4/d11/dd/d21/f75 [4194304,4194304] 0 2024-09-13T02:50:58.463 INFO:tasks.workunit.client.1.smithi122.stdout:7/951: unlink d4/d8/d24/daa/l11d 0 2024-09-13T02:50:58.465 INFO:tasks.workunit.client.1.smithi122.stdout:1/939: symlink dc/d38/d51/daf/d105/l135 0 2024-09-13T02:50:58.469 INFO:tasks.workunit.client.1.smithi122.stdout:9/947: truncate d8/d16/d3d/db5/ff2 935585 0 2024-09-13T02:50:58.470 INFO:tasks.workunit.client.1.smithi122.stdout:5/869: creat d0/d17/d36/f122 x:0 0 0 2024-09-13T02:50:58.471 INFO:tasks.workunit.client.1.smithi122.stdout:5/870: creat d0/da/f123 x:0 0 0 2024-09-13T02:50:58.473 INFO:tasks.workunit.client.1.smithi122.stdout:2/877: rename d0/d1c/cc4 to d0/d1c/d3b/d41/d4e/d75/d95/c120 0 2024-09-13T02:50:58.485 INFO:tasks.workunit.client.1.smithi122.stdout:8/830: dwrite d3/d31/d52/f5b [4194304,4194304] 0 2024-09-13T02:50:58.485 INFO:tasks.workunit.client.1.smithi122.stdout:8/831: write d3/da/d1e/f8f [1131609,60649] 0 2024-09-13T02:50:58.485 INFO:tasks.workunit.client.1.smithi122.stdout:0/920: dwrite d1/d11a/da/d92/d94/f12c [0,4194304] 0 2024-09-13T02:50:58.485 INFO:tasks.workunit.client.1.smithi122.stdout:0/921: readlink d1/d11a/da/d92/d94/d137/db4/ddc/df0/d81/lad 0 2024-09-13T02:50:58.488 INFO:tasks.workunit.client.1.smithi122.stdout:1/940: dread dc/de/d18/d22/d76/fd4 [0,4194304] 0 2024-09-13T02:50:58.496 INFO:tasks.workunit.client.1.smithi122.stdout:8/832: dread d3/d31/d52/d89/db1/fc0 [0,4194304] 0 2024-09-13T02:50:58.496 INFO:tasks.workunit.client.1.smithi122.stdout:3/996: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/dd5/d103/f171 x:0 0 0 2024-09-13T02:50:58.497 INFO:tasks.workunit.client.1.smithi122.stdout:9/948: creat d8/d16/f11c x:0 0 0 2024-09-13T02:50:58.503 INFO:tasks.workunit.client.1.smithi122.stdout:5/871: symlink d0/da/d48/db4/d95/l124 0 2024-09-13T02:50:58.506 INFO:tasks.workunit.client.1.smithi122.stdout:2/878: creat d0/d1e/d26/d3d/d84/ddb/d10f/dc6/dfb/f121 x:0 0 0 2024-09-13T02:50:58.506 INFO:tasks.workunit.client.1.smithi122.stdout:2/879: read d0/f10 [2304515,107905] 0 2024-09-13T02:50:58.521 INFO:tasks.workunit.client.1.smithi122.stdout:0/922: stat d1/d11a/da/d92/d94/d137/l78 0 2024-09-13T02:50:58.526 INFO:tasks.workunit.client.1.smithi122.stdout:1/941: truncate dc/de/d18/d86/f11b 3253799 0 2024-09-13T02:50:58.527 INFO:tasks.workunit.client.1.smithi122.stdout:8/833: creat d3/d31/fff x:0 0 0 2024-09-13T02:50:58.528 INFO:tasks.workunit.client.1.smithi122.stdout:0/923: dread d1/d5/d10/f7b [0,4194304] 0 2024-09-13T02:50:58.529 INFO:tasks.workunit.client.1.smithi122.stdout:3/997: creat d4/d11/dd/d21/d4e/dc8/f172 x:0 0 0 2024-09-13T02:50:58.530 INFO:tasks.workunit.client.1.smithi122.stdout:8/834: dread d3/d31/f6e [0,4194304] 0 2024-09-13T02:50:58.531 INFO:tasks.workunit.client.1.smithi122.stdout:8/835: chown d3/da/d1f/f63 901 1 2024-09-13T02:50:58.534 INFO:tasks.workunit.client.1.smithi122.stdout:9/949: mknod d8/d16/d3d/d59/d29/d90/c11d 0 2024-09-13T02:50:58.537 INFO:tasks.workunit.client.1.smithi122.stdout:5/872: link d0/da/d8c/lc0 d0/d17/d36/d3f/d4c/l125 0 2024-09-13T02:50:58.541 INFO:tasks.workunit.client.1.smithi122.stdout:2/880: creat d0/dc0/dde/f122 x:0 0 0 2024-09-13T02:50:58.541 INFO:tasks.workunit.client.1.smithi122.stdout:0/924: dread d1/f38 [0,4194304] 0 2024-09-13T02:50:58.541 INFO:tasks.workunit.client.1.smithi122.stdout:0/925: chown d1/d11a/da/d92/d94/d137/db4/ddc/df0/d60/fb1 0 1 2024-09-13T02:50:58.547 INFO:tasks.workunit.client.1.smithi122.stdout:1/942: creat dc/d38/db1/d72/dd7/d46/db7/f136 x:0 0 0 2024-09-13T02:50:58.550 INFO:tasks.workunit.client.1.smithi122.stdout:3/998: creat d4/d11/dd/d21/d2b/d36/d3c/d9e/dec/dee/d161/f173 x:0 0 0 2024-09-13T02:50:58.554 INFO:tasks.workunit.client.1.smithi122.stdout:9/950: rename c7 to d8/d16/d3e/c11e 0 2024-09-13T02:50:58.557 INFO:tasks.workunit.client.1.smithi122.stdout:5/873: creat d0/d17/d36/d3f/d4c/d7f/dd1/f126 x:0 0 0 2024-09-13T02:50:58.557 INFO:tasks.workunit.client.1.smithi122.stdout:8/836: dwrite d3/d31/d52/d89/ff2 [0,4194304] 0 2024-09-13T02:50:58.557 INFO:tasks.workunit.client.1.smithi122.stdout:8/837: truncate d3/da6/fb3 592402 0 2024-09-13T02:50:58.559 INFO:tasks.workunit.client.1.smithi122.stdout:2/881: mknod d0/d1c/d3b/d41/d4e/d90/df9/c123 0 2024-09-13T02:50:58.561 INFO:tasks.workunit.client.1.smithi122.stdout:1/943: mkdir dc/de/d7a/d12c/d137 0 2024-09-13T02:50:58.563 INFO:tasks.workunit.client.1.smithi122.stdout:3/999: rename d4/d11/dd/d21/d6c/lf4 to d4/d11/dd/d21/d2b/d36/d3c/d9e/da0/de3/d129/d68/d127/d14d/l174 0 2024-09-13T02:50:58.568 INFO:tasks.workunit.client.1.smithi122.stdout:8/838: mkdir d3/d53/d34/d94/d100 0 2024-09-13T02:50:58.572 INFO:tasks.workunit.client.1.smithi122.stdout:0/926: dwrite d1/d5/d10/d29/d32/d5f/f6c [0,4194304] 0 2024-09-13T02:50:58.572 INFO:tasks.workunit.client.1.smithi122.stdout:1/944: creat dc/de/d18/d22/d1c/d10d/f138 x:0 0 0 2024-09-13T02:50:58.574 INFO:tasks.workunit.client.1.smithi122.stdout:8/839: symlink d3/da/l101 0 2024-09-13T02:50:58.576 INFO:tasks.workunit.client.1.smithi122.stdout:9/951: dread d8/d16/d3d/d59/d29/d90/db7/fdf [0,4194304] 0 2024-09-13T02:50:58.576 INFO:tasks.workunit.client.1.smithi122.stdout:9/952: stat d8/d16/d45/l51 0 2024-09-13T02:50:58.578 INFO:tasks.workunit.client.1.smithi122.stdout:5/874: write d0/d17/d36/d3f/de7/f11a [2600210,32654] 0 2024-09-13T02:50:58.584 INFO:tasks.workunit.client.1.smithi122.stdout:0/927: symlink d1/d11a/da/d92/d94/d10d/l139 0 2024-09-13T02:50:58.584 INFO:tasks.workunit.client.1.smithi122.stdout:0/928: creat d1/d5/d10/d29/d32/d83/db3/df4/f13a x:0 0 0 2024-09-13T02:50:58.584 INFO:tasks.workunit.client.1.smithi122.stdout:0/929: stat d1/d5/d10/d29/d32/ccc 0 2024-09-13T02:50:58.586 INFO:tasks.workunit.client.1.smithi122.stdout:1/945: dread dc/de/d18/d22/d1c/d57/f59 [0,4194304] 0 2024-09-13T02:50:58.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/882: dread d0/d5d/f91 [0,4194304] 0 2024-09-13T02:50:58.590 INFO:tasks.workunit.client.1.smithi122.stdout:9/953: creat d8/d16/d3e/d57/df5/f11f x:0 0 0 2024-09-13T02:50:58.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/875: mknod d0/d17/d36/c127 0 2024-09-13T02:50:58.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/876: readlink d0/d17/d36/d3f/de7/l109 0 2024-09-13T02:50:58.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/877: chown d0/d17/d36/d25 6682242 1 2024-09-13T02:50:58.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/878: creat d0/da/dbf/f128 x:0 0 0 2024-09-13T02:50:58.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/879: chown d0/da/d48/db4/df3/l11c 565158 1 2024-09-13T02:50:58.598 INFO:tasks.workunit.client.1.smithi122.stdout:0/930: mknod d1/d5/d10/d29/c13b 0 2024-09-13T02:50:58.599 INFO:tasks.workunit.client.1.smithi122.stdout:1/946: mkdir dc/de/d18/d22/d1c/d47/d139 0 2024-09-13T02:50:58.603 INFO:tasks.workunit.client.1.smithi122.stdout:8/840: dwrite d3/d53/d21/f98 [0,4194304] 0 2024-09-13T02:50:58.605 INFO:tasks.workunit.client.1.smithi122.stdout:2/883: symlink d0/d55/d70/d59/dd2/d106/l124 0 2024-09-13T02:50:58.607 INFO:tasks.workunit.client.1.smithi122.stdout:0/931: read d1/f38 [1076272,54073] 0 2024-09-13T02:50:58.607 INFO:tasks.workunit.client.1.smithi122.stdout:0/932: chown d1/d11a/da/d92/d94/f2c 113267 1 2024-09-13T02:50:58.608 INFO:tasks.workunit.client.1.smithi122.stdout:5/880: mknod d0/d17/d36/d25/d2b/c129 0 2024-09-13T02:50:58.609 INFO:tasks.workunit.client.1.smithi122.stdout:9/954: dwrite d8/f33 [8388608,4194304] 0 2024-09-13T02:50:58.610 INFO:tasks.workunit.client.1.smithi122.stdout:9/955: write d8/d16/d3d/d59/d49/fc5 [106764,5818] 0 2024-09-13T02:50:58.614 INFO:tasks.workunit.client.1.smithi122.stdout:8/841: rename d3/d53/d4d/l9f to d3/d31/d65/l102 0 2024-09-13T02:50:58.614 INFO:tasks.workunit.client.1.smithi122.stdout:8/842: truncate d3/d31/fff 1044099 0 2024-09-13T02:50:58.616 INFO:tasks.workunit.client.1.smithi122.stdout:7/952: sync 2024-09-13T02:50:58.616 INFO:tasks.workunit.client.1.smithi122.stdout:6/959: sync 2024-09-13T02:50:58.616 INFO:tasks.workunit.client.1.smithi122.stdout:6/960: fdatasync d5/d3d/fa7 0 2024-09-13T02:50:58.616 INFO:tasks.workunit.client.1.smithi122.stdout:6/961: dread - d5/db/d29/d60/fff zero size 2024-09-13T02:50:58.616 INFO:tasks.workunit.client.1.smithi122.stdout:2/884: unlink d0/dc0/fd9 0 2024-09-13T02:50:58.617 INFO:tasks.workunit.client.1.smithi122.stdout:0/933: unlink d1/d11a/da/d92/d94/d137/db4/ddc/df0/d81/l96 0 2024-09-13T02:50:58.617 INFO:tasks.workunit.client.1.smithi122.stdout:0/934: chown d1/d5/d10/d29/d32/d83/db3/d119/l138 612214 1 2024-09-13T02:50:58.622 INFO:tasks.workunit.client.1.smithi122.stdout:9/956: mkdir d8/d16/d3d/d59/d29/d90/db7/dd1/d10a/d120 0 2024-09-13T02:50:58.622 INFO:tasks.workunit.client.1.smithi122.stdout:9/957: fsync d8/d16/d3d/d59/d49/fb9 0 2024-09-13T02:50:58.625 INFO:tasks.workunit.client.1.smithi122.stdout:2/885: truncate d0/f51 4163705 0 2024-09-13T02:50:58.626 INFO:tasks.workunit.client.1.smithi122.stdout:2/886: chown d0/d1e/d22/d29/d11b/dcf/dd5 1656030 1 2024-09-13T02:50:58.626 INFO:tasks.workunit.client.1.smithi122.stdout:2/887: write d0/d55/d70/fe5 [1012763,93159] 0 2024-09-13T02:50:58.626 INFO:tasks.workunit.client.1.smithi122.stdout:9/958: truncate d8/d16/d3d/d59/d23/d7b/d82/f95 975582 0 2024-09-13T02:50:58.626 INFO:tasks.workunit.client.1.smithi122.stdout:9/959: truncate d8/d16/d3d/d59/f8c 84504 0 2024-09-13T02:50:58.628 INFO:tasks.workunit.client.1.smithi122.stdout:6/962: symlink d5/db/l122 0 2024-09-13T02:50:58.629 INFO:tasks.workunit.client.1.smithi122.stdout:2/888: stat d0/d1e/d2e/cbe 0 2024-09-13T02:50:58.629 INFO:tasks.workunit.client.1.smithi122.stdout:9/960: symlink d8/d16/d3d/d59/d49/l121 0 2024-09-13T02:50:58.631 INFO:tasks.workunit.client.1.smithi122.stdout:6/963: unlink d5/d3d/d6c/d41/d4e/f116 0 2024-09-13T02:50:58.631 INFO:tasks.workunit.client.1.smithi122.stdout:6/964: read d5/d11/f75 [1009244,124970] 0 2024-09-13T02:50:58.636 INFO:tasks.workunit.client.1.smithi122.stdout:8/843: dread d3/f9 [0,4194304] 0 2024-09-13T02:50:58.636 INFO:tasks.workunit.client.1.smithi122.stdout:8/844: creat d3/f103 x:0 0 0 2024-09-13T02:50:58.636 INFO:tasks.workunit.client.1.smithi122.stdout:1/947: dwrite dc/de/d18/d22/d76/fd4 [0,4194304] 0 2024-09-13T02:50:58.640 INFO:tasks.workunit.client.1.smithi122.stdout:1/948: truncate dc/de/f2e 2361231 0 2024-09-13T02:50:58.642 INFO:tasks.workunit.client.1.smithi122.stdout:1/949: mknod dc/d38/d51/daf/de3/c13a 0 2024-09-13T02:50:58.644 INFO:tasks.workunit.client.1.smithi122.stdout:1/950: symlink dc/d38/d51/daf/de3/l13b 0 2024-09-13T02:50:58.676 INFO:tasks.workunit.client.1.smithi122.stdout:5/881: dwrite d0/d17/d36/d25/d2b/f97 [4194304,4194304] 0 2024-09-13T02:50:58.679 INFO:tasks.workunit.client.1.smithi122.stdout:5/882: mkdir d0/d17/d36/d8b/daf/d12a 0 2024-09-13T02:50:58.681 INFO:tasks.workunit.client.1.smithi122.stdout:5/883: mknod d0/da/d48/d63/c12b 0 2024-09-13T02:50:58.685 INFO:tasks.workunit.client.1.smithi122.stdout:5/884: symlink d0/d17/d36/l12c 0 2024-09-13T02:50:58.685 INFO:tasks.workunit.client.1.smithi122.stdout:5/885: stat d0/d17/d36/d3f/d4c/d7f/dcb/f10b 0 2024-09-13T02:50:58.685 INFO:tasks.workunit.client.1.smithi122.stdout:5/886: fsync d0/d17/d36/d3f/fae 0 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:2/889: dwrite d0/d1e/d2e/d3e/f4b [8388608,4194304] 0 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:0/935: dwrite d1/d11a/fcb [0,4194304] 0 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:0/936: chown d1/d11a/da/cb8 18044493 1 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:2/890: chown d0/d1c/d3b/d41/d4e/dd7 0 1 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:2/891: write d0/f68 [333657,57316] 0 2024-09-13T02:50:58.689 INFO:tasks.workunit.client.1.smithi122.stdout:7/953: dwrite d4/d8/d3d/dc2/f125 [4194304,4194304] 0 2024-09-13T02:50:58.690 INFO:tasks.workunit.client.1.smithi122.stdout:5/887: getdents d0/da/dbf 0 2024-09-13T02:50:58.690 INFO:tasks.workunit.client.1.smithi122.stdout:8/845: dwrite d3/d53/d34/fb7 [0,4194304] 0 2024-09-13T02:50:58.690 INFO:tasks.workunit.client.1.smithi122.stdout:8/846: chown d3/da/d7d/fd5 500599 1 2024-09-13T02:50:58.690 INFO:tasks.workunit.client.1.smithi122.stdout:8/847: chown d3/d31/d52 159738530 1 2024-09-13T02:50:58.690 INFO:tasks.workunit.client.1.smithi122.stdout:1/951: dwrite dc/de/d7a/f10e [0,4194304] 0 2024-09-13T02:50:58.698 INFO:tasks.workunit.client.1.smithi122.stdout:0/937: unlink d1/d11a/da/d7d/fab 0 2024-09-13T02:50:58.698 INFO:tasks.workunit.client.1.smithi122.stdout:0/938: write d1/d5/d10/d29/d32/d5f/f50 [3529935,9779] 0 2024-09-13T02:50:58.698 INFO:tasks.workunit.client.1.smithi122.stdout:0/939: fdatasync d1/d11a/da/d92/d94/f12c 0 2024-09-13T02:50:58.698 INFO:tasks.workunit.client.1.smithi122.stdout:0/940: truncate d1/d5/d10/d29/d118/f135 303585 0 2024-09-13T02:50:58.699 INFO:tasks.workunit.client.1.smithi122.stdout:2/892: getdents d0/d55/d70/d59/dfe 0 2024-09-13T02:50:58.703 INFO:tasks.workunit.client.1.smithi122.stdout:7/954: truncate d4/d8/db/dc/d1b/f34 1057303 0 2024-09-13T02:50:58.708 INFO:tasks.workunit.client.1.smithi122.stdout:1/952: dwrite dc/de/d6e/fac [0,4194304] 0 2024-09-13T02:50:58.714 INFO:tasks.workunit.client.1.smithi122.stdout:9/961: dread d8/d16/d3d/d59/d23/d7b/d82/f95 [0,4194304] 0 2024-09-13T02:50:58.720 INFO:tasks.workunit.client.1.smithi122.stdout:0/941: symlink d1/d11a/da/d92/d94/d10d/l13c 0 2024-09-13T02:50:58.723 INFO:tasks.workunit.client.1.smithi122.stdout:2/893: readlink d0/d1e/d2e/l36 0 2024-09-13T02:50:58.730 INFO:tasks.workunit.client.1.smithi122.stdout:7/955: symlink d4/d8/db7/d102/l13d 0 2024-09-13T02:50:58.733 INFO:tasks.workunit.client.1.smithi122.stdout:8/848: rename d3/d53/d34/dbf to d3/d31/d52/d89/d8b/d104 0 2024-09-13T02:50:58.736 INFO:tasks.workunit.client.1.smithi122.stdout:0/942: rename d1/d5/d10/d29/d118/d69/d85/cd2 to d1/d5/d10/d29/d118/d69/d85/c13d 0 2024-09-13T02:50:58.736 INFO:tasks.workunit.client.1.smithi122.stdout:0/943: truncate d1/d5/d10/d29/d32/d5f/f134 753590 0 2024-09-13T02:50:58.737 INFO:tasks.workunit.client.1.smithi122.stdout:7/956: link d4/d4e/d5d/d6b/db4/f118 d4/d8/d3d/dcd/f13e 0 2024-09-13T02:50:58.740 INFO:tasks.workunit.client.1.smithi122.stdout:2/894: rename d0/d1c/d3b/d41/d4e/d90/f101 to d0/d1e/d22/f125 0 2024-09-13T02:50:58.740 INFO:tasks.workunit.client.1.smithi122.stdout:2/895: chown d0/d55/daf/leb 6 1 2024-09-13T02:50:58.742 INFO:tasks.workunit.client.1.smithi122.stdout:7/957: dread d4/d77/fa2 [0,4194304] 0 2024-09-13T02:50:58.742 INFO:tasks.workunit.client.1.smithi122.stdout:8/849: rename d3/d53/d21/cbe to d3/d53/d21/c105 0 2024-09-13T02:50:58.745 INFO:tasks.workunit.client.1.smithi122.stdout:7/958: mknod d4/d6d/d8c/dc3/c13f 0 2024-09-13T02:50:58.747 INFO:tasks.workunit.client.1.smithi122.stdout:9/962: dwrite d8/d16/d3d/d59/d29/f38 [0,4194304] 0 2024-09-13T02:50:58.748 INFO:tasks.workunit.client.1.smithi122.stdout:9/963: write d8/d16/f2b [2164167,87807] 0 2024-09-13T02:50:58.748 INFO:tasks.workunit.client.1.smithi122.stdout:1/953: dwrite dc/d38/db1/deb/d132/f52 [0,4194304] 0 2024-09-13T02:50:58.748 INFO:tasks.workunit.client.1.smithi122.stdout:8/850: symlink d3/da/d7d/l106 0 2024-09-13T02:50:58.748 INFO:tasks.workunit.client.1.smithi122.stdout:8/851: fsync d3/d31/d52/d89/ff2 0 2024-09-13T02:50:58.749 INFO:tasks.workunit.client.1.smithi122.stdout:0/944: rmdir d1/d5/d10/d29/d32/d83/dd7 39 2024-09-13T02:50:58.749 INFO:tasks.workunit.client.1.smithi122.stdout:0/945: fsync d1/d11a/da/d7d/fb6 0 2024-09-13T02:50:58.753 INFO:tasks.workunit.client.1.smithi122.stdout:2/896: dread d0/f16 [0,4194304] 0 2024-09-13T02:50:58.773 INFO:tasks.workunit.client.1.smithi122.stdout:9/964: rename d8/d16/d3e/c9a to d8/d16/d3d/d59/d29/d90/db7/dbc/c122 0 2024-09-13T02:50:58.774 INFO:tasks.workunit.client.1.smithi122.stdout:1/954: symlink dc/l13c 0 2024-09-13T02:50:58.775 INFO:tasks.workunit.client.1.smithi122.stdout:2/897: dwrite d0/d1e/d26/d3d/d84/fbb [0,4194304] 0 2024-09-13T02:50:58.776 INFO:tasks.workunit.client.1.smithi122.stdout:8/852: symlink d3/d31/l107 0 2024-09-13T02:50:58.779 INFO:tasks.workunit.client.1.smithi122.stdout:7/959: getdents d4/d8/db/dc/d1b/d49/da0 0 2024-09-13T02:50:58.780 INFO:tasks.workunit.client.1.smithi122.stdout:5/888: dwrite d0/da/d48/db4/d95/fbc [0,4194304] 0 2024-09-13T02:50:58.782 INFO:tasks.workunit.client.1.smithi122.stdout:7/960: dread d4/d8/d3d/dc2/dca/ff8 [4194304,4194304] 0 2024-09-13T02:50:58.784 INFO:tasks.workunit.client.1.smithi122.stdout:9/965: symlink d8/d16/d3d/d59/d7d/l123 0 2024-09-13T02:50:58.785 INFO:tasks.workunit.client.1.smithi122.stdout:9/966: write d8/d16/d3d/d59/d7d/ff1 [172038,61081] 0 2024-09-13T02:50:58.785 INFO:tasks.workunit.client.1.smithi122.stdout:9/967: creat d8/d16/f124 x:0 0 0 2024-09-13T02:50:58.788 INFO:tasks.workunit.client.1.smithi122.stdout:1/955: creat dc/d38/db1/d72/d123/d130/f13d x:0 0 0 2024-09-13T02:50:58.794 INFO:tasks.workunit.client.1.smithi122.stdout:5/889: dwrite d0/d17/d3a/f4f [0,4194304] 0 2024-09-13T02:50:58.794 INFO:tasks.workunit.client.1.smithi122.stdout:8/853: link d3/d31/d65/l51 d3/d31/d52/d89/d8b/l108 0 2024-09-13T02:50:58.796 INFO:tasks.workunit.client.1.smithi122.stdout:0/946: getdents d1/d11a/da/d92 0 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/961: getdents d4/d6d/da6/df2/dfc 0 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/962: dread - d4/d8/d24/f139 zero size 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/963: write d4/d8/db7/d102/df9/f123 [899446,16261] 0 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/964: stat d4/f7d 0 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/965: chown d4/d8/db/dc/f61 66 1 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:7/966: getdents d4/d8/db7/d102/dcb 0 2024-09-13T02:50:58.804 INFO:tasks.workunit.client.1.smithi122.stdout:0/947: write d1/d11a/da/d92/d94/d137/db4/ddc/df0/d81/fae [3378538,126413] 0 2024-09-13T02:50:58.808 INFO:tasks.workunit.client.1.smithi122.stdout:2/898: dwrite d0/d1c/d3b/d41/d6a/f72 [0,4194304] 0 2024-09-13T02:50:58.808 INFO:tasks.workunit.client.1.smithi122.stdout:9/968: symlink d8/d16/d3d/d59/d23/d1f/d36/l125 0 2024-09-13T02:50:58.808 INFO:tasks.workunit.client.1.smithi122.stdout:9/969: write d8/d16/d3d/d59/d7d/d83/f112 [958015,102985] 0 2024-09-13T02:50:58.808 INFO:tasks.workunit.client.1.smithi122.stdout:9/970: chown d8/d16/d3d/c119 1 1 2024-09-13T02:50:58.811 INFO:tasks.workunit.client.1.smithi122.stdout:1/956: mkdir dc/de/d18/df1/d13e 0 2024-09-13T02:50:58.811 INFO:tasks.workunit.client.1.smithi122.stdout:1/957: readlink dc/de/d18/l93 0 2024-09-13T02:50:58.811 INFO:tasks.workunit.client.1.smithi122.stdout:1/958: write dc/d38/db1/deb/f115 [894106,48048] 0 2024-09-13T02:50:58.817 INFO:tasks.workunit.client.1.smithi122.stdout:5/890: link d0/d17/fa4 d0/da/d48/d63/d98/f12d 0 2024-09-13T02:50:58.820 INFO:tasks.workunit.client.1.smithi122.stdout:8/854: creat d3/d31/d52/d89/d8b/d104/f109 x:0 0 0 2024-09-13T02:50:58.820 INFO:tasks.workunit.client.1.smithi122.stdout:8/855: stat d3/da/d7d/fd5 0 2024-09-13T02:50:58.824 INFO:tasks.workunit.client.1.smithi122.stdout:0/948: rmdir d1/d11a/da/d92/d94/dbf/d108 0 2024-09-13T02:50:58.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/899: creat d0/d1e/d2e/d3e/d116/f126 x:0 0 0 2024-09-13T02:50:58.843 INFO:tasks.workunit.client.1.smithi122.stdout:2/900: write d0/d1c/d3b/d41/d8c/fab [856544,7155] 0 2024-09-13T02:50:58.846 INFO:tasks.workunit.client.1.smithi122.stdout:9/971: symlink d8/d16/d3d/d59/d29/l126 0 2024-09-13T02:50:58.848 INFO:tasks.workunit.client.1.smithi122.stdout:1/959: mknod dc/d38/d51/c13f 0 2024-09-13T02:50:58.848 INFO:tasks.workunit.client.1.smithi122.stdout:1/960: fdatasync dc/de/d7a/f10e 0 2024-09-13T02:50:58.850 INFO:tasks.workunit.client.1.smithi122.stdout:5/891: mknod d0/da/d48/d63/c12e 0 2024-09-13T02:50:58.853 INFO:tasks.workunit.client.1.smithi122.stdout:8/856: mknod d3/d31/d65/de4/c10a 0 2024-09-13T02:50:58.854 INFO:tasks.workunit.client.1.smithi122.stdout:7/967: rmdir d4/d8/d24/daa 39 2024-09-13T02:50:58.856 INFO:tasks.workunit.client.1.smithi122.stdout:0/949: mkdir d1/d5/d10/d29/d32/d83/db3/d119/d126/d13e 0 2024-09-13T02:50:58.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/892: write d0/d2/f6e [1556930,31594] 0 2024-09-13T02:50:58.860 INFO:tasks.workunit.client.1.smithi122.stdout:5/893: fsync d0/f7 0 2024-09-13T02:50:58.860 INFO:tasks.workunit.client.1.smithi122.stdout:9/972: mknod d8/c127 0 2024-09-13T02:50:58.860 INFO:tasks.workunit.client.1.smithi122.stdout:0/950: write d1/d11a/da/d92/d94/d137/f4e [3409918,17597] 0 2024-09-13T02:50:58.863 INFO:tasks.workunit.client.1.smithi122.stdout:7/968: dread d4/d8/f7 [0,4194304] 0 2024-09-13T02:50:58.863 INFO:tasks.workunit.client.1.smithi122.stdout:1/961: mknod dc/d38/d51/c140 0 2024-09-13T02:50:58.863 INFO:tasks.workunit.client.1.smithi122.stdout:8/857: getdents d3/d31/d52/dc1 0 2024-09-13T02:50:58.863 INFO:tasks.workunit.client.1.smithi122.stdout:8/858: chown d3/d31/d52/d89/d8b/d104/f109 0 1 2024-09-13T02:50:58.864 INFO:tasks.workunit.client.1.smithi122.stdout:1/962: read dc/de/d18/d86/f100 [467511,126528] 0 2024-09-13T02:50:58.866 INFO:tasks.workunit.client.1.smithi122.stdout:6/965: sync 2024-09-13T02:50:58.866 INFO:tasks.workunit.client.1.smithi122.stdout:2/901: rename d0/d5d/lb5 to d0/d1e/d26/d3d/d84/ddb/d10f/dc6/dfb/l127 0 2024-09-13T02:50:58.868 INFO:tasks.workunit.client.1.smithi122.stdout:5/894: link d0/da/dbf/f115 d0/da/d48/d63/d98/f12f 0 2024-09-13T02:50:58.868 INFO:tasks.workunit.client.1.smithi122.stdout:5/895: dread - d0/d2/d33/f10a zero size 2024-09-13T02:50:58.872 INFO:tasks.workunit.client.1.smithi122.stdout:9/973: unlink d8/d16/d3d/d59/d23/d1f/c106 0 2024-09-13T02:50:58.872 INFO:tasks.workunit.client.1.smithi122.stdout:9/974: readlink d8/d16/d3e/d57/l86 0 2024-09-13T02:50:58.873 INFO:tasks.workunit.client.1.smithi122.stdout:7/969: getdents d4/d8/d3d/dc2/d103 0 2024-09-13T02:50:58.876 INFO:tasks.workunit.client.1.smithi122.stdout:6/966: truncate d5/d3d/d6c/d41/d4e/d93/fdf 4119420 0 2024-09-13T02:50:58.877 INFO:tasks.workunit.client.1.smithi122.stdout:6/967: read d5/db/d29/ffe [671872,78149] 0 2024-09-13T02:50:58.877 INFO:tasks.workunit.client.1.smithi122.stdout:1/963: write dc/d38/db1/deb/d132/f52 [1492260,10509] 0 2024-09-13T02:50:58.878 INFO:tasks.workunit.client.1.smithi122.stdout:7/970: dread d4/d4e/d5d/d6b/fd0 [0,4194304] 0 2024-09-13T02:50:58.878 INFO:tasks.workunit.client.1.smithi122.stdout:7/971: chown d4/d77/d108 256231 1 2024-09-13T02:50:58.879 INFO:tasks.workunit.client.1.smithi122.stdout:5/896: rename d0/da/f6c to d0/da/d48/db4/d95/f130 0 2024-09-13T02:50:58.881 INFO:tasks.workunit.client.1.smithi122.stdout:1/964: rmdir dc/d38/d51/daf/d105 39 2024-09-13T02:50:58.883 INFO:tasks.workunit.client.1.smithi122.stdout:9/975: rename d8/d16/d3d/d59/f4d to d8/d16/d3e/d57/df5/f128 0 2024-09-13T02:50:58.883 INFO:tasks.workunit.client.1.smithi122.stdout:8/859: dwrite d3/f103 [0,4194304] 0 2024-09-13T02:50:58.884 INFO:tasks.workunit.client.1.smithi122.stdout:5/897: creat d0/d17/d36/d3f/d4c/d113/f131 x:0 0 0 2024-09-13T02:50:58.885 INFO:tasks.workunit.client.1.smithi122.stdout:6/968: mkdir d5/d11/d123 0 2024-09-13T02:50:58.886 INFO:tasks.workunit.client.1.smithi122.stdout:2/902: dread d0/d1e/d2e/f97 [0,4194304] 0 2024-09-13T02:50:58.886 INFO:tasks.workunit.client.1.smithi122.stdout:1/965: unlink dc/de/f2e 0 2024-09-13T02:50:58.888 INFO:tasks.workunit.client.1.smithi122.stdout:7/972: rename d4/d8/d24/cde to d4/d8/d3d/dcd/c140 0 2024-09-13T02:50:58.891 INFO:tasks.workunit.client.1.smithi122.stdout:8/860: unlink d3/d53/d34/f38 0 2024-09-13T02:50:58.891 INFO:tasks.workunit.client.1.smithi122.stdout:8/861: chown d3/da/d1e 5 1 2024-09-13T02:50:58.891 INFO:tasks.workunit.client.1.smithi122.stdout:2/903: dread d0/d1e/d22/f45 [0,4194304] 0 2024-09-13T02:50:58.892 INFO:tasks.workunit.client.1.smithi122.stdout:6/969: mkdir d5/d3d/d6c/d41/d124 0 2024-09-13T02:50:58.894 INFO:tasks.workunit.client.1.smithi122.stdout:5/898: dread d0/f7 [0,4194304] 0 2024-09-13T02:50:58.894 INFO:tasks.workunit.client.1.smithi122.stdout:1/966: symlink dc/d38/db1/d72/dd7/d3f/dc1/dcf/l141 0 2024-09-13T02:50:58.894 INFO:tasks.workunit.client.1.smithi122.stdout:5/899: write d0/d17/d36/d3f/d4c/d7f/fc1 [948738,49230] 0 2024-09-13T02:50:58.895 INFO:tasks.workunit.client.1.smithi122.stdout:5/900: read d0/d2/d33/f87 [183083,104747] 0 2024-09-13T02:50:58.895 INFO:tasks.workunit.client.1.smithi122.stdout:5/901: creat d0/d17/d3a/f132 x:0 0 0 2024-09-13T02:50:58.896 INFO:tasks.workunit.client.1.smithi122.stdout:7/973: creat d4/d8/d3d/dc2/d103/f141 x:0 0 0 2024-09-13T02:50:58.899 INFO:tasks.workunit.client.1.smithi122.stdout:8/862: mkdir d3/d31/d52/d89/d8b/d5c/d10b 0 2024-09-13T02:50:58.900 INFO:tasks.workunit.client.1.smithi122.stdout:2/904: creat d0/d5d/f128 x:0 0 0 2024-09-13T02:50:58.902 INFO:tasks.workunit.client.1.smithi122.stdout:6/970: dread d5/db/d29/f1d [0,4194304] 0 2024-09-13T02:50:58.902 INFO:tasks.workunit.client.1.smithi122.stdout:5/902: mkdir d0/d1d/d133 0 2024-09-13T02:50:58.903 INFO:tasks.workunit.client.1.smithi122.stdout:1/967: dread dc/f32 [8388608,4194304] 0 2024-09-13T02:50:58.905 INFO:tasks.workunit.client.1.smithi122.stdout:9/976: rename d8/d16/d3e/d57/fe1 to d8/d88/d65/f129 0 2024-09-13T02:50:58.906 INFO:tasks.workunit.client.1.smithi122.stdout:2/905: link d0/d1e/d2e/d3e/l7c d0/d55/d70/d59/dd2/de6/l129 0 2024-09-13T02:50:58.907 INFO:tasks.workunit.client.1.smithi122.stdout:6/971: creat d5/d11/d2f/f125 x:0 0 0 2024-09-13T02:50:58.908 INFO:tasks.workunit.client.1.smithi122.stdout:1/968: dread dc/f9c [0,4194304] 0 2024-09-13T02:50:58.908 INFO:tasks.workunit.client.1.smithi122.stdout:1/969: write dc/de/d18/d22/ffa [23048,7727] 0 2024-09-13T02:50:58.910 INFO:tasks.workunit.client.1.smithi122.stdout:9/977: dread d8/d16/d3d/d59/d23/d1f/f54 [0,4194304] 0 2024-09-13T02:50:58.910 INFO:tasks.workunit.client.1.smithi122.stdout:9/978: creat d8/d16/d3e/d57/df5/f12a x:0 0 0 2024-09-13T02:50:58.914 INFO:tasks.workunit.client.1.smithi122.stdout:6/972: mknod d5/d3d/d6c/d41/d4e/d5f/df8/c126 0 2024-09-13T02:50:58.915 INFO:tasks.workunit.client.1.smithi122.stdout:1/970: creat dc/d38/d51/daf/dee/f142 x:0 0 0 2024-09-13T02:50:58.919 INFO:tasks.workunit.client.1.smithi122.stdout:9/979: rename d8/d16/d3d/d59/d23/d7b/d82/f95 to d8/d16/d3d/d59/d29/d90/dc8/f12b 0 2024-09-13T02:50:58.927 INFO:tasks.workunit.client.1.smithi122.stdout:6/973: write d5/d11/d45/fcc [3307065,69391] 0 2024-09-13T02:50:58.927 INFO:tasks.workunit.client.1.smithi122.stdout:5/903: rmdir d0/d17/d36/d3f/d4c/d7f 39 2024-09-13T02:50:58.929 INFO:tasks.workunit.client.1.smithi122.stdout:2/906: rmdir d0/d1e/d26/d3d/dea 39 2024-09-13T02:50:58.929 INFO:tasks.workunit.client.1.smithi122.stdout:2/907: chown d0/d1c/f31 202 1 2024-09-13T02:50:58.929 INFO:tasks.workunit.client.1.smithi122.stdout:7/974: dwrite d4/d8/db/fe0 [0,4194304] 0 2024-09-13T02:50:58.930 INFO:tasks.workunit.client.1.smithi122.stdout:1/971: dread dc/de/f27 [0,4194304] 0 2024-09-13T02:50:58.931 INFO:tasks.workunit.client.1.smithi122.stdout:8/863: dwrite d3/d31/d52/d89/d8b/fd3 [0,4194304] 0 2024-09-13T02:50:58.932 INFO:tasks.workunit.client.1.smithi122.stdout:9/980: mkdir d8/d4a/d64/d12c 0 2024-09-13T02:50:58.933 INFO:tasks.workunit.client.1.smithi122.stdout:9/981: chown d8/d16/d3d/d59/d29/d90/dc8/f12b 200 1 2024-09-13T02:50:58.933 INFO:tasks.workunit.client.1.smithi122.stdout:9/982: readlink d8/d16/d45/lea 0 2024-09-13T02:50:58.940 INFO:tasks.workunit.client.1.smithi122.stdout:6/974: creat d5/db/dc/d10c/f127 x:0 0 0 2024-09-13T02:50:58.946 INFO:tasks.workunit.client.1.smithi122.stdout:7/975: creat d4/d8/db/f142 x:0 0 0 2024-09-13T02:50:58.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/864: getdents d3/d31/d52/d89/d8b/d104/dcb 0 2024-09-13T02:50:58.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/865: truncate d3/d31/d52/d59/f5f 2499158 0 2024-09-13T02:50:58.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/866: fsync d3/fec 0 2024-09-13T02:50:58.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/867: write d3/d53/fd6 [4760430,64407] 0 2024-09-13T02:50:58.949 INFO:tasks.workunit.client.1.smithi122.stdout:8/868: readlink d3/d31/d52/l97 0 2024-09-13T02:50:58.952 INFO:tasks.workunit.client.1.smithi122.stdout:9/983: truncate d8/d16/d3d/d59/d23/d7b/d82/fbb 215961 0 2024-09-13T02:50:58.953 INFO:tasks.workunit.client.1.smithi122.stdout:7/976: mknod d4/d8/d3d/dc2/d129/c143 0 2024-09-13T02:50:58.953 INFO:tasks.workunit.client.1.smithi122.stdout:6/975: write d5/d3d/d6c/d41/d4e/d93/fdf [3937167,112169] 0 2024-09-13T02:50:58.953 INFO:tasks.workunit.client.1.smithi122.stdout:6/976: creat d5/db/dc/f128 x:0 0 0 2024-09-13T02:50:58.957 INFO:tasks.workunit.client.1.smithi122.stdout:9/984: creat d8/d16/d3d/d59/d23/d7b/f12d x:0 0 0 2024-09-13T02:50:58.961 INFO:tasks.workunit.client.1.smithi122.stdout:8/869: dread d3/d53/d34/f55 [0,4194304] 0 2024-09-13T02:50:58.962 INFO:tasks.workunit.client.1.smithi122.stdout:5/904: dwrite d0/da/d48/d63/f82 [0,4194304] 0 2024-09-13T02:50:58.965 INFO:tasks.workunit.client.1.smithi122.stdout:2/908: dwrite d0/d1e/d26/d3d/d84/fbb [0,4194304] 0 2024-09-13T02:50:58.965 INFO:tasks.workunit.client.1.smithi122.stdout:1/972: dwrite dc/de/d18/d86/f100 [0,4194304] 0 2024-09-13T02:50:58.965 INFO:tasks.workunit.client.1.smithi122.stdout:2/909: truncate d0/d1c/d3b/d41/d4e/d75/d95/f9a 660398 0 2024-09-13T02:50:58.965 INFO:tasks.workunit.client.1.smithi122.stdout:6/977: link d5/d3d/d6c/db5/ld0 d5/d11/d123/l129 0 2024-09-13T02:50:58.968 INFO:tasks.workunit.client.1.smithi122.stdout:8/870: dread d3/d31/d52/d59/f5f [0,4194304] 0 2024-09-13T02:50:58.973 INFO:tasks.workunit.client.1.smithi122.stdout:1/973: symlink dc/de/d18/d22/d1c/d47/l143 0 2024-09-13T02:50:58.973 INFO:tasks.workunit.client.1.smithi122.stdout:1/974: readlink dc/d38/db1/d72/dd7/d3f/l41 0 2024-09-13T02:50:58.974 INFO:tasks.workunit.client.1.smithi122.stdout:7/977: dwrite d4/d8/db/f1f [0,4194304] 0 2024-09-13T02:50:58.974 INFO:tasks.workunit.client.1.smithi122.stdout:7/978: fdatasync d4/d8/db7/f12d 0 2024-09-13T02:50:58.975 INFO:tasks.workunit.client.1.smithi122.stdout:6/978: truncate d5/d3d/d6c/f7f 829247 0 2024-09-13T02:50:58.975 INFO:tasks.workunit.client.1.smithi122.stdout:5/905: rmdir d0/d17/d36/d8b 39 2024-09-13T02:50:58.976 INFO:tasks.workunit.client.1.smithi122.stdout:5/906: chown d0/da/d90/la8 253784260 1 2024-09-13T02:50:58.976 INFO:tasks.workunit.client.1.smithi122.stdout:5/907: dread - d0/da/fd6 zero size 2024-09-13T02:50:58.980 INFO:tasks.workunit.client.1.smithi122.stdout:8/871: creat d3/d53/d34/d94/deb/f10c x:0 0 0 2024-09-13T02:50:58.981 INFO:tasks.workunit.client.1.smithi122.stdout:8/872: dread d3/da6/fb3 [0,4194304] 0 2024-09-13T02:50:58.981 INFO:tasks.workunit.client.1.smithi122.stdout:8/873: creat d3/d53/d21/f10d x:0 0 0 2024-09-13T02:50:58.982 INFO:tasks.workunit.client.1.smithi122.stdout:1/975: dread dc/d38/db1/d7d/f83 [0,4194304] 0 2024-09-13T02:50:58.988 INFO:tasks.workunit.client.1.smithi122.stdout:7/979: rename d4/d8/d3d/c88 to d4/d77/d108/c144 0 2024-09-13T02:50:58.989 INFO:tasks.workunit.client.1.smithi122.stdout:6/979: creat d5/d3d/da3/f12a x:0 0 0 2024-09-13T02:50:58.991 INFO:tasks.workunit.client.1.smithi122.stdout:5/908: symlink d0/d17/d36/d3f/l134 0 2024-09-13T02:50:58.994 INFO:tasks.workunit.client.1.smithi122.stdout:8/874: symlink d3/d31/d52/d89/d8b/d104/l10e 0 2024-09-13T02:50:58.997 INFO:tasks.workunit.client.1.smithi122.stdout:7/980: mknod d4/d77/d108/c145 0 2024-09-13T02:50:58.999 INFO:tasks.workunit.client.1.smithi122.stdout:6/980: rename d5/d11/d45/c63 to d5/d3d/d82/dcf/df0/c12b 0 2024-09-13T02:50:58.999 INFO:tasks.workunit.client.1.smithi122.stdout:6/981: dread - d5/db/d29/d60/fff zero size 2024-09-13T02:50:59.001 INFO:tasks.workunit.client.1.smithi122.stdout:5/909: symlink d0/d17/d36/d3f/d4c/d7f/dd1/l135 0 2024-09-13T02:50:59.001 INFO:tasks.workunit.client.1.smithi122.stdout:5/910: dread - d0/da/d48/fed zero size 2024-09-13T02:50:59.001 INFO:tasks.workunit.client.1.smithi122.stdout:5/911: dread - d0/da/d8c/d8f/da0/dba/f118 zero size 2024-09-13T02:50:59.002 INFO:tasks.workunit.client.1.smithi122.stdout:5/912: getdents d0/da/dbf 0 2024-09-13T02:50:59.002 INFO:tasks.workunit.client.1.smithi122.stdout:5/913: chown d0/d17/d36/d3f/d4c 2042093 1 2024-09-13T02:50:59.003 INFO:tasks.workunit.client.1.smithi122.stdout:6/982: creat d5/d3d/d6c/d41/f12c x:0 0 0 2024-09-13T02:50:59.003 INFO:tasks.workunit.client.1.smithi122.stdout:6/983: chown d5/d40/f35 13 1 2024-09-13T02:50:59.005 INFO:tasks.workunit.client.1.smithi122.stdout:6/984: mknod d5/db/d29/d60/dac/c12d 0 2024-09-13T02:50:59.006 INFO:tasks.workunit.client.1.smithi122.stdout:5/914: getdents d0/da/d48/db4 0 2024-09-13T02:50:59.006 INFO:tasks.workunit.client.1.smithi122.stdout:5/915: chown d0/da/d48/d63/d98/c110 80 1 2024-09-13T02:50:59.007 INFO:tasks.workunit.client.1.smithi122.stdout:6/985: symlink d5/d11/d45/d21/d8a/l12e 0 2024-09-13T02:50:59.008 INFO:tasks.workunit.client.1.smithi122.stdout:8/875: write d3/d53/d34/f48 [2639315,36420] 0 2024-09-13T02:50:59.009 INFO:tasks.workunit.client.1.smithi122.stdout:1/976: dwrite dc/de/d18/f134 [0,4194304] 0 2024-09-13T02:50:59.010 INFO:tasks.workunit.client.1.smithi122.stdout:1/977: dread - dc/de/d18/d22/d1c/d47/fdf zero size 2024-09-13T02:50:59.010 INFO:tasks.workunit.client.1.smithi122.stdout:1/978: creat dc/de/d18/f144 x:0 0 0 2024-09-13T02:50:59.010 INFO:tasks.workunit.client.1.smithi122.stdout:5/916: mkdir d0/d17/d136 0 2024-09-13T02:50:59.010 INFO:tasks.workunit.client.1.smithi122.stdout:6/986: rmdir d5/d3d/d48/d111 0 2024-09-13T02:50:59.010 INFO:tasks.workunit.client.1.smithi122.stdout:8/876: dread d3/d31/f6e [0,4194304] 0 2024-09-13T02:50:59.011 INFO:tasks.workunit.client.1.smithi122.stdout:8/877: chown d3/d53/la9 404 1 2024-09-13T02:50:59.012 INFO:tasks.workunit.client.1.smithi122.stdout:7/981: dread d4/d8/db/dc/d1b/f57 [0,4194304] 0 2024-09-13T02:50:59.012 INFO:tasks.workunit.client.1.smithi122.stdout:7/982: truncate d4/d8/db/dc/f1d 5068945 0 2024-09-13T02:50:59.012 INFO:tasks.workunit.client.1.smithi122.stdout:7/983: fdatasync d4/d8/d3d/dcd/f13e 0 2024-09-13T02:50:59.012 INFO:tasks.workunit.client.1.smithi122.stdout:7/984: chown d4/d8/db/dc/d1b/d49/da0/ce2 931184015 1 2024-09-13T02:50:59.017 INFO:tasks.workunit.client.1.smithi122.stdout:1/979: rename f2 to dc/d38/db1/d72/dd7/d46/db7/f145 0 2024-09-13T02:50:59.019 INFO:tasks.workunit.client.1.smithi122.stdout:5/917: link d0/d17/cf2 d0/d17/d36/d3f/c137 0 2024-09-13T02:50:59.021 INFO:tasks.workunit.client.1.smithi122.stdout:6/987: mkdir d5/d11/d2f/d12f 0 2024-09-13T02:50:59.026 INFO:tasks.workunit.client.1.smithi122.stdout:7/985: symlink d4/d4e/d110/l146 0 2024-09-13T02:50:59.030 INFO:tasks.workunit.client.1.smithi122.stdout:6/988: mkdir d5/d40/dcd/d130 0 2024-09-13T02:50:59.030 INFO:tasks.workunit.client.1.smithi122.stdout:5/918: dread d0/d17/d3a/faa [0,4194304] 0 2024-09-13T02:50:59.032 INFO:tasks.workunit.client.1.smithi122.stdout:8/878: getdents d3 0 2024-09-13T02:50:59.040 INFO:tasks.workunit.client.1.smithi122.stdout:1/980: dwrite dc/de/d18/d22/d1c/d47/f4d [0,4194304] 0 2024-09-13T02:50:59.040 INFO:tasks.workunit.client.1.smithi122.stdout:1/981: chown dc/de/d18/d22/d76/dfb 76341 1 2024-09-13T02:50:59.041 INFO:tasks.workunit.client.1.smithi122.stdout:5/919: write d0/d17/d36/d25/d2b/f2c [1812154,124237] 0 2024-09-13T02:50:59.043 INFO:tasks.workunit.client.1.smithi122.stdout:1/982: mknod dc/d38/d51/c146 0 2024-09-13T02:50:59.047 INFO:tasks.workunit.client.1.smithi122.stdout:5/920: rename d0/d2/d33/l44 to d0/d17/d36/l138 0 2024-09-13T02:50:59.047 INFO:tasks.workunit.client.1.smithi122.stdout:5/921: read - d0/da/d48/fed zero size 2024-09-13T02:50:59.049 INFO:tasks.workunit.client.1.smithi122.stdout:1/983: symlink dc/d38/db1/d7d/l147 0 2024-09-13T02:50:59.051 INFO:tasks.workunit.client.1.smithi122.stdout:8/879: write d3/d31/d52/fa8 [1379300,55390] 0 2024-09-13T02:50:59.052 INFO:tasks.workunit.client.1.smithi122.stdout:1/984: rename dc/d38/d51/daf/de3/f114 to dc/de/d7a/f148 0 2024-09-13T02:50:59.054 INFO:tasks.workunit.client.1.smithi122.stdout:7/986: dwrite d4/d8/db7/d102/fc0 [0,4194304] 0 2024-09-13T02:50:59.054 INFO:tasks.workunit.client.1.smithi122.stdout:7/987: write d4/d8/d24/f139 [739730,123364] 0 2024-09-13T02:50:59.054 INFO:tasks.workunit.client.1.smithi122.stdout:7/988: getdents d4/d6d/da6/df2/dfc 0 2024-09-13T02:50:59.055 INFO:tasks.workunit.client.1.smithi122.stdout:6/989: dwrite d5/d3d/d82/dcf/fae [0,4194304] 0 2024-09-13T02:50:59.055 INFO:tasks.workunit.client.1.smithi122.stdout:6/990: readlink d5/d3d/d48/le4 0 2024-09-13T02:50:59.062 INFO:tasks.workunit.client.1.smithi122.stdout:5/922: rmdir d0/d17/d36 39 2024-09-13T02:50:59.065 INFO:tasks.workunit.client.1.smithi122.stdout:8/880: rename d3/d31/d52/d89/d8b/faa to d3/d31/d52/d89/f10f 0 2024-09-13T02:50:59.065 INFO:tasks.workunit.client.1.smithi122.stdout:8/881: chown d3/da/l101 29454 1 2024-09-13T02:50:59.067 INFO:tasks.workunit.client.1.smithi122.stdout:7/989: creat d4/d6d/da6/dbf/db1/da3/f147 x:0 0 0 2024-09-13T02:50:59.068 INFO:tasks.workunit.client.1.smithi122.stdout:6/991: mknod d5/d3d/d6c/d41/d4e/d5f/c131 0 2024-09-13T02:50:59.071 INFO:tasks.workunit.client.1.smithi122.stdout:8/882: rmdir d3/d31/d52/d89/d8b/d5c 39 2024-09-13T02:50:59.071 INFO:tasks.workunit.client.1.smithi122.stdout:1/985: dwrite dc/d38/db1/deb/d132/d2f/d94/fbc [0,4194304] 0 2024-09-13T02:50:59.071 INFO:tasks.workunit.client.1.smithi122.stdout:1/986: truncate dc/de/d7a/f148 683663 0 2024-09-13T02:50:59.071 INFO:tasks.workunit.client.1.smithi122.stdout:8/883: write d3/d31/d52/d89/db1/fe9 [1656701,124088] 0 2024-09-13T02:50:59.071 INFO:tasks.workunit.client.1.smithi122.stdout:8/884: chown d3/d53/d21/c77 1 1 2024-09-13T02:50:59.076 INFO:tasks.workunit.client.1.smithi122.stdout:5/923: dread d0/f53 [0,4194304] 0 2024-09-13T02:50:59.076 INFO:tasks.workunit.client.1.smithi122.stdout:5/924: chown d0/da/d48/db4/dc8/f116 105339715 1 2024-09-13T02:50:59.078 INFO:tasks.workunit.client.1.smithi122.stdout:7/990: dread d4/d8/d3d/d7e/fe6 [0,4194304] 0 2024-09-13T02:50:59.078 INFO:tasks.workunit.client.1.smithi122.stdout:6/992: mkdir d5/d3d/d82/dc9/d132 0 2024-09-13T02:50:59.080 INFO:tasks.workunit.client.1.smithi122.stdout:1/987: mkdir dc/d38/db1/d72/dd7/d46/db7/d149 0 2024-09-13T02:50:59.080 INFO:tasks.workunit.client.1.smithi122.stdout:1/988: fdatasync dc/d38/db1/deb/d132/d2f/f4b 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:5/925: dread d0/d2/d33/f52 [0,4194304] 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:5/926: fsync d0/da/d48/d63/d98/f12f 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:5/927: write d0/d17/d3a/f132 [661009,93718] 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:5/928: write d0/d17/d3a/faa [1040516,56682] 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:7/991: rename d4/d8/db/f11 to d4/d8/f148 0 2024-09-13T02:50:59.082 INFO:tasks.workunit.client.1.smithi122.stdout:7/992: chown d4/d8/f148 7688226 1 2024-09-13T02:50:59.084 INFO:tasks.workunit.client.1.smithi122.stdout:6/993: rmdir d5/d3d/d6c/db5 39 2024-09-13T02:50:59.084 INFO:tasks.workunit.client.1.smithi122.stdout:6/994: readlink d5/d11/d2f/l53 0 2024-09-13T02:50:59.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/885: write d3/d31/d52/d89/d8b/d5c/f86 [3517183,60310] 0 2024-09-13T02:50:59.085 INFO:tasks.workunit.client.1.smithi122.stdout:8/886: dread - d3/da/d1e/fee zero size 2024-09-13T02:50:59.088 INFO:tasks.workunit.client.1.smithi122.stdout:6/995: dread d5/d3d/d82/fdb [0,4194304] 0 2024-09-13T02:50:59.088 INFO:tasks.workunit.client.1.smithi122.stdout:6/996: write d5/d3d/da3/f12a [436895,61904] 0 2024-09-13T02:50:59.090 INFO:tasks.workunit.client.1.smithi122.stdout:1/989: getdents dc/d38/db1/d7d 0 2024-09-13T02:50:59.094 INFO:tasks.workunit.client.1.smithi122.stdout:5/929: rmdir d0/da/d48/d63 39 2024-09-13T02:50:59.094 INFO:tasks.workunit.client.1.smithi122.stdout:5/930: chown d0/da/d48/db4/ldb 0 1 2024-09-13T02:50:59.094 INFO:tasks.workunit.client.1.smithi122.stdout:5/931: readlink d0/d17/d36/lc7 0 2024-09-13T02:50:59.094 INFO:tasks.workunit.client.1.smithi122.stdout:5/932: fsync d0/da/d48/db4/d95/f130 0 2024-09-13T02:50:59.094 INFO:tasks.workunit.client.1.smithi122.stdout:5/933: truncate d0/d17/d36/d25/f85 408071 0 2024-09-13T02:50:59.097 INFO:tasks.workunit.client.1.smithi122.stdout:7/993: truncate d4/d8/db/dc/f61 1321977 0 2024-09-13T02:50:59.097 INFO:tasks.workunit.client.1.smithi122.stdout:8/887: symlink d3/d53/d34/d94/deb/l110 0 2024-09-13T02:50:59.098 INFO:tasks.workunit.client.1.smithi122.stdout:8/888: dread - d3/da/d1f/f9c zero size 2024-09-13T02:50:59.100 INFO:tasks.workunit.client.1.smithi122.stdout:6/997: mkdir d5/d3d/d82/dc9/d132/d133 0 2024-09-13T02:50:59.100 INFO:tasks.workunit.client.1.smithi122.stdout:1/990: symlink dc/d38/db1/l14a 0 2024-09-13T02:50:59.104 INFO:tasks.workunit.client.1.smithi122.stdout:5/934: mknod d0/d1d/d133/c139 0 2024-09-13T02:50:59.105 INFO:tasks.workunit.client.1.smithi122.stdout:8/889: unlink d3/d31/d52/d89/d8b/l108 0 2024-09-13T02:50:59.107 INFO:tasks.workunit.client.1.smithi122.stdout:6/998: link d5/d11/d45/d21/c9b d5/d3d/d6c/d41/d4e/d5f/df8/c134 0 2024-09-13T02:50:59.108 INFO:tasks.workunit.client.1.smithi122.stdout:1/991: creat dc/d38/d51/daf/f14b x:0 0 0 2024-09-13T02:50:59.110 INFO:tasks.workunit.client.1.smithi122.stdout:5/935: truncate d0/f84 319836 0 2024-09-13T02:50:59.112 INFO:tasks.workunit.client.1.smithi122.stdout:8/890: mkdir d3/da/d111 0 2024-09-13T02:50:59.113 INFO:tasks.workunit.client.1.smithi122.stdout:6/999: symlink d5/db/d29/d60/dac/l135 0 2024-09-13T02:50:59.115 INFO:tasks.workunit.client.1.smithi122.stdout:5/936: mknod d0/d1d/c13a 0 2024-09-13T02:50:59.115 INFO:tasks.workunit.client.1.smithi122.stdout:5/937: dread - d0/d17/d36/d3f/d4c/d113/ffb zero size 2024-09-13T02:50:59.117 INFO:tasks.workunit.client.1.smithi122.stdout:8/891: rename d3/d31/d52/l97 to d3/da6/l112 0 2024-09-13T02:50:59.117 INFO:tasks.workunit.client.1.smithi122.stdout:8/892: readlink d3/da/d7d/lab 0 2024-09-13T02:50:59.119 INFO:tasks.workunit.client.1.smithi122.stdout:5/938: rename d0/da/d8c/d8f/df7/d102/l10e to d0/da/d48/l13b 0 2024-09-13T02:50:59.119 INFO:tasks.workunit.client.1.smithi122.stdout:7/994: dwrite d4/d8/db/f84 [0,4194304] 0 2024-09-13T02:50:59.137 INFO:tasks.workunit.client.1.smithi122.stdout:7/995: mkdir d4/d8/d3d/dc2/d103/d149 0 2024-09-13T02:50:59.139 INFO:tasks.workunit.client.1.smithi122.stdout:7/996: symlink d4/d4e/d110/d12a/l14a 0 2024-09-13T02:50:59.142 INFO:tasks.workunit.client.1.smithi122.stdout:0/951: sync 2024-09-13T02:50:59.144 INFO:tasks.workunit.client.1.smithi122.stdout:0/952: creat d1/f13f x:0 0 0 2024-09-13T02:50:59.144 INFO:tasks.workunit.client.1.smithi122.stdout:0/953: stat d1/d4b/c51 0 2024-09-13T02:50:59.144 INFO:tasks.workunit.client.1.smithi122.stdout:0/954: chown d1/d5/f13 15 1 2024-09-13T02:50:59.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/955: creat d1/d5/d10/d29/d32/d83/db3/d119/d126/d13e/f140 x:0 0 0 2024-09-13T02:50:59.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/956: truncate d1/d5/d10/f5e 4233762 0 2024-09-13T02:50:59.146 INFO:tasks.workunit.client.1.smithi122.stdout:0/957: chown d1/d5/d10/f7b 0 1 2024-09-13T02:50:59.149 INFO:tasks.workunit.client.1.smithi122.stdout:0/958: rmdir d1/d11a/da/d92/d94/d137/db4/ddc/df0/d81 39 2024-09-13T02:50:59.149 INFO:tasks.workunit.client.1.smithi122.stdout:0/959: truncate d1/d5/d10/f7b 3909468 0 2024-09-13T02:50:59.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/997: dread d4/d6d/da6/dbf/db1/f87 [0,4194304] 0 2024-09-13T02:50:59.152 INFO:tasks.workunit.client.1.smithi122.stdout:7/998: chown d4/d8/d24/daa 805 1 2024-09-13T02:50:59.153 INFO:tasks.workunit.client.1.smithi122.stdout:7/999: symlink d4/d8/d24/d47/l14b 0 2024-09-13T02:50:59.175 INFO:tasks.workunit.client.1.smithi122.stdout:0/960: dread d1/d11a/fcb [0,4194304] 0 2024-09-13T02:50:59.176 INFO:tasks.workunit.client.1.smithi122.stdout:0/961: write d1/d11a/da/d7d/fa2 [1199400,80237] 0 2024-09-13T02:50:59.181 INFO:tasks.workunit.client.1.smithi122.stdout:8/893: dwrite d3/d31/d52/d89/db1/fd0 [0,4194304] 0 2024-09-13T02:50:59.181 INFO:tasks.workunit.client.1.smithi122.stdout:5/939: dwrite d0/da/d90/fd5 [0,4194304] 0 2024-09-13T02:50:59.192 INFO:tasks.workunit.client.1.smithi122.stdout:5/940: dread d0/d17/d36/d8b/fa5 [0,4194304] 0 2024-09-13T02:50:59.192 INFO:tasks.workunit.client.1.smithi122.stdout:5/941: stat d0/da/l6a 0 2024-09-13T02:50:59.193 INFO:tasks.workunit.client.1.smithi122.stdout:5/942: getdents d0/da/d48/db4/df3 0 2024-09-13T02:50:59.194 INFO:tasks.workunit.client.1.smithi122.stdout:8/894: write d3/d31/d52/d89/db1/fd0 [522156,71604] 0 2024-09-13T02:50:59.195 INFO:tasks.workunit.client.1.smithi122.stdout:5/943: rename d0/d17/d36/d8b/ff4 to d0/d17/d36/f13c 0 2024-09-13T02:50:59.195 INFO:tasks.workunit.client.1.smithi122.stdout:5/944: write d0/f7 [2394619,63392] 0 2024-09-13T02:50:59.203 INFO:tasks.workunit.client.1.smithi122.stdout:0/962: dwrite d1/d11a/da/f75 [0,4194304] 0 2024-09-13T02:50:59.209 INFO:tasks.workunit.client.1.smithi122.stdout:5/945: dread d0/d17/d36/f9e [0,4194304] 0 2024-09-13T02:50:59.209 INFO:tasks.workunit.client.1.smithi122.stdout:5/946: readlink d0/da/d48/db4/lb9 0 2024-09-13T02:50:59.209 INFO:tasks.workunit.client.1.smithi122.stdout:5/947: write d0/d17/d36/d3f/de7/f100 [780095,102744] 0 2024-09-13T02:50:59.209 INFO:tasks.workunit.client.1.smithi122.stdout:5/948: stat d0/d17/d36/c127 0 2024-09-13T02:50:59.210 INFO:tasks.workunit.client.1.smithi122.stdout:5/949: creat d0/f13d x:0 0 0 2024-09-13T02:50:59.210 INFO:tasks.workunit.client.1.smithi122.stdout:5/950: chown d0/da/d48/d63/d98/c110 0 1 2024-09-13T02:50:59.216 INFO:tasks.workunit.client.1.smithi122.stdout:8/895: dwrite d3/d31/d52/d89/db1/fc0 [4194304,4194304] 0 2024-09-13T02:50:59.227 INFO:tasks.workunit.client.1.smithi122.stdout:5/951: write d0/d2/f6b [916685,31094] 0 2024-09-13T02:50:59.230 INFO:tasks.workunit.client.1.smithi122.stdout:8/896: read d3/d53/d21/f4b [595010,85189] 0 2024-09-13T02:50:59.230 INFO:tasks.workunit.client.1.smithi122.stdout:8/897: getdents d3/d31/d65/de4/df7 0 2024-09-13T02:50:59.230 INFO:tasks.workunit.client.1.smithi122.stdout:5/952: creat d0/d1d/d133/f13e x:0 0 0 2024-09-13T02:50:59.232 INFO:tasks.workunit.client.1.smithi122.stdout:8/898: symlink d3/da/d111/l113 0 2024-09-13T02:50:59.232 INFO:tasks.workunit.client.1.smithi122.stdout:8/899: getdents d3/d31/d65/de4/df7 0 2024-09-13T02:50:59.233 INFO:tasks.workunit.client.1.smithi122.stdout:8/900: truncate d3/da/d1e/f47 8960668 0 2024-09-13T02:50:59.234 INFO:tasks.workunit.client.1.smithi122.stdout:0/963: dwrite d1/d5/d10/d29/d32/d5f/f134 [0,4194304] 0 2024-09-13T02:50:59.234 INFO:tasks.workunit.client.1.smithi122.stdout:0/964: dread - d1/d5/f125 zero size 2024-09-13T02:50:59.235 INFO:tasks.workunit.client.1.smithi122.stdout:8/901: rename d3/d53/le8 to d3/d31/l114 0 2024-09-13T02:50:59.245 INFO:tasks.workunit.client.1.smithi122.stdout:0/965: rename d1/d11a/da/d7d to d1/d5/d141 0 2024-09-13T02:50:59.246 INFO:tasks.workunit.client.1.smithi122.stdout:8/902: rename d3/d31/d52/f5b to d3/d31/d52/d89/d8b/d5c/d10b/f115 0 2024-09-13T02:50:59.247 INFO:tasks.workunit.client.1.smithi122.stdout:8/903: chown d3/ff5 3 1 2024-09-13T02:50:59.256 INFO:tasks.workunit.client.1.smithi122.stdout:8/904: dread d3/d31/f3b [4194304,4194304] 0 2024-09-13T02:50:59.265 INFO:tasks.workunit.client.1.smithi122.stdout:0/966: dwrite d1/d11a/da/d92/d94/f5c [0,4194304] 0 2024-09-13T02:50:59.265 INFO:tasks.workunit.client.1.smithi122.stdout:0/967: read d1/d11a/da/d92/d94/f31 [2314279,30628] 0 2024-09-13T02:50:59.266 INFO:tasks.workunit.client.1.smithi122.stdout:0/968: chown d1/d5/d10/d29/d32/f102 176492 1 2024-09-13T02:50:59.266 INFO:tasks.workunit.client.1.smithi122.stdout:0/969: chown d1/d5/d10/d29/c13b 7288710 1 2024-09-13T02:50:59.269 INFO:tasks.workunit.client.1.smithi122.stdout:8/905: dread d3/d53/d21/f5e [0,4194304] 0 2024-09-13T02:50:59.269 INFO:tasks.workunit.client.1.smithi122.stdout:0/970: mknod d1/d5/d10/d29/d32/d83/db3/c142 0 2024-09-13T02:50:59.271 INFO:tasks.workunit.client.1.smithi122.stdout:8/906: mknod d3/da/d111/c116 0 2024-09-13T02:50:59.274 INFO:tasks.workunit.client.1.smithi122.stdout:0/971: mkdir d1/d5/d10/d29/d32/d83/db3/d119/d143 0 2024-09-13T02:50:59.274 INFO:tasks.workunit.client.1.smithi122.stdout:0/972: stat d1/d5/d10/d29/d32/d5f/f134 0 2024-09-13T02:50:59.277 INFO:tasks.workunit.client.1.smithi122.stdout:0/973: mknod d1/d5/d10/c144 0 2024-09-13T02:50:59.282 INFO:tasks.workunit.client.1.smithi122.stdout:0/974: unlink d1/d5/d10/d29/d32/d5f/f50 0 2024-09-13T02:50:59.282 INFO:tasks.workunit.client.1.smithi122.stdout:0/975: chown d1/d5/d10/d29/d32/d83/db3/d119 9862053 1 2024-09-13T02:50:59.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/976: link d1/d11a/da/d92/d94/d137/db4/ddc/df0/c71 d1/d5/d10/d29/d32/d83/db3/d119/c145 0 2024-09-13T02:50:59.285 INFO:tasks.workunit.client.1.smithi122.stdout:0/977: read - d1/d5/d10/d29/d118/d69/d85/f12e zero size 2024-09-13T02:50:59.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/978: link d1/d11a/da/d92/d94/d137/db4/ddc/df0/fcd d1/d11a/da/d92/dbb/f146 0 2024-09-13T02:50:59.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/979: dread - d1/d5/d141/ffd zero size 2024-09-13T02:50:59.287 INFO:tasks.workunit.client.1.smithi122.stdout:0/980: chown d1/d11a/da/c93 360928366 1 2024-09-13T02:50:59.292 INFO:tasks.workunit.client.1.smithi122.stdout:0/981: dread d1/d5/d10/d29/d32/f5d [0,4194304] 0 2024-09-13T02:50:59.292 INFO:tasks.workunit.client.1.smithi122.stdout:0/982: write d1/d5/d10/d29/d32/f6f [136566,92542] 0 2024-09-13T02:50:59.294 INFO:tasks.workunit.client.1.smithi122.stdout:0/983: creat d1/d11a/da/d11d/f147 x:0 0 0 2024-09-13T02:50:59.296 INFO:tasks.workunit.client.1.smithi122.stdout:0/984: creat d1/d5/d10/d29/d118/f148 x:0 0 0 2024-09-13T02:50:59.304 INFO:tasks.workunit.client.1.smithi122.stdout:8/907: dwrite d3/d31/d52/d89/d8b/d104/dcb/d76/f7b [0,4194304] 0 2024-09-13T02:50:59.305 INFO:tasks.workunit.client.1.smithi122.stdout:8/908: dread - d3/d31/fdb zero size 2024-09-13T02:50:59.305 INFO:tasks.workunit.client.1.smithi122.stdout:8/909: creat d3/da6/f117 x:0 0 0 2024-09-13T02:50:59.309 INFO:tasks.workunit.client.1.smithi122.stdout:8/910: creat d3/d53/d34/d94/d100/f118 x:0 0 0 2024-09-13T02:50:59.316 INFO:tasks.workunit.client.1.smithi122.stdout:0/985: dwrite d1/d11a/da/d92/d94/d137/db4/ddc/f115 [0,4194304] 0 2024-09-13T02:50:59.331 INFO:tasks.workunit.client.1.smithi122.stdout:9/985: sync 2024-09-13T02:50:59.331 INFO:tasks.workunit.client.1.smithi122.stdout:2/910: sync 2024-09-13T02:50:59.333 INFO:tasks.workunit.client.1.smithi122.stdout:2/911: rename d0/d1c/d3b/d41/d8c/f119 to d0/d1c/d3b/d41/d4e/d90/f12a 0 2024-09-13T02:50:59.336 INFO:tasks.workunit.client.1.smithi122.stdout:9/986: symlink d8/d16/d3d/d59/d23/d7b/d82/da3/da7/dbe/l12e 0 2024-09-13T02:50:59.337 INFO:tasks.workunit.client.1.smithi122.stdout:9/987: read d8/d16/d3d/d59/d23/f8e [182491,23432] 0 2024-09-13T02:50:59.338 INFO:tasks.workunit.client.1.smithi122.stdout:2/912: creat d0/d1e/d26/d3d/d84/ddb/f12b x:0 0 0 2024-09-13T02:50:59.338 INFO:tasks.workunit.client.1.smithi122.stdout:2/913: chown d0/d55/l77 251 1 2024-09-13T02:50:59.338 INFO:tasks.workunit.client.1.smithi122.stdout:2/914: fdatasync d0/d55/d70/d59/f6e 0 2024-09-13T02:50:59.338 INFO:tasks.workunit.client.1.smithi122.stdout:2/915: chown d0/d1e/d26/d3d/cc5 514051598 1 2024-09-13T02:50:59.338 INFO:tasks.workunit.client.1.smithi122.stdout:8/911: dwrite d3/da6/f117 [0,4194304] 0 2024-09-13T02:50:59.344 INFO:tasks.workunit.client.1.smithi122.stdout:8/912: dread d3/da/d1e/f47 [4194304,4194304] 0 2024-09-13T02:50:59.345 INFO:tasks.workunit.client.1.smithi122.stdout:8/913: chown d3/d53/d4d/l84 5615085 1 2024-09-13T02:50:59.346 INFO:tasks.workunit.client.1.smithi122.stdout:0/986: dwrite d1/d4b/fde [4194304,4194304] 0 2024-09-13T02:50:59.346 INFO:tasks.workunit.client.1.smithi122.stdout:9/988: write d8/d16/f108 [1648403,23060] 0 2024-09-13T02:50:59.347 INFO:tasks.workunit.client.1.smithi122.stdout:0/987: write d1/d5/d10/d29/d32/f102 [681133,71540] 0 2024-09-13T02:50:59.347 INFO:tasks.workunit.client.1.smithi122.stdout:0/988: write d1/d11a/da/d92/d94/fa0 [1041018,45009] 0 2024-09-13T02:50:59.347 INFO:tasks.workunit.client.1.smithi122.stdout:9/989: read d8/d16/d3d/d59/d7d/d83/f112 [271992,81328] 0 2024-09-13T02:50:59.348 INFO:tasks.workunit.client.1.smithi122.stdout:8/914: rename d3/d31/fff to d3/d31/f119 0 2024-09-13T02:50:59.348 INFO:tasks.workunit.client.1.smithi122.stdout:8/915: dread - d3/d31/fdb zero size 2024-09-13T02:50:59.353 INFO:tasks.workunit.client.1.smithi122.stdout:9/990: unlink d8/d16/d3d/d59/d23/d1f/f2d 0 2024-09-13T02:50:59.353 INFO:tasks.workunit.client.1.smithi122.stdout:9/991: truncate d8/d16/d3e/fd6 4439599 0 2024-09-13T02:50:59.353 INFO:tasks.workunit.client.1.smithi122.stdout:0/989: dread d1/d4b/f7c [0,4194304] 0 2024-09-13T02:50:59.355 INFO:tasks.workunit.client.1.smithi122.stdout:8/916: rmdir d3/d31/d52/d89 39 2024-09-13T02:50:59.355 INFO:tasks.workunit.client.1.smithi122.stdout:8/917: write d3/da6/fe2 [222888,50150] 0 2024-09-13T02:50:59.356 INFO:tasks.workunit.client.1.smithi122.stdout:9/992: creat d8/d16/d3d/d59/d49/f12f x:0 0 0 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:8/918: mknod d3/d31/d52/d89/d8b/d5c/dfe/c11a 0 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:1/992: sync 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:8/919: creat d3/d31/d52/d89/d8b/d104/f11b x:0 0 0 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:8/920: creat d3/d31/f11c x:0 0 0 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:8/921: dread - d3/d31/f11c zero size 2024-09-13T02:50:59.360 INFO:tasks.workunit.client.1.smithi122.stdout:2/916: dwrite d0/d1e/f38 [0,4194304] 0 2024-09-13T02:50:59.364 INFO:tasks.workunit.client.1.smithi122.stdout:9/993: unlink d8/d16/d3d/c119 0 2024-09-13T02:50:59.371 INFO:tasks.workunit.client.1.smithi122.stdout:0/990: dwrite d1/f13f [0,4194304] 0 2024-09-13T02:50:59.372 INFO:tasks.workunit.client.1.smithi122.stdout:1/993: symlink dc/de/d18/d22/d1c/l14c 0 2024-09-13T02:50:59.372 INFO:tasks.workunit.client.1.smithi122.stdout:1/994: dread - dc/de/d18/d22/d1c/d47/fdf zero size 2024-09-13T02:50:59.375 INFO:tasks.workunit.client.1.smithi122.stdout:8/922: rename d3/d53/f41 to d3/d53/f11d 0 2024-09-13T02:50:59.379 INFO:tasks.workunit.client.1.smithi122.stdout:2/917: rename d0/d1c/d3b/d41/d4e/d90/df9/c123 to d0/d1c/d3b/d41/d4e/d90/c12c 0 2024-09-13T02:50:59.379 INFO:tasks.workunit.client.1.smithi122.stdout:1/995: write dc/d38/d51/fcb [1440427,66793] 0 2024-09-13T02:50:59.387 INFO:tasks.workunit.client.1.smithi122.stdout:1/996: dread dc/d38/db1/deb/d132/f23 [0,4194304] 0 2024-09-13T02:50:59.387 INFO:tasks.workunit.client.1.smithi122.stdout:1/997: chown dc/de/d18/d22/d1c/d47/f110 543778497 1 2024-09-13T02:50:59.388 INFO:tasks.workunit.client.1.smithi122.stdout:8/923: mkdir d3/d31/d52/d89/d8b/d104/d11e 0 2024-09-13T02:50:59.388 INFO:tasks.workunit.client.1.smithi122.stdout:8/924: creat d3/da/d91/f11f x:0 0 0 2024-09-13T02:50:59.388 INFO:tasks.workunit.client.1.smithi122.stdout:8/925: dread - d3/d31/f11c zero size 2024-09-13T02:50:59.392 INFO:tasks.workunit.client.1.smithi122.stdout:9/994: dwrite d8/d16/d3d/d59/d7d/fe6 [4194304,4194304] 0 2024-09-13T02:50:59.393 INFO:tasks.workunit.client.1.smithi122.stdout:2/918: write d0/d1e/d26/d3d/d84/fbb [650588,87773] 0 2024-09-13T02:50:59.396 INFO:tasks.workunit.client.1.smithi122.stdout:1/998: creat dc/d38/f14d x:0 0 0 2024-09-13T02:50:59.396 INFO:tasks.workunit.client.1.smithi122.stdout:1/999: write dc/de/d18/d22/f127 [966094,64995] 0 2024-09-13T02:50:59.401 INFO:tasks.workunit.client.1.smithi122.stdout:8/926: symlink d3/l120 0 2024-09-13T02:50:59.407 INFO:tasks.workunit.client.1.smithi122.stdout:9/995: mknod d8/d16/dfb/c130 0 2024-09-13T02:50:59.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/919: unlink d0/d1e/d22/d29/la7 0 2024-09-13T02:50:59.409 INFO:tasks.workunit.client.1.smithi122.stdout:2/920: getdents d0/d1c/d3b/d41/d4e/dd7 0 2024-09-13T02:50:59.410 INFO:tasks.workunit.client.1.smithi122.stdout:2/921: read - d0/d1e/d2e/d3e/d116/f126 zero size 2024-09-13T02:50:59.410 INFO:tasks.workunit.client.1.smithi122.stdout:2/922: creat d0/d1e/d92/f12d x:0 0 0 2024-09-13T02:50:59.410 INFO:tasks.workunit.client.1.smithi122.stdout:2/923: creat d0/d1e/f12e x:0 0 0 2024-09-13T02:50:59.411 INFO:tasks.workunit.client.1.smithi122.stdout:8/927: mkdir d3/d53/d34/d94/deb/d121 0 2024-09-13T02:50:59.416 INFO:tasks.workunit.client.1.smithi122.stdout:8/928: dread d3/da6/fe2 [0,4194304] 0 2024-09-13T02:50:59.419 INFO:tasks.workunit.client.1.smithi122.stdout:0/991: rename d1/d11a/da/d92/d94/d137 to d1/d11a/d149 0 2024-09-13T02:50:59.419 INFO:tasks.workunit.client.1.smithi122.stdout:0/992: write d1/d11a/da/d92/dbb/f146 [1245689,89100] 0 2024-09-13T02:50:59.431 INFO:tasks.workunit.client.1.smithi122.stdout:2/924: creat d0/d1e/d26/dbd/f12f x:0 0 0 2024-09-13T02:50:59.433 INFO:tasks.workunit.client.1.smithi122.stdout:0/993: rename d1/d5/d10/d29/d32/d83/dd7/fdd to d1/d11a/da/f14a 0 2024-09-13T02:50:59.433 INFO:tasks.workunit.client.1.smithi122.stdout:0/994: read d1/d11a/da/fc3 [195840,98872] 0 2024-09-13T02:50:59.434 INFO:tasks.workunit.client.1.smithi122.stdout:9/996: mknod d8/d16/d3d/d59/d7d/d83/c131 0 2024-09-13T02:50:59.434 INFO:tasks.workunit.client.1.smithi122.stdout:9/997: readlink d8/d16/l9e 0 2024-09-13T02:50:59.438 INFO:tasks.workunit.client.1.smithi122.stdout:2/925: mkdir d0/d1e/d2e/d5a/d130 0 2024-09-13T02:50:59.440 INFO:tasks.workunit.client.1.smithi122.stdout:2/926: creat d0/d1e/d26/d3d/dea/f131 x:0 0 0 2024-09-13T02:50:59.440 INFO:tasks.workunit.client.1.smithi122.stdout:5/953: sync 2024-09-13T02:50:59.440 INFO:tasks.workunit.client.1.smithi122.stdout:5/954: chown d0/da/d48/c3d 19 1 2024-09-13T02:50:59.441 INFO:tasks.workunit.client.1.smithi122.stdout:2/927: creat d0/d1c/d3b/d41/f132 x:0 0 0 2024-09-13T02:50:59.442 INFO:tasks.workunit.client.1.smithi122.stdout:2/928: symlink d0/d55/d70/d59/dfe/d115/l133 0 2024-09-13T02:50:59.442 INFO:tasks.workunit.client.1.smithi122.stdout:2/929: chown d0/d1c/d3b/d41/d4e/fe4 2283 1 2024-09-13T02:50:59.442 INFO:tasks.workunit.client.1.smithi122.stdout:2/930: fdatasync d0/d1e/d26/d3d/d84/fbb 0 2024-09-13T02:50:59.510 INFO:tasks.workunit.client.1.smithi122.stdout:9/998: dwrite d8/f28 [0,4194304] 0 2024-09-13T02:50:59.510 INFO:tasks.workunit.client.1.smithi122.stdout:9/999: readlink d8/l15 0 2024-09-13T02:50:59.522 INFO:tasks.workunit.client.1.smithi122.stdout:2/931: dwrite d0/d1e/d22/f37 [0,4194304] 0 2024-09-13T02:50:59.523 INFO:tasks.workunit.client.1.smithi122.stdout:5/955: dwrite d0/d1d/fd0 [0,4194304] 0 2024-09-13T02:50:59.523 INFO:tasks.workunit.client.1.smithi122.stdout:5/956: creat d0/da/d8c/d8f/f13f x:0 0 0 2024-09-13T02:50:59.524 INFO:tasks.workunit.client.1.smithi122.stdout:2/932: unlink d0/d1e/d22/l8d 0 2024-09-13T02:50:59.531 INFO:tasks.workunit.client.1.smithi122.stdout:5/957: creat d0/d17/d36/d3f/de7/f140 x:0 0 0 2024-09-13T02:50:59.531 INFO:tasks.workunit.client.1.smithi122.stdout:5/958: readlink d0/d17/d36/d99/l119 0 2024-09-13T02:50:59.532 INFO:tasks.workunit.client.1.smithi122.stdout:5/959: write d0/d2/d33/f5e [3424632,112685] 0 2024-09-13T02:50:59.532 INFO:tasks.workunit.client.1.smithi122.stdout:5/960: chown d0/da/d8c/d8f/fbb 1 1 2024-09-13T02:50:59.533 INFO:tasks.workunit.client.1.smithi122.stdout:2/933: symlink d0/dc0/dde/d105/l134 0 2024-09-13T02:50:59.533 INFO:tasks.workunit.client.1.smithi122.stdout:2/934: readlink d0/d1e/d92/l10d 0 2024-09-13T02:50:59.536 INFO:tasks.workunit.client.1.smithi122.stdout:5/961: rmdir d0/d17/d36/d3f/d4c/d7f/dcb 39 2024-09-13T02:50:59.537 INFO:tasks.workunit.client.1.smithi122.stdout:5/962: unlink d0/da/la6 0 2024-09-13T02:50:59.549 INFO:tasks.workunit.client.1.smithi122.stdout:5/963: write d0/d17/d36/d8b/f96 [675688,122447] 0 2024-09-13T02:50:59.549 INFO:tasks.workunit.client.1.smithi122.stdout:5/964: chown d0/d17/d36/f13c 5132 1 2024-09-13T02:50:59.558 INFO:tasks.workunit.client.1.smithi122.stdout:2/935: dwrite d0/d55/d70/d59/f6e [0,4194304] 0 2024-09-13T02:50:59.562 INFO:tasks.workunit.client.1.smithi122.stdout:2/936: rmdir d0/d1e/d26/d3d 39 2024-09-13T02:50:59.563 INFO:tasks.workunit.client.1.smithi122.stdout:2/937: rename d0/d1e/d22/d29/d11b/dcf/c11f to d0/d1e/c135 0 2024-09-13T02:50:59.563 INFO:tasks.workunit.client.1.smithi122.stdout:2/938: fsync d0/d1e/f38 0 2024-09-13T02:50:59.564 INFO:tasks.workunit.client.1.smithi122.stdout:2/939: creat d0/d1e/d22/d29/d11b/f136 x:0 0 0 2024-09-13T02:50:59.569 INFO:tasks.workunit.client.1.smithi122.stdout:5/965: dwrite d0/d17/d36/d25/fb5 [0,4194304] 0 2024-09-13T02:50:59.569 INFO:tasks.workunit.client.1.smithi122.stdout:5/966: fsync d0/d17/d36/d3f/d4c/d7f/dcb/ffe 0 2024-09-13T02:50:59.573 INFO:tasks.workunit.client.1.smithi122.stdout:5/967: rmdir d0/d2/d33 39 2024-09-13T02:50:59.586 INFO:tasks.workunit.client.1.smithi122.stdout:2/940: dwrite d0/d5d/f91 [0,4194304] 0 2024-09-13T02:50:59.586 INFO:tasks.workunit.client.1.smithi122.stdout:5/968: dwrite d0/f84 [0,4194304] 0 2024-09-13T02:50:59.587 INFO:tasks.workunit.client.1.smithi122.stdout:2/941: mkdir d0/d1e/d26/d3d/d84/ddb/d137 0 2024-09-13T02:50:59.588 INFO:tasks.workunit.client.1.smithi122.stdout:2/942: creat d0/d1e/d26/f138 x:0 0 0 2024-09-13T02:50:59.589 INFO:tasks.workunit.client.1.smithi122.stdout:2/943: symlink d0/d1c/d3b/d41/l139 0 2024-09-13T02:50:59.596 INFO:tasks.workunit.client.1.smithi122.stdout:5/969: dread d0/d2/f1b [0,4194304] 0 2024-09-13T02:50:59.597 INFO:tasks.workunit.client.1.smithi122.stdout:2/944: dread d0/d1e/d22/f37 [0,4194304] 0 2024-09-13T02:50:59.599 INFO:tasks.workunit.client.1.smithi122.stdout:2/945: dread d0/d1e/d22/f125 [0,4194304] 0 2024-09-13T02:50:59.599 INFO:tasks.workunit.client.1.smithi122.stdout:2/946: fdatasync d0/d1e/d22/d29/d11b/f136 0 2024-09-13T02:50:59.608 INFO:tasks.workunit.client.1.smithi122.stdout:2/947: dread d0/d1e/d2e/d5a/fd6 [0,4194304] 0 2024-09-13T02:50:59.610 INFO:tasks.workunit.client.1.smithi122.stdout:5/970: dwrite d0/d17/d36/d3f/fd4 [0,4194304] 0 2024-09-13T02:50:59.610 INFO:tasks.workunit.client.1.smithi122.stdout:5/971: chown d0/d17/d36/d3f/d4c/f77 514818367 1 2024-09-13T02:50:59.611 INFO:tasks.workunit.client.1.smithi122.stdout:2/948: mkdir d0/d1e/d26/d3d/d84/d13a 0 2024-09-13T02:50:59.625 INFO:tasks.workunit.client.1.smithi122.stdout:5/972: rename d0/d2/lb0 to d0/d17/d36/d8b/daf/l141 0 2024-09-13T02:50:59.626 INFO:tasks.workunit.client.1.smithi122.stdout:8/929: sync 2024-09-13T02:50:59.626 INFO:tasks.workunit.client.1.smithi122.stdout:0/995: sync 2024-09-13T02:50:59.629 INFO:tasks.workunit.client.1.smithi122.stdout:0/996: mknod d1/d11a/da/d11d/c14b 0 2024-09-13T02:50:59.629 INFO:tasks.workunit.client.1.smithi122.stdout:0/997: write d1/d11a/da/d92/f10f [86980,104470] 0 2024-09-13T02:50:59.629 INFO:tasks.workunit.client.1.smithi122.stdout:0/998: read - d1/d5/d10/d29/d32/d83/db3/df4/f13a zero size 2024-09-13T02:50:59.630 INFO:tasks.workunit.client.1.smithi122.stdout:8/930: creat d3/da/d111/f122 x:0 0 0 2024-09-13T02:50:59.632 INFO:tasks.workunit.client.1.smithi122.stdout:5/973: write d0/da/f5b [3366778,21070] 0 2024-09-13T02:50:59.632 INFO:tasks.workunit.client.1.smithi122.stdout:5/974: readlink d0/d17/d36/d25/l57 0 2024-09-13T02:50:59.632 INFO:tasks.workunit.client.1.smithi122.stdout:0/999: rename d1/d5/d10/d29/d32/d5f/le5 to d1/d5/d10/d29/d32/d83/l14c 0 2024-09-13T02:50:59.634 INFO:tasks.workunit.client.1.smithi122.stdout:8/931: symlink d3/d53/d21/d92/l123 0 2024-09-13T02:50:59.634 INFO:tasks.workunit.client.1.smithi122.stdout:8/932: creat d3/d31/d52/d89/d8b/d104/f124 x:0 0 0 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/975: write d0/f92 [2282444,46979] 0 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/976: readlink d0/d17/d36/lc7 0 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/977: truncate d0/d2/d33/f5e 4496751 0 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/978: chown d0/d17/d36/d25/f74 69224205 1 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/979: fdatasync d0/d17/d36/d25/f85 0 2024-09-13T02:50:59.638 INFO:tasks.workunit.client.1.smithi122.stdout:5/980: dread - d0/f13d zero size 2024-09-13T02:50:59.639 INFO:tasks.workunit.client.1.smithi122.stdout:8/933: creat d3/d53/d21/d92/f125 x:0 0 0 2024-09-13T02:50:59.643 INFO:tasks.workunit.client.1.smithi122.stdout:5/981: creat d0/d17/d36/d3f/f142 x:0 0 0 2024-09-13T02:50:59.647 INFO:tasks.workunit.client.1.smithi122.stdout:8/934: rename d3/d53/l80 to d3/d53/d34/d94/deb/d121/l126 0 2024-09-13T02:50:59.652 INFO:tasks.workunit.client.1.smithi122.stdout:8/935: rename d3/da/d1e/fee to d3/da/d91/f127 0 2024-09-13T02:50:59.653 INFO:tasks.workunit.client.1.smithi122.stdout:8/936: mknod d3/d31/d65/de4/c128 0 2024-09-13T02:50:59.653 INFO:tasks.workunit.client.1.smithi122.stdout:8/937: readlink d3/da/d1e/l60 0 2024-09-13T02:50:59.655 INFO:tasks.workunit.client.1.smithi122.stdout:8/938: creat d3/d31/d65/de4/f129 x:0 0 0 2024-09-13T02:50:59.657 INFO:tasks.workunit.client.1.smithi122.stdout:8/939: unlink d3/d31/d52/d89/d8b/d104/dcb/d76/dbb/fe1 0 2024-09-13T02:50:59.658 INFO:tasks.workunit.client.1.smithi122.stdout:5/982: dwrite d0/d2/d33/f5e [4194304,4194304] 0 2024-09-13T02:50:59.663 INFO:tasks.workunit.client.1.smithi122.stdout:5/983: dread d0/da/d48/fdd [0,4194304] 0 2024-09-13T02:50:59.666 INFO:tasks.workunit.client.1.smithi122.stdout:8/940: dread d3/d53/d21/f33 [0,4194304] 0 2024-09-13T02:50:59.666 INFO:tasks.workunit.client.1.smithi122.stdout:8/941: dread d3/d31/f119 [0,4194304] 0 2024-09-13T02:50:59.669 INFO:tasks.workunit.client.1.smithi122.stdout:8/942: rename d3/da/d1e/ff6 to d3/d31/d52/d89/d8b/f12a 0 2024-09-13T02:50:59.672 INFO:tasks.workunit.client.1.smithi122.stdout:5/984: dread d0/da/fef [0,4194304] 0 2024-09-13T02:50:59.673 INFO:tasks.workunit.client.1.smithi122.stdout:5/985: symlink d0/da/d8c/d8f/da0/d107/l143 0 2024-09-13T02:50:59.673 INFO:tasks.workunit.client.1.smithi122.stdout:5/986: dread - d0/d17/d36/d99/ff5 zero size 2024-09-13T02:50:59.676 INFO:tasks.workunit.client.1.smithi122.stdout:5/987: dread d0/d17/d36/d3f/de7/f100 [0,4194304] 0 2024-09-13T02:50:59.676 INFO:tasks.workunit.client.1.smithi122.stdout:5/988: truncate d0/da/d48/db4/f10d 4455077 0 2024-09-13T02:50:59.677 INFO:tasks.workunit.client.1.smithi122.stdout:5/989: fdatasync d0/da/dbf/f115 0 2024-09-13T02:50:59.678 INFO:tasks.workunit.client.1.smithi122.stdout:5/990: link d0/d17/l104 d0/da/d48/d63/l144 0 2024-09-13T02:50:59.678 INFO:tasks.workunit.client.1.smithi122.stdout:5/991: getdents d0/da/d8c/d8f/df7 0 2024-09-13T02:50:59.678 INFO:tasks.workunit.client.1.smithi122.stdout:5/992: rmdir d0/d17/d36 39 2024-09-13T02:50:59.687 INFO:tasks.workunit.client.1.smithi122.stdout:5/993: read d0/d17/d36/d3f/d4c/d7f/dd1/fea [2192277,29621] 0 2024-09-13T02:50:59.687 INFO:tasks.workunit.client.1.smithi122.stdout:5/994: rmdir d0/d17/d36/d99 39 2024-09-13T02:50:59.688 INFO:tasks.workunit.client.1.smithi122.stdout:5/995: mknod d0/d17/d36/d3f/d11e/c145 0 2024-09-13T02:50:59.689 INFO:tasks.workunit.client.1.smithi122.stdout:5/996: rmdir d0/d17/d36/d8b/daf/d105 0 2024-09-13T02:50:59.691 INFO:tasks.workunit.client.1.smithi122.stdout:5/997: link d0/da/d48/d63/c12e d0/da/d8c/d8f/c146 0 2024-09-13T02:50:59.835 INFO:tasks.workunit.client.1.smithi122.stdout:8/943: sync 2024-09-13T02:50:59.835 INFO:tasks.workunit.client.1.smithi122.stdout:2/949: sync 2024-09-13T02:50:59.835 INFO:tasks.workunit.client.1.smithi122.stdout:5/998: sync 2024-09-13T02:50:59.835 INFO:tasks.workunit.client.1.smithi122.stdout:5/999: truncate d0/d17/f54 829657 0 2024-09-13T02:50:59.836 INFO:tasks.workunit.client.1.smithi122.stdout:2/950: symlink d0/d55/d70/d59/dd2/d106/l13b 0 2024-09-13T02:50:59.842 INFO:tasks.workunit.client.1.smithi122.stdout:2/951: write d0/d1c/d3b/d41/d4e/d75/d95/fac [495623,66749] 0 2024-09-13T02:50:59.842 INFO:tasks.workunit.client.1.smithi122.stdout:2/952: write d0/d1e/d2e/f97 [845803,5541] 0 2024-09-13T02:50:59.843 INFO:tasks.workunit.client.1.smithi122.stdout:8/944: write d3/f103 [2458654,130164] 0 2024-09-13T02:50:59.845 INFO:tasks.workunit.client.1.smithi122.stdout:2/953: symlink d0/d1e/d22/d29/d11b/l13c 0 2024-09-13T02:50:59.845 INFO:tasks.workunit.client.1.smithi122.stdout:2/954: chown d0/d55/d70/d59/cf3 333568 1 2024-09-13T02:50:59.845 INFO:tasks.workunit.client.1.smithi122.stdout:2/955: write d0/d1e/d22/f47 [7869864,96155] 0 2024-09-13T02:50:59.845 INFO:tasks.workunit.client.1.smithi122.stdout:2/956: creat d0/d1c/d3b/d41/d4e/d75/d95/dd4/f13d x:0 0 0 2024-09-13T02:50:59.847 INFO:tasks.workunit.client.1.smithi122.stdout:2/957: creat d0/d55/d70/d59/dd2/d106/f13e x:0 0 0 2024-09-13T02:50:59.849 INFO:tasks.workunit.client.1.smithi122.stdout:2/958: write d0/f18 [320973,92913] 0 2024-09-13T02:50:59.850 INFO:tasks.workunit.client.1.smithi122.stdout:8/945: dread d3/da/f10 [0,4194304] 0 2024-09-13T02:50:59.851 INFO:tasks.workunit.client.1.smithi122.stdout:8/946: creat d3/d31/d52/d89/d8b/d104/f12b x:0 0 0 2024-09-13T02:50:59.851 INFO:tasks.workunit.client.1.smithi122.stdout:2/959: creat d0/d1e/d2e/f13f x:0 0 0 2024-09-13T02:50:59.853 INFO:tasks.workunit.client.1.smithi122.stdout:8/947: mknod d3/d31/d52/d89/d8b/d104/dcb/d76/dbb/c12c 0 2024-09-13T02:50:59.853 INFO:tasks.workunit.client.1.smithi122.stdout:8/948: dread - d3/ff5 zero size 2024-09-13T02:50:59.853 INFO:tasks.workunit.client.1.smithi122.stdout:8/949: write d3/d31/d52/fb4 [1143726,96881] 0 2024-09-13T02:50:59.854 INFO:tasks.workunit.client.1.smithi122.stdout:8/950: unlink d3/d53/d34/d94/caf 0 2024-09-13T02:50:59.858 INFO:tasks.workunit.client.1.smithi122.stdout:2/960: dread d0/d1e/d22/f32 [0,4194304] 0 2024-09-13T02:50:59.858 INFO:tasks.workunit.client.1.smithi122.stdout:2/961: fsync d0/d55/d70/d59/f6e 0 2024-09-13T02:50:59.858 INFO:tasks.workunit.client.1.smithi122.stdout:2/962: creat d0/d1e/d26/dbd/f140 x:0 0 0 2024-09-13T02:50:59.861 INFO:tasks.workunit.client.1.smithi122.stdout:2/963: symlink d0/d1e/d22/l141 0 2024-09-13T02:50:59.865 INFO:tasks.workunit.client.1.smithi122.stdout:8/951: dread d3/d31/d52/f87 [0,4194304] 0 2024-09-13T02:50:59.866 INFO:tasks.workunit.client.1.smithi122.stdout:8/952: creat d3/f12d x:0 0 0 2024-09-13T02:50:59.866 INFO:tasks.workunit.client.1.smithi122.stdout:8/953: creat d3/d31/d52/d89/d8b/d104/f12e x:0 0 0 2024-09-13T02:50:59.866 INFO:tasks.workunit.client.1.smithi122.stdout:8/954: write d3/d53/d34/d94/d100/f118 [783904,26005] 0 2024-09-13T02:50:59.868 INFO:tasks.workunit.client.1.smithi122.stdout:8/955: unlink d3/da/d7d/lab 0 2024-09-13T02:50:59.878 INFO:tasks.workunit.client.1.smithi122.stdout:2/964: dwrite d0/d1e/d92/f12d [0,4194304] 0 2024-09-13T02:50:59.893 INFO:tasks.workunit.client.1.smithi122.stdout:8/956: dwrite d3/d53/d4d/f62 [4194304,4194304] 0 2024-09-13T02:50:59.894 INFO:tasks.workunit.client.1.smithi122.stdout:8/957: symlink d3/da/d91/l12f 0 2024-09-13T02:50:59.895 INFO:tasks.workunit.client.1.smithi122.stdout:2/965: dwrite d0/d1e/d92/f12d [0,4194304] 0 2024-09-13T02:50:59.896 INFO:tasks.workunit.client.1.smithi122.stdout:8/958: rename d3/d31/d52/d89/f10f to d3/d31/d52/d89/d8b/d104/dcb/d76/dbb/f130 0 2024-09-13T02:50:59.896 INFO:tasks.workunit.client.1.smithi122.stdout:8/959: write d3/da/d1f/f9c [614648,103201] 0 2024-09-13T02:50:59.897 INFO:tasks.workunit.client.1.smithi122.stdout:2/966: creat d0/d5d/f142 x:0 0 0 2024-09-13T02:50:59.901 INFO:tasks.workunit.client.1.smithi122.stdout:8/960: fdatasync d3/d53/d34/d94/d100/f118 0 2024-09-13T02:50:59.909 INFO:tasks.workunit.client.1.smithi122.stdout:2/967: read d0/d1e/d22/f32 [8149908,112496] 0 2024-09-13T02:50:59.914 INFO:tasks.workunit.client.1.smithi122.stdout:2/968: rename d0/d1e/d2e to d0/d1e/d26/d3d/d84/ddb/d10f/d143 0 2024-09-13T02:50:59.915 INFO:tasks.workunit.client.1.smithi122.stdout:2/969: read - d0/d1c/d3b/d41/d4e/f108 zero size 2024-09-13T02:50:59.915 INFO:tasks.workunit.client.1.smithi122.stdout:2/970: symlink d0/d1e/d26/d3d/d84/l144 0 2024-09-13T02:50:59.924 INFO:tasks.workunit.client.1.smithi122.stdout:8/961: dwrite d3/d53/d21/d92/f125 [0,4194304] 0 2024-09-13T02:50:59.928 INFO:tasks.workunit.client.1.smithi122.stdout:8/962: creat d3/d31/d52/d89/d8b/d5c/d10b/f131 x:0 0 0 2024-09-13T02:50:59.929 INFO:tasks.workunit.client.1.smithi122.stdout:2/971: read d0/d5d/f91 [1836039,113400] 0 2024-09-13T02:50:59.930 INFO:tasks.workunit.client.1.smithi122.stdout:8/963: creat d3/d31/d52/d89/d8b/d104/dcb/d76/f132 x:0 0 0 2024-09-13T02:50:59.936 INFO:tasks.workunit.client.1.smithi122.stdout:8/964: getdents d3 0 2024-09-13T02:50:59.944 INFO:tasks.workunit.client.1.smithi122.stdout:8/965: truncate d3/d31/d52/d89/ff2 4016032 0 2024-09-13T02:50:59.944 INFO:tasks.workunit.client.1.smithi122.stdout:8/966: creat d3/d31/d52/d89/d8b/d104/dcb/d76/f133 x:0 0 0 2024-09-13T02:50:59.952 INFO:tasks.workunit.client.1.smithi122.stdout:8/967: dread d3/d31/d52/d89/d8b/fd3 [0,4194304] 0 2024-09-13T02:50:59.954 INFO:tasks.workunit.client.1.smithi122.stdout:8/968: link d3/d31/f11c d3/da/d111/f134 0 2024-09-13T02:50:59.954 INFO:tasks.workunit.client.1.smithi122.stdout:8/969: creat d3/d31/d65/de4/f135 x:0 0 0 2024-09-13T02:50:59.960 INFO:tasks.workunit.client.1.smithi122.stdout:8/970: dread d3/d31/f3b [0,4194304] 0 2024-09-13T02:50:59.969 INFO:tasks.workunit.client.1.smithi122.stdout:8/971: write d3/d31/d52/d89/ff2 [3781264,13332] 0 2024-09-13T02:50:59.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/972: dread d3/d31/f61 [0,4194304] 0 2024-09-13T02:50:59.976 INFO:tasks.workunit.client.1.smithi122.stdout:8/973: chown d3/d53/d34/ff1 12760750 1 2024-09-13T02:50:59.977 INFO:tasks.workunit.client.1.smithi122.stdout:8/974: mkdir d3/d31/d52/d89/db1/d136 0 2024-09-13T02:50:59.977 INFO:tasks.workunit.client.1.smithi122.stdout:8/975: truncate d3/d53/d21/ff9 36160 0 2024-09-13T02:50:59.990 INFO:tasks.workunit.client.1.smithi122.stdout:8/976: dwrite d3/d31/f11c [0,4194304] 0 2024-09-13T02:50:59.998 INFO:tasks.workunit.client.1.smithi122.stdout:8/977: dread d3/fec [0,4194304] 0 2024-09-13T02:50:59.998 INFO:tasks.workunit.client.1.smithi122.stdout:8/978: truncate d3/da6/f117 2534822 0 2024-09-13T02:51:00.000 INFO:tasks.workunit.client.1.smithi122.stdout:8/979: rename d3/da/l101 to d3/da/d1f/l137 0 2024-09-13T02:51:00.001 INFO:tasks.workunit.client.1.smithi122.stdout:8/980: rename d3/d53/d4d/f6b to d3/da/d7d/f138 0 2024-09-13T02:51:00.002 INFO:tasks.workunit.client.1.smithi122.stdout:8/981: readlink d3/d31/l114 0 2024-09-13T02:51:00.003 INFO:tasks.workunit.client.1.smithi122.stdout:8/982: rename d3/d31/f99 to d3/f139 0 2024-09-13T02:51:00.010 INFO:tasks.workunit.client.1.smithi122.stdout:8/983: write d3/d31/f85 [2846654,125215] 0 2024-09-13T02:51:00.014 INFO:tasks.workunit.client.1.smithi122.stdout:8/984: rmdir d3/d53/d21/d92 39 2024-09-13T02:51:00.016 INFO:tasks.workunit.client.1.smithi122.stdout:8/985: creat d3/d53/d21/d92/f13a x:0 0 0 2024-09-13T02:51:00.019 INFO:tasks.workunit.client.1.smithi122.stdout:8/986: getdents d3/d31 0 2024-09-13T02:51:00.021 INFO:tasks.workunit.client.1.smithi122.stdout:2/972: sync 2024-09-13T02:51:00.022 INFO:tasks.workunit.client.1.smithi122.stdout:8/987: rmdir d3/d53/d34/d94/deb 39 2024-09-13T02:51:00.022 INFO:tasks.workunit.client.1.smithi122.stdout:8/988: fdatasync d3/d31/f6e 0 2024-09-13T02:51:00.022 INFO:tasks.workunit.client.1.smithi122.stdout:8/989: creat d3/da/d91/f13b x:0 0 0 2024-09-13T02:51:00.024 INFO:tasks.workunit.client.1.smithi122.stdout:2/973: rename d0/d1c/d3b/d41/d4e/d90/f12a to d0/d1e/d26/d3d/d84/ddb/d10f/f145 0 2024-09-13T02:51:00.027 INFO:tasks.workunit.client.1.smithi122.stdout:8/990: link f2 d3/d31/d52/d89/d8b/d104/d11e/f13c 0 2024-09-13T02:51:00.028 INFO:tasks.workunit.client.1.smithi122.stdout:8/991: truncate d3/d31/f6e 477567 0 2024-09-13T02:51:00.032 INFO:tasks.workunit.client.1.smithi122.stdout:8/992: dread d3/d31/f61 [0,4194304] 0 2024-09-13T02:51:00.032 INFO:tasks.workunit.client.1.smithi122.stdout:8/993: creat d3/d53/d21/d92/f13d x:0 0 0 2024-09-13T02:51:00.032 INFO:tasks.workunit.client.1.smithi122.stdout:8/994: stat d3/da/d1f/f63 0 2024-09-13T02:51:00.033 INFO:tasks.workunit.client.1.smithi122.stdout:2/974: dread d0/d1e/f25 [0,4194304] 0 2024-09-13T02:51:00.033 INFO:tasks.workunit.client.1.smithi122.stdout:2/975: fsync d0/d1e/d22/f125 0 2024-09-13T02:51:00.035 INFO:tasks.workunit.client.1.smithi122.stdout:2/976: mknod d0/d1c/d3b/d41/d4e/dd7/c146 0 2024-09-13T02:51:00.036 INFO:tasks.workunit.client.1.smithi122.stdout:2/977: creat d0/d1e/d22/f147 x:0 0 0 2024-09-13T02:51:00.037 INFO:tasks.workunit.client.1.smithi122.stdout:2/978: mkdir d0/d1c/d3b/d41/d4e/d90/d148 0 2024-09-13T02:51:00.039 INFO:tasks.workunit.client.1.smithi122.stdout:2/979: rmdir d0 39 2024-09-13T02:51:00.039 INFO:tasks.workunit.client.1.smithi122.stdout:2/980: write d0/d55/d70/d59/dd2/de6/ff8 [955580,3836] 0 2024-09-13T02:51:00.061 INFO:tasks.workunit.client.1.smithi122.stdout:8/995: dwrite d3/d53/d21/f4b [0,4194304] 0 2024-09-13T02:51:00.061 INFO:tasks.workunit.client.1.smithi122.stdout:2/981: dwrite d0/d1e/d26/d3d/d84/ddb/d10f/d143/d3e/f46 [4194304,4194304] 0 2024-09-13T02:51:00.061 INFO:tasks.workunit.client.1.smithi122.stdout:2/982: truncate d0/d1c/f31 2076438 0 2024-09-13T02:51:00.061 INFO:tasks.workunit.client.1.smithi122.stdout:2/983: creat d0/d1c/d3b/d41/d8c/f149 x:0 0 0 2024-09-13T02:51:00.061 INFO:tasks.workunit.client.1.smithi122.stdout:8/996: mknod d3/d31/d52/d89/d8b/d104/c13e 0 2024-09-13T02:51:00.063 INFO:tasks.workunit.client.1.smithi122.stdout:2/984: link d0/d55/f81 d0/dc0/dde/f14a 0 2024-09-13T02:51:00.067 INFO:tasks.workunit.client.1.smithi122.stdout:2/985: symlink d0/d5d/l14b 0 2024-09-13T02:51:00.071 INFO:tasks.workunit.client.1.smithi122.stdout:8/997: rmdir d3/d31/d52/d89/d8b/d104 39 2024-09-13T02:51:00.071 INFO:tasks.workunit.client.1.smithi122.stdout:2/986: dread d0/d1e/d26/fa0 [0,4194304] 0 2024-09-13T02:51:00.072 INFO:tasks.workunit.client.1.smithi122.stdout:2/987: creat d0/d1e/d22/f14c x:0 0 0 2024-09-13T02:51:00.072 INFO:tasks.workunit.client.1.smithi122.stdout:2/988: stat d0/d1e/d22 0 2024-09-13T02:51:00.074 INFO:tasks.workunit.client.1.smithi122.stdout:8/998: unlink d3/d53/d4d/lae 0 2024-09-13T02:51:00.076 INFO:tasks.workunit.client.1.smithi122.stdout:2/989: dread d0/d5d/f91 [0,4194304] 0 2024-09-13T02:51:00.077 INFO:tasks.workunit.client.1.smithi122.stdout:8/999: dread f2 [4194304,4194304] 0 2024-09-13T02:51:00.078 INFO:tasks.workunit.client.1.smithi122.stdout:2/990: creat d0/d55/d70/f14d x:0 0 0 2024-09-13T02:51:00.102 INFO:tasks.workunit.client.1.smithi122.stdout:2/991: dwrite d0/d1e/d26/f138 [0,4194304] 0 2024-09-13T02:51:00.102 INFO:tasks.workunit.client.1.smithi122.stdout:2/992: write d0/d1e/d26/d3d/d84/ddb/d10f/f145 [579304,3649] 0 2024-09-13T02:51:00.152 INFO:tasks.workunit.client.1.smithi122.stdout:2/993: sync 2024-09-13T02:51:00.153 INFO:tasks.workunit.client.1.smithi122.stdout:2/994: creat d0/f14e x:0 0 0 2024-09-13T02:51:00.154 INFO:tasks.workunit.client.1.smithi122.stdout:2/995: creat d0/d1c/f14f x:0 0 0 2024-09-13T02:51:00.156 INFO:tasks.workunit.client.1.smithi122.stdout:2/996: unlink d0/f1b 0 2024-09-13T02:51:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 117 MiB/s rd, 139 MiB/s wr, 241 op/s 2024-09-13T02:51:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi100 to 1557M 2024-09-13T02:51:00.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:50:59 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 117 MiB/s rd, 139 MiB/s wr, 241 op/s 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi100 to 1557M 2024-09-13T02:51:00.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:50:59 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:00.234 INFO:tasks.workunit.client.1.smithi122.stdout:2/997: sync 2024-09-13T02:51:00.236 INFO:tasks.workunit.client.1.smithi122.stdout:2/998: unlink d0/d1c/f31 0 2024-09-13T02:51:00.255 INFO:tasks.workunit.client.1.smithi122.stdout:2/999: dwrite d0/d1e/d26/f43 [0,4194304] 0 2024-09-13T02:51:00.259 INFO:tasks.workunit.client.1.smithi122.stderr:+ rm -rf -- ./tmp.5rUVjpaYX2 2024-09-13T02:51:01.512 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:01 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.512 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:01 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.513 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:01 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.513 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:01 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:01 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:01 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:01 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:01 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:02.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:02 smithi122 ceph-mon[34559]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 194 MiB/s rd, 233 MiB/s wr, 410 op/s 2024-09-13T02:51:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:02 smithi100 ceph-mon[27894]: pgmap v9: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 194 MiB/s rd, 233 MiB/s wr, 410 op/s 2024-09-13T02:51:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:04 smithi100 ceph-mon[27894]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 210 MiB/s wr, 369 op/s 2024-09-13T02:51:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:04 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:04 smithi122 ceph-mon[34559]: pgmap v10: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 210 MiB/s wr, 369 op/s 2024-09-13T02:51:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:04 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.676 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Adjusting osd_memory_target on smithi122 to 2581M 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 210 MiB/s wr, 369 op/s 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:51:05.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:05 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:51:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Adjusting osd_memory_target on smithi122 to 2581M 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:05.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: pgmap v11: 65 pgs: 65 active+clean; 2.3 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 175 MiB/s rd, 210 MiB/s wr, 369 op/s 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:51:05.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:05 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:51:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2024-09-13T02:51:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:06 smithi122 ceph-mon[34559]: Deploying daemon node-exporter.smithi100 on smithi100 2024-09-13T02:51:06.843 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2024-09-13T02:51:06.844 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:06 smithi100 ceph-mon[27894]: Deploying daemon node-exporter.smithi100 on smithi100 2024-09-13T02:51:07.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:07 smithi100 ceph-mon[27894]: pgmap v12: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 181 MiB/s rd, 214 MiB/s wr, 494 op/s 2024-09-13T02:51:07.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:07 smithi122 ceph-mon[34559]: pgmap v12: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 181 MiB/s rd, 214 MiB/s wr, 494 op/s 2024-09-13T02:51:09.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:09 smithi122 ceph-mon[34559]: pgmap v13: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 113 MiB/s wr, 317 op/s 2024-09-13T02:51:10.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:09 smithi100 ceph-mon[27894]: pgmap v13: 65 pgs: 65 active+clean; 1.9 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 95 MiB/s rd, 113 MiB/s wr, 317 op/s 2024-09-13T02:51:11.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:11 smithi100 ceph-mon[27894]: pgmap v14: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 95 MiB/s rd, 114 MiB/s wr, 507 op/s 2024-09-13T02:51:12.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:11 smithi122 ceph-mon[34559]: pgmap v14: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 95 MiB/s rd, 114 MiB/s wr, 507 op/s 2024-09-13T02:51:13.290 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:51:13.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T02:51:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:13 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:13 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:13 smithi122 ceph-mon[34559]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2024-09-13T02:51:13.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:13 smithi122 ceph-mon[34559]: Deploying daemon alertmanager.smithi100 on smithi100 2024-09-13T02:51:13.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:13 smithi122 ceph-mon[34559]: pgmap v15: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 314 op/s 2024-09-13T02:51:13.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:13 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:13.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:13 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:13.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:13 smithi100 ceph-mon[27894]: Reconfiguring alertmanager.smithi100 (dependencies changed)... 2024-09-13T02:51:13.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:13 smithi100 ceph-mon[27894]: Deploying daemon alertmanager.smithi100 on smithi100 2024-09-13T02:51:13.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:13 smithi100 ceph-mon[27894]: pgmap v15: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 314 op/s 2024-09-13T02:51:15.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:15 smithi122 ceph-mon[34559]: pgmap v16: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 314 op/s 2024-09-13T02:51:16.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:15 smithi100 ceph-mon[27894]: pgmap v16: 65 pgs: 65 active+clean; 1010 MiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 314 op/s 2024-09-13T02:51:17.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:17 smithi122 ceph-mon[34559]: pgmap v17: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 511 op/s 2024-09-13T02:51:18.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:17 smithi100 ceph-mon[27894]: pgmap v17: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 511 op/s 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 -- 172.21.15.100:0/483500154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fc730 msgr2=0x7f3dd40fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/483500154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fc730 0x7f3dd40fcba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40048d0 tx=0x7f3dc4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 -- 172.21.15.100:0/483500154 shutdown_connections 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/483500154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fc730 0x7f3dd40fcba0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/483500154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fb460 0x7f3dd40fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 -- 172.21.15.100:0/483500154 >> 172.21.15.100:0/483500154 conn(0x7f3dd40f6c40 msgr2=0x7f3dd40f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 -- 172.21.15.100:0/483500154 shutdown_connections 2024-09-13T02:51:18.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.687+0000 7f3ddbda1640 1 -- 172.21.15.100:0/483500154 wait complete. 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 Processor -- start 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 -- start start 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fc730 0x7f3dd4112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40666d0 con 0x7f3dd40fb460 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3ddbda1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4066840 con 0x7f3dd40fc730 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3dd9b3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3dd9b3d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54312/0 (socket says 172.21.15.100:54312) 2024-09-13T02:51:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3dd9b3d640 1 -- 172.21.15.100:0/1860776492 learned_addr learned my addr 172.21.15.100:0/1860776492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.688+0000 7f3dd933c640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fc730 0x7f3dd4112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dd9b3d640 1 -- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fc730 msgr2=0x7f3dd4112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dd9b3d640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fc730 0x7f3dd4112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dd9b3d640 1 -- 172.21.15.100:0/1860776492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4005040 con 0x7f3dd40fb460 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dd9b3d640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000eb70 tx=0x7f3dd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd0007c30 con 0x7f3dd40fb460 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd4112850 con 0x7f3dd40fb460 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3dd000f040 con 0x7f3dd40fb460 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd000ca60 con 0x7f3dd40fb460 2024-09-13T02:51:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.689+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd4112dc0 con 0x7f3dd40fb460 2024-09-13T02:51:18.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.691+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd40fa8c0 con 0x7f3dd40fb460 2024-09-13T02:51:18.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.691+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f3dd000cbc0 con 0x7f3dd40fb460 2024-09-13T02:51:18.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.692+0000 7f3dca7fc640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 0x7f3dc0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:18.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.692+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3dd008dc10 con 0x7f3dd40fb460 2024-09-13T02:51:18.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.692+0000 7f3dd933c640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 0x7f3dc0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:18.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.692+0000 7f3dd933c640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 0x7f3dc0070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:18.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.698+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3dd0057600 con 0x7f3dd40fb460 2024-09-13T02:51:18.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.972+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd4100ad0 con 0x7f3dc006e6e0 2024-09-13T02:51:18.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.974+0000 7f3dca7fc640 1 -- 172.21.15.100:0/1860776492 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3dd4100ad0 con 0x7f3dc006e6e0 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 msgr2=0x7f3dc0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 0x7f3dc0070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4035040 comp rx=0 tx=0).stop 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 msgr2=0x7f3dd410fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000eb70 tx=0x7f3dd000b040 comp rx=0 tx=0).stop 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 shutdown_connections 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f3dc006e6e0 0x7f3dc0070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3dd40fc730 0x7f3dd4112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 --2- 172.21.15.100:0/1860776492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dd40fb460 0x7f3dd410fdc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 >> 172.21.15.100:0/1860776492 conn(0x7f3dd40f6c40 msgr2=0x7f3dd40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 shutdown_connections 2024-09-13T02:51:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:18.976+0000 7f3ddbda1640 1 -- 172.21.15.100:0/1860776492 wait complete. 2024-09-13T02:51:18.987 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 -- 172.21.15.100:0/1642124571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 msgr2=0x7ff3800fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 --2- 172.21.15.100:0/1642124571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff3800fcb70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff3740048d0 tx=0x7ff374009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 -- 172.21.15.100:0/1642124571 shutdown_connections 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 --2- 172.21.15.100:0/1642124571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff3800fcb70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 --2- 172.21.15.100:0/1642124571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff3800fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 -- 172.21.15.100:0/1642124571 >> 172.21.15.100:0/1642124571 conn(0x7ff3800f6c10 msgr2=0x7ff3800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 -- 172.21.15.100:0/1642124571 shutdown_connections 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.086+0000 7ff386634640 1 -- 172.21.15.100:0/1642124571 wait complete. 2024-09-13T02:51:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 Processor -- start 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 -- start start 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38010dbd0 con 0x7ff3800fc700 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff386634640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38010e3f0 con 0x7ff3800fb430 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54322/0 (socket says 172.21.15.100:54322) 2024-09-13T02:51:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff37f7fe640 1 -- 172.21.15.100:0/3815668514 learned_addr learned my addr 172.21.15.100:0/3815668514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.087+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:57616/0 (socket says 172.21.15.100:57616) 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37f7fe640 1 -- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 msgr2=0x7ff38010d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37f7fe640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37f7fe640 1 -- 172.21.15.100:0/3815668514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374005040 con 0x7ff3800fc700 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37ffff640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37f7fe640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3740048a0 tx=0x7ff374009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff374038070 con 0x7ff3800fc700 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff374009800 con 0x7ff3800fc700 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38010e620 con 0x7ff3800fc700 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38010ebc0 con 0x7ff3800fc700 2024-09-13T02:51:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.088+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff37403e670 con 0x7ff3800fc700 2024-09-13T02:51:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.089+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3800fa890 con 0x7ff3800fc700 2024-09-13T02:51:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.090+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff374030020 con 0x7ff3800fc700 2024-09-13T02:51:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.091+0000 7ff37cff9640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 0x7ff368070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.091+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff3740aded0 con 0x7ff3800fc700 2024-09-13T02:51:19.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.092+0000 7ff37ffff640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 0x7ff368070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.092+0000 7ff37ffff640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 0x7ff368070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff370004fd0 tx=0x7ff37000b040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.096+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff374077910 con 0x7ff3800fc700 2024-09-13T02:51:19.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.355+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff380103ff0 con 0x7ff36806e6e0 2024-09-13T02:51:19.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.357+0000 7ff37cff9640 1 -- 172.21.15.100:0/3815668514 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff380103ff0 con 0x7ff36806e6e0 2024-09-13T02:51:19.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 msgr2=0x7ff368070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 0x7ff368070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff370004fd0 tx=0x7ff37000b040 comp rx=0 tx=0).stop 2024-09-13T02:51:19.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 msgr2=0x7ff38010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3740048a0 tx=0x7ff374009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 shutdown_connections 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff36806e6e0 0x7ff368070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800fc700 0x7ff38010d580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 --2- 172.21.15.100:0/3815668514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3800fb430 0x7ff38010d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 >> 172.21.15.100:0/3815668514 conn(0x7ff3800f6c10 msgr2=0x7ff3800655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 shutdown_connections 2024-09-13T02:51:19.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.359+0000 7ff386634640 1 -- 172.21.15.100:0/3815668514 wait complete. 2024-09-13T02:51:19.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.442+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1394699480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fb430 msgr2=0x7fa2040fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.442+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1394699480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fb430 0x7fa2040fb840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa2000048d0 tx=0x7fa200009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1394699480 shutdown_connections 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1394699480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fc700 0x7fa2040fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1394699480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fb430 0x7fa2040fb840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1394699480 >> 172.21.15.100:0/1394699480 conn(0x7fa2040f6c10 msgr2=0x7fa2040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1394699480 shutdown_connections 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1394699480 wait complete. 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 Processor -- start 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- start start 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fb430 0x7fa20410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20410dc30 con 0x7fa2040fc700 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20c7ef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20410e450 con 0x7fa2040fb430 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa209d8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa209d8a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54352/0 (socket says 172.21.15.100:54352) 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa209d8a640 1 -- 172.21.15.100:0/1963346557 learned_addr learned my addr 172.21.15.100:0/1963346557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.443+0000 7fa20a58b640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fb430 0x7fa20410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa209d8a640 1 -- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fb430 msgr2=0x7fa20410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa209d8a640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fb430 0x7fa20410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa209d8a640 1 -- 172.21.15.100:0/1963346557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200005040 con 0x7fa2040fc700 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa209d8a640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4002a50 tx=0x7fa1f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f4007c30 con 0x7fa2040fc700 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa1f400f040 con 0x7fa2040fc700 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f400dad0 con 0x7fa2040fc700 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20410e6e0 con 0x7fa2040fc700 2024-09-13T02:51:19.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.444+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20410ec80 con 0x7fa2040fc700 2024-09-13T02:51:19.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.445+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2040fa890 con 0x7fa2040fc700 2024-09-13T02:51:19.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.446+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa1f400dc30 con 0x7fa2040fc700 2024-09-13T02:51:19.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.446+0000 7fa1faffd640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 0x7fa1f0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.447+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa1f408dd90 con 0x7fa2040fc700 2024-09-13T02:51:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.447+0000 7fa20a58b640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 0x7fa1f0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.447+0000 7fa20a58b640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 0x7fa1f0070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa20000b020 tx=0x7fa200035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.452+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa1f4057610 con 0x7fa2040fc700 2024-09-13T02:51:19.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.738+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa204103fe0 con 0x7fa1f006e6e0 2024-09-13T02:51:19.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.755+0000 7fa1faffd640 1 -- 172.21.15.100:0/1963346557 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa200039040 con 0x7fa1f006e6e0 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (7m) 21s ago 8m 25.7M - 0.25.0 c8568f914cd2 b8a7d5c34ee4 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (8m) 21s ago 8m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (7m) 19s ago 7m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (7m) 21s ago 8m 86.1M - 9.4.7 954c08fa6188 01535f0a2bc6 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (2m) 21s ago 2m 200M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (3m) 21s ago 3m 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (2m) 19s ago 2m 15.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (3m) 19s ago 3m 145M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:9283,8765,8443 running (9m) 21s ago 9m 248M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 64770a652812 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (73s) 19s ago 7m 480M - 19.1.1-322-g7741f7f9 19dc8d659727 35f358ab59e1 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (9m) 21s ago 9m 47.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:51:19.758 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (7m) 19s ago 7m 39.7M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 starting - - - - 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (7m) 19s ago 7m 15.9M - 1.5.0 0da6a335fe13 0a932e11b83f 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 21s ago 6m 235M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (6m) 21s ago 6m 274M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (5m) 21s ago 5m 189M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (5m) 19s ago 5m 271M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (4m) 19s ago 4m 239M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (4m) 19s ago 4m 260M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:51:19.759 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (6m) 21s ago 8m 60.9M - 2.43.0 a07b618ecd1d 332d2f3ab6d1 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.758+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 msgr2=0x7fa1f0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 0x7fa1f0070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa20000b020 tx=0x7fa200035040 comp rx=0 tx=0).stop 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 msgr2=0x7fa20410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4002a50 tx=0x7fa1f4004600 comp rx=0 tx=0).stop 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 shutdown_connections 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fa1f006e6e0 0x7fa1f0070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2040fc700 0x7fa20410d5e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 --2- 172.21.15.100:0/1963346557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2040fb430 0x7fa20410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 >> 172.21.15.100:0/1963346557 conn(0x7fa2040f6c10 msgr2=0x7fa204065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 shutdown_connections 2024-09-13T02:51:19.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.759+0000 7fa20c7ef640 1 -- 172.21.15.100:0/1963346557 wait complete. 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- 172.21.15.100:0/1919726603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3180ff680 msgr2=0x7fe318101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 --2- 172.21.15.100:0/1919726603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3180ff680 0x7fe318101a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe3040048d0 tx=0x7fe304009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- 172.21.15.100:0/1919726603 shutdown_connections 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 --2- 172.21.15.100:0/1919726603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3180ff680 0x7fe318101a60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 --2- 172.21.15.100:0/1919726603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe318065c40 0x7fe3180ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- 172.21.15.100:0/1919726603 >> 172.21.15.100:0/1919726603 conn(0x7fe3180f6c10 msgr2=0x7fe3180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- 172.21.15.100:0/1919726603 shutdown_connections 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- 172.21.15.100:0/1919726603 wait complete. 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 Processor -- start 2024-09-13T02:51:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.854+0000 7fe31eea6640 1 -- start start 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31eea6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 0x7fe31810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31eea6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 0x7fe31810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31eea6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31810dc00 con 0x7fe318065c40 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31eea6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31810e3b0 con 0x7fe3180ff680 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 0x7fe31810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31cc42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 0x7fe31810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54372/0 (socket says 172.21.15.100:54372) 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe31cc42640 1 -- 172.21.15.100:0/3453508114 learned_addr learned my addr 172.21.15.100:0/3453508114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe317fff640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 0x7fe31810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe317fff640 1 -- 172.21.15.100:0/3453508114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 msgr2=0x7fe31810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe317fff640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 0x7fe31810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.855+0000 7fe317fff640 1 -- 172.21.15.100:0/3453508114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304005040 con 0x7fe3180ff680 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe317fff640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 0x7fe31810d5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3040048a0 tx=0x7fe304009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe304038070 con 0x7fe3180ff680 2024-09-13T02:51:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe304004290 con 0x7fe3180ff680 2024-09-13T02:51:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe30402c8b0 con 0x7fe3180ff680 2024-09-13T02:51:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31810e5e0 con 0x7fe3180ff680 2024-09-13T02:51:19.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.856+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31810eb80 con 0x7fe3180ff680 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.857+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3180fa890 con 0x7fe3180ff680 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.858+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fe304030020 con 0x7fe3180ff680 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.858+0000 7fe3157fa640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 0x7fe308070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.858+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe3040adf20 con 0x7fe3180ff680 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.859+0000 7fe31cc42640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 0x7fe308070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.859+0000 7fe31cc42640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 0x7fe308070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe30c004a30 tx=0x7fe30c00b040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:19.865+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe304077970 con 0x7fe3180ff680 2024-09-13T02:51:20.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.161+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe318104f50 con 0x7fe3180ff680 2024-09-13T02:51:20.162 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:19 smithi100 ceph-mon[27894]: pgmap v18: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 386 op/s 2024-09-13T02:51:20.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:19 smithi100 ceph-mon[27894]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:20.163 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:19 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.161+0000 7fe3157fa640 1 -- 172.21.15.100:0/3453508114 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fe30407b030 con 0x7fe3180ff680 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:20.163 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:51:20.164 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:51:20.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 msgr2=0x7fe308070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 0x7fe308070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe30c004a30 tx=0x7fe30c00b040 comp rx=0 tx=0).stop 2024-09-13T02:51:20.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 msgr2=0x7fe31810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 0x7fe31810d5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe3040048a0 tx=0x7fe304009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 shutdown_connections 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fe30806e6e0 0x7fe308070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3180ff680 0x7fe31810d5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 --2- 172.21.15.100:0/3453508114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe318065c40 0x7fe31810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 >> 172.21.15.100:0/3453508114 conn(0x7fe3180f6c10 msgr2=0x7fe3180f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 shutdown_connections 2024-09-13T02:51:20.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.164+0000 7fe31eea6640 1 -- 172.21.15.100:0/3453508114 wait complete. 2024-09-13T02:51:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:19 smithi122 ceph-mon[34559]: pgmap v18: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 2.0 MiB/s wr, 386 op/s 2024-09-13T02:51:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:19 smithi122 ceph-mon[34559]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:20.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:19 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 -- 172.21.15.100:0/1863490951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 msgr2=0x7f1cf40fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/1863490951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf40fa670 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0048d0 tx=0x7f1cdc009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 -- 172.21.15.100:0/1863490951 shutdown_connections 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/1863490951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf40fa670 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/1863490951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf40fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 -- 172.21.15.100:0/1863490951 >> 172.21.15.100:0/1863490951 conn(0x7f1cf40f63c0 msgr2=0x7f1cf40f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 -- 172.21.15.100:0/1863490951 shutdown_connections 2024-09-13T02:51:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.253+0000 7f1cf9d66640 1 -- 172.21.15.100:0/1863490951 wait complete. 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 Processor -- start 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 -- start start 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf410dc90 con 0x7f1cf40fe510 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.254+0000 7f1cf9d66640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf410e4b0 con 0x7f1cf40fdbc0 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1ceb7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:57654/0 (socket says 172.21.15.100:57654) 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1ceb7fe640 1 -- 172.21.15.100:0/4137499262 learned_addr learned my addr 172.21.15.100:0/4137499262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf37fe640 1 -- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 msgr2=0x7f1cf410d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf37fe640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf410d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf37fe640 1 -- 172.21.15.100:0/4137499262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc005040 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf37fe640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf410d640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0043d0 tx=0x7f1cdc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc038070 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1cdc02ae90 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf410e6e0 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.255+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cdc03e670 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.256+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf410eb40 con 0x7f1cf40fe510 2024-09-13T02:51:20.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.257+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40fa060 con 0x7f1cf40fe510 2024-09-13T02:51:20.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.257+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1cdc030020 con 0x7f1cf40fe510 2024-09-13T02:51:20.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.258+0000 7f1cf0ff9640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 0x7f1ce0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.258+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1cdc0addc0 con 0x7f1cf40fe510 2024-09-13T02:51:20.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.258+0000 7f1ceb7fe640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 0x7f1ce0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.259+0000 7f1ceb7fe640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 0x7f1ce0070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4010210 tx=0x7f1ce400b040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:20.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.266+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1cdc077840 con 0x7f1cf40fe510 2024-09-13T02:51:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.552+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cf4104fa0 con 0x7f1cf40fe510 2024-09-13T02:51:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.552+0000 7f1cf0ff9640 1 -- 172.21.15.100:0/4137499262 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f1cdc07af00 con 0x7f1cf40fe510 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:20.555 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:51:20.556 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:51:20.556 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:51:20.556 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:51:20.556 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:51:20.556 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:51:20.557 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:51:20.558 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:20.559 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 msgr2=0x7f1ce0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 0x7f1ce0070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4010210 tx=0x7f1ce400b040 comp rx=0 tx=0).stop 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 msgr2=0x7f1cf410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf410d640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0043d0 tx=0x7f1cdc009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 shutdown_connections 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ce006e6e0 0x7f1ce0070b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cf40fe510 0x7f1cf410d640 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 --2- 172.21.15.100:0/4137499262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf40fdbc0 0x7f1cf410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 >> 172.21.15.100:0/4137499262 conn(0x7f1cf40f63c0 msgr2=0x7f1cf40f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 shutdown_connections 2024-09-13T02:51:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.555+0000 7f1cf9d66640 1 -- 172.21.15.100:0/4137499262 wait complete. 2024-09-13T02:51:20.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/2065085581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fb8f0 msgr2=0x7ff7bc0fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/2065085581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc0fbd00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0048d0 tx=0x7ff7ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/2065085581 shutdown_connections 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/2065085581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/2065085581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc0fbd00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.655+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/2065085581 >> 172.21.15.100:0/2065085581 conn(0x7ff7bc0f63c0 msgr2=0x7ff7bc0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.656+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/2065085581 shutdown_connections 2024-09-13T02:51:20.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.656+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/2065085581 wait complete. 2024-09-13T02:51:20.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.657+0000 7ff7c3bf3640 1 Processor -- start 2024-09-13T02:51:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.658+0000 7ff7c3bf3640 1 -- start start 2024-09-13T02:51:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c3bf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c3bf3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c3bf3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc114260 con 0x7ff7bc0fc240 2024-09-13T02:51:20.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c3bf3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc114a80 con 0x7ff7bc0fb8f0 2024-09-13T02:51:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c198f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c198f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:57670/0 (socket says 172.21.15.100:57670) 2024-09-13T02:51:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.659+0000 7ff7c198f640 1 -- 172.21.15.100:0/602609131 learned_addr learned my addr 172.21.15.100:0/602609131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:20.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.660+0000 7ff7c118e640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c118e640 1 -- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 msgr2=0x7ff7bc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c118e640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c118e640 1 -- 172.21.15.100:0/602609131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac005040 con 0x7ff7bc0fc240 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c198f640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c118e640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc113c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c6e0 tx=0x7ff7b8004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b800a700 con 0x7ff7bc0fc240 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7b800ad00 con 0x7ff7bc0fc240 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc114d10 con 0x7ff7bc0fc240 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.661+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b8012e00 con 0x7ff7bc0fc240 2024-09-13T02:51:20.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.662+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc115250 con 0x7ff7bc0fc240 2024-09-13T02:51:20.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.663+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7ff7b800a860 con 0x7ff7bc0fc240 2024-09-13T02:51:20.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.663+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc0fa060 con 0x7ff7bc0fc240 2024-09-13T02:51:20.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.664+0000 7ff7b27fc640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 0x7ff7a8070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:20.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.664+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff7b808dd40 con 0x7ff7bc0fc240 2024-09-13T02:51:20.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.664+0000 7ff7c198f640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 0x7ff7a8070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:20.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.665+0000 7ff7c198f640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 0x7ff7a8070be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007ac0 tx=0x7ff7ac035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:20.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.672+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff7b8057810 con 0x7ff7bc0fc240 2024-09-13T02:51:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:20 smithi100 ceph-mon[27894]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:20 smithi100 ceph-mon[27894]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3453508114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:20.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:20 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/4137499262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:20.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.965+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7bc115610 con 0x7ff7a806e730 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.967+0000 7ff7b27fc640 1 -- 172.21.15.100:0/602609131 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff7bc115610 con 0x7ff7a806e730 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2024-09-13T02:51:20.969 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:51:20.970 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:51:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 msgr2=0x7ff7a8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 0x7ff7a8070be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac007ac0 tx=0x7ff7ac035040 comp rx=0 tx=0).stop 2024-09-13T02:51:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 msgr2=0x7ff7bc113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc113c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c6e0 tx=0x7ff7b8004330 comp rx=0 tx=0).stop 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 shutdown_connections 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7ff7a806e730 0x7ff7a8070be0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc0fc240 0x7ff7bc113c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 --2- 172.21.15.100:0/602609131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff7bc0fb8f0 0x7ff7bc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.970+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 >> 172.21.15.100:0/602609131 conn(0x7ff7bc0f63c0 msgr2=0x7ff7bc0f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.971+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 shutdown_connections 2024-09-13T02:51:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:20.971+0000 7ff7c3bf3640 1 -- 172.21.15.100:0/602609131 wait complete. 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/4272257358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00fe760 msgr2=0x7fbcf00feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/4272257358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00fe760 0x7fbcf00feb70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbce40048d0 tx=0x7fbce4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/4272257358 shutdown_connections 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/4272257358 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00ffa30 0x7fbcf00ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/4272257358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00fe760 0x7fbcf00feb70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/4272257358 >> 172.21.15.100:0/4272257358 conn(0x7fbcf00fa060 msgr2=0x7fbcf00fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:21.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/4272257358 shutdown_connections 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/4272257358 wait complete. 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 Processor -- start 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.092+0000 7fbcf6ef8640 1 -- start start 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf6ef8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf6ef8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 0x7fbcf010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf6ef8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf010fdf0 con 0x7fbcf00ffa30 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf6ef8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0110610 con 0x7fbcf00fe760 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbceffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 0x7fbcf010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:57680/0 (socket says 172.21.15.100:57680) 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 -- 172.21.15.100:0/2534101306 learned_addr learned my addr 172.21.15.100:0/2534101306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbceffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 0x7fbcf010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54450/0 (socket says 172.21.15.100:54450) 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 -- 172.21.15.100:0/2534101306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 msgr2=0x7fbcf010f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 0x7fbcf010f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.093+0000 7fbcf4c94640 1 -- 172.21.15.100:0/2534101306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4005040 con 0x7fbcf00fe760 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbcf4c94640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbce40048a0 tx=0x7fbce4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce4038070 con 0x7fbcf00fe760 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbce4004290 con 0x7fbcf00fe760 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf0110840 con 0x7fbcf00fe760 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce4033660 con 0x7fbcf00fe760 2024-09-13T02:51:21.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.094+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0110de0 con 0x7fbcf00fe760 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.096+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf00fdbc0 con 0x7fbcf00fe760 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.096+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fbce4030020 con 0x7fbcf00fe760 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.096+0000 7fbced7fa640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 0x7fbce0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.097+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbce40adf60 con 0x7fbcf00fe760 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.097+0000 7fbceffff640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 0x7fbce0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.097+0000 7fbceffff640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 0x7fbce0070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcf010f010 tx=0x7fbcdc00b040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.105+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbce40779a0 con 0x7fbcf00fe760 2024-09-13T02:51:21.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:20 smithi122 ceph-mon[34559]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:21.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:20 smithi122 ceph-mon[34559]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:21.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:20 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3453508114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:21.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:20 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/4137499262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.412+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbcf004b720 con 0x7fbcf00fe760 2024-09-13T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.412+0000 7fbced7fa640 1 -- 172.21.15.100:0/2534101306 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbce402c870 con 0x7fbcf00fe760 2024-09-13T02:51:21.414 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 msgr2=0x7fbce0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 0x7fbce0070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcf010f010 tx=0x7fbcdc00b040 comp rx=0 tx=0).stop 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 msgr2=0x7fbcf010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbce40048a0 tx=0x7fbce4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 shutdown_connections 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fbce006e6e0 0x7fbce0070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcf00ffa30 0x7fbcf010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 --2- 172.21.15.100:0/2534101306 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcf00fe760 0x7fbcf010f260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.415+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 >> 172.21.15.100:0/2534101306 conn(0x7fbcf00fa060 msgr2=0x7fbcf00fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.416+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 shutdown_connections 2024-09-13T02:51:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:21.416+0000 7fbcf6ef8640 1 -- 172.21.15.100:0/2534101306 wait complete. 2024-09-13T02:51:22.149 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:21 smithi100 ceph-mon[27894]: pgmap v19: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 3.7 MiB/s wr, 650 op/s 2024-09-13T02:51:22.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:21 smithi100 ceph-mon[27894]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:22.150 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:21 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2534101306' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:51:22.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:21 smithi122 ceph-mon[34559]: pgmap v19: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 3.7 MiB/s wr, 650 op/s 2024-09-13T02:51:22.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:21 smithi122 ceph-mon[34559]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:22.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:21 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2534101306' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:51:23.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:23 smithi100 ceph-mon[27894]: pgmap v20: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 461 op/s 2024-09-13T02:51:24.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:23 smithi122 ceph-mon[34559]: pgmap v20: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 461 op/s 2024-09-13T02:51:26.100 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:25 smithi100 ceph-mon[27894]: pgmap v21: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 461 op/s 2024-09-13T02:51:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:25 smithi122 ceph-mon[34559]: pgmap v21: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.6 MiB/s wr, 461 op/s 2024-09-13T02:51:27.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:27 smithi100 ceph-mon[27894]: pgmap v22: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 75 KiB/s rd, 4.0 MiB/s wr, 726 op/s 2024-09-13T02:51:28.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:27 smithi122 ceph-mon[34559]: pgmap v22: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 75 KiB/s rd, 4.0 MiB/s wr, 726 op/s 2024-09-13T02:51:29.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:28 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:29.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:28 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:29.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:28 smithi100 ceph-mon[27894]: Reconfiguring grafana.smithi100 (dependencies changed)... 2024-09-13T02:51:29.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:28 smithi100 ceph-mon[27894]: Reconfiguring daemon grafana.smithi100 on smithi100 2024-09-13T02:51:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:28 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:28 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:28 smithi122 ceph-mon[34559]: Reconfiguring grafana.smithi100 (dependencies changed)... 2024-09-13T02:51:29.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:28 smithi122 ceph-mon[34559]: Reconfiguring daemon grafana.smithi100 on smithi100 2024-09-13T02:51:29.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:29 smithi100 ceph-mon[27894]: pgmap v23: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.1 MiB/s wr, 529 op/s 2024-09-13T02:51:30.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:29 smithi122 ceph-mon[34559]: pgmap v23: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.1 MiB/s wr, 529 op/s 2024-09-13T02:51:32.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:31 smithi100 ceph-mon[27894]: pgmap v24: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 81 KiB/s rd, 4.2 MiB/s wr, 813 op/s 2024-09-13T02:51:32.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:31 smithi122 ceph-mon[34559]: pgmap v24: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 81 KiB/s rd, 4.2 MiB/s wr, 813 op/s 2024-09-13T02:51:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:33 smithi100 ceph-mon[27894]: pgmap v25: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-13T02:51:34.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:33 smithi122 ceph-mon[34559]: pgmap v25: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-13T02:51:34.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:34 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:35.087 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:34 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:36.044 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:35 smithi100 ceph-mon[27894]: pgmap v26: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-13T02:51:36.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:35 smithi122 ceph-mon[34559]: pgmap v26: 65 pgs: 65 active+clean; 326 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.5 MiB/s wr, 548 op/s 2024-09-13T02:51:36.541 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T02:51:36.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T02:51:36.905 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:37.835 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:37 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:37.835 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:37 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:37.835 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:37 smithi100 ceph-mon[27894]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:51:37.835 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:37 smithi100 ceph-mon[27894]: pgmap v27: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 84 KiB/s rd, 3.7 MiB/s wr, 837 op/s 2024-09-13T02:51:37.835 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:37 smithi100 ceph-mon[27894]: Deploying daemon prometheus.smithi100 on smithi100 2024-09-13T02:51:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:37 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:37 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:37 smithi122 ceph-mon[34559]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:51:37.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:37 smithi122 ceph-mon[34559]: pgmap v27: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 84 KiB/s rd, 3.7 MiB/s wr, 837 op/s 2024-09-13T02:51:37.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:37 smithi122 ceph-mon[34559]: Deploying daemon prometheus.smithi100 on smithi100 2024-09-13T02:51:40.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:39 smithi100 ceph-mon[27894]: pgmap v28: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.3 MiB/s wr, 571 op/s 2024-09-13T02:51:40.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:39 smithi122 ceph-mon[34559]: pgmap v28: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.3 MiB/s wr, 571 op/s 2024-09-13T02:51:41.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:41 smithi100 ceph-mon[27894]: pgmap v29: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 80 KiB/s rd, 3.1 MiB/s wr, 781 op/s 2024-09-13T02:51:42.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:41 smithi122 ceph-mon[34559]: pgmap v29: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 80 KiB/s rd, 3.1 MiB/s wr, 781 op/s 2024-09-13T02:51:44.395 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:44 smithi122 ceph-mon[34559]: pgmap v30: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 498 op/s 2024-09-13T02:51:44.395 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:44 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:44.395 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:44 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:44.395 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:44 smithi122 ceph-mon[34559]: Reconfiguring node-exporter.smithi122 (dependencies changed)... 2024-09-13T02:51:44.395 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:44 smithi122 ceph-mon[34559]: Deploying daemon node-exporter.smithi122 on smithi122 2024-09-13T02:51:44.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:44 smithi100 ceph-mon[27894]: pgmap v30: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 498 op/s 2024-09-13T02:51:44.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:44 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:44.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:44 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:44.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:44 smithi100 ceph-mon[27894]: Reconfiguring node-exporter.smithi122 (dependencies changed)... 2024-09-13T02:51:44.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:44 smithi100 ceph-mon[27894]: Deploying daemon node-exporter.smithi122 on smithi122 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: pgmap v31: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 498 op/s 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:51:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:51:46.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:46 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: pgmap v31: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.0 MiB/s wr, 498 op/s 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:51:46.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:51:46.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:46 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:47 smithi100 ceph-mon[27894]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:51:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:47 smithi100 ceph-mon[27894]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:51:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:47 smithi100 ceph-mon[27894]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:51:47.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:47 smithi100 ceph-mon[27894]: Upgrade: Need to upgrade myself (mgr.smithi122.ptcenr) 2024-09-13T02:51:47.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:47 smithi100 ceph-mon[27894]: Upgrade: Need to upgrade myself (mgr.smithi122.ptcenr) 2024-09-13T02:51:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:47 smithi122 ceph-mon[34559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:51:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:47 smithi122 ceph-mon[34559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:51:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:47 smithi122 ceph-mon[34559]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:51:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:47 smithi122 ceph-mon[34559]: Upgrade: Need to upgrade myself (mgr.smithi122.ptcenr) 2024-09-13T02:51:47.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:47 smithi122 ceph-mon[34559]: Upgrade: Need to upgrade myself (mgr.smithi122.ptcenr) 2024-09-13T02:51:48.279 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:48 smithi122 ceph-mon[34559]: pgmap v32: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.7 MiB/s wr, 646 op/s 2024-09-13T02:51:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:48 smithi100 ceph-mon[27894]: pgmap v32: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.7 MiB/s wr, 646 op/s 2024-09-13T02:51:49.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: Upgrade: Updating mgr.smithi100.lhjyck 2024-09-13T02:51:49.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:49.649 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:49.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:49.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:51:49.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:49.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: Deploying daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:51:49.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:49 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: Upgrade: Updating mgr.smithi100.lhjyck 2024-09-13T02:51:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:51:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:51:49.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:49.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: Deploying daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:51:49.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:49 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:50.335 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:50 smithi100 ceph-mon[27894]: pgmap v33: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-09-13T02:51:50.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:50 smithi122 ceph-mon[34559]: pgmap v33: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 -- 172.21.15.100:0/775330205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fc570 msgr2=0x7f65440fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 --2- 172.21.15.100:0/775330205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fc570 0x7f65440fc980 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f65400048d0 tx=0x7f6540009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 -- 172.21.15.100:0/775330205 shutdown_connections 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 --2- 172.21.15.100:0/775330205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fd840 0x7f65440fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 --2- 172.21.15.100:0/775330205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fc570 0x7f65440fc980 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 -- 172.21.15.100:0/775330205 >> 172.21.15.100:0/775330205 conn(0x7f65440f7d30 msgr2=0x7f65440fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 -- 172.21.15.100:0/775330205 shutdown_connections 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.505+0000 7f654b5ca640 1 -- 172.21.15.100:0/775330205 wait complete. 2024-09-13T02:51:51.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 Processor -- start 2024-09-13T02:51:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 -- start start 2024-09-13T02:51:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 0x7f654410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 0x7f654410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654410dc60 con 0x7f65440fd840 2024-09-13T02:51:51.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f654b5ca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654410e430 con 0x7f65440fc570 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f6548b65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 0x7f654410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.506+0000 7f6548b65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 0x7f654410d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53150/0 (socket says 172.21.15.100:53150) 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6548b65640 1 -- 172.21.15.100:0/3341738528 learned_addr learned my addr 172.21.15.100:0/3341738528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6549366640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 0x7f654410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6549366640 1 -- 172.21.15.100:0/3341738528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 msgr2=0x7f654410d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6549366640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 0x7f654410d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6549366640 1 -- 172.21.15.100:0/3341738528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540005040 con 0x7f65440fc570 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6549366640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 0x7f654410d0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f654002a530 tx=0x7f6540009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6540038070 con 0x7f65440fc570 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654410e660 con 0x7f65440fc570 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f654002ae90 con 0x7f65440fc570 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.507+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6540033660 con 0x7f65440fc570 2024-09-13T02:51:51.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.508+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654410ec00 con 0x7f65440fc570 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.509+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f6540030020 con 0x7f65440fc570 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.509+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65440fb9d0 con 0x7f65440fc570 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.510+0000 7f6539ffb640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 0x7f6530070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.510+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f65400adf00 con 0x7f65440fc570 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.510+0000 7f6548b65640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 0x7f6530070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.511+0000 7f6548b65640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 0x7f6530070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f654410ce80 tx=0x7f653400b040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:51.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.515+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f65400778d0 con 0x7f65440fc570 2024-09-13T02:51:51.542 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T02:51:51.542 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T02:51:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.715+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f654410ef30 con 0x7f653006e6e0 2024-09-13T02:51:51.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.717+0000 7f6539ffb640 1 -- 172.21.15.100:0/3341738528 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f654410ef30 con 0x7f653006e6e0 2024-09-13T02:51:51.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 msgr2=0x7f6530070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 0x7f6530070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f654410ce80 tx=0x7f653400b040 comp rx=0 tx=0).stop 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 msgr2=0x7f654410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 0x7f654410d0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f654002a530 tx=0x7f6540009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 shutdown_connections 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f653006e6e0 0x7f6530070b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65440fd840 0x7f654410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 --2- 172.21.15.100:0/3341738528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f65440fc570 0x7f654410d0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 >> 172.21.15.100:0/3341738528 conn(0x7f65440f7d30 msgr2=0x7f65440f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 shutdown_connections 2024-09-13T02:51:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.719+0000 7f654b5ca640 1 -- 172.21.15.100:0/3341738528 wait complete. 2024-09-13T02:51:51.730 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3674415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 msgr2=0x7f78b40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3674415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b40fb840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f78a40048d0 tx=0x7f78a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3674415242 shutdown_connections 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3674415242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 0x7f78b40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3674415242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b40fb840 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3674415242 >> 172.21.15.100:0/3674415242 conn(0x7f78b40f6c10 msgr2=0x7f78b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3674415242 shutdown_connections 2024-09-13T02:51:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.813+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3674415242 wait complete. 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 Processor -- start 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 -- start start 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 0x7f78b410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b410dc10 con 0x7f78b40fb430 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78ba0ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b410e430 con 0x7f78b40fc700 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53162/0 (socket says 172.21.15.100:53162) 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.814+0000 7f78b37fe640 1 -- 172.21.15.100:0/3704554488 learned_addr learned my addr 172.21.15.100:0/3704554488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.815+0000 7f78abfff640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 0x7f78b410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.815+0000 7f78b37fe640 1 -- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 msgr2=0x7f78b410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.815+0000 7f78b37fe640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 0x7f78b410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.815+0000 7f78b37fe640 1 -- 172.21.15.100:0/3704554488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4005040 con 0x7f78b40fb430 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.816+0000 7f78b37fe640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78a40043d0 tx=0x7f78a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.816+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a402a9f0 con 0x7f78b40fb430 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.816+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b410e660 con 0x7f78b40fb430 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.816+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b410eba0 con 0x7f78b40fb430 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.816+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78a402c070 con 0x7f78b40fb430 2024-09-13T02:51:51.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.817+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a4039660 con 0x7f78b40fb430 2024-09-13T02:51:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.818+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7894005240 con 0x7f78b40fb430 2024-09-13T02:51:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.818+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f78a4030020 con 0x7f78b40fb430 2024-09-13T02:51:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.819+0000 7f78b0ff9640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 0x7f78a00709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.819+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f78a40b2210 con 0x7f78b40fb430 2024-09-13T02:51:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.820+0000 7f78abfff640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 0x7f78a00709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.821+0000 7f78abfff640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 0x7f78a00709d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f789c007fd0 tx=0x7f789c009e90 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:51.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:51.825+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f78a407bc10 con 0x7f78b40fb430 2024-09-13T02:51:51.956 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:51.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:51:52.009 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:51:52.009 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:51:52.043 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:51:52.044 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:52.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.109+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7894000bf0 con 0x7f78a006e520 2024-09-13T02:51:52.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.110+0000 7f78b0ff9640 1 -- 172.21.15.100:0/3704554488 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f7894000bf0 con 0x7f78a006e520 2024-09-13T02:51:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 msgr2=0x7f78a00709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 0x7f78a00709d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f789c007fd0 tx=0x7f789c009e90 comp rx=0 tx=0).stop 2024-09-13T02:51:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 msgr2=0x7f78b410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78a40043d0 tx=0x7f78a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 shutdown_connections 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f78a006e520 0x7f78a00709d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78b40fc700 0x7f78b410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 --2- 172.21.15.100:0/3704554488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78b40fb430 0x7f78b410d080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.112+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 >> 172.21.15.100:0/3704554488 conn(0x7f78b40f6c10 msgr2=0x7f78b40655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.113+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 shutdown_connections 2024-09-13T02:51:52.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.113+0000 7f78ba0ec640 1 -- 172.21.15.100:0/3704554488 wait complete. 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 -- 172.21.15.100:0/1439262983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fb430 msgr2=0x7f1ee00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/1439262983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fb430 0x7f1ee00fb840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009c50 tx=0x7f1ed0004d10 comp rx=0 tx=0).stop 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 -- 172.21.15.100:0/1439262983 shutdown_connections 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/1439262983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fc700 0x7f1ee00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/1439262983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fb430 0x7f1ee00fb840 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 -- 172.21.15.100:0/1439262983 >> 172.21.15.100:0/1439262983 conn(0x7f1ee00f6c10 msgr2=0x7f1ee00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 -- 172.21.15.100:0/1439262983 shutdown_connections 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.193+0000 7f1ee59bc640 1 -- 172.21.15.100:0/1439262983 wait complete. 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 Processor -- start 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 -- start start 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fb430 0x7f1ee010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0065c80 con 0x7f1ee00fc700 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ee59bc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee0065df0 con 0x7f1ee00fb430 2024-09-13T02:51:52.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ede7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ede7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53194/0 (socket says 172.21.15.100:53194) 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1ede7fc640 1 -- 172.21.15.100:0/890400669 learned_addr learned my addr 172.21.15.100:0/890400669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.194+0000 7f1edeffd640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fb430 0x7f1ee010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ede7fc640 1 -- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fb430 msgr2=0x7f1ee010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ede7fc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fb430 0x7f1ee010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ede7fc640 1 -- 172.21.15.100:0/890400669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00098b0 con 0x7f1ee00fc700 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ede7fc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4002a50 tx=0x7f1ed4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed4007c30 con 0x7f1ee00fc700 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ed400f040 con 0x7f1ee00fc700 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee0112890 con 0x7f1ee00fc700 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed400da90 con 0x7f1ee00fc700 2024-09-13T02:51:52.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.195+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee0112e00 con 0x7f1ee00fc700 2024-09-13T02:51:52.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.196+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee00fa890 con 0x7f1ee00fc700 2024-09-13T02:51:52.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.197+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1ed400dd00 con 0x7f1ee00fc700 2024-09-13T02:51:52.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.197+0000 7f1ec77fe640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 0x7f1ec8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.197+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1ed408d760 con 0x7f1ee00fc700 2024-09-13T02:51:52.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.197+0000 7f1edeffd640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 0x7f1ec8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.198+0000 7f1edeffd640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 0x7f1ec8070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0000f80 tx=0x7f1ed0004d10 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.201+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1ed404f670 con 0x7f1ee00fc700 2024-09-13T02:51:52.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:52 smithi100 ceph-mon[27894]: pgmap v34: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.2 MiB/s wr, 494 op/s 2024-09-13T02:51:52.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.413+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ee0100b60 con 0x7f1ec806e6e0 2024-09-13T02:51:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.423+0000 7f1ec77fe640 1 -- 172.21.15.100:0/890400669 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1ee0100b60 con 0x7f1ec806e6e0 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 starting - - - - 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (9m) 54s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (8m) 52s ago 8m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 starting - - - - 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (3m) 54s ago 3m 200M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (3m) 54s ago 3m 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (3m) 52s ago 3m 15.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (3m) 52s ago 3m 145M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 starting - - - - 2024-09-13T02:51:52.425 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (106s) 52s ago 8m 480M - 19.1.1-322-g7741f7f9 19dc8d659727 35f358ab59e1 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (10m) 54s ago 10m 47.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (8m) 52s ago 8m 39.7M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 starting - - - - 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 starting - - - - 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 54s ago 7m 235M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (6m) 54s ago 6m 274M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (6m) 54s ago 6m 189M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (5m) 52s ago 5m 271M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (5m) 52s ago 5m 239M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (5m) 52s ago 5m 260M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:51:52.426 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 starting - - - - 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 msgr2=0x7f1ec8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 0x7f1ec8070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0000f80 tx=0x7f1ed0004d10 comp rx=0 tx=0).stop 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 msgr2=0x7f1ee01122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4002a50 tx=0x7f1ed4004600 comp rx=0 tx=0).stop 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 shutdown_connections 2024-09-13T02:51:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ec806e6e0 0x7f1ec8070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ee00fc700 0x7f1ee01122f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 --2- 172.21.15.100:0/890400669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ee00fb430 0x7f1ee010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 >> 172.21.15.100:0/890400669 conn(0x7f1ee00f6c10 msgr2=0x7f1ee00f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 shutdown_connections 2024-09-13T02:51:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.426+0000 7f1ee59bc640 1 -- 172.21.15.100:0/890400669 wait complete. 2024-09-13T02:51:52.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:52 smithi122 ceph-mon[34559]: pgmap v34: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.2 MiB/s wr, 494 op/s 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 -- 172.21.15.100:0/76105882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fc700 msgr2=0x7f1eb80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 --2- 172.21.15.100:0/76105882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fc700 0x7f1eb80fcb70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0048d0 tx=0x7f1eac009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 -- 172.21.15.100:0/76105882 shutdown_connections 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 --2- 172.21.15.100:0/76105882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fc700 0x7f1eb80fcb70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 --2- 172.21.15.100:0/76105882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fb430 0x7f1eb80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 -- 172.21.15.100:0/76105882 >> 172.21.15.100:0/76105882 conn(0x7f1eb80f6c10 msgr2=0x7f1eb80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 -- 172.21.15.100:0/76105882 shutdown_connections 2024-09-13T02:51:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.508+0000 7f1ebccde640 1 -- 172.21.15.100:0/76105882 wait complete. 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 Processor -- start 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 -- start start 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fc700 0x7f1eb8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8065c60 con 0x7f1eb80fb430 2024-09-13T02:51:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1ebccde640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8065dd0 con 0x7f1eb80fc700 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1eb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1eb659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53226/0 (socket says 172.21.15.100:53226) 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1eb659c640 1 -- 172.21.15.100:0/3088987866 learned_addr learned my addr 172.21.15.100:0/3088987866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.509+0000 7f1eb5d9b640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fc700 0x7f1eb8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1eb659c640 1 -- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fc700 msgr2=0x7f1eb8112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1eb659c640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fc700 0x7f1eb8112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1eb659c640 1 -- 172.21.15.100:0/3088987866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac005040 con 0x7f1eb80fb430 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1eb659c640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8002a50 tx=0x7f1ea8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ea8007c30 con 0x7f1eb80fb430 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ea800f040 con 0x7f1eb80fb430 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ea800da10 con 0x7f1eb80fb430 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb81128b0 con 0x7f1eb80fb430 2024-09-13T02:51:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.510+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb8112dd0 con 0x7f1eb80fb430 2024-09-13T02:51:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.511+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb80fa890 con 0x7f1eb80fb430 2024-09-13T02:51:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.513+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1ea800dc80 con 0x7f1eb80fb430 2024-09-13T02:51:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.513+0000 7f1ea6ffd640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 0x7f1ea0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.513+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1ea808d6c0 con 0x7f1eb80fb430 2024-09-13T02:51:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.513+0000 7f1eb5d9b640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 0x7f1ea0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.514+0000 7f1eb5d9b640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 0x7f1ea0070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b020 tx=0x7f1eac035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.522+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1ea804f670 con 0x7f1eb80fb430 2024-09-13T02:51:52.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.777+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1eb8103e50 con 0x7f1eb80fb430 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:52.780 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:51:52.781 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:51:52.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.778+0000 7f1ea6ffd640 1 -- 172.21.15.100:0/3088987866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f1ea8056ff0 con 0x7f1eb80fb430 2024-09-13T02:51:52.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 msgr2=0x7f1ea0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 0x7f1ea0070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b020 tx=0x7f1eac035040 comp rx=0 tx=0).stop 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 msgr2=0x7f1eb810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8002a50 tx=0x7f1ea8004600 comp rx=0 tx=0).stop 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 shutdown_connections 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f1ea006e6e0 0x7f1ea0070b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1eb80fc700 0x7f1eb8112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 --2- 172.21.15.100:0/3088987866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1eb80fb430 0x7f1eb810fdc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 >> 172.21.15.100:0/3088987866 conn(0x7f1eb80f6c10 msgr2=0x7f1eb80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 shutdown_connections 2024-09-13T02:51:52.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.780+0000 7f1ebccde640 1 -- 172.21.15.100:0/3088987866 wait complete. 2024-09-13T02:51:52.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.891+0000 7f24b190a640 1 -- 172.21.15.100:0/3587130460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4093990 msgr2=0x7f24a4093da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.891+0000 7f24b190a640 1 --2- 172.21.15.100:0/3587130460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4093990 0x7f24a4093da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f24a00048d0 tx=0x7f24a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 -- 172.21.15.100:0/3587130460 shutdown_connections 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 --2- 172.21.15.100:0/3587130460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4094c60 0x7f24a40950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 --2- 172.21.15.100:0/3587130460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4093990 0x7f24a4093da0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 -- 172.21.15.100:0/3587130460 >> 172.21.15.100:0/3587130460 conn(0x7f24a408f130 msgr2=0x7f24a4091580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 -- 172.21.15.100:0/3587130460 shutdown_connections 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 -- 172.21.15.100:0/3587130460 wait complete. 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 Processor -- start 2024-09-13T02:51:52.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.892+0000 7f24b190a640 1 -- start start 2024-09-13T02:51:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b190a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b190a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 0x7f24a4095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b190a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4097ed0 con 0x7f24a4094c60 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b190a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40964e0 con 0x7f24a4093990 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b0908640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 0x7f24a4095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b0908640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:50962/0 (socket says 172.21.15.100:50962) 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b0908640 1 -- 172.21.15.100:0/3687448003 learned_addr learned my addr 172.21.15.100:0/3687448003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24abfff640 1 -- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 msgr2=0x7f24a4097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24abfff640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24abfff640 1 -- 172.21.15.100:0/3687448003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0005040 con 0x7f24a4094c60 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b0908640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24abfff640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 0x7f24a4095fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f249800c6e0 tx=0x7f2498004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24980106f0 con 0x7f24a4094c60 2024-09-13T02:51:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.893+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4096770 con 0x7f24a4094c60 2024-09-13T02:51:52.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.894+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a4096d10 con 0x7f24a4094c60 2024-09-13T02:51:52.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.894+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2498010cf0 con 0x7f24a4094c60 2024-09-13T02:51:52.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.894+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2498012e90 con 0x7f24a4094c60 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.895+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2490005210 con 0x7f24a4094c60 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.895+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f2498011470 con 0x7f24a4094c60 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.896+0000 7f24a97fa640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 0x7f249c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.896+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f249808dd30 con 0x7f24a4094c60 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.896+0000 7f24b0908640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 0x7f249c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:52.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.897+0000 7f24b0908640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 0x7f249c070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007eb0 tx=0x7f24a0035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:52.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:52.900+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2498057740 con 0x7f24a4094c60 2024-09-13T02:51:53.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.111+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2490005790 con 0x7f24a4094c60 2024-09-13T02:51:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.112+0000 7f24a97fa640 1 -- 172.21.15.100:0/3687448003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f249805ae00 con 0x7f24a4094c60 2024-09-13T02:51:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:51:53.115 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:51:53.116 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:51:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:53.118 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.114+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 msgr2=0x7f249c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.114+0000 7f24b190a640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 0x7f249c070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007eb0 tx=0x7f24a0035040 comp rx=0 tx=0).stop 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.114+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 msgr2=0x7f24a4095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.114+0000 7f24b190a640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 0x7f24a4095fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f249800c6e0 tx=0x7f2498004330 comp rx=0 tx=0).stop 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 shutdown_connections 2024-09-13T02:51:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7f249c06e7b0 0x7f249c070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a4094c60 0x7f24a4095fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 --2- 172.21.15.100:0/3687448003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4093990 0x7f24a4097880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 >> 172.21.15.100:0/3687448003 conn(0x7f24a408f130 msgr2=0x7f24a40053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 shutdown_connections 2024-09-13T02:51:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.115+0000 7f24b190a640 1 -- 172.21.15.100:0/3687448003 wait complete. 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 -- 172.21.15.100:0/3107358172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fc560 msgr2=0x7fde500fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 --2- 172.21.15.100:0/3107358172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fc560 0x7fde500fc970 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fde440048d0 tx=0x7fde44009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 -- 172.21.15.100:0/3107358172 shutdown_connections 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 --2- 172.21.15.100:0/3107358172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fd830 0x7fde500fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 --2- 172.21.15.100:0/3107358172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fc560 0x7fde500fc970 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 -- 172.21.15.100:0/3107358172 >> 172.21.15.100:0/3107358172 conn(0x7fde500f7d20 msgr2=0x7fde500fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 -- 172.21.15.100:0/3107358172 shutdown_connections 2024-09-13T02:51:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.197+0000 7fde56d22640 1 -- 172.21.15.100:0/3107358172 wait complete. 2024-09-13T02:51:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 Processor -- start 2024-09-13T02:51:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 -- start start 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 0x7fde50071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5006ffa0 con 0x7fde500fd830 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde56d22640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50070110 con 0x7fde500fc560 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53254/0 (socket says 172.21.15.100:53254) 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.198+0000 7fde4ffff640 1 -- 172.21.15.100:0/2471656978 learned_addr learned my addr 172.21.15.100:0/2471656978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde54abe640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 0x7fde50071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4ffff640 1 -- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 msgr2=0x7fde50071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4ffff640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 0x7fde50071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4ffff640 1 -- 172.21.15.100:0/2471656978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44005040 con 0x7fde500fd830 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde54abe640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 0x7fde50071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4ffff640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00eb70 tx=0x7fde3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c007c30 con 0x7fde500fd830 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde50070340 con 0x7fde500fd830 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.199+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde3c00f040 con 0x7fde500fd830 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.200+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3c0094e0 con 0x7fde500fd830 2024-09-13T02:51:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.200+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500708e0 con 0x7fde500fd830 2024-09-13T02:51:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.201+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500fb9c0 con 0x7fde500fd830 2024-09-13T02:51:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.201+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fde3c009720 con 0x7fde500fd830 2024-09-13T02:51:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.201+0000 7fde4d7fa640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 0x7fde40070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.201+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fde3c08dc40 con 0x7fde500fd830 2024-09-13T02:51:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.201+0000 7fde54abe640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 0x7fde40070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.202+0000 7fde54abe640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 0x7fde40070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fde44007ac0 tx=0x7fde44035040 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.209+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fde3c093020 con 0x7fde500fd830 2024-09-13T02:51:53.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:53.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:53.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:53.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:53.341 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:53.342 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3088987866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:53.342 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:53 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3687448003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:53.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.400+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 --> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde50101c00 con 0x7fde4006e6e0 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.402+0000 7fde4d7fa640 1 -- 172.21.15.100:0/2471656978 <== mgr.24355 v2:172.21.15.122:6828/3888337405 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fde50101c00 con 0x7fde4006e6e0 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "", 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:51:53.404 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:51:53.405 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 msgr2=0x7fde40070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 0x7fde40070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fde44007ac0 tx=0x7fde44035040 comp rx=0 tx=0).stop 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 msgr2=0x7fde5006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00eb70 tx=0x7fde3c00b040 comp rx=0 tx=0).stop 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 shutdown_connections 2024-09-13T02:51:53.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fde4006e6e0 0x7fde40070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde500fd830 0x7fde5006fa60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 --2- 172.21.15.100:0/2471656978 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde500fc560 0x7fde50071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 >> 172.21.15.100:0/2471656978 conn(0x7fde500f7d20 msgr2=0x7fde500f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 shutdown_connections 2024-09-13T02:51:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.404+0000 7fde56d22640 1 -- 172.21.15.100:0/2471656978 wait complete. 2024-09-13T02:51:53.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 -- 172.21.15.100:0/2441746534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fc700 msgr2=0x7fd3f00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2441746534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fc700 0x7fd3f00fcb70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80048d0 tx=0x7fd3d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 -- 172.21.15.100:0/2441746534 shutdown_connections 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2441746534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fc700 0x7fd3f00fcb70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2441746534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fb430 0x7fd3f00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 -- 172.21.15.100:0/2441746534 >> 172.21.15.100:0/2441746534 conn(0x7fd3f00f6c10 msgr2=0x7fd3f00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 -- 172.21.15.100:0/2441746534 shutdown_connections 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.485+0000 7fd3f498d640 1 -- 172.21.15.100:0/2441746534 wait complete. 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 Processor -- start 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 -- start start 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 0x7fd3f010c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f010d300 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3f498d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f010d470 con 0x7fd3f00fc700 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3ee59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3ee59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53264/0 (socket says 172.21.15.100:53264) 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.486+0000 7fd3ee59c640 1 -- 172.21.15.100:0/2641441645 learned_addr learned my addr 172.21.15.100:0/2641441645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3e7fff640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 0x7fd3f010c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3ee59c640 1 -- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 msgr2=0x7fd3f010c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3ee59c640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 0x7fd3f010c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3ee59c640 1 -- 172.21.15.100:0/2641441645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d8005040 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3e7fff640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 0x7fd3f010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3ee59c640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000daf0 tx=0x7fd3e000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e000edb0 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f010d6f0 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3e0017910 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e00169f0 con 0x7fd3f00fb430 2024-09-13T02:51:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.487+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f010dc10 con 0x7fd3f00fb430 2024-09-13T02:51:53.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.488+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f01046c0 con 0x7fd3f00fb430 2024-09-13T02:51:53.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.488+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 24) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd3e0014070 con 0x7fd3f00fb430 2024-09-13T02:51:53.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.489+0000 7fd3e6ffd640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 0x7fd3dc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.489+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd3e0090160 con 0x7fd3f00fb430 2024-09-13T02:51:53.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.489+0000 7fd3e7fff640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 0x7fd3dc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.490+0000 7fd3e7fff640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 0x7fd3dc070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b020 tx=0x7fd3d8009da0 comp rx=0 tx=0).ready entity=mgr.24355 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.497+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd3e0059b70 con 0x7fd3f00fb430 2024-09-13T02:51:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:53.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:53.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:51:53.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:53.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3088987866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:51:53.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:53 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3687448003' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:53.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.737+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd3f004b720 con 0x7fd3f00fb430 2024-09-13T02:51:53.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.738+0000 7fd3e6ffd640 1 -- 172.21.15.100:0/2641441645 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd3e005d230 con 0x7fd3f00fb430 2024-09-13T02:51:53.740 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:51:53.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 msgr2=0x7fd3dc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 0x7fd3dc070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800b020 tx=0x7fd3d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 msgr2=0x7fd3f010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000daf0 tx=0x7fd3e000b460 comp rx=0 tx=0).stop 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 shutdown_connections 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:6828/3888337405,v1:172.21.15.122:6829/3888337405] conn(0x7fd3dc06e6e0 0x7fd3dc070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd3f00fc700 0x7fd3f010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 --2- 172.21.15.100:0/2641441645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3f00fb430 0x7fd3f010bfc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 >> 172.21.15.100:0/2641441645 conn(0x7fd3f00f6c10 msgr2=0x7fd3f00f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 shutdown_connections 2024-09-13T02:51:53.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:51:53.740+0000 7fd3f498d640 1 -- 172.21.15.100:0/2641441645 wait complete. 2024-09-13T02:51:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:54 smithi100 ceph-mon[27894]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:54 smithi100 ceph-mon[27894]: pgmap v35: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-13T02:51:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:54 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2641441645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:51:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:54 smithi122 ceph-mon[34559]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:54 smithi122 ceph-mon[34559]: pgmap v35: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-13T02:51:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:54 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2641441645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:51:55.575 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:55 smithi100 ceph-mon[27894]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:55 smithi122 ceph-mon[34559]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:56.435 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:56 smithi100 ceph-mon[27894]: pgmap v36: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-13T02:51:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:56 smithi122 ceph-mon[34559]: pgmap v36: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-13T02:51:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: Standby manager daemon smithi100.lhjyck restarted 2024-09-13T02:51:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: Standby manager daemon smithi100.lhjyck started 2024-09-13T02:51:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/crt"}]: dispatch 2024-09-13T02:51:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:51:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/key"}]: dispatch 2024-09-13T02:51:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:57 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: Standby manager daemon smithi100.lhjyck restarted 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: Standby manager daemon smithi100.lhjyck started 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/crt"}]: dispatch 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.lhjyck/key"}]: dispatch 2024-09-13T02:51:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:57 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:51:58.611 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:58 smithi122 ceph-mon[34559]: pgmap v37: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 379 op/s 2024-09-13T02:51:58.611 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:51:58 smithi122 ceph-mon[34559]: mgrmap e25: smithi122.ptcenr(active, since 68s), standbys: smithi100.lhjyck 2024-09-13T02:51:58.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:58 smithi100 ceph-mon[27894]: pgmap v37: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 379 op/s 2024-09-13T02:51:58.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:51:58 smithi100 ceph-mon[27894]: mgrmap e25: smithi122.ptcenr(active, since 68s), standbys: smithi100.lhjyck 2024-09-13T02:52:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:00 smithi100 ceph-mon[27894]: pgmap v38: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 996 KiB/s wr, 231 op/s 2024-09-13T02:52:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:00 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:00 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:00 smithi122 ceph-mon[34559]: pgmap v38: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 996 KiB/s wr, 231 op/s 2024-09-13T02:52:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:00 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:00 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.591 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:02 smithi100 ceph-mon[27894]: pgmap v39: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1002 KiB/s wr, 232 op/s 2024-09-13T02:52:02.591 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:02 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.591 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:02 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.591 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:02 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.592 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:02 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:02 smithi122 ceph-mon[34559]: pgmap v39: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1002 KiB/s wr, 232 op/s 2024-09-13T02:52:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:02 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:02 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:02 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:02.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:02 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:04.581 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:04 smithi100 ceph-mon[27894]: pgmap v40: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 318 KiB/s wr, 96 op/s 2024-09-13T02:52:04.581 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:04 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:04 smithi122 ceph-mon[34559]: pgmap v40: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 318 KiB/s wr, 96 op/s 2024-09-13T02:52:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:04 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:06.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: pgmap v41: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 318 KiB/s wr, 96 op/s 2024-09-13T02:52:06.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd='[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]': finished 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: mgrmap e26: smithi100.lhjyck(active, starting, since 0.00595438s) 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:06.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:06.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:06.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:52:06.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:06.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:06.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:06.430 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:06 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:06.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: pgmap v41: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 318 KiB/s wr, 96 op/s 2024-09-13T02:52:06.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 172.21.15.122:0/2583921671' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.24355 ' entity='mgr.smithi122.ptcenr' cmd='[{"prefix": "mgr fail", "who": "smithi122.ptcenr"}]': finished 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: mgrmap e26: smithi100.lhjyck(active, starting, since 0.00595438s) 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:06.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:06.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:06.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:52:06.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:06.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:06.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:06.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:06 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:07 smithi122 ceph-mon[34559]: mgrmap e27: smithi100.lhjyck(active, since 1.00919s) 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:07 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:07] ENGINE Bus STARTING 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:07 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:07] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:07 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:07] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Traceback (most recent call last): 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:07.811 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._run(expiration_interval) 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self.do_handshake() 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:07.812 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:07.825 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:07 smithi100 ceph-mon[27894]: mgrmap e27: smithi100.lhjyck(active, since 1.00919s) 2024-09-13T02:52:07.825 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:07 smithi100 ceph-mon[27894]: [13/Sep/2024:02:52:07] ENGINE Bus STARTING 2024-09-13T02:52:07.825 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:07 smithi100 ceph-mon[27894]: [13/Sep/2024:02:52:07] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:52:07.825 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:07 smithi100 ceph-mon[27894]: [13/Sep/2024:02:52:07] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:07.825 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:07.826 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:07.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:52:07.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:07.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:07.827 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:08 smithi100 ceph-mon[27894]: [13/Sep/2024:02:52:07] ENGINE Serving on http://172.21.15.100:8765 2024-09-13T02:52:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:08 smithi100 ceph-mon[27894]: [13/Sep/2024:02:52:07] ENGINE Bus STARTED 2024-09-13T02:52:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:08 smithi100 ceph-mon[27894]: pgmap v4: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:08.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:08 smithi100 ceph-mon[27894]: mgrmap e28: smithi100.lhjyck(active, since 2s) 2024-09-13T02:52:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:08 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:07] ENGINE Serving on http://172.21.15.100:8765 2024-09-13T02:52:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:08 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:07] ENGINE Bus STARTED 2024-09-13T02:52:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:08 smithi122 ceph-mon[34559]: pgmap v4: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:08 smithi122 ceph-mon[34559]: mgrmap e28: smithi100.lhjyck(active, since 2s) 2024-09-13T02:52:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:10 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:10 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:10 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:10 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:10 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:10 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:10 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:10.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:10 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:11.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: pgmap v5: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:11.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: mgrmap e29: smithi100.lhjyck(active, since 4s) 2024-09-13T02:52:11.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:11.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:11.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:11.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:11.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:11 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: pgmap v5: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: mgrmap e29: smithi100.lhjyck(active, since 4s) 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:11.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:11.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:11 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/582355639' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: mgrmap e30: smithi100.lhjyck(active, since 5s), standbys: smithi122.ptcenr 2024-09-13T02:52:12.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:12.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:12 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: mgrmap e30: smithi100.lhjyck(active, since 5s), standbys: smithi122.ptcenr 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:12.461 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:12 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:13.495 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:13 smithi100 ceph-mon[27894]: pgmap v6: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:13 smithi122 ceph-mon[34559]: pgmap v6: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:15 smithi100 ceph-mon[27894]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 293 B/s wr, 17 op/s 2024-09-13T02:52:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:15 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:15 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:15 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:15 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:15 smithi122 ceph-mon[34559]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 293 B/s wr, 17 op/s 2024-09-13T02:52:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:15 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:15 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:15 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:15 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:52:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:52:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:16 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:16 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 227 B/s wr, 13 op/s 2024-09-13T02:52:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:17.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:17.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:17.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:17.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:17 smithi100 ceph-mon[27894]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:52:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:17.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 227 B/s wr, 13 op/s 2024-09-13T02:52:17.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:17.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:17.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:17.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:17.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:17 smithi122 ceph-mon[34559]: Reconfiguring prometheus.smithi100 (dependencies changed)... 2024-09-13T02:52:18.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:18 smithi100 ceph-mon[27894]: Reconfiguring daemon prometheus.smithi100 on smithi100 2024-09-13T02:52:18.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:18 smithi122 ceph-mon[34559]: Reconfiguring daemon prometheus.smithi100 on smithi100 2024-09-13T02:52:19.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:19 smithi100 ceph-mon[27894]: pgmap v9: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 372 B/s wr, 11 op/s 2024-09-13T02:52:19.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:19 smithi122 ceph-mon[34559]: pgmap v9: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 372 B/s wr, 11 op/s 2024-09-13T02:52:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:21 smithi100 ceph-mon[27894]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:21 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:21 smithi122 ceph-mon[34559]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:21 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:22 smithi100 ceph-mon[27894]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:22.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:52:22.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:22.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:22 smithi122 ceph-mon[34559]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:23.397 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:23 smithi122 ceph-mon[34559]: Upgrade: Updating mgr.smithi122.ptcenr 2024-09-13T02:52:23.397 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:23 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:23.397 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:23 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:52:23.397 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:23 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:23.397 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:23 smithi122 ceph-mon[34559]: Deploying daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:52:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:23 smithi100 ceph-mon[27894]: Upgrade: Updating mgr.smithi122.ptcenr 2024-09-13T02:52:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:23 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:52:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:23 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:52:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:23 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:23 smithi100 ceph-mon[27894]: Deploying daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:52:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 -- 172.21.15.100:0/4030458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa700065b80 msgr2=0x7fa7000ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:23.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 --2- 172.21.15.100:0/4030458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa700065b80 0x7fa7000ff200 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00048d0 tx=0x7fa6f0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 -- 172.21.15.100:0/4030458953 shutdown_connections 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 --2- 172.21.15.100:0/4030458953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7000ff740 0x7fa700101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 --2- 172.21.15.100:0/4030458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa700065b80 0x7fa7000ff200 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 -- 172.21.15.100:0/4030458953 >> 172.21.15.100:0/4030458953 conn(0x7fa7000f6c10 msgr2=0x7fa7000f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 -- 172.21.15.100:0/4030458953 shutdown_connections 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 -- 172.21.15.100:0/4030458953 wait complete. 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.832+0000 7fa705d8c640 1 Processor -- start 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa705d8c640 1 -- start start 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa705d8c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa700065b80 0x7fa7000fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa705d8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa705d8c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000fb640 con 0x7fa7000ff740 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa705d8c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000fb780 con 0x7fa700065b80 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40680/0 (socket says 172.21.15.100:40680) 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 -- 172.21.15.100:0/1073198806 learned_addr learned my addr 172.21.15.100:0/1073198806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6ff7fe640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa700065b80 0x7fa7000fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 -- 172.21.15.100:0/1073198806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa700065b80 msgr2=0x7fa7000fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa700065b80 0x7fa7000fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 -- 172.21.15.100:0/1073198806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0005040 con 0x7fa7000ff740 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.833+0000 7fa6feffd640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4002a50 tx=0x7fa6f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.834+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4007c30 con 0x7fa7000ff740 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.834+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6f400f040 con 0x7fa7000ff740 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.834+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7000fba60 con 0x7fa7000ff740 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.834+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f400da10 con 0x7fa7000ff740 2024-09-13T02:52:23.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.834+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa700115100 con 0x7fa7000ff740 2024-09-13T02:52:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.835+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7000fa890 con 0x7fa7000ff740 2024-09-13T02:52:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.835+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fa6f400dc80 con 0x7fa7000ff740 2024-09-13T02:52:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.836+0000 7fa6e7fff640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 0x7fa6e8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.836+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa6f408d250 con 0x7fa7000ff740 2024-09-13T02:52:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.836+0000 7fa6ff7fe640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 0x7fa6e8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.836+0000 7fa6ff7fe640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 0x7fa6e8070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7000fc970 tx=0x7fa6f0035040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:23.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:23.840+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa6f4056a20 con 0x7fa7000ff740 2024-09-13T02:52:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.020+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 --> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7000f8700 con 0x7fa6e806df60 2024-09-13T02:52:24.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.021+0000 7fa6e7fff640 1 -- 172.21.15.100:0/1073198806 <== mgr.14706 v2:172.21.15.100:6800/2131214238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa7000f8700 con 0x7fa6e806df60 2024-09-13T02:52:24.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 msgr2=0x7fa6e8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 0x7fa6e8070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7000fc970 tx=0x7fa6f0035040 comp rx=0 tx=0).stop 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 msgr2=0x7fa7000fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4002a50 tx=0x7fa6f4004600 comp rx=0 tx=0).stop 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 shutdown_connections 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fa6e806df60 0x7fa6e8070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7000ff740 0x7fa7000fb100 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 --2- 172.21.15.100:0/1073198806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa700065b80 0x7fa7000fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 >> 172.21.15.100:0/1073198806 conn(0x7fa7000f6c10 msgr2=0x7fa7000f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 shutdown_connections 2024-09-13T02:52:24.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.023+0000 7fa705d8c640 1 -- 172.21.15.100:0/1073198806 wait complete. 2024-09-13T02:52:24.033 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:52:24.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 -- 172.21.15.100:0/4143341291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 msgr2=0x7f6a5c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/4143341291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c0fb860 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0048d0 tx=0x7f6a4c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 -- 172.21.15.100:0/4143341291 shutdown_connections 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/4143341291 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 0x7f6a5c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/4143341291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c0fb860 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 -- 172.21.15.100:0/4143341291 >> 172.21.15.100:0/4143341291 conn(0x7f6a5c0f6c10 msgr2=0x7f6a5c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 -- 172.21.15.100:0/4143341291 shutdown_connections 2024-09-13T02:52:24.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.102+0000 7f6a61bcb640 1 -- 172.21.15.100:0/4143341291 wait complete. 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 Processor -- start 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 -- start start 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 0x7f6a5c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c10dcb0 con 0x7f6a5c0fb450 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a61bcb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c10e480 con 0x7f6a5c0fc720 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40698/0 (socket says 172.21.15.100:40698) 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a5b7fe640 1 -- 172.21.15.100:0/3996043319 learned_addr learned my addr 172.21.15.100:0/3996043319 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.103+0000 7f6a53fff640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 0x7f6a5c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a5b7fe640 1 -- 172.21.15.100:0/3996043319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 msgr2=0x7f6a5c10d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a5b7fe640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 0x7f6a5c10d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a5b7fe640 1 -- 172.21.15.100:0/3996043319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c005040 con 0x7f6a5c0fb450 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a5b7fe640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0043d0 tx=0x7f6a4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a4c038070 con 0x7f6a5c0fb450 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c10e6b0 con 0x7f6a5c0fb450 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a4c02ae90 con 0x7f6a5c0fb450 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a4c03e670 con 0x7f6a5c0fb450 2024-09-13T02:52:24.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.104+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c10ec50 con 0x7f6a5c0fb450 2024-09-13T02:52:24.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.105+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0fa8b0 con 0x7f6a5c0fb450 2024-09-13T02:52:24.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.106+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f6a4c030020 con 0x7f6a5c0fb450 2024-09-13T02:52:24.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.106+0000 7f6a58ff9640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 0x7f6a48070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.106+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6a4c0adb20 con 0x7f6a5c0fb450 2024-09-13T02:52:24.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.106+0000 7f6a53fff640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 0x7f6a48070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.107+0000 7f6a53fff640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 0x7f6a48070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c10ced0 tx=0x7f6a4400b040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.111+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6a4c077400 con 0x7f6a5c0fb450 2024-09-13T02:52:24.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.292+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 --> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a5c103fe0 con 0x7f6a4806df60 2024-09-13T02:52:24.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.293+0000 7f6a58ff9640 1 -- 172.21.15.100:0/3996043319 <== mgr.14706 v2:172.21.15.100:6800/2131214238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6a5c103fe0 con 0x7f6a4806df60 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 msgr2=0x7f6a48070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 0x7f6a48070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c10ced0 tx=0x7f6a4400b040 comp rx=0 tx=0).stop 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 msgr2=0x7f6a5c10d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0043d0 tx=0x7f6a4c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 shutdown_connections 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f6a4806df60 0x7f6a48070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a5c0fc720 0x7f6a5c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 --2- 172.21.15.100:0/3996043319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a5c0fb450 0x7f6a5c10d120 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 >> 172.21.15.100:0/3996043319 conn(0x7f6a5c0f6c10 msgr2=0x7f6a5c066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.295+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 shutdown_connections 2024-09-13T02:52:24.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.296+0000 7f6a61bcb640 1 -- 172.21.15.100:0/3996043319 wait complete. 2024-09-13T02:52:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- 172.21.15.100:0/2234093433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 msgr2=0x7fe2140fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 --2- 172.21.15.100:0/2234093433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe2140fc960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe2100048d0 tx=0x7fe210009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- 172.21.15.100:0/2234093433 shutdown_connections 2024-09-13T02:52:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 --2- 172.21.15.100:0/2234093433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 0x7fe2140fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 --2- 172.21.15.100:0/2234093433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe2140fc960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- 172.21.15.100:0/2234093433 >> 172.21.15.100:0/2234093433 conn(0x7fe2140f7d30 msgr2=0x7fe2140fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.376 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:24 smithi100 ceph-mon[27894]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:24.376 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:24 smithi100 ceph-mon[27894]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- 172.21.15.100:0/2234093433 shutdown_connections 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- 172.21.15.100:0/2234093433 wait complete. 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 Processor -- start 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.374+0000 7fe21b360640 1 -- start start 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe21b360640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe21b360640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 0x7fe21406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe21b360640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21406fff0 con 0x7fe2140fc550 2024-09-13T02:52:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe21b360640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214070130 con 0x7fe2140fd820 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40722/0 (socket says 172.21.15.100:40722) 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 -- 172.21.15.100:0/1454487171 learned_addr learned my addr 172.21.15.100:0/1454487171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2188fb640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 0x7fe21406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 -- 172.21.15.100:0/1454487171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 msgr2=0x7fe21406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 0x7fe21406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 -- 172.21.15.100:0/1454487171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210005040 con 0x7fe2140fc550 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe2190fc640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2100043d0 tx=0x7fe210009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe210038070 con 0x7fe2140fc550 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe21002ae90 con 0x7fe2140fc550 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.375+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2140703b0 con 0x7fe2140fc550 2024-09-13T02:52:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.376+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe21003e670 con 0x7fe2140fc550 2024-09-13T02:52:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.376+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2141150d0 con 0x7fe2140fc550 2024-09-13T02:52:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.377+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2140fb9b0 con 0x7fe2140fc550 2024-09-13T02:52:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.377+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fe210030020 con 0x7fe2140fc550 2024-09-13T02:52:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.378+0000 7fe205ffb640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 0x7fe200070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.378+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe2100adb80 con 0x7fe2140fc550 2024-09-13T02:52:24.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.378+0000 7fe2188fb640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 0x7fe200070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.378+0000 7fe2188fb640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 0x7fe200070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe208004ed0 tx=0x7fe20800b040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.382+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe210077460 con 0x7fe2140fc550 2024-09-13T02:52:24.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.559+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 --> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe214101c20 con 0x7fe20006df60 2024-09-13T02:52:24.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.568+0000 7fe205ffb640 1 -- 172.21.15.100:0/1454487171 <== mgr.14706 v2:172.21.15.100:6800/2131214238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe214101c20 con 0x7fe20006df60 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (57s) 13s ago 9m 17.0M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (9m) 13s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (8m) 15s ago 8m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (48s) 13s ago 9m 75.9M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (4m) 13s ago 4m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (4m) 13s ago 4m 12.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (3m) 15s ago 3m 15.7M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (4m) 15s ago 4m 121M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (32s) 13s ago 10m 475M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283 running (2m) 15s ago 8m 109M - 19.1.1-322-g7741f7f9 19dc8d659727 35f358ab59e1 2024-09-13T02:52:24.570 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (10m) 13s ago 11m 52.1M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8b35ca3b7b1c 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (8m) 15s ago 8m 40.1M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (76s) 13s ago 9m 8560k - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (39s) 15s ago 8m 8715k - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (7m) 13s ago 7m 207M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (7m) 13s ago 7m 237M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (6m) 13s ago 6m 181M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (6m) 15s ago 6m 258M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (6m) 15s ago 6m 229M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (5m) 15s ago 5m 222M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:52:24.571 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 starting - - - - 2024-09-13T02:52:24.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 msgr2=0x7fe200070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 0x7fe200070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe208004ed0 tx=0x7fe20800b040 comp rx=0 tx=0).stop 2024-09-13T02:52:24.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 msgr2=0x7fe214071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2100043d0 tx=0x7fe210009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 shutdown_connections 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fe20006df60 0x7fe200070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2140fd820 0x7fe21406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 --2- 172.21.15.100:0/1454487171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2140fc550 0x7fe214071570 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 >> 172.21.15.100:0/1454487171 conn(0x7fe2140f7d30 msgr2=0x7fe2140f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 shutdown_connections 2024-09-13T02:52:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.570+0000 7fe21b360640 1 -- 172.21.15.100:0/1454487171 wait complete. 2024-09-13T02:52:24.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:24 smithi122 ceph-mon[34559]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-13T02:52:24.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:24 smithi122 ceph-mon[34559]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 -- 172.21.15.100:0/1378133020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fe510 msgr2=0x7f5acc0fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 --2- 172.21.15.100:0/1378133020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fe510 0x7f5acc0fa670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80048d0 tx=0x7f5ac8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 -- 172.21.15.100:0/1378133020 shutdown_connections 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 --2- 172.21.15.100:0/1378133020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fe510 0x7f5acc0fa670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 --2- 172.21.15.100:0/1378133020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc0fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 -- 172.21.15.100:0/1378133020 >> 172.21.15.100:0/1378133020 conn(0x7f5acc0f63c0 msgr2=0x7f5acc0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 -- 172.21.15.100:0/1378133020 shutdown_connections 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.647+0000 7f5ad415b640 1 -- 172.21.15.100:0/1378133020 wait complete. 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 Processor -- start 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 -- start start 2024-09-13T02:52:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fe510 0x7f5acc10f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc110760 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad415b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc1108d0 con 0x7f5acc0fe510 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad1ef7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad1ef7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40748/0 (socket says 172.21.15.100:40748) 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad1ef7640 1 -- 172.21.15.100:0/2251982253 learned_addr learned my addr 172.21.15.100:0/2251982253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.648+0000 7f5ad16f6640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fe510 0x7f5acc10f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad1ef7640 1 -- 172.21.15.100:0/2251982253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fe510 msgr2=0x7f5acc10f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad1ef7640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fe510 0x7f5acc10f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad1ef7640 1 -- 172.21.15.100:0/2251982253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8005040 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad1ef7640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00b790 tx=0x7f5abc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc00c700 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5abc00cd00 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc015e80 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc110bb0 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.649+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc1110a0 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.650+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc105820 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.651+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f5abc012070 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.651+0000 7f5ac27fc640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 0x7f5ab8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.651+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5abc08d190 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.651+0000 7f5ad16f6640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 0x7f5ab8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.652+0000 7f5ad16f6640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 0x7f5ab8070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8000c00 tx=0x7f5ac8035040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.656+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5abc056a40 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.886+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5acc04b720 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.886+0000 7f5ac27fc640 1 -- 172.21.15.100:0/2251982253 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f5abc05a100 con 0x7f5acc0fdbc0 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:52:24.888 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 12, 2024-09-13T02:52:24.889 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:52:24.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:52:24.890 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 msgr2=0x7f5ab8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 0x7f5ab8070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8000c00 tx=0x7f5ac8035040 comp rx=0 tx=0).stop 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 msgr2=0x7f5acc10f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00b790 tx=0x7f5abc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 shutdown_connections 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f5ab806df60 0x7f5ab8070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5acc0fe510 0x7f5acc10f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 --2- 172.21.15.100:0/2251982253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5acc0fdbc0 0x7f5acc10f3b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.888+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 >> 172.21.15.100:0/2251982253 conn(0x7f5acc0f63c0 msgr2=0x7f5acc0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.889+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 shutdown_connections 2024-09-13T02:52:24.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.889+0000 7f5ad415b640 1 -- 172.21.15.100:0/2251982253 wait complete. 2024-09-13T02:52:24.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 -- 172.21.15.100:0/3402098102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4066710 msgr2=0x7f7bc40fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/3402098102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4066710 0x7f7bc40fcf60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00048d0 tx=0x7f7bc0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 -- 172.21.15.100:0/3402098102 shutdown_connections 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/3402098102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc40ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/3402098102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc4066710 0x7f7bc40fcf60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 -- 172.21.15.100:0/3402098102 >> 172.21.15.100:0/3402098102 conn(0x7f7bc40f6c40 msgr2=0x7f7bc40f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.967+0000 7f7bcb4af640 1 -- 172.21.15.100:0/3402098102 shutdown_connections 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 -- 172.21.15.100:0/3402098102 wait complete. 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 Processor -- start 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 -- start start 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc4066710 0x7f7bc41136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4114250 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bcb4af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4114a20 con 0x7f7bc4066710 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bc8a4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bc8a4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40776/0 (socket says 172.21.15.100:40776) 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.968+0000 7f7bc8a4a640 1 -- 172.21.15.100:0/4176357043 learned_addr learned my addr 172.21.15.100:0/4176357043 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bc924b640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc4066710 0x7f7bc41136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bc8a4a640 1 -- 172.21.15.100:0/4176357043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc4066710 msgr2=0x7f7bc41136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bc8a4a640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc4066710 0x7f7bc41136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bc8a4a640 1 -- 172.21.15.100:0/4176357043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bc8a4a640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4002a80 tx=0x7f7bb4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb4007c30 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc4114cb0 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bb400f040 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb4009530 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.969+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc41151d0 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.970+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40fa8c0 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.971+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f7bb40097a0 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.971+0000 7f7bb9ffb640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 0x7f7bb0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.971+0000 7f7bc924b640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 0x7f7bb0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.971+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7bb408d4a0 con 0x7f7bc40fd4a0 2024-09-13T02:52:24.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.972+0000 7f7bc924b640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 0x7f7bb0070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000c00 tx=0x7f7bc0009da0 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:24.975+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7bb4056bc0 con 0x7f7bc40fd4a0 2024-09-13T02:52:25.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.172+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7bc410b560 con 0x7f7bc40fd4a0 2024-09-13T02:52:25.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.173+0000 7f7bb9ffb640 1 -- 172.21.15.100:0/4176357043 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f7bb405fe60 con 0x7f7bc40fd4a0 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:52:25.175 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:52:25.176 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:25.177 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:25.178 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:25.178 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:52:25.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 msgr2=0x7f7bb0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 0x7f7bb0070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000c00 tx=0x7f7bc0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 msgr2=0x7f7bc4113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4002a80 tx=0x7f7bb4004600 comp rx=0 tx=0).stop 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 shutdown_connections 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f7bb006df60 0x7f7bb0070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bc40fd4a0 0x7f7bc4113c00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 --2- 172.21.15.100:0/4176357043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bc4066710 0x7f7bc41136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 >> 172.21.15.100:0/4176357043 conn(0x7f7bc40f6c40 msgr2=0x7f7bc40f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 shutdown_connections 2024-09-13T02:52:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.175+0000 7f7bcb4af640 1 -- 172.21.15.100:0/4176357043 wait complete. 2024-09-13T02:52:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- 172.21.15.100:0/2322761126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 msgr2=0x7f9a080fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/2322761126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a080fc980 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0048d0 tx=0x7f99fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- 172.21.15.100:0/2322761126 shutdown_connections 2024-09-13T02:52:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/2322761126 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 0x7f9a080fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/2322761126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a080fc980 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- 172.21.15.100:0/2322761126 >> 172.21.15.100:0/2322761126 conn(0x7f9a080f7d30 msgr2=0x7f9a080fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- 172.21.15.100:0/2322761126 shutdown_connections 2024-09-13T02:52:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- 172.21.15.100:0/2322761126 wait complete. 2024-09-13T02:52:25.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 Processor -- start 2024-09-13T02:52:25.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.255+0000 7f9a0f11a640 1 -- start start 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0f11a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0f11a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 0x7f9a0810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0f11a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0810dc50 con 0x7f9a080fc570 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0f11a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0810e470 con 0x7f9a080fd840 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40796/0 (socket says 172.21.15.100:40796) 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 -- 172.21.15.100:0/987190161 learned_addr learned my addr 172.21.15.100:0/987190161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a07fff640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 0x7f9a0810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 -- 172.21.15.100:0/987190161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 msgr2=0x7f9a0810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 0x7f9a0810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.256+0000 7f9a0ceb6640 1 -- 172.21.15.100:0/987190161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc005040 con 0x7f9a080fc570 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a0ceb6640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0048a0 tx=0x7f99fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99fc038070 con 0x7f9a080fc570 2024-09-13T02:52:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99fc004290 con 0x7f9a080fc570 2024-09-13T02:52:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0810e6a0 con 0x7f9a080fc570 2024-09-13T02:52:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99fc033660 con 0x7f9a080fc570 2024-09-13T02:52:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.257+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0810ec40 con 0x7f9a080fc570 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.258+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080fb9d0 con 0x7f9a080fc570 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.259+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f99fc030020 con 0x7f9a080fc570 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.259+0000 7f9a057fa640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 0x7f99f8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.259+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f99fc0adab0 con 0x7f9a080fc570 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.259+0000 7f9a07fff640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 0x7f99f8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.260+0000 7f9a07fff640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 0x7f99f8070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a0810ce70 tx=0x7f99f400b040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.263+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f99fc077390 con 0x7f9a080fc570 2024-09-13T02:52:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.446+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 --> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a0810ef70 con 0x7f99f806df60 2024-09-13T02:52:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.447+0000 7f9a057fa640 1 -- 172.21.15.100:0/987190161 <== mgr.14706 v2:172.21.15.100:6800/2131214238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9a0810ef70 con 0x7f99f806df60 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr" 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "2/21 daemons upgraded", 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:52:25.449 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 msgr2=0x7f99f8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 0x7f99f8070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a0810ce70 tx=0x7f99f400b040 comp rx=0 tx=0).stop 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 msgr2=0x7f9a0810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0048a0 tx=0x7f99fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 shutdown_connections 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7f99f806df60 0x7f99f8070410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9a080fd840 0x7f9a0810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 --2- 172.21.15.100:0/987190161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a080fc570 0x7f9a0810d0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 >> 172.21.15.100:0/987190161 conn(0x7f9a080f7d30 msgr2=0x7f9a080f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 shutdown_connections 2024-09-13T02:52:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.449+0000 7f9a0f11a640 1 -- 172.21.15.100:0/987190161 wait complete. 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3113669014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fb430 msgr2=0x7fee280fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3113669014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fb430 0x7fee280fb840 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fee180048d0 tx=0x7fee18009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3113669014 shutdown_connections 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3113669014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fc700 0x7fee280fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3113669014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fb430 0x7fee280fb840 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3113669014 >> 172.21.15.100:0/3113669014 conn(0x7fee280f6c10 msgr2=0x7fee280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:25.529 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:25 smithi100 ceph-mon[27894]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:25.530 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:25 smithi100 ceph-mon[27894]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:25.530 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:25 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/2251982253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:25.530 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:25 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/4176357043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3113669014 shutdown_connections 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.527+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3113669014 wait complete. 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 Processor -- start 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 -- start start 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fb430 0x7fee2810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28065c60 con 0x7fee280fc700 2024-09-13T02:52:25.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee2dc8e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28065dd0 con 0x7fee280fb430 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee26ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee26ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40802/0 (socket says 172.21.15.100:40802) 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee26ffd640 1 -- 172.21.15.100:0/3593994063 learned_addr learned my addr 172.21.15.100:0/3593994063 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.528+0000 7fee277fe640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fb430 0x7fee2810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee26ffd640 1 -- 172.21.15.100:0/3593994063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fb430 msgr2=0x7fee2810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee26ffd640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fb430 0x7fee2810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee26ffd640 1 -- 172.21.15.100:0/3593994063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18005040 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee26ffd640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fee1c002a50 tx=0x7fee1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c007c30 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee1c00f040 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee281128b0 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c00da10 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.529+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee28112e20 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.530+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280fa890 con 0x7fee280fc700 2024-09-13T02:52:25.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.531+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 30) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fee1c00dbb0 con 0x7fee280fc700 2024-09-13T02:52:25.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.531+0000 7fee0ffff640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 0x7fee10070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:25.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.531+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fee1c08d190 con 0x7fee280fc700 2024-09-13T02:52:25.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.531+0000 7fee277fe640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 0x7fee10070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:25.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.532+0000 7fee277fe640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 0x7fee10070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee18035040 comp rx=0 tx=0).ready entity=mgr.14706 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:25.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.535+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fee1c0569e0 con 0x7fee280fc700 2024-09-13T02:52:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:25 smithi122 ceph-mon[34559]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:25 smithi122 ceph-mon[34559]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:25 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/2251982253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:25 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/4176357043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:52:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.764+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fee2804b720 con 0x7fee280fc700 2024-09-13T02:52:25.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.764+0000 7fee0ffff640 1 -- 172.21.15.100:0/3593994063 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fee1c00de60 con 0x7fee280fc700 2024-09-13T02:52:25.766 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 msgr2=0x7fee10070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 0x7fee10070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee18035040 comp rx=0 tx=0).stop 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 msgr2=0x7fee28112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fee1c002a50 tx=0x7fee1c004600 comp rx=0 tx=0).stop 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 shutdown_connections 2024-09-13T02:52:25.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:6800/2131214238,v1:172.21.15.100:6801/2131214238] conn(0x7fee1006df60 0x7fee10070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee280fc700 0x7fee28112310 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 --2- 172.21.15.100:0/3593994063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee280fb430 0x7fee2810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 >> 172.21.15.100:0/3593994063 conn(0x7fee280f6c10 msgr2=0x7fee280f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 shutdown_connections 2024-09-13T02:52:25.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:25.766+0000 7fee2dc8e640 1 -- 172.21.15.100:0/3593994063 wait complete. 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: from='client.? 172.21.15.100:0/3593994063' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:26.603 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:26 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:52:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: from='client.? 172.21.15.100:0/3593994063' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:52:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:26.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:26 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:27.726 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:27 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:27.726 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:27 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:27.829 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:27 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:27.829 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:27 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:28.554 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:28 smithi122 ceph-mon[34559]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:52:28.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:28 smithi100 ceph-mon[27894]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:52:30.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:30 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:30 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:30 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:30 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.322 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:30 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.322 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:30 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.322 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:30 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:30.322 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:30 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:31.104 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:31 smithi122 ceph-mon[34559]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:31.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:31 smithi100 ceph-mon[27894]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:32.406 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:32 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:32.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.? 172.21.15.122:0/2439380236' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:32.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:32 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:33.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: mgrmap e31: smithi100.lhjyck(active, since 26s), standbys: smithi122.ptcenr 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.lhjyck"}]': finished 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:33.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi122.ptcenr"}]': finished 2024-09-13T02:52:33.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:33 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:52:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: mgrmap e31: smithi100.lhjyck(active, since 26s), standbys: smithi122.ptcenr 2024-09-13T02:52:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.lhjyck"}]': finished 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi122.ptcenr"}]': finished 2024-09-13T02:52:33.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:33 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:52:34.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:34 smithi100 ceph-mon[27894]: Upgrade: Setting container_image for all mgr 2024-09-13T02:52:34.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:34 smithi122 ceph-mon[34559]: Upgrade: Setting container_image for all mgr 2024-09-13T02:52:35.337 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:35 smithi122 ceph-mon[34559]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:35.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:35 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:35.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:35 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:52:35.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:35 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:52:35.338 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:35 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:35.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:35 smithi100 ceph-mon[27894]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:35.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:35 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:35.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:35 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:52:35.408 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:35 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:52:35.409 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:35 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:36.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:52:36.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 ceph-mon[27894]: Upgrade: Updating mon.smithi100 2024-09-13T02:52:36.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 ceph-mon[27894]: Deploying daemon mon.smithi100 on smithi100 2024-09-13T02:52:36.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 ceph-mon[27894]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:36.349 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:36 smithi122 ceph-mon[34559]: Upgrade: Updating mon.smithi100 2024-09-13T02:52:36.349 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:36 smithi122 ceph-mon[34559]: Deploying daemon mon.smithi100 on smithi100 2024-09-13T02:52:36.349 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:36 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:36.613 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[27890]: 2024-09-13T02:52:36.293+0000 7f794de20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:52:36.613 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[27890]: 2024-09-13T02:52:36.293+0000 7f794de20640 -1 mon.smithi100@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T02:52:36.613 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 podman[92171]: 2024-09-13 02:52:36.3361351 +0000 UTC m=+0.155677498 container died 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=quincy-bbdadfa, GIT_CLEAN=True) 2024-09-13T02:52:36.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 podman[92171]: 2024-09-13 02:52:36.803354737 +0000 UTC m=+0.622897119 container cleanup 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, ceph=True, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:52:36.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:36 smithi100 bash[92171]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100 2024-09-13T02:52:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 podman[92183]: 2024-09-13 02:52:37.088581668 +0000 UTC m=+0.755104882 container remove 8b35ca3b7b1c5053a90d69c80a33564759476ba6e1846a1c49679970d453fb77 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T02:52:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service: Deactivated successfully. 2024-09-13T02:52:37.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 systemd[1]: Stopped Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:52:37.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service: Consumed 10.112s CPU time. 2024-09-13T02:52:37.792 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 systemd[1]: Starting Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:52:37.792 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 podman[92321]: 2024-09-13 02:52:37.549355393 +0000 UTC m=+0.015661454 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:52:37.792 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 podman[92321]: 2024-09-13 02:52:37.665038177 +0000 UTC m=+0.131344224 container create 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 podman[92321]: 2024-09-13 02:52:37.892326537 +0000 UTC m=+0.358632587 container init 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 podman[92321]: 2024-09-13 02:52:37.895760698 +0000 UTC m=+0.362066749 container start 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731) 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: pidfile_write: ignore empty --pid-file 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: load: jerasure load: lrc 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Git sha 0 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:52:38.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: DB SUMMARY 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: DB Session ID: 2DUZ3V29KW97RXM1J8N5 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 1, files: 000030.sst 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000028.log size: 2216687 ; 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:52:38.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.env: 0x559942fbf940 2024-09-13T02:52:38.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:52:38.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.info_log: 0x5599444698c0 2024-09-13T02:52:38.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:52:38.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.statistics: (nil) 2024-09-13T02:52:38.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.use_fsync: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:52:38.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.db_log_dir: 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.wal_dir: 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.write_buffer_manager: 0x559944478dc0 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:52:38.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.unordered_write: 0 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.row_cache: None 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.wal_filter: None 2024-09-13T02:52:38.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.wal_compression: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:52:38.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:52:38.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_open_files: -1 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Compression algorithms supported: 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kZSTD supported: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:52:38.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000015 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.merge_operator: 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_filter: None 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559944469520) 2024-09-13T02:52:38.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 4 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x55994445d1f0 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2024-09-13T02:52:38.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: bloomfilter 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2024-09-13T02:52:38.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 5 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_auto_readahead_size: 262144 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: prepopulate_block_cache: 0 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression: NoCompression 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:52:38.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.num_levels: 7 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:52:38.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:52:38.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:52:38.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:52:38.194 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.ttl: 2592000 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:52:38.195 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:52:38.196 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10307, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bb6af400-03b8-41d8-a6ab-4f1c6cc6ebee 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195957922383, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195957929001, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2008376, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10308, "largest_seqno": 11125, "table_properties": {"data_size": 2003776, "index_size": 2600, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 965, "raw_key_size": 8918, "raw_average_key_size": 23, "raw_value_size": 1995459, "raw_average_value_size": 5251, "num_data_blocks": 119, "num_entries": 380, "num_filter_entries": 380, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726195957, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bb6af400-03b8-41d8-a6ab-4f1c6cc6ebee", "db_session_id": "2DUZ3V29KW97RXM1J8N5", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195957929123, "job": 1, "event": "recovery_finished"} 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55994448ae00 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: DB pointer 0x559944586000 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:52:38.197 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 1/0 1.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 546.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T02:52:38.198 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L6 1/0 5.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 546.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 546.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 546.5 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:52:38.199 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 208.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 208.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache BinnedLRUCache@0x55994445d1f0#2 capacity: 512.00 MB usage: 3.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: starting mon.smithi100 rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???) e2 preinit fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).mds e18 new map 2024-09-13T02:52:38.200 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).mds e18 print_map 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e18 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: 1 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: fs_name cephfs 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: epoch 18 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: tableserver 0 2024-09-13T02:52:38.201 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: root 0 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_timeout 60 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_autoclose 300 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_file_size 1099511627776 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_xattr_size 65536 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: required_client_features {} 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure 0 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure_osd_epoch 44 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_mds 2 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: in 0,1 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: up {0=14470,1=24259} 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: failed 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: damaged 2024-09-13T02:52:38.202 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: stopped 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_pools [3] 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_pool 2 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: inline_data disabled 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: balancer 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: bal_rank_mask -1 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: standby_count_wanted 1 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Standby daemons: 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-09-13T02:52:38.203 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 ceph-mon[92340]: mon.smithi100@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 bash[92321]: 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 2024-09-13T02:52:38.204 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:37 smithi100 systemd[1]: Started Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:52:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: mon.smithi100 calling monitor election 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: mon.smithi100 is new leader, mons smithi100,smithi122 in quorum (ranks 0,1) 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: monmap epoch 2 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: last_changed 2024-09-13T02:43:50.646765+0000 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: created 2024-09-13T02:41:18.575466+0000 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: min_mon_release 17 (quincy) 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: election_strategy: 1 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-09-13T02:52:39.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.smithi122 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: mgrmap e31: smithi100.lhjyck(active, since 33s), standbys: smithi122.ptcenr 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: overall HEALTH_OK 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: from='mgr.14706 ' entity='' 2024-09-13T02:52:39.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:39 smithi100 ceph-mon[92340]: mgrmap e32: smithi100.lhjyck(active, since 33s), standbys: smithi122.ptcenr 2024-09-13T02:52:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: from='mgr.14706 172.21.15.100:0/2563959981' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: mon.smithi100 calling monitor election 2024-09-13T02:52:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: mon.smithi100 is new leader, mons smithi100,smithi122 in quorum (ranks 0,1) 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: monmap epoch 2 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: last_changed 2024-09-13T02:43:50.646765+0000 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: created 2024-09-13T02:41:18.575466+0000 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: min_mon_release 17 (quincy) 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: election_strategy: 1 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.smithi122 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: mgrmap e31: smithi100.lhjyck(active, since 33s), standbys: smithi122.ptcenr 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: overall HEALTH_OK 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: from='mgr.14706 ' entity='' 2024-09-13T02:52:39.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:39 smithi122 ceph-mon[34559]: mgrmap e32: smithi100.lhjyck(active, since 33s), standbys: smithi122.ptcenr 2024-09-13T02:52:44.411 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:52:44.412 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:44.412 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:44.412 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:44.412 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:44.412 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:44 smithi122 ceph-mon[34559]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: Standby manager daemon smithi122.ptcenr restarted 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: Standby manager daemon smithi122.ptcenr started 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/crt"}]: dispatch 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi122.ptcenr/key"}]: dispatch 2024-09-13T02:52:44.512 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:44 smithi100 ceph-mon[92340]: from='mgr.? 172.21.15.122:0/1195826590' entity='mgr.smithi122.ptcenr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: mgrmap e33: smithi100.lhjyck(active, since 38s), standbys: smithi122.ptcenr 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: Active manager daemon smithi100.lhjyck restarted 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: mgrmap e34: smithi100.lhjyck(active, starting, since 0.00771537s), standbys: smithi122.ptcenr 2024-09-13T02:52:45.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:45.523 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:45.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: mgrmap e33: smithi100.lhjyck(active, since 38s), standbys: smithi122.ptcenr 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: Active manager daemon smithi100.lhjyck restarted 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: Activating manager daemon smithi100.lhjyck 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: mgrmap e34: smithi100.lhjyck(active, starting, since 0.00771537s), standbys: smithi122.ptcenr 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi100.lhjyck", "id": "smithi100.lhjyck"}]: dispatch 2024-09-13T02:52:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr metadata", "who": "smithi122.ptcenr", "id": "smithi122.ptcenr"}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: Manager daemon smithi100.lhjyck is now available 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:45.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:45.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:52:45.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:45 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.lhjyck/trash_purge_schedule"}]: dispatch 2024-09-13T02:52:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:46 smithi100 ceph-mon[92340]: mgrmap e35: smithi100.lhjyck(active, since 1.01295s), standbys: smithi122.ptcenr 2024-09-13T02:52:46.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:46 smithi100 ceph-mon[92340]: pgmap v3: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:46.599 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:46 smithi122 ceph-mon[34559]: mgrmap e35: smithi100.lhjyck(active, since 1.01295s), standbys: smithi122.ptcenr 2024-09-13T02:52:46.599 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:46 smithi122 ceph-mon[34559]: pgmap v3: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: [13/Sep/2024:02:52:45] ENGINE Bus STARTING 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: [13/Sep/2024:02:52:45] ENGINE Serving on http://172.21.15.100:8765 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: [13/Sep/2024:02:52:45] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: [13/Sep/2024:02:52:45] ENGINE Bus STARTED 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: [13/Sep/2024:02:52:45] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:47.616 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Traceback (most recent call last): 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._run(expiration_interval) 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:47.617 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self.do_handshake() 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: pgmap v4: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:47.618 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:47 smithi100 ceph-mon[92340]: mgrmap e36: smithi100.lhjyck(active, since 2s), standbys: smithi122.ptcenr 2024-09-13T02:52:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:45] ENGINE Bus STARTING 2024-09-13T02:52:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:45] ENGINE Serving on http://172.21.15.100:8765 2024-09-13T02:52:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:45] ENGINE Serving on https://172.21.15.100:7150 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:45] ENGINE Bus STARTED 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: [13/Sep/2024:02:52:45] ENGINE Error in HTTPServer.serve 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Traceback (most recent call last): 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:52:47.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._run(expiration_interval) 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:52:47.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: s = self.context.wrap_socket( 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: return self.sslsocket_class._create( 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self.do_handshake() 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: self._sslobj.do_handshake() 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: pgmap v4: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:47.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:47 smithi122 ceph-mon[34559]: mgrmap e36: smithi100.lhjyck(active, since 2s), standbys: smithi122.ptcenr 2024-09-13T02:52:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:48 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:48 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:48 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:48.585 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:48 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:49.451 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:49 smithi122 ceph-mon[34559]: pgmap v5: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:49.452 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:49 smithi122 ceph-mon[34559]: mgrmap e37: smithi100.lhjyck(active, since 4s), standbys: smithi122.ptcenr 2024-09-13T02:52:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:49 smithi100 ceph-mon[92340]: pgmap v5: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:49 smithi100 ceph-mon[92340]: mgrmap e37: smithi100.lhjyck(active, since 4s), standbys: smithi122.ptcenr 2024-09-13T02:52:50.789 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:50 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.789 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:50 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.790 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:50 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.790 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:50 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.790 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:50 smithi122 ceph-mon[34559]: pgmap v6: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:50.808 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:50 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.808 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:50 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.808 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:50 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.808 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:50 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:50.808 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:50 smithi100 ceph-mon[92340]: pgmap v6: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:52:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:52.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:52.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:52:52.185 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-13T02:52:52.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:52.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:52.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:52.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:51 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:52:53.082 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:52 smithi122 ceph-mon[34559]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:53.082 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:52 smithi122 ceph-mon[34559]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:53.082 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:52 smithi122 ceph-mon[34559]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T02:52:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:52 smithi100 ceph-mon[92340]: Updating smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:52 smithi100 ceph-mon[92340]: Updating smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:52:53.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:52 smithi100 ceph-mon[92340]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-13T02:52:54.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: Upgrade: Updating mon.smithi122 2024-09-13T02:52:54.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:54.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:52:54.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:52:54.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:54.422 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: Upgrade: Updating mon.smithi122 2024-09-13T02:52:54.423 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:54.423 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:52:54.423 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:52:54.423 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:54.423 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-mon[34559]: Deploying daemon mon.smithi122 on smithi122 2024-09-13T02:52:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:54 smithi100 ceph-mon[92340]: Deploying daemon mon.smithi122 on smithi122 2024-09-13T02:52:55.006 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 systemd[1]: Stopping Ceph mon.smithi122 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:52:55.006 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122[34555]: 2024-09-13T02:52:54.944+0000 7f2f1713b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi122 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:52:55.006 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:54 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122[34555]: 2024-09-13T02:52:54.944+0000 7f2f1713b640 -1 mon.smithi122@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T02:52:55.303 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 podman[79519]: 2024-09-13 02:52:55.005636311 +0000 UTC m=+0.162859011 container died 5a2c18cdbdfb91be18b8a8d1883b1c7df24841938df1ef85ad1d37032a273972 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T02:52:55.562 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 podman[79519]: 2024-09-13 02:52:55.402464119 +0000 UTC m=+0.559686815 container cleanup 5a2c18cdbdfb91be18b8a8d1883b1c7df24841938df1ef85ad1d37032a273972 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=quincy-bbdadfa, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:52:55.563 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 bash[79519]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122 2024-09-13T02:52:55.818 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 podman[79531]: 2024-09-13 02:52:55.562072277 +0000 UTC m=+0.550434788 container remove 5a2c18cdbdfb91be18b8a8d1883b1c7df24841938df1ef85ad1d37032a273972 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2) 2024-09-13T02:52:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1665564952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c540ff720 msgr2=0x7f1c54101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1665564952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c540ff720 0x7f1c54101b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c400048d0 tx=0x7f1c40009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1665564952 shutdown_connections 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1665564952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c540ff720 0x7f1c54101b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1665564952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c54066690 0x7f1c540ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1665564952 >> 172.21.15.100:0/1665564952 conn(0x7f1c540f6c10 msgr2=0x7f1c540f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1665564952 shutdown_connections 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1665564952 wait complete. 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 Processor -- start 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.857+0000 7f1c5acb7640 1 -- start start 2024-09-13T02:52:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c5acb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c5acb7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 0x7f1c5410d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c5acb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5410e530 con 0x7f1c54066690 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c5acb7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5410e6a0 con 0x7f1c540ff720 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c53fff640 1 -- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 msgr2=0x7f1c5410d6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.122:3300/0 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c53fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 0x7f1c5410d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48178/0 (socket says 172.21.15.100:48178) 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 -- 172.21.15.100:0/1415370230 learned_addr learned my addr 172.21.15.100:0/1415370230 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 -- 172.21.15.100:0/1415370230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 msgr2=0x7f1c5410d6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 0x7f1c5410d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.858+0000 7f1c58a53640 1 -- 172.21.15.100:0/1415370230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40005040 con 0x7f1c54066690 2024-09-13T02:52:55.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c58a53640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800b530 tx=0x7f1c48006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:55.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c48010790 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c48010d90 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5410e980 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4800f300 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.859+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5410ef20 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.860+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c540fa8b0 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.861+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f1c48011440 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.861+0000 7f1c517fa640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 0x7f1c44070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.861+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1c4808e4d0 con 0x7f1c54066690 2024-09-13T02:52:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.861+0000 7f1c53fff640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 0x7f1c44070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.862+0000 7f1c53fff640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 0x7f1c44070aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:55.866+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c480574b0 con 0x7f1c54066690 2024-09-13T02:52:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.050+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c5410f140 con 0x7f1c4406e5f0 2024-09-13T02:52:56.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.052+0000 7f1c517fa640 1 -- 172.21.15.100:0/1415370230 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1c5410f140 con 0x7f1c4406e5f0 2024-09-13T02:52:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 msgr2=0x7f1c44070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 0x7f1c44070aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 msgr2=0x7f1c5410d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800b530 tx=0x7f1c48006f90 comp rx=0 tx=0).stop 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 shutdown_connections 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c4406e5f0 0x7f1c44070aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c540ff720 0x7f1c5410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 --2- 172.21.15.100:0/1415370230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c54066690 0x7f1c5410d180 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 >> 172.21.15.100:0/1415370230 conn(0x7f1c540f6c10 msgr2=0x7f1c540f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 shutdown_connections 2024-09-13T02:52:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.054+0000 7f1c5acb7640 1 -- 172.21.15.100:0/1415370230 wait complete. 2024-09-13T02:52:56.064 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 -- 172.21.15.100:0/2200597633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fc550 msgr2=0x7f8bec0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/2200597633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fc550 0x7f8bec0fc960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8be80048d0 tx=0x7f8be8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 -- 172.21.15.100:0/2200597633 shutdown_connections 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/2200597633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fd820 0x7f8bec0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/2200597633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fc550 0x7f8bec0fc960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 -- 172.21.15.100:0/2200597633 >> 172.21.15.100:0/2200597633 conn(0x7f8bec0f7d30 msgr2=0x7f8bec0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 -- 172.21.15.100:0/2200597633 shutdown_connections 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.133+0000 7f8bf47b0640 1 -- 172.21.15.100:0/2200597633 wait complete. 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 Processor -- start 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 -- start start 2024-09-13T02:52:56.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 0x7f8bec10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec10e4a0 con 0x7f8bec0fd820 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf47b0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec10e610 con 0x7f8bec0fc550 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf254c640 1 -- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 msgr2=0x7f8bec10d0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.122:3300/0 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf254c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 0x7f8bec10d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48204/0 (socket says 172.21.15.100:48204) 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 -- 172.21.15.100:0/3712417318 learned_addr learned my addr 172.21.15.100:0/3712417318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 -- 172.21.15.100:0/3712417318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 msgr2=0x7f8bec10d0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 0x7f8bec10d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.134+0000 7f8bf1d4b640 1 -- 172.21.15.100:0/3712417318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8005040 con 0x7f8bec0fd820 2024-09-13T02:52:56.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8bf1d4b640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00b560 tx=0x7f8bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc010790 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bdc010d90 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc00f300 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec10e8f0 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.135+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec10ee40 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.136+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec0fb9b0 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.137+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8bdc011440 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.137+0000 7f8be2ffd640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 0x7f8bd8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.137+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8bdc08e570 con 0x7f8bec0fd820 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.137+0000 7f8bf254c640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 0x7f8bd8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.138+0000 7f8bf254c640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 0x7f8bd8070a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8be8007ac0 tx=0x7f8be8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.142+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8bdc057550 con 0x7f8bec0fd820 2024-09-13T02:52:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi122.service: Deactivated successfully. 2024-09-13T02:52:56.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 systemd[1]: Stopped Ceph mon.smithi122 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:52:56.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:55 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi122.service: Consumed 5.640s CPU time. 2024-09-13T02:52:56.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 systemd[1]: Starting Ceph mon.smithi122 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:52:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.326+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bec10f120 con 0x7f8bd806e5a0 2024-09-13T02:52:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.327+0000 7f8be2ffd640 1 -- 172.21.15.100:0/3712417318 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8bec10f120 con 0x7f8bd806e5a0 2024-09-13T02:52:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 msgr2=0x7f8bd8070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 0x7f8bd8070a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8be8007ac0 tx=0x7f8be8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 msgr2=0x7f8bec10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00b560 tx=0x7f8bdc0091a0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 shutdown_connections 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8bd806e5a0 0x7f8bd8070a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bec0fd820 0x7f8bec10d630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 --2- 172.21.15.100:0/3712417318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8bec0fc550 0x7f8bec10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 >> 172.21.15.100:0/3712417318 conn(0x7f8bec0f7d30 msgr2=0x7f8bec0f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 shutdown_connections 2024-09-13T02:52:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.330+0000 7f8bf47b0640 1 -- 172.21.15.100:0/3712417318 wait complete. 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 -- 172.21.15.100:0/643984139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fc720 msgr2=0x7f7bd80fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 --2- 172.21.15.100:0/643984139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fc720 0x7f7bd80fcb90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00048d0 tx=0x7f7bc0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 -- 172.21.15.100:0/643984139 shutdown_connections 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 --2- 172.21.15.100:0/643984139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fc720 0x7f7bd80fcb90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 --2- 172.21.15.100:0/643984139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fb450 0x7f7bd80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.408+0000 7f7bdd854640 1 -- 172.21.15.100:0/643984139 >> 172.21.15.100:0/643984139 conn(0x7f7bd80f6c10 msgr2=0x7f7bd80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 -- 172.21.15.100:0/643984139 shutdown_connections 2024-09-13T02:52:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 -- 172.21.15.100:0/643984139 wait complete. 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 Processor -- start 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 -- start start 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 0x7f7bd8112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8066840 con 0x7f7bd80fb450 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bdd854640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80669b0 con 0x7f7bd80fc720 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bcffff640 1 -- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 msgr2=0x7f7bd8112350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.122:3300/0 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bcffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 0x7f7bd8112350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bd6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48212/0 (socket says 172.21.15.100:48212) 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.409+0000 7f7bd6ffd640 1 -- 172.21.15.100:0/2800220176 learned_addr learned my addr 172.21.15.100:0/2800220176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bd6ffd640 1 -- 172.21.15.100:0/2800220176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 msgr2=0x7f7bd8112350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bd6ffd640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 0x7f7bd8112350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bd6ffd640 1 -- 172.21.15.100:0/2800220176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bd6ffd640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800b590 tx=0x7f7bc80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800f6f0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bc800fcf0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd81129b0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.410+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc8011e60 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.411+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd8112f50 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.412+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd80fa8b0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.412+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7bc80116b0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.412+0000 7f7bcf7fe640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 0x7f7bc4070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.413+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7bc808dfa0 con 0x7f7bd80fb450 2024-09-13T02:52:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.413+0000 7f7bcffff640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 0x7f7bc4070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.413+0000 7f7bcffff640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 0x7f7bc4070ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0007ac0 tx=0x7f7bc0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.417+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7bc805abf0 con 0x7f7bd80fb450 2024-09-13T02:52:56.499 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 podman[79661]: 2024-09-13 02:52:56.140635687 +0000 UTC m=+0.016124719 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:52:56.499 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 podman[79661]: 2024-09-13 02:52:56.263833422 +0000 UTC m=+0.139322487 container create a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T02:52:56.499 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 podman[79661]: 2024-09-13 02:52:56.474824856 +0000 UTC m=+0.350313877 container init a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, ceph=True, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T02:52:56.499 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 podman[79661]: 2024-09-13 02:52:56.477913048 +0000 UTC m=+0.353402071 container start a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T02:52:56.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.601+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd8100b30 con 0x7f7bc406e600 2024-09-13T02:52:56.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.611+0000 7f7bcf7fe640 1 -- 172.21.15.100:0/2800220176 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7bd8100b30 con 0x7f7bc406e600 2024-09-13T02:52:56.612 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:52:56.612 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (89s) 7s ago 10m 17.0M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:52:56.612 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (10m) 7s ago 10m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:52:56.612 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (9m) 9s ago 9m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (80s) 7s ago 9m 76.7M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (4m) 7s ago 4m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (4m) 7s ago 4m 12.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (4m) 9s ago 4m 16.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (4m) 9s ago 4m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (64s) 7s ago 11m 472M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (30s) 9s ago 9m 437M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (19s) 7s ago 11m 27.7M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (9m) 9s ago 9m 45.6M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 5a2c18cdbdfb 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (108s) 7s ago 10m 8338k - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (71s) 9s ago 9m 8946k - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (8m) 7s ago 8m 208M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:52:56.613 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (7m) 7s ago 7m 238M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:52:56.614 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (7m) 7s ago 7m 182M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:52:56.614 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (7m) 9s ago 7m 259M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:52:56.614 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (6m) 9s ago 6m 230M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:52:56.614 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (6m) 9s ago 6m 223M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:52:56.614 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (35s) 7s ago 9m 50.1M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 msgr2=0x7f7bc4070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 0x7f7bc4070ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0007ac0 tx=0x7f7bc0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 msgr2=0x7f7bd810fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800b590 tx=0x7f7bc80090f0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 shutdown_connections 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7bc406e600 0x7f7bc4070ab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bd80fc720 0x7f7bd8112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 --2- 172.21.15.100:0/2800220176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bd80fb450 0x7f7bd810fe00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 >> 172.21.15.100:0/2800220176 conn(0x7f7bd80f6c10 msgr2=0x7f7bd80f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 shutdown_connections 2024-09-13T02:52:56.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.613+0000 7f7bdd854640 1 -- 172.21.15.100:0/2800220176 wait complete. 2024-09-13T02:52:56.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- 172.21.15.100:0/2863660482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 msgr2=0x7ff6400fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 --2- 172.21.15.100:0/2863660482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff6400fc930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048d0 tx=0x7ff63c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- 172.21.15.100:0/2863660482 shutdown_connections 2024-09-13T02:52:56.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 --2- 172.21.15.100:0/2863660482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 0x7ff6400fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 --2- 172.21.15.100:0/2863660482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff6400fc930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- 172.21.15.100:0/2863660482 >> 172.21.15.100:0/2863660482 conn(0x7ff6400f7ce0 msgr2=0x7ff6400fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- 172.21.15.100:0/2863660482 shutdown_connections 2024-09-13T02:52:56.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- 172.21.15.100:0/2863660482 wait complete. 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 Processor -- start 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.695+0000 7ff647718640 1 -- start start 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff647718640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff647718640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 0x7ff64010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff647718640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64010e450 con 0x7ff6400fc520 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff647718640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64010e5c0 con 0x7ff6400fd7f0 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48230/0 (socket says 172.21.15.100:48230) 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 -- 172.21.15.100:0/608251618 learned_addr learned my addr 172.21.15.100:0/608251618 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff644cb3640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 0x7ff64010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 -- 172.21.15.100:0/608251618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 msgr2=0x7ff64010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 0x7ff64010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 -- 172.21.15.100:0/608251618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c005040 con 0x7ff6400fc520 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff6454b4640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff63c003080 tx=0x7ff63c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c038070 con 0x7ff6400fc520 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.696+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff63c02abd0 con 0x7ff6400fc520 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.697+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c03e670 con 0x7ff6400fc520 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.697+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64010e840 con 0x7ff6400fc520 2024-09-13T02:52:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.697+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64010ed60 con 0x7ff6400fc520 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.698+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6401057b0 con 0x7ff6400fc520 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.698+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff63c030020 con 0x7ff6400fc520 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.699+0000 7ff635ffb640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 0x7ff62c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.699+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff63c0ae720 con 0x7ff6400fc520 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.699+0000 7ff644cb3640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 0x7ff62c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:56.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.700+0000 7ff644cb3640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 0x7ff62c070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff630006fd0 tx=0x7ff630008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:56.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.703+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff63c077700 con 0x7ff6400fc520 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: pidfile_write: ignore empty --pid-file 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: load: jerasure load: lrc 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Git sha 0 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: DB SUMMARY 2024-09-13T02:52:56.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: DB Session ID: GBCIXLDS5XWPB8YFG0NT 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: MANIFEST file: MANIFEST-000009 size: 896 Bytes 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi122/store.db dir, Total Num: 1, files: 000024.sst 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi122/store.db: 000022.log size: 6128376 ; 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.env: 0x5634ddb8f940 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:52:56.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.info_log: 0x5634df53d8c0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.statistics: (nil) 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.use_fsync: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:52:56.939 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:52:56.940 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:52:56.940 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.db_log_dir: 2024-09-13T02:52:56.940 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.wal_dir: 2024-09-13T02:52:56.940 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:52:56.941 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:52:56.941 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:52:56.941 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:52:56.941 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.write_buffer_manager: 0x5634df54cdc0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:52:56.942 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.unordered_write: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.row_cache: None 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.wal_filter: None 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.wal_compression: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:52:56.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:52:56.944 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_open_files: -1 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Compression algorithms supported: 2024-09-13T02:52:56.945 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kZSTD supported: 0 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi122/store.db/MANIFEST-000009 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.merge_operator: 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_filter: None 2024-09-13T02:52:56.946 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634df53d520) 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: index_type: 0 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: data_block_index_type: 0 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: index_shortening: 1 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:52:56.947 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: checksum: 4 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: no_block_cache: 0 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_cache: 0x5634df5311f0 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_cache_options: 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: capacity : 536870912 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: num_shard_bits : 4 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: strict_capacity_limit : 0 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_cache_compressed: (nil) 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: persistent_cache: (nil) 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_size: 4096 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_size_deviation: 10 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_restart_interval: 16 2024-09-13T02:52:56.948 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: index_block_restart_interval: 1 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: metadata_block_size: 4096 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: partition_filters: 0 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: use_delta_encoding: 1 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: filter_policy: bloomfilter 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: whole_key_filtering: 1 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: verify_compression: 0 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: format_version: 5 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: enable_index_compression: 1 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: block_align: 0 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: max_auto_readahead_size: 262144 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: prepopulate_block_cache: 0 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:52:56.949 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression: NoCompression 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.num_levels: 7 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:52:56.950 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:52:56.951 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:52:56.952 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:52:56.953 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:52:56.954 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.ttl: 2592000 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:52:56.955 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi122/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10402, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 82941a30-7e7a-4335-a98b-5106fe5e907b 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195976504287, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195976520368, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3679900, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10407, "largest_seqno": 11748, "table_properties": {"data_size": 3673474, "index_size": 3909, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13469, "raw_average_key_size": 23, "raw_value_size": 3661151, "raw_average_value_size": 6389, "num_data_blocks": 178, "num_entries": 573, "num_filter_entries": 573, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726195976, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "82941a30-7e7a-4335-a98b-5106fe5e907b", "db_session_id": "GBCIXLDS5XWPB8YFG0NT", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:52:56.956 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195976520496, "job": 1, "event": "recovery_finished"} 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi122/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5634df55ee00 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: DB pointer 0x5634df65a000 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ** DB Stats ** 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:52:56.957 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ** Compaction Stats [default] ** 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: L0 1/0 3.51 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.3 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-09-13T02:52:56.958 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: L6 1/0 5.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Sum 2/0 8.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.3 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.3 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ** Compaction Stats [default] ** 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 430.3 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.959 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Cumulative compaction: 0.00 GB write, 187.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Interval compaction: 0.00 GB write, 187.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Block cache BinnedLRUCache@0x5634df5311f0#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: starting mon.smithi122 rank 1 at public addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] at bind addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi122 fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:56.960 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???) e2 preinit fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).mds e18 new map 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).mds e18 print_map 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: e18 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: legacy client fscid: 1 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: fs_name cephfs 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: epoch 18 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:52:56.961 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: tableserver 0 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: root 0 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: session_timeout 60 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: session_autoclose 300 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: max_file_size 1099511627776 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: max_xattr_size 65536 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: required_client_features {} 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: last_failure 0 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: last_failure_osd_epoch 44 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: max_mds 2 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: in 0,1 2024-09-13T02:52:56.962 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: up {0=14470,1=24259} 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: failed 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: damaged 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: stopped 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: data_pools [3] 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: metadata_pool 2 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: inline_data disabled 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: balancer 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: bal_rank_mask -1 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: standby_count_wanted 1 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: [mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: [mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:56.963 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: Standby daemons: 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: [mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout: [mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 ceph-mon[79680]: mon.smithi122@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 bash[79661]: a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 2024-09-13T02:52:56.964 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:56 smithi122 systemd[1]: Started Ceph mon.smithi122 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:52:56.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.947+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6400fb980 con 0x7ff6400fc520 2024-09-13T02:52:56.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.948+0000 7ff635ffb640 1 -- 172.21.15.100:0/608251618 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7ff63c07adc0 con 0x7ff6400fc520 2024-09-13T02:52:56.965 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:52:56.965 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:52:56.966 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 11, 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 msgr2=0x7ff62c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 0x7ff62c070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff630006fd0 tx=0x7ff630008040 comp rx=0 tx=0).stop 2024-09-13T02:52:56.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 msgr2=0x7ff64010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff63c003080 tx=0x7ff63c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 shutdown_connections 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff62c06e660 0x7ff62c070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6400fd7f0 0x7ff64010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 --2- 172.21.15.100:0/608251618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6400fc520 0x7ff64010d0a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 >> 172.21.15.100:0/608251618 conn(0x7ff6400f7ce0 msgr2=0x7ff6400f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 shutdown_connections 2024-09-13T02:52:56.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:56.951+0000 7ff647718640 1 -- 172.21.15.100:0/608251618 wait complete. 2024-09-13T02:52:57.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 -- 172.21.15.100:0/1641265814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 msgr2=0x7efd940fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1641265814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fcb70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0048d0 tx=0x7efd7c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 -- 172.21.15.100:0/1641265814 shutdown_connections 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1641265814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fcb70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1641265814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.031+0000 7efd99ab7640 1 -- 172.21.15.100:0/1641265814 >> 172.21.15.100:0/1641265814 conn(0x7efd940f6c10 msgr2=0x7efd940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 -- 172.21.15.100:0/1641265814 shutdown_connections 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 -- 172.21.15.100:0/1641265814 wait complete. 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 Processor -- start 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 -- start start 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940fdfd0 con 0x7efd940fc700 2024-09-13T02:52:57.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd99ab7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940fe110 con 0x7efd940fb430 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48242/0 (socket says 172.21.15.100:48242) 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd8bfff640 1 -- 172.21.15.100:0/1849163052 learned_addr learned my addr 172.21.15.100:0/1849163052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.032+0000 7efd937fe640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd937fe640 1 -- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 msgr2=0x7efd940ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd937fe640 1 -- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 msgr2=0x7efd940ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd937fe640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd937fe640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:57.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd8bfff640 1 -- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 msgr2=0x7efd940ff550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd8bfff640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd8bfff640 1 -- 172.21.15.100:0/1849163052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c005040 con 0x7efd940fc700 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd8bfff640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0043d0 tx=0x7efd7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c038070 con 0x7efd940fc700 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efd7c02ae90 con 0x7efd940fc700 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd940fe390 con 0x7efd940fc700 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c03e670 con 0x7efd940fc700 2024-09-13T02:52:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.033+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd941150d0 con 0x7efd940fc700 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.034+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd940fa890 con 0x7efd940fc700 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.035+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7efd7c030020 con 0x7efd940fc700 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.036+0000 7efd90ff9640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 0x7efd80070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.036+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efd7c0ae4f0 con 0x7efd940fc700 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.036+0000 7efd937fe640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 0x7efd80070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.036+0000 7efd937fe640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 0x7efd80070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd940ff300 tx=0x7efd84009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.040+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efd7c077600 con 0x7efd940fc700 2024-09-13T02:52:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.241+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd9404b720 con 0x7efd940fc700 2024-09-13T02:52:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.241+0000 7efd90ff9640 1 -- 172.21.15.100:0/1849163052 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1966 (secure 0 0 0) 0x7efd7c07acc0 con 0x7efd940fc700 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:52:57.243 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:57.244 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:57.245 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:57.246 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 msgr2=0x7efd80070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 0x7efd80070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efd940ff300 tx=0x7efd84009ee0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 msgr2=0x7efd940fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0043d0 tx=0x7efd7c009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 shutdown_connections 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7efd8006e660 0x7efd80070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd940fc700 0x7efd940fda40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 --2- 172.21.15.100:0/1849163052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd940fb430 0x7efd940ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.243+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 >> 172.21.15.100:0/1849163052 conn(0x7efd940f6c10 msgr2=0x7efd94065590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.244+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 shutdown_connections 2024-09-13T02:52:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.244+0000 7efd99ab7640 1 -- 172.21.15.100:0/1849163052 wait complete. 2024-09-13T02:52:57.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 -- 172.21.15.100:0/3313637944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 msgr2=0x7fc6440fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 --2- 172.21.15.100:0/3313637944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc6440fc930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6400048d0 tx=0x7fc640009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 -- 172.21.15.100:0/3313637944 shutdown_connections 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 --2- 172.21.15.100:0/3313637944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc6440fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 --2- 172.21.15.100:0/3313637944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc6440fc930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 -- 172.21.15.100:0/3313637944 >> 172.21.15.100:0/3313637944 conn(0x7fc6440f7ce0 msgr2=0x7fc6440fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.323+0000 7fc64b386640 1 -- 172.21.15.100:0/3313637944 shutdown_connections 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 -- 172.21.15.100:0/3313637944 wait complete. 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 Processor -- start 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 -- start start 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64410dc40 con 0x7fc6440fc520 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc64b386640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64410e460 con 0x7fc6440fd7f0 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc649122640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc649122640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48260/0 (socket says 172.21.15.100:48260) 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc649122640 1 -- 172.21.15.100:0/2676932019 learned_addr learned my addr 172.21.15.100:0/2676932019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.324+0000 7fc648921640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc648921640 1 -- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 msgr2=0x7fc64410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc648921640 1 -- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 msgr2=0x7fc64410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc648921640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc648921640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc649122640 1 -- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 msgr2=0x7fc64410d5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc649122640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc649122640 1 -- 172.21.15.100:0/2676932019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640005040 con 0x7fc6440fc520 2024-09-13T02:52:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc649122640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6400043d0 tx=0x7fc640009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc640038070 con 0x7fc6440fc520 2024-09-13T02:52:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc64002ae90 con 0x7fc6440fc520 2024-09-13T02:52:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64410e690 con 0x7fc6440fc520 2024-09-13T02:52:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64003e670 con 0x7fc6440fc520 2024-09-13T02:52:57.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.325+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64410ec30 con 0x7fc6440fc520 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.326+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6440fb980 con 0x7fc6440fc520 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.327+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc640030020 con 0x7fc6440fc520 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.327+0000 7fc639ffb640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 0x7fc630070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.327+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc6400ae550 con 0x7fc6440fc520 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.327+0000 7fc648921640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 0x7fc630070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.328+0000 7fc648921640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 0x7fc630070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc634007fd0 tx=0x7fc634009ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.336+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc640077530 con 0x7fc6440fc520 2024-09-13T02:52:57.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.520+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc64410ef80 con 0x7fc63006e660 2024-09-13T02:52:57.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.522+0000 7fc639ffb640 1 -- 172.21.15.100:0/2676932019 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc64410ef80 con 0x7fc63006e660 2024-09-13T02:52:57.523 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:52:57.523 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:52:57.523 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:52:57.523 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr" 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "3/21 daemons upgraded", 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:52:57.524 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:52:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 msgr2=0x7fc630070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 0x7fc630070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc634007fd0 tx=0x7fc634009ec0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 msgr2=0x7fc64410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6400043d0 tx=0x7fc640009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 shutdown_connections 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc63006e660 0x7fc630070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6440fd7f0 0x7fc64410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 --2- 172.21.15.100:0/2676932019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6440fc520 0x7fc64410d0b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 >> 172.21.15.100:0/2676932019 conn(0x7fc6440f7ce0 msgr2=0x7fc6440f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 shutdown_connections 2024-09-13T02:52:57.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.524+0000 7fc64b386640 1 -- 172.21.15.100:0/2676932019 wait complete. 2024-09-13T02:52:57.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.601+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3469077837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fd820 msgr2=0x7fc0b80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.601+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3469077837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fd820 0x7fc0b80fdc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0048d0 tx=0x7fc0ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.601+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3469077837 shutdown_connections 2024-09-13T02:52:57.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.601+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3469077837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fd820 0x7fc0b80fdc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.601+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3469077837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fc550 0x7fc0b80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.602+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3469077837 >> 172.21.15.100:0/3469077837 conn(0x7fc0b80f7d30 msgr2=0x7fc0b80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.602+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3469077837 shutdown_connections 2024-09-13T02:52:57.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.602+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3469077837 wait complete. 2024-09-13T02:52:57.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.602+0000 7fc0bd39c640 1 Processor -- start 2024-09-13T02:52:57.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.602+0000 7fc0bd39c640 1 -- start start 2024-09-13T02:52:57.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0bd39c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0bd39c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0bd39c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b810dc20 con 0x7fc0b80fc550 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0bd39c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b810e440 con 0x7fc0b80fd820 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48280/0 (socket says 172.21.15.100:48280) 2024-09-13T02:52:57.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 -- 172.21.15.100:0/3605131326 learned_addr learned my addr 172.21.15.100:0/3605131326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b67fc640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b67fc640 1 -- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 msgr2=0x7fc0b810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b67fc640 1 -- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 msgr2=0x7fc0b810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b67fc640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b67fc640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 -- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 msgr2=0x7fc0b810d5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 -- 172.21.15.100:0/3605131326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac005040 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.603+0000 7fc0b6ffd640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8002a50 tx=0x7fc0a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.604+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a8007c30 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.604+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b810e6d0 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.604+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0a800f040 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.604+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a800db50 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.604+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b810ec70 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.605+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b80fb9b0 con 0x7fc0b80fc550 2024-09-13T02:52:57.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.605+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc0a800dcb0 con 0x7fc0b80fc550 2024-09-13T02:52:57.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.606+0000 7fc09f7fe640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 0x7fc0a0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:57.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.606+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc0a808e3b0 con 0x7fc0b80fc550 2024-09-13T02:52:57.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.606+0000 7fc0b67fc640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 0x7fc0a0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:57.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.606+0000 7fc0b67fc640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 0x7fc0a0070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007ac0 tx=0x7fc0ac009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:57.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.614+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc0a8057280 con 0x7fc0b80fc550 2024-09-13T02:52:57.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.851+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc0b8104f60 con 0x7fc0b80fc550 2024-09-13T02:52:57.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.852+0000 7fc09f7fe640 1 -- 172.21.15.100:0/3605131326 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc0a805a940 con 0x7fc0b80fc550 2024-09-13T02:52:57.853 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 msgr2=0x7fc0a0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 0x7fc0a0070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007ac0 tx=0x7fc0ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 msgr2=0x7fc0b810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8002a50 tx=0x7fc0a8004600 comp rx=0 tx=0).stop 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 shutdown_connections 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0a006e660 0x7fc0a0070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0b80fd820 0x7fc0b810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 --2- 172.21.15.100:0/3605131326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0b80fc550 0x7fc0b810d090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 >> 172.21.15.100:0/3605131326 conn(0x7fc0b80f7d30 msgr2=0x7fc0b80f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 shutdown_connections 2024-09-13T02:52:57.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:52:57.854+0000 7fc0bd39c640 1 -- 172.21.15.100:0/3605131326 wait complete. 2024-09-13T02:52:59.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: mon.smithi100 calling monitor election 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: mon.smithi122 calling monitor election 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: mon.smithi100 is new leader, mons smithi100,smithi122 in quorum (ranks 0,1) 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: monmap epoch 3 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: last_changed 2024-09-13T02:52:58.122496+0000 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: created 2024-09-13T02:41:18.575466+0000 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: min_mon_release 19 (squid) 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: election_strategy: 1 2024-09-13T02:52:59.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.smithi122 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: mgrmap e37: smithi100.lhjyck(active, since 13s), standbys: smithi122.ptcenr 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: overall HEALTH_OK 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:59.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:52:59 smithi100 ceph-mon[92340]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:52:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: mon.smithi100 calling monitor election 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: mon.smithi122 calling monitor election 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mon metadata", "id": "smithi122"}]: dispatch 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: mon.smithi100 is new leader, mons smithi100,smithi122 in quorum (ranks 0,1) 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: monmap epoch 3 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: fsid 84e01cde-7179-11ef-bceb-c7b262605968 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: last_changed 2024-09-13T02:52:58.122496+0000 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: created 2024-09-13T02:41:18.575466+0000 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: min_mon_release 19 (squid) 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: election_strategy: 1 2024-09-13T02:52:59.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.smithi122 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: mgrmap e37: smithi100.lhjyck(active, since 13s), standbys: smithi122.ptcenr 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: overall HEALTH_OK 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:59.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:52:59 smithi122 ceph-mon[79680]: pgmap v10: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:53:00.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:00.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:01.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:01 smithi100 ceph-mon[92340]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:53:01.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:01.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:01 smithi122 ceph-mon[79680]: pgmap v11: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:53:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:01.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:02 smithi100 ceph-mon[92340]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:53:02.828 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:02.829 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:02.829 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:02 smithi122 ceph-mon[79680]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:53:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:53:05.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:05.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:05.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:53:05.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:53:05.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:06.576 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: Reconfiguring mon.smithi100 (monmap changed)... 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: Reconfiguring daemon mon.smithi100 on smithi100 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:53:06.577 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: Reconfiguring mon.smithi100 (monmap changed)... 2024-09-13T02:53:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: Reconfiguring daemon mon.smithi100 on smithi100 2024-09-13T02:53:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.lhjyck", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:53:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:53:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:07 smithi100 ceph-mon[92340]: Reconfiguring mgr.smithi100.lhjyck (monmap changed)... 2024-09-13T02:53:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:07 smithi100 ceph-mon[92340]: Reconfiguring daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:53:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:07 smithi100 ceph-mon[92340]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:07 smithi122 ceph-mon[79680]: Reconfiguring mgr.smithi100.lhjyck (monmap changed)... 2024-09-13T02:53:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:07 smithi122 ceph-mon[79680]: Reconfiguring daemon mgr.smithi100.lhjyck on smithi100 2024-09-13T02:53:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:07 smithi122 ceph-mon[79680]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: Reconfiguring crash.smithi100 (monmap changed)... 2024-09-13T02:53:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:08.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:08 smithi100 ceph-mon[92340]: Reconfiguring daemon crash.smithi100 on smithi100 2024-09-13T02:53:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: Reconfiguring crash.smithi100 (monmap changed)... 2024-09-13T02:53:08.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:08.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:08.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:08 smithi122 ceph-mon[79680]: Reconfiguring daemon crash.smithi100 on smithi100 2024-09-13T02:53:09.468 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:09 smithi100 ceph-mon[92340]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:09.468 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:09 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:09.468 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:09 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:09.468 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:09 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:53:09.468 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:09 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:09 smithi122 ceph-mon[79680]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:09 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:09 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:09 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:53:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:09 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:10.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:53:10.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.0 on smithi100 2024-09-13T02:53:10.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:10.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:10.646 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:53:10.647 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:10 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:53:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.0 on smithi100 2024-09-13T02:53:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:53:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:10 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:11 smithi100 ceph-mon[92340]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:11 smithi100 ceph-mon[92340]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:53:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:11 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.1 on smithi100 2024-09-13T02:53:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:11 smithi122 ceph-mon[79680]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:11 smithi122 ceph-mon[79680]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:53:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:11 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.1 on smithi100 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.2 on smithi100 2024-09-13T02:53:13.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:12 smithi100 ceph-mon[92340]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:13.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:13.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:13.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:53:13.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:53:13.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:13.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.2 on smithi100 2024-09-13T02:53:13.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:12 smithi122 ceph-mon[79680]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: Reconfiguring mds.cephfs.smithi100.slkwfs (monmap changed)... 2024-09-13T02:53:14.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:14.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:14.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:14 smithi100 ceph-mon[92340]: Reconfiguring daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:53:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: Reconfiguring mds.cephfs.smithi100.slkwfs (monmap changed)... 2024-09-13T02:53:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:14 smithi122 ceph-mon[79680]: Reconfiguring daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:53:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:16.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:16 smithi100 ceph-mon[92340]: Reconfiguring mds.cephfs.smithi100.ciqoxn (monmap changed)... 2024-09-13T02:53:16.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:16 smithi100 ceph-mon[92340]: Reconfiguring daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:53:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:16 smithi122 ceph-mon[79680]: Reconfiguring mds.cephfs.smithi100.ciqoxn (monmap changed)... 2024-09-13T02:53:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:16 smithi122 ceph-mon[79680]: Reconfiguring daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:53:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:17 smithi100 ceph-mon[92340]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:17 smithi122 ceph-mon[79680]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:17.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:18.565 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: Reconfiguring crash.smithi122 (monmap changed)... 2024-09-13T02:53:18.565 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: Reconfiguring daemon crash.smithi122 on smithi122 2024-09-13T02:53:18.565 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:18.565 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:18.566 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:53:18.566 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:53:18.566 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:18 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:18.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: Reconfiguring crash.smithi122 (monmap changed)... 2024-09-13T02:53:18.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: Reconfiguring daemon crash.smithi122 on smithi122 2024-09-13T02:53:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi122.ptcenr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:53:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:53:18.661 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:18 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:19 smithi100 ceph-mon[92340]: Reconfiguring mgr.smithi122.ptcenr (monmap changed)... 2024-09-13T02:53:19.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:19 smithi100 ceph-mon[92340]: Reconfiguring daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:53:19.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:19 smithi100 ceph-mon[92340]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:19 smithi122 ceph-mon[79680]: Reconfiguring mgr.smithi122.ptcenr (monmap changed)... 2024-09-13T02:53:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:19 smithi122 ceph-mon[79680]: Reconfiguring daemon mgr.smithi122.ptcenr on smithi122 2024-09-13T02:53:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:19 smithi122 ceph-mon[79680]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: Reconfiguring mon.smithi122 (monmap changed)... 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:20 smithi100 ceph-mon[92340]: Reconfiguring daemon mon.smithi122 on smithi122 2024-09-13T02:53:20.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: Reconfiguring mon.smithi122 (monmap changed)... 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:20.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:20 smithi122 ceph-mon[79680]: Reconfiguring daemon mon.smithi122 on smithi122 2024-09-13T02:53:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:21 smithi100 ceph-mon[92340]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:53:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:21 smithi122 ceph-mon[79680]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:53:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:53:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.3 on smithi122 2024-09-13T02:53:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:53:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:22 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.3 on smithi122 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:53:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:22 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:23 smithi100 ceph-mon[92340]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:53:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:23 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.4 on smithi122 2024-09-13T02:53:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:23 smithi100 ceph-mon[92340]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:23 smithi122 ceph-mon[79680]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:53:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:23 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.4 on smithi122 2024-09-13T02:53:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:23 smithi122 ceph-mon[79680]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:24.807 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: Reconfiguring daemon osd.5 on smithi122 2024-09-13T02:53:24.808 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:24 smithi122 ceph-mon[79680]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:53:24.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:53:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: Reconfiguring daemon osd.5 on smithi122 2024-09-13T02:53:24.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:24 smithi100 ceph-mon[92340]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:26.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:26.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:26.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: Reconfiguring mds.cephfs.smithi122.wmvyfe (monmap changed)... 2024-09-13T02:53:26.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:26.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:26.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:25 smithi100 ceph-mon[92340]: Reconfiguring daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: Reconfiguring mds.cephfs.smithi122.wmvyfe (monmap changed)... 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:26.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:25 smithi122 ceph-mon[79680]: Reconfiguring daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:53:27.546 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: Reconfiguring mds.cephfs.smithi122.crukff (monmap changed)... 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:27.547 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:27 smithi122 ceph-mon[79680]: Reconfiguring daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:53:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: Reconfiguring mds.cephfs.smithi122.crukff (monmap changed)... 2024-09-13T02:53:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:53:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:27 smithi100 ceph-mon[92340]: Reconfiguring daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:53:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 -- 172.21.15.100:0/194773298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 msgr2=0x7fad780fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 --2- 172.21.15.100:0/194773298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad780fad40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0048d0 tx=0x7fad6c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:27.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 -- 172.21.15.100:0/194773298 shutdown_connections 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 --2- 172.21.15.100:0/194773298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad780fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 --2- 172.21.15.100:0/194773298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad780fad40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 -- 172.21.15.100:0/194773298 >> 172.21.15.100:0/194773298 conn(0x7fad780f6390 msgr2=0x7fad780f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 -- 172.21.15.100:0/194773298 shutdown_connections 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.946+0000 7fad7cec0640 1 -- 172.21.15.100:0/194773298 wait complete. 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 Processor -- start 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 -- start start 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad7810d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7810de10 con 0x7fad780fa930 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7cec0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7810e630 con 0x7fad780fb280 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49054/0 (socket says 172.21.15.100:49054) 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 -- 172.21.15.100:0/73499783 learned_addr learned my addr 172.21.15.100:0/73499783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad75d9b640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad7810d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 -- 172.21.15.100:0/73499783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 msgr2=0x7fad7810d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad7810d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 -- 172.21.15.100:0/73499783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c005040 con 0x7fad780fa930 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad75d9b640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad7810d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.947+0000 7fad7659c640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad6c003080 tx=0x7fad6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.948+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c038070 con 0x7fad780fa930 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.948+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad6c02abd0 con 0x7fad780fa930 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.948+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c03e670 con 0x7fad780fa930 2024-09-13T02:53:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.948+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7810e860 con 0x7fad780fa930 2024-09-13T02:53:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.948+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7810ee00 con 0x7fad780fa930 2024-09-13T02:53:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.949+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad780fa010 con 0x7fad780fa930 2024-09-13T02:53:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.949+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fad6c030020 con 0x7fad780fa930 2024-09-13T02:53:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.950+0000 7fad66ffd640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 0x7fad60070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.950+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fad6c0ae720 con 0x7fad780fa930 2024-09-13T02:53:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.950+0000 7fad75d9b640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 0x7fad60070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.950+0000 7fad75d9b640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 0x7fad60070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad7810d030 tx=0x7fad68009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:27.955+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fad6c077700 con 0x7fad780fa930 2024-09-13T02:53:28.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.142+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad78105340 con 0x7fad6006e660 2024-09-13T02:53:28.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.143+0000 7fad66ffd640 1 -- 172.21.15.100:0/73499783 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fad78105340 con 0x7fad6006e660 2024-09-13T02:53:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 msgr2=0x7fad60070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 0x7fad60070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad7810d030 tx=0x7fad68009040 comp rx=0 tx=0).stop 2024-09-13T02:53:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 msgr2=0x7fad7810d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad6c003080 tx=0x7fad6c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 shutdown_connections 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fad6006e660 0x7fad60070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fad780fb280 0x7fad7810d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 --2- 172.21.15.100:0/73499783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad780fa930 0x7fad7810d280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 >> 172.21.15.100:0/73499783 conn(0x7fad780f6390 msgr2=0x7fad780f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 shutdown_connections 2024-09-13T02:53:28.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.145+0000 7fad7cec0640 1 -- 172.21.15.100:0/73499783 wait complete. 2024-09-13T02:53:28.155 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:53:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 -- 172.21.15.100:0/3832827379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 msgr2=0x7f12500fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 --2- 172.21.15.100:0/3832827379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f12500fdfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1240009c50 tx=0x7f1240004d10 comp rx=0 tx=0).stop 2024-09-13T02:53:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 -- 172.21.15.100:0/3832827379 shutdown_connections 2024-09-13T02:53:28.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 --2- 172.21.15.100:0/3832827379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f12500fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 --2- 172.21.15.100:0/3832827379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f12500fdfb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 -- 172.21.15.100:0/3832827379 >> 172.21.15.100:0/3832827379 conn(0x7f12500f63a0 msgr2=0x7f12500f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 -- 172.21.15.100:0/3832827379 shutdown_connections 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.227+0000 7f125831f640 1 -- 172.21.15.100:0/3832827379 wait complete. 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 Processor -- start 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 -- start start 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f125010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125010dc20 con 0x7f12500fdba0 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f125831f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125010e440 con 0x7f12500fe4f0 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f12560bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f12560bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49074/0 (socket says 172.21.15.100:49074) 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f12560bb640 1 -- 172.21.15.100:0/4134802380 learned_addr learned my addr 172.21.15.100:0/4134802380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.228+0000 7f12558ba640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f125010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f12560bb640 1 -- 172.21.15.100:0/4134802380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 msgr2=0x7f125010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f12560bb640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f125010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f12560bb640 1 -- 172.21.15.100:0/4134802380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400098b0 con 0x7f12500fdba0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f12558ba640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f125010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f12560bb640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1240004a30 tx=0x7f1240004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1240032850 con 0x7f12500fdba0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1240009710 con 0x7f12500fdba0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125010e670 con 0x7f12500fdba0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124003dc20 con 0x7f12500fdba0 2024-09-13T02:53:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.229+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125010ec10 con 0x7f12500fdba0 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.230+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12500fa040 con 0x7f12500fdba0 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.230+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f124002f030 con 0x7f12500fdba0 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.231+0000 7f124effd640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 0x7f1238070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.231+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f12400af9e0 con 0x7f12500fdba0 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.231+0000 7f12558ba640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 0x7f1238070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.231+0000 7f12558ba640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 0x7f1238070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f125010ce40 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.235+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1240078930 con 0x7f12500fdba0 2024-09-13T02:53:28.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.426+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f125010ef90 con 0x7f123806e660 2024-09-13T02:53:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.428+0000 7f124effd640 1 -- 172.21.15.100:0/4134802380 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f125010ef90 con 0x7f123806e660 2024-09-13T02:53:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 msgr2=0x7f1238070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 0x7f1238070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f125010ce40 tx=0x7f1244009040 comp rx=0 tx=0).stop 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 msgr2=0x7f125010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1240004a30 tx=0x7f1240004d10 comp rx=0 tx=0).stop 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 shutdown_connections 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123806e660 0x7f1238070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12500fe4f0 0x7f125010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 --2- 172.21.15.100:0/4134802380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12500fdba0 0x7f125010d090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 >> 172.21.15.100:0/4134802380 conn(0x7f12500f63a0 msgr2=0x7f12500f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 shutdown_connections 2024-09-13T02:53:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.430+0000 7f125831f640 1 -- 172.21.15.100:0/4134802380 wait complete. 2024-09-13T02:53:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 -- 172.21.15.100:0/3755033535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a00ff590 msgr2=0x7f81a0101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 --2- 172.21.15.100:0/3755033535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a00ff590 0x7f81a0101970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81940048d0 tx=0x7f8194009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 -- 172.21.15.100:0/3755033535 shutdown_connections 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 --2- 172.21.15.100:0/3755033535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a00ff590 0x7f81a0101970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 --2- 172.21.15.100:0/3755033535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a0065a30 0x7f81a00ff050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 -- 172.21.15.100:0/3755033535 >> 172.21.15.100:0/3755033535 conn(0x7f81a00f6a40 msgr2=0x7f81a00f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 -- 172.21.15.100:0/3755033535 shutdown_connections 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.508+0000 7f81a57a2640 1 -- 172.21.15.100:0/3755033535 wait complete. 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 Processor -- start 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 -- start start 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a00ff590 0x7f81a00faf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00fb490 con 0x7f81a0065a30 2024-09-13T02:53:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f81a57a2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00fb600 con 0x7f81a00ff590 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33820/0 (socket says 172.21.15.100:33820) 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819ffff640 1 -- 172.21.15.100:0/47216739 learned_addr learned my addr 172.21.15.100:0/47216739 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819f7fe640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a00ff590 0x7f81a00faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819ffff640 1 -- 172.21.15.100:0/47216739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a00ff590 msgr2=0x7f81a00faf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.509+0000 7f819ffff640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a00ff590 0x7f81a00faf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f819ffff640 1 -- 172.21.15.100:0/47216739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194005040 con 0x7f81a0065a30 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f819ffff640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8190002a80 tx=0x7f8190004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8190007c30 con 0x7f81a0065a30 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f819000f040 con 0x7f81a0065a30 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00fb8e0 con 0x7f81a0065a30 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819000dad0 con 0x7f81a0065a30 2024-09-13T02:53:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.510+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a0114f60 con 0x7f81a0065a30 2024-09-13T02:53:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.511+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a005ed70 con 0x7f81a0065a30 2024-09-13T02:53:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.511+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f819000dc30 con 0x7f81a0065a30 2024-09-13T02:53:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.512+0000 7f819cff9640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 0x7f8188070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.512+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f819008e1b0 con 0x7f81a0065a30 2024-09-13T02:53:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.512+0000 7f819f7fe640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 0x7f8188070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.512+0000 7f819f7fe640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 0x7f8188070b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f819400b020 tx=0x7f8194035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.516+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8190057100 con 0x7f81a0065a30 2024-09-13T02:53:28.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.696+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81a00f8580 con 0x7f818806e650 2024-09-13T02:53:28.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.706+0000 7f819cff9640 1 -- 172.21.15.100:0/47216739 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f81a00f8580 con 0x7f818806e650 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (2m) 39s ago 10m 17.0M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (10m) 39s ago 10m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 98d2b5d38c63 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (9m) 27s ago 9m 6899k - 17.2.7-1627-gbbdadfa3 a994b00deb3a 5e841a4c3f87 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (112s) 39s ago 10m 76.7M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (5m) 39s ago 5m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (5m) 39s ago 5m 12.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (5m) 27s ago 5m 16.1M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (5m) 27s ago 5m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (96s) 39s ago 11m 472M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:53:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (63s) 27s ago 9m 438M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (51s) 39s ago 12m 27.7M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (32s) 27s ago 9m 22.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 39s ago 10m 8338k - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (103s) 27s ago 9m 9684k - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (8m) 39s ago 8m 208M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0ef13635857a 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (8m) 39s ago 8m 238M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (7m) 39s ago 7m 182M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (7m) 27s ago 7m 258M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (7m) 27s ago 7m 230M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (6m) 27s ago 6m 223M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:53:28.709 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (67s) 39s ago 10m 50.1M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 msgr2=0x7f8188070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 0x7f8188070b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f819400b020 tx=0x7f8194035040 comp rx=0 tx=0).stop 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 msgr2=0x7f81a00fc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8190002a80 tx=0x7f8190004570 comp rx=0 tx=0).stop 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 shutdown_connections 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f818806e650 0x7f8188070b00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81a00ff590 0x7f81a00faf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 --2- 172.21.15.100:0/47216739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a0065a30 0x7f81a00fc9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.708+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 >> 172.21.15.100:0/47216739 conn(0x7f81a00f6a40 msgr2=0x7f81a00f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.709+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 shutdown_connections 2024-09-13T02:53:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.709+0000 7f81a57a2640 1 -- 172.21.15.100:0/47216739 wait complete. 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 -- 172.21.15.100:0/710058997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 msgr2=0x7fd68c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 --2- 172.21.15.100:0/710058997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c0fa620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd6800048d0 tx=0x7fd680009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 -- 172.21.15.100:0/710058997 shutdown_connections 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 --2- 172.21.15.100:0/710058997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c0fa620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 --2- 172.21.15.100:0/710058997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 0x7fd68c0fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.786+0000 7fd6929d0640 1 -- 172.21.15.100:0/710058997 >> 172.21.15.100:0/710058997 conn(0x7fd68c0f6390 msgr2=0x7fd68c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all mon 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi122"}]: dispatch 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi122"}]': finished 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:28.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:28 smithi100 ceph-mon[92340]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.787+0000 7fd6929d0640 1 -- 172.21.15.100:0/710058997 shutdown_connections 2024-09-13T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.787+0000 7fd6929d0640 1 -- 172.21.15.100:0/710058997 wait complete. 2024-09-13T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.787+0000 7fd6929d0640 1 Processor -- start 2024-09-13T02:53:28.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.787+0000 7fd6929d0640 1 -- start start 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd6929d0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 0x7fd68c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd6929d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd6929d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c10dc40 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd6929d0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c10e460 con 0x7fd68c0fdb70 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33834/0 (socket says 172.21.15.100:33834) 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 -- 172.21.15.100:0/3542518910 learned_addr learned my addr 172.21.15.100:0/3542518910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68bfff640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 0x7fd68c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 -- 172.21.15.100:0/3542518910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 msgr2=0x7fd68c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 0x7fd68c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:28.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 -- 172.21.15.100:0/3542518910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680005040 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd68b7fe640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6800048a0 tx=0x7fd680009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd680038070 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd68002abd0 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c10e690 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.788+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd680033640 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.789+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c10ec30 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.790+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c0fa010 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.790+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fd680030020 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.790+0000 7fd688ff9640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 0x7fd674070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.791+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd6800ae6a0 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.791+0000 7fd68bfff640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 0x7fd674070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:28.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.791+0000 7fd68bfff640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 0x7fd674070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0041d0 tx=0x7fd67c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:28.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:28.795+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd680077680 con 0x7fd68c0fe4c0 2024-09-13T02:53:28.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all mon 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi122"}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi122"}]': finished 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:28.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:28 smithi122 ceph-mon[79680]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:29.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.033+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd68c04b720 con 0x7fd68c0fe4c0 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.034+0000 7fd688ff9640 1 -- 172.21.15.100:0/3542518910 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7fd68007ad40 con 0x7fd68c0fe4c0 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:53:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 10, 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:53:29.036 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:53:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 msgr2=0x7fd674070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 0x7fd674070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0041d0 tx=0x7fd67c009040 comp rx=0 tx=0).stop 2024-09-13T02:53:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 msgr2=0x7fd68c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6800048a0 tx=0x7fd680009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 shutdown_connections 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd67406e660 0x7fd674070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd68c0fe4c0 0x7fd68c10d5f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 --2- 172.21.15.100:0/3542518910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd68c0fdb70 0x7fd68c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 >> 172.21.15.100:0/3542518910 conn(0x7fd68c0f6390 msgr2=0x7fd68c0f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 shutdown_connections 2024-09-13T02:53:29.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.036+0000 7fd6929d0640 1 -- 172.21.15.100:0/3542518910 wait complete. 2024-09-13T02:53:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 -- 172.21.15.100:0/3010385805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fb450 msgr2=0x7fc42c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 --2- 172.21.15.100:0/3010385805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fb450 0x7fc42c0fb860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0048d0 tx=0x7fc41c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 -- 172.21.15.100:0/3010385805 shutdown_connections 2024-09-13T02:53:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 --2- 172.21.15.100:0/3010385805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fc720 0x7fc42c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 --2- 172.21.15.100:0/3010385805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fb450 0x7fc42c0fb860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 -- 172.21.15.100:0/3010385805 >> 172.21.15.100:0/3010385805 conn(0x7fc42c0f6c10 msgr2=0x7fc42c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 -- 172.21.15.100:0/3010385805 shutdown_connections 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.115+0000 7fc430e14640 1 -- 172.21.15.100:0/3010385805 wait complete. 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 Processor -- start 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 -- start start 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fb450 0x7fc42c10fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c0667e0 con 0x7fc42c0fc720 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc430e14640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c066950 con 0x7fc42c0fb450 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33858/0 (socket says 172.21.15.100:33858) 2024-09-13T02:53:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 -- 172.21.15.100:0/3451368775 learned_addr learned my addr 172.21.15.100:0/3451368775 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc42a59c640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fb450 0x7fc42c10fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 -- 172.21.15.100:0/3451368775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fb450 msgr2=0x7fc42c10fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fb450 0x7fc42c10fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 -- 172.21.15.100:0/3451368775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c005040 con 0x7fc42c0fc720 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.116+0000 7fc429d9b640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b790 tx=0x7fc4140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.117+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc41400c700 con 0x7fc42c0fc720 2024-09-13T02:53:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.117+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc41400cd00 con 0x7fc42c0fc720 2024-09-13T02:53:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.117+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c112990 con 0x7fc42c0fc720 2024-09-13T02:53:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.117+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc414015e80 con 0x7fc42c0fc720 2024-09-13T02:53:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.117+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c112eb0 con 0x7fc42c0fc720 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.118+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c0fa8b0 con 0x7fc42c0fc720 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.118+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fc414012070 con 0x7fc42c0fc720 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.118+0000 7fc422ffd640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 0x7fc418070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.119+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc41408db50 con 0x7fc42c0fc720 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.119+0000 7fc42a59c640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 0x7fc418070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.119+0000 7fc42a59c640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 0x7fc418070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.123+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc414056bb0 con 0x7fc42c0fc720 2024-09-13T02:53:29.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.351+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc42c103ed0 con 0x7fc42c0fc720 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.352+0000 7fc422ffd640 1 -- 172.21.15.100:0/3451368775 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1966 (secure 0 0 0) 0x7fc41405a270 con 0x7fc42c0fc720 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:53:29.354 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:29.355 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:29.356 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:29.357 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 msgr2=0x7fc418070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 0x7fc418070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c035040 comp rx=0 tx=0).stop 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 msgr2=0x7fc42c112390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b790 tx=0x7fc4140091d0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 shutdown_connections 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc41806e660 0x7fc418070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc42c0fc720 0x7fc42c112390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 --2- 172.21.15.100:0/3451368775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc42c0fb450 0x7fc42c10fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 >> 172.21.15.100:0/3451368775 conn(0x7fc42c0f6c10 msgr2=0x7fc42c0f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 shutdown_connections 2024-09-13T02:53:29.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.355+0000 7fc430e14640 1 -- 172.21.15.100:0/3451368775 wait complete. 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 -- 172.21.15.100:0/333668667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 msgr2=0x7ff8c80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 --2- 172.21.15.100:0/333668667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c80fdcb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0048d0 tx=0x7ff8bc009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 -- 172.21.15.100:0/333668667 shutdown_connections 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 --2- 172.21.15.100:0/333668667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c80fdcb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 --2- 172.21.15.100:0/333668667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c80fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 -- 172.21.15.100:0/333668667 >> 172.21.15.100:0/333668667 conn(0x7ff8c80f7d30 msgr2=0x7ff8c80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 -- 172.21.15.100:0/333668667 shutdown_connections 2024-09-13T02:53:29.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.441+0000 7ff8ce210640 1 -- 172.21.15.100:0/333668667 wait complete. 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 Processor -- start 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 -- start start 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c810e480 con 0x7ff8c80fd840 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.442+0000 7ff8ce210640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c810e5f0 con 0x7ff8c80fc570 2024-09-13T02:53:29.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33876/0 (socket says 172.21.15.100:33876) 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 -- 172.21.15.100:0/265668653 learned_addr learned my addr 172.21.15.100:0/265668653 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c77fe640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 -- 172.21.15.100:0/265668653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 msgr2=0x7ff8c810d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c810d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 -- 172.21.15.100:0/265668653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc005040 con 0x7ff8c80fd840 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c77fe640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8c6ffd640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc003080 tx=0x7ff8bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc038070 con 0x7ff8c80fd840 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c810e870 con 0x7ff8c80fd840 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff8bc02abd0 con 0x7ff8c80fd840 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc03e670 con 0x7ff8c80fd840 2024-09-13T02:53:29.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.443+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c810ed90 con 0x7ff8c80fd840 2024-09-13T02:53:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.444+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c80fb9d0 con 0x7ff8c80fd840 2024-09-13T02:53:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.445+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff8bc030020 con 0x7ff8c80fd840 2024-09-13T02:53:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.445+0000 7ff8affff640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 0x7ff8b0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.446+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff8bc0ae620 con 0x7ff8c80fd840 2024-09-13T02:53:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.446+0000 7ff8c77fe640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 0x7ff8b0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.446+0000 7ff8c77fe640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 0x7ff8b0070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8006fd0 tx=0x7ff8b8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.450+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff8bc077680 con 0x7ff8c80fd840 2024-09-13T02:53:29.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.637+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8c810f000 con 0x7ff8b006e660 2024-09-13T02:53:29.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.638+0000 7ff8affff640 1 -- 172.21.15.100:0/265668653 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7ff8c810f000 con 0x7ff8b006e660 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "4/21 daemons upgraded", 2024-09-13T02:53:29.640 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T02:53:29.641 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:53:29.641 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 msgr2=0x7ff8b0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 0x7ff8b0070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8006fd0 tx=0x7ff8b8008040 comp rx=0 tx=0).stop 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 msgr2=0x7ff8c810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc003080 tx=0x7ff8bc009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 shutdown_connections 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff8b006e660 0x7ff8b0070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8c80fd840 0x7ff8c810d610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 --2- 172.21.15.100:0/265668653 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c80fc570 0x7ff8c810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.640+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 >> 172.21.15.100:0/265668653 conn(0x7ff8c80f7d30 msgr2=0x7ff8c80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.641+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 shutdown_connections 2024-09-13T02:53:29.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.641+0000 7ff8ce210640 1 -- 172.21.15.100:0/265668653 wait complete. 2024-09-13T02:53:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 -- 172.21.15.100:0/1520682529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fb450 msgr2=0x7fa7e40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 --2- 172.21.15.100:0/1520682529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fb450 0x7fa7e40fb860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00048d0 tx=0x7fa7e0009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 -- 172.21.15.100:0/1520682529 shutdown_connections 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 --2- 172.21.15.100:0/1520682529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fc720 0x7fa7e40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 --2- 172.21.15.100:0/1520682529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fb450 0x7fa7e40fb860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 -- 172.21.15.100:0/1520682529 >> 172.21.15.100:0/1520682529 conn(0x7fa7e40f6c10 msgr2=0x7fa7e40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 -- 172.21.15.100:0/1520682529 shutdown_connections 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.720+0000 7fa7ec646640 1 -- 172.21.15.100:0/1520682529 wait complete. 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 Processor -- start 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 -- start start 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fb450 0x7fa7e410d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e410dca0 con 0x7fa7e40fc720 2024-09-13T02:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ec646640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e410e4c0 con 0x7fa7e40fb450 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33902/0 (socket says 172.21.15.100:33902) 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 -- 172.21.15.100:0/3215941774 learned_addr learned my addr 172.21.15.100:0/3215941774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 -- 172.21.15.100:0/3215941774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fb450 msgr2=0x7fa7e410d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7ea3e2640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fb450 0x7fa7e410d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fb450 0x7fa7e410d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 -- 172.21.15.100:0/3215941774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0005040 con 0x7fa7e40fc720 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.721+0000 7fa7e9be1640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400eb70 tx=0x7fa7d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.722+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7d4007c30 con 0x7fa7e40fc720 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.722+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa7d400f040 con 0x7fa7e40fc720 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.722+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e410e6f0 con 0x7fa7e40fc720 2024-09-13T02:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.722+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7d400ca60 con 0x7fa7e40fc720 2024-09-13T02:53:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.722+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e410ec90 con 0x7fa7e40fc720 2024-09-13T02:53:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.723+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e40fa8b0 con 0x7fa7e40fc720 2024-09-13T02:53:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.723+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa7d400cbc0 con 0x7fa7e40fc720 2024-09-13T02:53:29.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.724+0000 7fa7daffd640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 0x7fa7d0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:29.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.724+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa7d408e0b0 con 0x7fa7e40fc720 2024-09-13T02:53:29.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.724+0000 7fa7ea3e2640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 0x7fa7d0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:29.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.724+0000 7fa7ea3e2640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 0x7fa7d0070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000b020 tx=0x7fa7e0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:29.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.728+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa7d4056f80 con 0x7fa7e40fc720 2024-09-13T02:53:29.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:29.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3542518910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: Upgrade: Updating crash.smithi100 (1/2) 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: Deploying daemon crash.smithi100 on smithi100 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:29.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:29 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3451368775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3542518910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: Upgrade: Updating crash.smithi100 (1/2) 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: Deploying daemon crash.smithi100 on smithi100 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:29.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:29 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3451368775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.974+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa7e4103f10 con 0x7fa7e40fc720 2024-09-13T02:53:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.974+0000 7fa7daffd640 1 -- 172.21.15.100:0/3215941774 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa7d405a640 con 0x7fa7e40fc720 2024-09-13T02:53:29.976 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:53:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 msgr2=0x7fa7d0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 0x7fa7d0070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000b020 tx=0x7fa7e0009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 msgr2=0x7fa7e410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400eb70 tx=0x7fa7d400b040 comp rx=0 tx=0).stop 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 shutdown_connections 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa7d006e660 0x7fa7d0070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e40fc720 0x7fa7e410d650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 --2- 172.21.15.100:0/3215941774 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa7e40fb450 0x7fa7e410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 >> 172.21.15.100:0/3215941774 conn(0x7fa7e40f6c10 msgr2=0x7fa7e40660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 shutdown_connections 2024-09-13T02:53:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:53:29.977+0000 7fa7ec646640 1 -- 172.21.15.100:0/3215941774 wait complete. 2024-09-13T02:53:30.870 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:30 smithi100 ceph-mon[92340]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:30.871 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:30 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3215941774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:30.871 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:30 smithi100 ceph-mon[92340]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:30 smithi122 ceph-mon[79680]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:30 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3215941774' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:30.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:30 smithi122 ceph-mon[79680]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:33.404 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:33 smithi122 ceph-mon[79680]: pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:33.405 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:33.405 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:33 smithi100 ceph-mon[92340]: pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:33.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:35.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: Upgrade: Updating crash.smithi122 (2/2) 2024-09-13T02:53:35.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:35.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:35.219 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:35.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: Deploying daemon crash.smithi122 on smithi122 2024-09-13T02:53:35.220 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:34 smithi122 ceph-mon[79680]: pgmap v28: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:35.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: Upgrade: Updating crash.smithi122 (2/2) 2024-09-13T02:53:35.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:35.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi122", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:53:35.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:35.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: Deploying daemon crash.smithi122 on smithi122 2024-09-13T02:53:35.412 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:34 smithi100 ceph-mon[92340]: pgmap v28: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:37 smithi100 ceph-mon[92340]: pgmap v29: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:37 smithi122 ceph-mon[79680]: pgmap v29: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:38.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.382 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:38.382 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.382 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:38.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:39 smithi122 ceph-mon[79680]: pgmap v30: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:39.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:39 smithi100 ceph-mon[92340]: pgmap v30: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:41.567 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:41 smithi122 ceph-mon[79680]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:41.568 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.568 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.568 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.568 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.607 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:41 smithi100 ceph-mon[92340]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:43 smithi100 ceph-mon[92340]: pgmap v32: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:43.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.361 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.384 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.384 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.384 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:43 smithi122 ceph-mon[79680]: pgmap v32: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:43.384 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:43.384 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:45.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:45.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:45.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:45 smithi100 ceph-mon[92340]: pgmap v33: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:45.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:45.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:45.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:45.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:45 smithi122 ceph-mon[79680]: pgmap v33: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:45.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:47.138 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.138 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.138 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:47.138 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:47.138 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all crash 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi122"}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi122"}]': finished 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: Upgrade: osd.0 is safe to restart 2024-09-13T02:53:47.139 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:46 smithi100 ceph-mon[92340]: pgmap v34: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:47.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all crash 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi122"}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi122"}]': finished 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: Upgrade: osd.0 is safe to restart 2024-09-13T02:53:47.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:46 smithi122 ceph-mon[79680]: pgmap v34: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:48.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: Upgrade: Updating osd.0 2024-09-13T02:53:48.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:48.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:53:48.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:48.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: Deploying daemon osd.0 on smithi100 2024-09-13T02:53:48.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:48 smithi100 ceph-mon[92340]: pgmap v35: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: Upgrade: Updating osd.0 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: Deploying daemon osd.0 on smithi100 2024-09-13T02:53:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:48 smithi122 ceph-mon[79680]: pgmap v35: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:50.926 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:50 smithi100 systemd[1]: Stopping Ceph osd.0 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:53:51.295 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:51 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[46603]: 2024-09-13T02:53:51.015+0000 7fa72606c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:53:51.295 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:51 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[46603]: 2024-09-13T02:53:51.015+0000 7fa72606c640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-13T02:53:51.295 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:51 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[46603]: 2024-09-13T02:53:51.015+0000 7fa72606c640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:53:51.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:51 smithi100 ceph-mon[92340]: pgmap v36: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:51.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:51 smithi100 ceph-mon[92340]: osd.0 marked itself down and dead 2024-09-13T02:53:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:51 smithi122 ceph-mon[79680]: pgmap v36: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:51 smithi122 ceph-mon[79680]: osd.0 marked itself down and dead 2024-09-13T02:53:52.060 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:51 smithi100 podman[100426]: 2024-09-13 02:53:51.751641666 +0000 UTC m=+0.868191432 container died 0ef13635857a7c8e2a11b99229aa1f333baaf294ff2d8c653365c65e13c14ab2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T02:53:52.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:52 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:53:52.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:52 smithi100 ceph-mon[92340]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T02:53:52.316 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:52 smithi100 podman[100426]: 2024-09-13 02:53:52.258788048 +0000 UTC m=+1.375337871 container cleanup 0ef13635857a7c8e2a11b99229aa1f333baaf294ff2d8c653365c65e13c14ab2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T02:53:52.317 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:52 smithi100 bash[100426]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0 2024-09-13T02:53:52.676 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:52 smithi100 podman[100441]: 2024-09-13 02:53:52.535639473 +0000 UTC m=+0.778023402 container remove 0ef13635857a7c8e2a11b99229aa1f333baaf294ff2d8c653365c65e13c14ab2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=quincy-bbdadfa, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:53:52.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:52 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:53:52.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:52 smithi122 ceph-mon[79680]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T02:53:53.132 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:52 smithi100 podman[100530]: 2024-09-13 02:53:52.746817306 +0000 UTC m=+0.015677932 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:53:53.132 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:52 smithi100 podman[100530]: 2024-09-13 02:53:52.844770665 +0000 UTC m=+0.113631281 container create 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:53:53.132 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:53 smithi100 podman[100530]: 2024-09-13 02:53:53.131405911 +0000 UTC m=+0.400266532 container init 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T02:53:53.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:53 smithi100 ceph-mon[92340]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:53 smithi100 ceph-mon[92340]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T02:53:53.427 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:53 smithi100 podman[100530]: 2024-09-13 02:53:53.135048875 +0000 UTC m=+0.403909502 container start 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T02:53:53.427 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:53 smithi100 podman[100530]: 2024-09-13 02:53:53.231489114 +0000 UTC m=+0.500349744 container attach 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:53:53.427 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:53 smithi100 podman[100530]: 2024-09-13 02:53:53.321547562 +0000 UTC m=+0.590408179 container died 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, ceph=True) 2024-09-13T02:53:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:53 smithi122 ceph-mon[79680]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:53 smithi122 ceph-mon[79680]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T02:53:54.286 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100554]: 2024-09-13 02:53:54.052093213 +0000 UTC m=+0.720701218 container remove 3d1d87f779b0a21352c07dd5935ae8c66749b7237e43ef64e0543bc77b4845c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:53:54.286 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T02:53:54.287 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 systemd[1]: Stopped Ceph osd.0 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:53:54.287 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.0.service: Consumed 51.295s CPU time. 2024-09-13T02:53:54.617 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 systemd[1]: Starting Ceph osd.0 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:53:54.618 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100652]: 2024-09-13 02:53:54.398833157 +0000 UTC m=+0.015930012 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:53:54.618 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100652]: 2024-09-13 02:53:54.519791988 +0000 UTC m=+0.136888830 container create 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T02:53:54.896 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100652]: 2024-09-13 02:53:54.764381198 +0000 UTC m=+0.381478041 container init 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:53:54.897 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100652]: 2024-09-13 02:53:54.767631038 +0000 UTC m=+0.384727888 container start 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T02:53:54.897 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 podman[100652]: 2024-09-13 02:53:54.847569189 +0000 UTC m=+0.464666045 container attach 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T02:53:54.897 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:53:55.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 bash[100652]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:53:55.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:53:55.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:54 smithi100 bash[100652]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:53:55.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-mon[92340]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:55 smithi122 ceph-mon[79680]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:53:55.923 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:53:55.923 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:53:55.923 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:53:55.923 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:53:56.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate[100667]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 bash[100652]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:53:56.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:55 smithi100 podman[100652]: 2024-09-13 02:53:55.950412831 +0000 UTC m=+1.567509688 container died 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T02:53:56.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:56 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 70/360 objects degraded (19.444%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:53:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:56 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 70/360 objects degraded (19.444%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:53:57.068 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:56 smithi100 podman[100813]: 2024-09-13 02:53:56.727286485 +0000 UTC m=+0.771184207 container remove 9bd4f9b1d08c0605ccfd3a59a98b56fca2563977c5e0420ada47951a73027085 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:53:57.068 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:56 smithi100 podman[100874]: 2024-09-13 02:53:56.837595583 +0000 UTC m=+0.015760575 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:53:57.068 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:56 smithi100 podman[100874]: 2024-09-13 02:53:56.944796382 +0000 UTC m=+0.122961370 container create 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T02:53:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:57 smithi100 ceph-mon[92340]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:53:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:57.677 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:57 smithi100 podman[100874]: 2024-09-13 02:53:57.180707894 +0000 UTC m=+0.358872883 container init 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T02:53:57.677 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:57 smithi100 podman[100874]: 2024-09-13 02:53:57.183990806 +0000 UTC m=+0.362155791 container start 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T02:53:57.677 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:57 smithi100 ceph-osd[100894]: -- 172.21.15.100:0/1375048337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d4e4001e0 con 0x555d4e396000 2024-09-13T02:53:57.677 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:57 smithi100 bash[100874]: 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 2024-09-13T02:53:57.677 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:57 smithi100 systemd[1]: Started Ceph osd.0 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:53:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:57 smithi122 ceph-mon[79680]: pgmap v41: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:53:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:59.369 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:53:59 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T02:53:59.044+0000 7f022c9a4640 -1 Falling back to public interface 2024-09-13T02:53:59.675 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:59 smithi100 ceph-mon[92340]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:53:59.675 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:59.675 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:53:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:59 smithi122 ceph-mon[79680]: pgmap v42: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:53:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:53:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:53:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:00.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 -- 172.21.15.100:0/3238750001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 msgr2=0x7f99e40fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 --2- 172.21.15.100:0/3238750001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e40fcb60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0048d0 tx=0x7f99cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 -- 172.21.15.100:0/3238750001 shutdown_connections 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 --2- 172.21.15.100:0/3238750001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e40fcb60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 --2- 172.21.15.100:0/3238750001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e40fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 -- 172.21.15.100:0/3238750001 >> 172.21.15.100:0/3238750001 conn(0x7f99e40f6c00 msgr2=0x7f99e40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 -- 172.21.15.100:0/3238750001 shutdown_connections 2024-09-13T02:54:00.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 -- 172.21.15.100:0/3238750001 wait complete. 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.059+0000 7f99e9a58640 1 Processor -- start 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e9a58640 1 -- start start 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e9a58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e410fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e9a58640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e9a58640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4066510 con 0x7f99e40fc6f0 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e9a58640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4066680 con 0x7f99e40fb420 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39122/0 (socket says 172.21.15.100:39122) 2024-09-13T02:54:00.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 -- 172.21.15.100:0/2034752191 learned_addr learned my addr 172.21.15.100:0/2034752191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e2ffd640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e410fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 -- 172.21.15.100:0/2034752191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 msgr2=0x7f99e410fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e410fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 -- 172.21.15.100:0/2034752191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc005040 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e2ffd640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e410fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.060+0000 7f99e27fc640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99cc003080 tx=0x7f99cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.061+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99cc038070 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.061+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99cc009800 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.061+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4112800 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.061+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99cc033660 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.061+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e4112d40 con 0x7f99e40fc6f0 2024-09-13T02:54:00.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.062+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40fa880 con 0x7f99e40fc6f0 2024-09-13T02:54:00.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.062+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f99cc030020 con 0x7f99e40fc6f0 2024-09-13T02:54:00.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.063+0000 7f99db7fe640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 0x7f99d0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.063+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99cc0ae460 con 0x7f99e40fc6f0 2024-09-13T02:54:00.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.063+0000 7f99e2ffd640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 0x7f99d0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.063+0000 7f99e2ffd640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 0x7f99d0070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99e4066200 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.067+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f99cc077440 con 0x7f99e40fc6f0 2024-09-13T02:54:00.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.266+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e4100b10 con 0x7f99d006e660 2024-09-13T02:54:00.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.268+0000 7f99db7fe640 1 -- 172.21.15.100:0/2034752191 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f99e4100b10 con 0x7f99d006e660 2024-09-13T02:54:00.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 msgr2=0x7f99d0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 0x7f99d0070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99e4066200 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2024-09-13T02:54:00.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 msgr2=0x7f99e41122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99cc003080 tx=0x7f99cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 shutdown_connections 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f99d006e660 0x7f99d0070b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99e40fc6f0 0x7f99e41122c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 --2- 172.21.15.100:0/2034752191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99e40fb420 0x7f99e410fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 >> 172.21.15.100:0/2034752191 conn(0x7f99e40f6c00 msgr2=0x7f99e40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 shutdown_connections 2024-09-13T02:54:00.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.270+0000 7f99e9a58640 1 -- 172.21.15.100:0/2034752191 wait complete. 2024-09-13T02:54:00.280 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:54:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- 172.21.15.100:0/925490240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 msgr2=0x7f8ad40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/925490240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad40fb860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40048d0 tx=0x7f8ac4009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- 172.21.15.100:0/925490240 shutdown_connections 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/925490240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 0x7f8ad40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/925490240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad40fb860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- 172.21.15.100:0/925490240 >> 172.21.15.100:0/925490240 conn(0x7f8ad40f6c10 msgr2=0x7f8ad40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- 172.21.15.100:0/925490240 shutdown_connections 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- 172.21.15.100:0/925490240 wait complete. 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 Processor -- start 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.352+0000 7f8ad8e53640 1 -- start start 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad8e53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad8e53640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 0x7f8ad4112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad8e53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40667b0 con 0x7f8ad40fb450 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad8e53640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad4066920 con 0x7f8ad40fc720 2024-09-13T02:54:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39138/0 (socket says 172.21.15.100:39138) 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 -- 172.21.15.100:0/2588860303 learned_addr learned my addr 172.21.15.100:0/2588860303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad1d9b640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 0x7f8ad4112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 -- 172.21.15.100:0/2588860303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 msgr2=0x7f8ad4112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 0x7f8ad4112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 -- 172.21.15.100:0/2588860303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4005040 con 0x7f8ad40fb450 2024-09-13T02:54:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad259c640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4003080 tx=0x7f8ac4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac4038070 con 0x7f8ad40fb450 2024-09-13T02:54:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad4112870 con 0x7f8ad40fb450 2024-09-13T02:54:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ac402abd0 con 0x7f8ad40fb450 2024-09-13T02:54:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.353+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ac403e670 con 0x7f8ad40fb450 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.354+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad4112de0 con 0x7f8ad40fb450 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.354+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad40fa8b0 con 0x7f8ad40fb450 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.355+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8ac4030020 con 0x7f8ad40fb450 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.355+0000 7f8ac2ffd640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 0x7f8abc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.355+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8ac40ae6a0 con 0x7f8ad40fb450 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.355+0000 7f8ad1d9b640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 0x7f8abc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.356+0000 7f8ad1d9b640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 0x7f8abc070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80041d0 tx=0x7f8ac8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.360+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ac4077680 con 0x7f8ad40fb450 2024-09-13T02:54:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.551+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ad4100b80 con 0x7f8abc06e660 2024-09-13T02:54:00.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.553+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/2588860303 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8ad4100b80 con 0x7f8abc06e660 2024-09-13T02:54:00.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 msgr2=0x7f8abc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 0x7f8abc070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80041d0 tx=0x7f8ac8009040 comp rx=0 tx=0).stop 2024-09-13T02:54:00.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 msgr2=0x7f8ad410fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4003080 tx=0x7f8ac4009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 shutdown_connections 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8abc06e660 0x7f8abc070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ad40fc720 0x7f8ad4112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 --2- 172.21.15.100:0/2588860303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ad40fb450 0x7f8ad410fde0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 >> 172.21.15.100:0/2588860303 conn(0x7f8ad40f6c10 msgr2=0x7f8ad40f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 shutdown_connections 2024-09-13T02:54:00.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.555+0000 7f8ad8e53640 1 -- 172.21.15.100:0/2588860303 wait complete. 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 -- 172.21.15.100:0/2763785749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 msgr2=0x7fb834103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2763785749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb834103ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8200048d0 tx=0x7fb820009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 -- 172.21.15.100:0/2763785749 shutdown_connections 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2763785749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb834103ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2763785749 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 0x7fb8341015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 -- 172.21.15.100:0/2763785749 >> 172.21.15.100:0/2763785749 conn(0x7fb8340f6c10 msgr2=0x7fb8340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 -- 172.21.15.100:0/2763785749 shutdown_connections 2024-09-13T02:54:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.642+0000 7fb83aec4640 1 -- 172.21.15.100:0/2763785749 wait complete. 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 Processor -- start 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 -- start start 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 0x7fb83410f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83410fdd0 con 0x7fb834101ae0 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb83aec4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341105f0 con 0x7fb834065be0 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.643+0000 7fb833fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39164/0 (socket says 172.21.15.100:39164) 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 -- 172.21.15.100:0/2232368724 learned_addr learned my addr 172.21.15.100:0/2232368724 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb838c60640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 0x7fb83410f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 -- 172.21.15.100:0/2232368724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 msgr2=0x7fb83410f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 0x7fb83410f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 -- 172.21.15.100:0/2232368724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820005040 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb833fff640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb8200048a0 tx=0x7fb820009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb820038070 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834110820 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb820032d30 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.644+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82003dc80 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.645+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834110d60 con 0x7fb834101ae0 2024-09-13T02:54:00.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.646+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8340fa890 con 0x7fb834101ae0 2024-09-13T02:54:00.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.646+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb820030020 con 0x7fb834101ae0 2024-09-13T02:54:00.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.647+0000 7fb8317fa640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 0x7fb824070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.647+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb8200aed10 con 0x7fb834101ae0 2024-09-13T02:54:00.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.647+0000 7fb838c60640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 0x7fb824070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.647+0000 7fb838c60640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 0x7fb824070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb834065940 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.653+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb820077d70 con 0x7fb834101ae0 2024-09-13T02:54:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.830+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb834111090 con 0x7fb82406e660 2024-09-13T02:54:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.839+0000 7fb8317fa640 1 -- 172.21.15.100:0/2232368724 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb834111090 con 0x7fb82406e660 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (2m) 18s ago 11m 17.0M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (28s) 18s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (23s) 20s ago 10m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (2m) 18s ago 10m 76.7M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (5m) 18s ago 5m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (5m) 18s ago 5m 13.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (5m) 20s ago 5m 16.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (5m) 20s ago 5m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (2m) 18s ago 12m 492M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (95s) 20s ago 10m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (83s) 18s ago 12m 41.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (64s) 20s ago 10m 34.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:54:00.841 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 18s ago 11m 8502k - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (2m) 20s ago 10m 16.8M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 starting - - - 1557M 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (8m) 18s ago 8m 238M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a ef472587365f 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (8m) 18s ago 8m 183M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (8m) 20s ago 8m 259M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (7m) 20s ago 7m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (7m) 20s ago 7m 224M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:54:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (99s) 18s ago 10m 51.4M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 msgr2=0x7fb824070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 0x7fb824070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb834065940 tx=0x7fb828009040 comp rx=0 tx=0).stop 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 msgr2=0x7fb83410f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb8200048a0 tx=0x7fb820009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 shutdown_connections 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb82406e660 0x7fb824070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb834101ae0 0x7fb83410f780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 --2- 172.21.15.100:0/2232368724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb834065be0 0x7fb83410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 >> 172.21.15.100:0/2232368724 conn(0x7fb8340f6c10 msgr2=0x7fb8340f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 shutdown_connections 2024-09-13T02:54:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.841+0000 7fb83aec4640 1 -- 172.21.15.100:0/2232368724 wait complete. 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1675990854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fc720 msgr2=0x7f0eac0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1675990854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fc720 0x7f0eac0fcb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80048d0 tx=0x7f0ea8009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1675990854 shutdown_connections 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1675990854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fc720 0x7f0eac0fcb90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1675990854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fb450 0x7f0eac0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1675990854 >> 172.21.15.100:0/1675990854 conn(0x7f0eac0f6c10 msgr2=0x7f0eac0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1675990854 shutdown_connections 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.924+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1675990854 wait complete. 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 Processor -- start 2024-09-13T02:54:00.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 -- start start 2024-09-13T02:54:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fc720 0x7f0eac10d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac10e550 con 0x7f0eac0fb450 2024-09-13T02:54:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb3c1d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac10e6c0 con 0x7f0eac0fc720 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39190/0 (socket says 172.21.15.100:39190) 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 -- 172.21.15.100:0/1549169480 learned_addr learned my addr 172.21.15.100:0/1549169480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb11b8640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fc720 0x7f0eac10d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 -- 172.21.15.100:0/1549169480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fc720 msgr2=0x7f0eac10d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fc720 0x7f0eac10d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 -- 172.21.15.100:0/1549169480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8005040 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.925+0000 7f0eb19b9640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00b790 tx=0x7f0e9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.926+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e9c00c700 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.926+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e9c00cd00 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.926+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e9c015e70 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.926+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac10e9a0 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.926+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac10eec0 con 0x7f0eac0fb450 2024-09-13T02:54:00.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.927+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac1046e0 con 0x7f0eac0fb450 2024-09-13T02:54:00.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.927+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f0e9c012070 con 0x7f0eac0fb450 2024-09-13T02:54:00.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.928+0000 7f0ea27fc640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 0x7f0e98070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:00.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.928+0000 7f0eb11b8640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 0x7f0e98070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:00.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.928+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0e9c08ddf0 con 0x7f0eac0fb450 2024-09-13T02:54:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.929+0000 7f0eb11b8640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 0x7f0e98070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007ac0 tx=0x7f0ea8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:00.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:00.933+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e9c056e50 con 0x7f0eac0fb450 2024-09-13T02:54:01.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.170+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0eac04b720 con 0x7f0eac0fb450 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.170+0000 7f0ea27fc640 1 -- 172.21.15.100:0/1549169480 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+744 (secure 0 0 0) 0x7f0e9c05a510 con 0x7f0eac0fb450 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:01.172 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 5 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 9, 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:54:01.173 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 msgr2=0x7f0e98070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 0x7f0e98070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007ac0 tx=0x7f0ea8035040 comp rx=0 tx=0).stop 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 msgr2=0x7f0eac10d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00b790 tx=0x7f0e9c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 shutdown_connections 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0e9806e660 0x7f0e98070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0eac0fc720 0x7f0eac10d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 --2- 172.21.15.100:0/1549169480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eac0fb450 0x7f0eac10d1f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.172+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 >> 172.21.15.100:0/1549169480 conn(0x7f0eac0f6c10 msgr2=0x7f0eac066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.173+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 shutdown_connections 2024-09-13T02:54:01.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.173+0000 7f0eb3c1d640 1 -- 172.21.15.100:0/1549169480 wait complete. 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 -- 172.21.15.100:0/345734144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fb430 msgr2=0x7fb8ac0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 --2- 172.21.15.100:0/345734144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0fb840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80048d0 tx=0x7fb8a8009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 -- 172.21.15.100:0/345734144 shutdown_connections 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 --2- 172.21.15.100:0/345734144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 --2- 172.21.15.100:0/345734144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0fb840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.252+0000 7fb8b409e640 1 -- 172.21.15.100:0/345734144 >> 172.21.15.100:0/345734144 conn(0x7fb8ac0f6c10 msgr2=0x7fb8ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 -- 172.21.15.100:0/345734144 shutdown_connections 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 -- 172.21.15.100:0/345734144 wait complete. 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 Processor -- start 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 -- start start 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0fdfd0 con 0x7fb8ac0fc700 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b409e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0fe110 con 0x7fb8ac0fb430 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b1639640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b1639640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39202/0 (socket says 172.21.15.100:39202) 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b1639640 1 -- 172.21.15.100:0/1058532076 learned_addr learned my addr 172.21.15.100:0/1058532076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.253+0000 7fb8b1e3a640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b1639640 1 -- 172.21.15.100:0/1058532076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fb430 msgr2=0x7fb8ac0ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b1639640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b1639640 1 -- 172.21.15.100:0/1058532076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8005040 con 0x7fb8ac0fc700 2024-09-13T02:54:01.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b1639640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb89c002a50 tx=0x7fb89c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89c007c30 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac0fe3f0 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb89c00f040 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89c00dad0 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.254+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac1150f0 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.255+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac0fa890 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.255+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fb89c00dc30 con 0x7fb8ac0fc700 2024-09-13T02:54:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.256+0000 7fb8a27fc640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 0x7fb898070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.256+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb89c08e290 con 0x7fb8ac0fc700 2024-09-13T02:54:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.256+0000 7fb8b1e3a640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 0x7fb898070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.257+0000 7fb8b1e3a640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 0x7fb898070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000c00 tx=0x7fb8a8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.260+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb89c057160 con 0x7fb8ac0fc700 2024-09-13T02:54:01.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.490+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb8ac103e30 con 0x7fb8ac0fc700 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.490+0000 7fb8a27fc640 1 -- 172.21.15.100:0/1058532076 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1966 (secure 0 0 0) 0x7fb89c05a820 con 0x7fb8ac0fc700 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:e18 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:54:01.492 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 18 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:50:38.732479+0000 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:54:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:54:01.494 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:01.495 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 msgr2=0x7fb898070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 0x7fb898070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000c00 tx=0x7fb8a8035040 comp rx=0 tx=0).stop 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 msgr2=0x7fb8ac0fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb89c002a50 tx=0x7fb89c004600 comp rx=0 tx=0).stop 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 shutdown_connections 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb89806e660 0x7fb898070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8ac0fc700 0x7fb8ac0fda40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 --2- 172.21.15.100:0/1058532076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac0fb430 0x7fb8ac0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 >> 172.21.15.100:0/1058532076 conn(0x7fb8ac0f6c10 msgr2=0x7fb8ac065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.492+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 shutdown_connections 2024-09-13T02:54:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.493+0000 7fb8b409e640 1 -- 172.21.15.100:0/1058532076 wait complete. 2024-09-13T02:54:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 -- 172.21.15.100:0/557752239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fc700 msgr2=0x7fa1440fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/557752239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fc700 0x7fa1440fcb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1380048d0 tx=0x7fa138009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 -- 172.21.15.100:0/557752239 shutdown_connections 2024-09-13T02:54:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/557752239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fc700 0x7fa1440fcb70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/557752239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fb430 0x7fa1440fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 -- 172.21.15.100:0/557752239 >> 172.21.15.100:0/557752239 conn(0x7fa1440f6c10 msgr2=0x7fa1440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 -- 172.21.15.100:0/557752239 shutdown_connections 2024-09-13T02:54:01.575 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:01 smithi100 ceph-mon[92340]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:01.575 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:01 smithi100 ceph-mon[92340]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:01.575 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:01 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1549169480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.572+0000 7fa14a7ea640 1 -- 172.21.15.100:0/557752239 wait complete. 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.573+0000 7fa14a7ea640 1 Processor -- start 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.573+0000 7fa14a7ea640 1 -- start start 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.573+0000 7fa14a7ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa14a7ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fc700 0x7fa14410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa14a7ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14410cb10 con 0x7fa1440fb430 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa14a7ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14410d330 con 0x7fa1440fc700 2024-09-13T02:54:01.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39226/0 (socket says 172.21.15.100:39226) 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 -- 172.21.15.100:0/1451960236 learned_addr learned my addr 172.21.15.100:0/1451960236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa1437fe640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fc700 0x7fa14410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 -- 172.21.15.100:0/1451960236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fc700 msgr2=0x7fa14410c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fc700 0x7fa14410c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 -- 172.21.15.100:0/1451960236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138005040 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa143fff640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa13400ea20 tx=0x7fa134004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13400cc90 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa13400cdf0 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.574+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14410d560 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.575+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa134019880 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.575+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14410db00 con 0x7fa1440fb430 2024-09-13T02:54:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.576+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1440fa890 con 0x7fa1440fb430 2024-09-13T02:54:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.576+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fa134011c30 con 0x7fa1440fb430 2024-09-13T02:54:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.576+0000 7fa140ff9640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 0x7fa12c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.577+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa134015070 con 0x7fa1440fb430 2024-09-13T02:54:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.577+0000 7fa1437fe640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 0x7fa12c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.577+0000 7fa1437fe640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 0x7fa12c070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa138007ac0 tx=0x7fa138035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.581+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa134059aa0 con 0x7fa1440fb430 2024-09-13T02:54:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:01 smithi122 ceph-mon[79680]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:01 smithi122 ceph-mon[79680]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:01 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1549169480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:01.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.773+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa14410de90 con 0x7fa12c06e660 2024-09-13T02:54:01.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.774+0000 7fa140ff9640 1 -- 172.21.15.100:0/1451960236 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa14410de90 con 0x7fa12c06e660 2024-09-13T02:54:01.775 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "6/21 daemons upgraded", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:54:01.776 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 msgr2=0x7fa12c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 0x7fa12c070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa138007ac0 tx=0x7fa138035040 comp rx=0 tx=0).stop 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 msgr2=0x7fa14410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa13400ea20 tx=0x7fa134004470 comp rx=0 tx=0).stop 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 shutdown_connections 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa12c06e660 0x7fa12c070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1440fc700 0x7fa14410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 --2- 172.21.15.100:0/1451960236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1440fb430 0x7fa14410bf80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.776+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 >> 172.21.15.100:0/1451960236 conn(0x7fa1440f6c10 msgr2=0x7fa1440f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.777+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 shutdown_connections 2024-09-13T02:54:01.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.777+0000 7fa14a7ea640 1 -- 172.21.15.100:0/1451960236 wait complete. 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 -- 172.21.15.100:0/3609712740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fd7f0 msgr2=0x7f58f00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 --2- 172.21.15.100:0/3609712740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fd7f0 0x7f58f00fdc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58e40048d0 tx=0x7f58e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 -- 172.21.15.100:0/3609712740 shutdown_connections 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 --2- 172.21.15.100:0/3609712740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fd7f0 0x7f58f00fdc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 --2- 172.21.15.100:0/3609712740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fc520 0x7f58f00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.864+0000 7f58f6888640 1 -- 172.21.15.100:0/3609712740 >> 172.21.15.100:0/3609712740 conn(0x7f58f00f7ce0 msgr2=0x7f58f00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 -- 172.21.15.100:0/3609712740 shutdown_connections 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 -- 172.21.15.100:0/3609712740 wait complete. 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 Processor -- start 2024-09-13T02:54:01.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 -- start start 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fd7f0 0x7f58f010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f010dbf0 con 0x7f58f00fc520 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58f6888640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f010e410 con 0x7f58f00fd7f0 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.865+0000 7f58effff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39234/0 (socket says 172.21.15.100:39234) 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58effff640 1 -- 172.21.15.100:0/919134952 learned_addr learned my addr 172.21.15.100:0/919134952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58ef7fe640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fd7f0 0x7f58f010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58effff640 1 -- 172.21.15.100:0/919134952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fd7f0 msgr2=0x7f58f010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58effff640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fd7f0 0x7f58f010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58effff640 1 -- 172.21.15.100:0/919134952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4005040 con 0x7f58f00fc520 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58effff640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58e000eb70 tx=0x7f58e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e0007c30 con 0x7f58f00fc520 2024-09-13T02:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58e000f040 con 0x7f58f00fc520 2024-09-13T02:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f010e640 con 0x7f58f00fc520 2024-09-13T02:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e0009550 con 0x7f58f00fc520 2024-09-13T02:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.866+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f010ebe0 con 0x7f58f00fc520 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.867+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f00fb980 con 0x7f58f00fc520 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.868+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 37) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f58e000cca0 con 0x7f58f00fc520 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.868+0000 7f58ecff9640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 0x7f58d8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.868+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f58e008e0b0 con 0x7f58f00fc520 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.868+0000 7f58ef7fe640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 0x7f58d8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:01.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.869+0000 7f58ef7fe640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 0x7f58d8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007ac0 tx=0x7f58e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:01.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:01.873+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f58e0057030 con 0x7f58f00fc520 2024-09-13T02:54:02.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.112+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f58f004b720 con 0x7f58f00fc520 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.112+0000 7f58ecff9640 1 -- 172.21.15.100:0/919134952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f58e005a6f0 con 0x7f58f00fc520 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 70/360 objects degraded (19.444%), 19 pgs degraded 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: osd.0 (root=default,host=smithi100) is down 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 70/360 objects degraded (19.444%), 19 pgs degraded 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-13T02:54:02.114 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-13T02:54:02.115 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T02:54:02.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.114+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 msgr2=0x7f58d8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:02.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.114+0000 7f58f6888640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 0x7f58d8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007ac0 tx=0x7f58e4035040 comp rx=0 tx=0).stop 2024-09-13T02:54:02.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.114+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 msgr2=0x7f58f010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:02.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58e000eb70 tx=0x7f58e000b040 comp rx=0 tx=0).stop 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 shutdown_connections 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f58d806e660 0x7f58d8070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58f00fd7f0 0x7f58f010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 --2- 172.21.15.100:0/919134952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58f00fc520 0x7f58f010d060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 >> 172.21.15.100:0/919134952 conn(0x7f58f00f7ce0 msgr2=0x7f58f00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 shutdown_connections 2024-09-13T02:54:02.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:02.115+0000 7f58f6888640 1 -- 172.21.15.100:0/919134952 wait complete. 2024-09-13T02:54:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1058532076' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/919134952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:02.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:02.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1058532076' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/919134952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:03 smithi100 ceph-mon[92340]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:03 smithi100 ceph-mon[92340]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:03 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:03.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:03 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:03 smithi122 ceph-mon[79680]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:03 smithi122 ceph-mon[79680]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:03 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:03 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:04.676 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:54:04 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T02:54:04.429+0000 7f022c9a4640 -1 osd.0 47 log_to_monitors true 2024-09-13T02:54:05.567 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:05 smithi100 ceph-mon[92340]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:05.567 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:05 smithi100 ceph-mon[92340]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:54:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:05 smithi122 ceph-mon[79680]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:05 smithi122 ceph-mon[79680]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:54:06.453 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T02:54:06.237+0000 7f0220736640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:06.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.455 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.455 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.455 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:06 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:54:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:54:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625]' entity='osd.0' 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:06.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:06 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:54:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:54:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625] boot 2024-09-13T02:54:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T02:54:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: osd.0 [v2:172.21.15.100:6802/2580027625,v1:172.21.15.100:6803/2580027625] boot 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T02:54:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:54:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:09 smithi100 ceph-mon[92340]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:09 smithi100 ceph-mon[92340]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T02:54:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:09 smithi122 ceph-mon[79680]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 70/360 objects degraded (19.444%) 2024-09-13T02:54:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:09 smithi122 ceph-mon[79680]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T02:54:10.578 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:10 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 14/360 objects degraded (3.889%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:10 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 14/360 objects degraded (3.889%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:11 smithi100 ceph-mon[92340]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/360 objects degraded (3.889%) 2024-09-13T02:54:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:11 smithi122 ceph-mon[79680]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 14/360 objects degraded (3.889%) 2024-09-13T02:54:12.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:12 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/360 objects degraded (3.889%), 3 pgs degraded) 2024-09-13T02:54:12.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:12 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:54:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:12 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/360 objects degraded (3.889%), 3 pgs degraded) 2024-09-13T02:54:12.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:12 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:54:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:13 smithi100 ceph-mon[92340]: pgmap v52: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:13 smithi122 ceph-mon[79680]: pgmap v52: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:15 smithi100 ceph-mon[92340]: pgmap v53: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:15 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:54:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:15 smithi122 ceph-mon[79680]: pgmap v53: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:15 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:54:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:17 smithi100 ceph-mon[92340]: pgmap v54: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 681 B/s wr, 0 op/s 2024-09-13T02:54:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:17 smithi100 ceph-mon[92340]: mgrmap e38: smithi100.lhjyck(active, since 92s), standbys: smithi122.ptcenr 2024-09-13T02:54:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:17 smithi122 ceph-mon[79680]: pgmap v54: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 681 B/s wr, 0 op/s 2024-09-13T02:54:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:17 smithi122 ceph-mon[79680]: mgrmap e38: smithi100.lhjyck(active, since 92s), standbys: smithi122.ptcenr 2024-09-13T02:54:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:19 smithi100 ceph-mon[92340]: pgmap v55: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-09-13T02:54:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:19 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:19 smithi122 ceph-mon[79680]: pgmap v55: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-09-13T02:54:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:19 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:21 smithi100 ceph-mon[92340]: pgmap v56: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:21 smithi122 ceph-mon[79680]: pgmap v56: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:22 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:22 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:22.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:22 smithi100 ceph-mon[92340]: Upgrade: osd.1 is safe to restart 2024-09-13T02:54:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:22 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:22 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:54:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:22 smithi122 ceph-mon[79680]: Upgrade: osd.1 is safe to restart 2024-09-13T02:54:23.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:23 smithi100 ceph-mon[92340]: pgmap v57: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:23.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:23 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:23.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:23 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:54:23.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:23 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:23 smithi122 ceph-mon[79680]: pgmap v57: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:23 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:23 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:54:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:23 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:24 smithi100 ceph-mon[92340]: Upgrade: Updating osd.1 2024-09-13T02:54:24.396 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:24 smithi100 ceph-mon[92340]: Deploying daemon osd.1 on smithi100 2024-09-13T02:54:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:24 smithi122 ceph-mon[79680]: Upgrade: Updating osd.1 2024-09-13T02:54:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:24 smithi122 ceph-mon[79680]: Deploying daemon osd.1 on smithi100 2024-09-13T02:54:25.377 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:25 smithi100 ceph-mon[92340]: pgmap v58: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:25 smithi122 ceph-mon[79680]: pgmap v58: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:26.016 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:25 smithi100 systemd[1]: Stopping Ceph osd.1 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:54:26.323 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:26 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[54438]: 2024-09-13T02:54:26.014+0000 7f4a354dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:54:26.323 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:26 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[54438]: 2024-09-13T02:54:26.014+0000 7f4a354dd640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-13T02:54:26.323 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:26 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[54438]: 2024-09-13T02:54:26.014+0000 7f4a354dd640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:54:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:26 smithi100 ceph-mon[92340]: osd.1 marked itself down and dead 2024-09-13T02:54:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:26 smithi122 ceph-mon[79680]: osd.1 marked itself down and dead 2024-09-13T02:54:27.074 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:26 smithi100 podman[105764]: 2024-09-13 02:54:26.760370765 +0000 UTC m=+0.877055141 container died ef472587365f3a2692ca5e133c8f16af20261dce97ce53d2a56fd01cfb34deee (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T02:54:27.330 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105764]: 2024-09-13 02:54:27.147787063 +0000 UTC m=+1.264471438 container cleanup ef472587365f3a2692ca5e133c8f16af20261dce97ce53d2a56fd01cfb34deee (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:54:27.330 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 bash[105764]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1 2024-09-13T02:54:27.676 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105779]: 2024-09-13 02:54:27.407543437 +0000 UTC m=+0.643484373 container remove ef472587365f3a2692ca5e133c8f16af20261dce97ce53d2a56fd01cfb34deee (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:54:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:27 smithi100 ceph-mon[92340]: pgmap v59: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:27 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:54:27.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:27 smithi100 ceph-mon[92340]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T02:54:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:27 smithi122 ceph-mon[79680]: pgmap v59: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-13T02:54:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:27 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:54:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:27 smithi122 ceph-mon[79680]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T02:54:27.987 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105866]: 2024-09-13 02:54:27.621922963 +0000 UTC m=+0.016328438 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:54:27.987 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105866]: 2024-09-13 02:54:27.742033885 +0000 UTC m=+0.136439359 container create 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T02:54:27.987 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105866]: 2024-09-13 02:54:27.98623716 +0000 UTC m=+0.380642634 container init 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T02:54:28.334 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:27 smithi100 podman[105866]: 2024-09-13 02:54:27.98961547 +0000 UTC m=+0.384020951 container start 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T02:54:28.334 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 podman[105866]: 2024-09-13 02:54:28.077766466 +0000 UTC m=+0.472171943 container attach 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:54:28.334 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 podman[105866]: 2024-09-13 02:54:28.173497532 +0000 UTC m=+0.567903006 container died 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T02:54:28.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:28 smithi100 ceph-mon[92340]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T02:54:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:28 smithi122 ceph-mon[79680]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T02:54:28.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 podman[105889]: 2024-09-13 02:54:28.82331492 +0000 UTC m=+0.643825067 container remove 8a032c0d391c5b4a829bba261b3563eedbc2b1c14a7501f34c498058a30f24ca (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T02:54:28.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T02:54:28.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 systemd[1]: Stopped Ceph osd.1 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:54:28.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:28 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.1.service: Consumed 59.134s CPU time. 2024-09-13T02:54:29.335 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 systemd[1]: Starting Ceph osd.1 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:54:29.335 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 podman[105988]: 2024-09-13 02:54:29.155214598 +0000 UTC m=+0.016161512 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:54:29.335 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 podman[105988]: 2024-09-13 02:54:29.291103494 +0000 UTC m=+0.152050394 container create 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T02:54:29.602 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:29 smithi100 ceph-mon[92340]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:29.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:29.603 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:29.603 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 podman[105988]: 2024-09-13 02:54:29.518835005 +0000 UTC m=+0.379781906 container init 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T02:54:29.603 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 podman[105988]: 2024-09-13 02:54:29.522198716 +0000 UTC m=+0.383145619 container start 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T02:54:29.603 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 podman[105988]: 2024-09-13 02:54:29.601946948 +0000 UTC m=+0.462893865 container attach 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T02:54:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:29 smithi122 ceph-mon[79680]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:29.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:54:29.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 bash[105988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:54:29.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:54:29.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:29 smithi100 bash[105988]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:54:30.669 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 49/360 objects degraded (13.611%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:30.669 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:54:30.669 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:54:30.670 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:54:30.670 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:54:30.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:30 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 49/360 objects degraded (13.611%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:30.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate[106002]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 bash[105988]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:54:30.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:30 smithi100 podman[105988]: 2024-09-13 02:54:30.696647862 +0000 UTC m=+1.557594772 container died 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T02:54:31.643 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:31 smithi100 ceph-mon[92340]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/360 objects degraded (13.611%) 2024-09-13T02:54:31.644 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 podman[106153]: 2024-09-13 02:54:31.297589496 +0000 UTC m=+0.595410474 container remove 109b56e9be9f6c5e1a2e1dc5c6746646ca8bcc24eb81380ea9e2eb835a0ab196 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T02:54:31.644 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 podman[106213]: 2024-09-13 02:54:31.407294412 +0000 UTC m=+0.015996687 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:54:31.644 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 podman[106213]: 2024-09-13 02:54:31.523609474 +0000 UTC m=+0.132311783 container create dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T02:54:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:31 smithi122 ceph-mon[79680]: pgmap v63: 65 pgs: 15 active+undersized, 3 stale+active+clean, 14 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/360 objects degraded (13.611%) 2024-09-13T02:54:31.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 podman[106213]: 2024-09-13 02:54:31.759318673 +0000 UTC m=+0.368020943 container init dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T02:54:31.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 podman[106213]: 2024-09-13 02:54:31.762552023 +0000 UTC m=+0.371254290 container start dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T02:54:31.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 ceph-osd[106233]: -- 172.21.15.100:0/2514938036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650359301e0 con 0x565034addc00 2024-09-13T02:54:31.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 bash[106213]: dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 2024-09-13T02:54:31.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:31 smithi100 systemd[1]: Started Ceph osd.1 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 -- 172.21.15.100:0/1349032700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 msgr2=0x7faa6c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 --2- 172.21.15.100:0/1349032700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c0fb830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faa680048d0 tx=0x7faa68009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 -- 172.21.15.100:0/1349032700 shutdown_connections 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 --2- 172.21.15.100:0/1349032700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 --2- 172.21.15.100:0/1349032700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c0fb830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 -- 172.21.15.100:0/1349032700 >> 172.21.15.100:0/1349032700 conn(0x7faa6c0f6c00 msgr2=0x7faa6c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.204+0000 7faa7415a640 1 -- 172.21.15.100:0/1349032700 shutdown_connections 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 -- 172.21.15.100:0/1349032700 wait complete. 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 Processor -- start 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 -- start start 2024-09-13T02:54:32.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0664f0 con 0x7faa6c0fb420 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa7415a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c066660 con 0x7faa6c0fc6f0 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa71ef6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa71ef6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48710/0 (socket says 172.21.15.100:48710) 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.205+0000 7faa71ef6640 1 -- 172.21.15.100:0/3486390438 learned_addr learned my addr 172.21.15.100:0/3486390438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa716f5640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa71ef6640 1 -- 172.21.15.100:0/3486390438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 msgr2=0x7faa6c112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa71ef6640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c112300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa71ef6640 1 -- 172.21.15.100:0/3486390438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68005040 con 0x7faa6c0fb420 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa716f5640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa71ef6640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa68003080 tx=0x7faa68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa68038070 con 0x7faa6c0fb420 2024-09-13T02:54:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa68009800 con 0x7faa6c0fb420 2024-09-13T02:54:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa68033660 con 0x7faa6c0fb420 2024-09-13T02:54:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c112840 con 0x7faa6c0fb420 2024-09-13T02:54:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.206+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c112d50 con 0x7faa6c0fb420 2024-09-13T02:54:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.207+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c0fa880 con 0x7faa6c0fb420 2024-09-13T02:54:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.208+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7faa68030020 con 0x7faa6c0fb420 2024-09-13T02:54:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.208+0000 7faa627fc640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 0x7faa580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.208+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faa680ae200 con 0x7faa6c0fb420 2024-09-13T02:54:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.208+0000 7faa716f5640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 0x7faa580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.209+0000 7faa716f5640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 0x7faa580709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0041d0 tx=0x7faa5c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.213+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faa68077370 con 0x7faa6c0fb420 2024-09-13T02:54:32.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.417+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa6c100b00 con 0x7faa5806e530 2024-09-13T02:54:32.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.418+0000 7faa627fc640 1 -- 172.21.15.100:0/3486390438 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faa6c100b00 con 0x7faa5806e530 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 msgr2=0x7faa580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 0x7faa580709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0041d0 tx=0x7faa5c009040 comp rx=0 tx=0).stop 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 msgr2=0x7faa6c10fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa68003080 tx=0x7faa68009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 shutdown_connections 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faa5806e530 0x7faa580709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa6c0fc6f0 0x7faa6c112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 --2- 172.21.15.100:0/3486390438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa6c0fb420 0x7faa6c10fdb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 >> 172.21.15.100:0/3486390438 conn(0x7faa6c0f6c00 msgr2=0x7faa6c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 shutdown_connections 2024-09-13T02:54:32.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.420+0000 7faa7415a640 1 -- 172.21.15.100:0/3486390438 wait complete. 2024-09-13T02:54:32.432 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 -- 172.21.15.100:0/198765968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 msgr2=0x7f9c5c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 --2- 172.21.15.100:0/198765968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c0fcb90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c440048d0 tx=0x7f9c44009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 -- 172.21.15.100:0/198765968 shutdown_connections 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 --2- 172.21.15.100:0/198765968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c0fcb90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 --2- 172.21.15.100:0/198765968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 0x7f9c5c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.500+0000 7f9c62a61640 1 -- 172.21.15.100:0/198765968 >> 172.21.15.100:0/198765968 conn(0x7f9c5c0f6c10 msgr2=0x7f9c5c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 -- 172.21.15.100:0/198765968 shutdown_connections 2024-09-13T02:54:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 -- 172.21.15.100:0/198765968 wait complete. 2024-09-13T02:54:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 Processor -- start 2024-09-13T02:54:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 -- start start 2024-09-13T02:54:32.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 0x7f9c5c112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c10dcb0 con 0x7f9c5c0fc720 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.501+0000 7f9c62a61640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0666a0 con 0x7f9c5c0fb450 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48726/0 (socket says 172.21.15.100:48726) 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 -- 172.21.15.100:0/3776169034 learned_addr learned my addr 172.21.15.100:0/3776169034 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c5bfff640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 0x7f9c5c112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 -- 172.21.15.100:0/3776169034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 msgr2=0x7f9c5c112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 0x7f9c5c112200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 -- 172.21.15.100:0/3776169034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44005040 con 0x7f9c5c0fc720 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c53fff640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c44038070 con 0x7f9c5c0fc720 2024-09-13T02:54:32.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c4402ae90 con 0x7f9c5c0fc720 2024-09-13T02:54:32.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c066920 con 0x7f9c5c0fc720 2024-09-13T02:54:32.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4403d420 con 0x7f9c5c0fc720 2024-09-13T02:54:32.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.502+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c114fc0 con 0x7f9c5c0fc720 2024-09-13T02:54:32.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.503+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c0fa8b0 con 0x7f9c5c0fc720 2024-09-13T02:54:32.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.504+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9c44030020 con 0x7f9c5c0fc720 2024-09-13T02:54:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.504+0000 7f9c597fa640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 0x7f9c480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.504+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9c440ae940 con 0x7f9c5c0fc720 2024-09-13T02:54:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.504+0000 7f9c5bfff640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 0x7f9c480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.505+0000 7f9c5bfff640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 0x7f9c480709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0041d0 tx=0x7f9c4c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.509+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c44077a30 con 0x7f9c5c0fc720 2024-09-13T02:54:32.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.697+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c5c100b70 con 0x7f9c4806e530 2024-09-13T02:54:32.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.698+0000 7f9c597fa640 1 -- 172.21.15.100:0/3776169034 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9c5c100b70 con 0x7f9c4806e530 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 msgr2=0x7f9c480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 0x7f9c480709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0041d0 tx=0x7f9c4c009040 comp rx=0 tx=0).stop 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 msgr2=0x7f9c5c114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 shutdown_connections 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9c4806e530 0x7f9c480709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c5c0fc720 0x7f9c5c114750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 --2- 172.21.15.100:0/3776169034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c5c0fb450 0x7f9c5c112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.700+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 >> 172.21.15.100:0/3776169034 conn(0x7f9c5c0f6c10 msgr2=0x7f9c5c0f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.701+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 shutdown_connections 2024-09-13T02:54:32.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.701+0000 7f9c62a61640 1 -- 172.21.15.100:0/3776169034 wait complete. 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- 172.21.15.100:0/3513027252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 msgr2=0x7f92840fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 --2- 172.21.15.100:0/3513027252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f92840fb840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92780048d0 tx=0x7f9278009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- 172.21.15.100:0/3513027252 shutdown_connections 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 --2- 172.21.15.100:0/3513027252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 0x7f92840fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 --2- 172.21.15.100:0/3513027252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f92840fb840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- 172.21.15.100:0/3513027252 >> 172.21.15.100:0/3513027252 conn(0x7f92840f6c10 msgr2=0x7f92840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- 172.21.15.100:0/3513027252 shutdown_connections 2024-09-13T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- 172.21.15.100:0/3513027252 wait complete. 2024-09-13T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 Processor -- start 2024-09-13T02:54:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.784+0000 7f928b1f5640 1 -- start start 2024-09-13T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f928b1f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f928b1f5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 0x7f928410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f928b1f5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928410dc10 con 0x7f92840fb430 2024-09-13T02:54:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f928b1f5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928410e430 con 0x7f92840fc700 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48752/0 (socket says 172.21.15.100:48752) 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 -- 172.21.15.100:0/1299165115 learned_addr learned my addr 172.21.15.100:0/1299165115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9283fff640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 0x7f928410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 -- 172.21.15.100:0/1299165115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 msgr2=0x7f928410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 0x7f928410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.785+0000 7f9288f91640 1 -- 172.21.15.100:0/1299165115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278005040 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f9288f91640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92780048a0 tx=0x7f9278009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9278038070 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928410e660 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9278004290 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9278033660 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.786+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928410ec00 con 0x7f92840fb430 2024-09-13T02:54:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.787+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92840fa890 con 0x7f92840fb430 2024-09-13T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.788+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9278030020 con 0x7f92840fb430 2024-09-13T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.789+0000 7f92817fa640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.789+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f92780ae270 con 0x7f92840fb430 2024-09-13T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.789+0000 7f9283fff640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.789+0000 7f9283fff640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 0x7f92740709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f928410ce30 tx=0x7f927000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.793+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f92780774a0 con 0x7f92840fb430 2024-09-13T02:54:32.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.976+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f928410f040 con 0x7f927406e530 2024-09-13T02:54:32.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.985+0000 7f92817fa640 1 -- 172.21.15.100:0/1299165115 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f928410f040 con 0x7f927406e530 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 30s ago 11m 17.0M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (60s) 30s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (56s) 52s ago 10m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (2m) 30s ago 11m 77.4M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (6m) 30s ago 6m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (6m) 30s ago 6m 13.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (6m) 52s ago 6m 16.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (6m) 52s ago 6m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (2m) 30s ago 12m 494M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:54:32.988 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (2m) 52s ago 10m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (115s) 30s ago 13m 42.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (96s) 52s ago 10m 34.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 30s ago 11m 8056k - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (2m) 52s ago 10m 16.8M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (36s) 30s ago 9m 14.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 starting - - - 1557M 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (9m) 30s ago 9m 181M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (8m) 52s ago 8m 259M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (8m) 52s ago 8m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (7m) 52s ago 7m 224M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:54:32.989 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (2m) 30s ago 11m 53.8M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:54:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 msgr2=0x7f92740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 0x7f92740709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f928410ce30 tx=0x7f927000b040 comp rx=0 tx=0).stop 2024-09-13T02:54:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 msgr2=0x7f928410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f92780048a0 tx=0x7f9278009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 shutdown_connections 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92840fc700 0x7f928410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 --2- 172.21.15.100:0/1299165115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92840fb430 0x7f928410d080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 >> 172.21.15.100:0/1299165115 conn(0x7f92840f6c10 msgr2=0x7f92840f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 shutdown_connections 2024-09-13T02:54:32.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:32.988+0000 7f928b1f5640 1 -- 172.21.15.100:0/1299165115 wait complete. 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3814475963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 msgr2=0x7f54a00ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3814475963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a00ff160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54900048d0 tx=0x7f5490009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3814475963 shutdown_connections 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3814475963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 0x7f54a0101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3814475963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a00ff160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3814475963 >> 172.21.15.100:0/3814475963 conn(0x7f54a00f6c10 msgr2=0x7f54a00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3814475963 shutdown_connections 2024-09-13T02:54:33.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.065+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3814475963 wait complete. 2024-09-13T02:54:33.072 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:32 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:33.072 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:32 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:33.072 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:32 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:33.073 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:32 smithi100 ceph-mon[92340]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:33.073 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:32 smithi100 ceph-mon[92340]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 Processor -- start 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 -- start start 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 0x7f54a010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a010dc60 con 0x7f54a0066730 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f54a5a7e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a010e480 con 0x7f54a00ff6a0 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f549f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48776/0 (socket says 172.21.15.100:48776) 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f549f7fe640 1 -- 172.21.15.100:0/3685438649 learned_addr learned my addr 172.21.15.100:0/3685438649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.066+0000 7f5497fff640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 0x7f54a010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549f7fe640 1 -- 172.21.15.100:0/3685438649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 msgr2=0x7f54a010d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549f7fe640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 0x7f54a010d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549f7fe640 1 -- 172.21.15.100:0/3685438649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490005040 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549f7fe640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54900043d0 tx=0x7f5490009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490038070 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5490009800 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a010e6b0 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549003e630 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.067+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a010ec50 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.068+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a00fa8b0 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.069+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5490030020 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.069+0000 7f549cff9640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 0x7f548c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.069+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f54900ae460 con 0x7f54a0066730 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.069+0000 7f5497fff640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 0x7f548c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.070+0000 7f5497fff640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 0x7f548c0709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54a010ce80 tx=0x7f548800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.074+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5490077600 con 0x7f54a0066730 2024-09-13T02:54:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:32 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:33.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:32 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:33.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:32 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:33.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:32 smithi122 ceph-mon[79680]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:33.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:32 smithi122 ceph-mon[79680]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.343+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54a010ef10 con 0x7f54a0066730 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.343+0000 7f549cff9640 1 -- 172.21.15.100:0/3685438649 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f549007acc0 con 0x7f54a0066730 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:33.345 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 8, 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:54:33.346 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 msgr2=0x7f548c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 0x7f548c0709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54a010ce80 tx=0x7f548800b040 comp rx=0 tx=0).stop 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 msgr2=0x7f54a010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54900043d0 tx=0x7f5490009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 shutdown_connections 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f548c06e530 0x7f548c0709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54a00ff6a0 0x7f54a010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 --2- 172.21.15.100:0/3685438649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54a0066730 0x7f54a010d0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 >> 172.21.15.100:0/3685438649 conn(0x7f54a00f6c10 msgr2=0x7f54a00f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.345+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 shutdown_connections 2024-09-13T02:54:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.346+0000 7f54a5a7e640 1 -- 172.21.15.100:0/3685438649 wait complete. 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 -- 172.21.15.100:0/1822138095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d40ff6c0 msgr2=0x7f54d4101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 --2- 172.21.15.100:0/1822138095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d40ff6c0 0x7f54d4101aa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f54c40048d0 tx=0x7f54c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 -- 172.21.15.100:0/1822138095 shutdown_connections 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 --2- 172.21.15.100:0/1822138095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d40ff6c0 0x7f54d4101aa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 --2- 172.21.15.100:0/1822138095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d4065c00 0x7f54d40ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.425+0000 7f54db57f640 1 -- 172.21.15.100:0/1822138095 >> 172.21.15.100:0/1822138095 conn(0x7f54d40f6c10 msgr2=0x7f54d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 -- 172.21.15.100:0/1822138095 shutdown_connections 2024-09-13T02:54:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 -- 172.21.15.100:0/1822138095 wait complete. 2024-09-13T02:54:33.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 Processor -- start 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 -- start start 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d40ff6c0 0x7f54d410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d410dcc0 con 0x7f54d4065c00 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54db57f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d410e490 con 0x7f54d40ff6c0 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54d931b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54d931b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48792/0 (socket says 172.21.15.100:48792) 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.426+0000 7f54d931b640 1 -- 172.21.15.100:0/3817892118 learned_addr learned my addr 172.21.15.100:0/3817892118 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54d8b1a640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d40ff6c0 0x7f54d410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54d931b640 1 -- 172.21.15.100:0/3817892118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d40ff6c0 msgr2=0x7f54d410d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54d931b640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d40ff6c0 0x7f54d410d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54d931b640 1 -- 172.21.15.100:0/3817892118 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4005040 con 0x7f54d4065c00 2024-09-13T02:54:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54d931b640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54d0002840 tx=0x7f54d0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d0007c30 con 0x7f54d4065c00 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54d000f040 con 0x7f54d4065c00 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d410e720 con 0x7f54d4065c00 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d000d990 con 0x7f54d4065c00 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.427+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d410ecc0 con 0x7f54d4065c00 2024-09-13T02:54:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.428+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d40fa890 con 0x7f54d4065c00 2024-09-13T02:54:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.429+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f54d0009600 con 0x7f54d4065c00 2024-09-13T02:54:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.429+0000 7f54c9ffb640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 0x7f54c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.429+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f54d008ded0 con 0x7f54d4065c00 2024-09-13T02:54:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.429+0000 7f54d8b1a640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 0x7f54c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.430+0000 7f54d8b1a640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 0x7f54c00709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54d410cee0 tx=0x7f54c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.433+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f54d0057040 con 0x7f54d4065c00 2024-09-13T02:54:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.639+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54d404b720 con 0x7f54d4065c00 2024-09-13T02:54:33.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.640+0000 7f54c9ffb640 1 -- 172.21.15.100:0/3817892118 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1964 (secure 0 0 0) 0x7f54d005a700 con 0x7f54d4065c00 2024-09-13T02:54:33.641 INFO:teuthology.orchestra.run.smithi100.stdout:e19 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:54:14:355758+0000 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 19 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:54:14.355755+0000 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:54:33.642 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:54:33.643 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 14470,24259 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:54:33.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:54:33.645 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:33.645 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-09-13T02:54:33.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 msgr2=0x7f54c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 0x7f54c00709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54d410cee0 tx=0x7f54c4035040 comp rx=0 tx=0).stop 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 msgr2=0x7f54d410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54d0002840 tx=0x7f54d0004570 comp rx=0 tx=0).stop 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 shutdown_connections 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54c006e530 0x7f54c00709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d40ff6c0 0x7f54d410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 --2- 172.21.15.100:0/3817892118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d4065c00 0x7f54d410d130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 >> 172.21.15.100:0/3817892118 conn(0x7f54d40f6c10 msgr2=0x7f54d40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 shutdown_connections 2024-09-13T02:54:33.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.642+0000 7f54db57f640 1 -- 172.21.15.100:0/3817892118 wait complete. 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.722+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2230831123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fdba0 msgr2=0x7f29a80fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.722+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2230831123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fdba0 0x7f29a80fdfb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f29980048d0 tx=0x7f2998009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2230831123 shutdown_connections 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2230831123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fe4f0 0x7f29a80fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2230831123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fdba0 0x7f29a80fdfb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2230831123 >> 172.21.15.100:0/2230831123 conn(0x7f29a80f63a0 msgr2=0x7f29a80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2230831123 shutdown_connections 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2230831123 wait complete. 2024-09-13T02:54:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 Processor -- start 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- start start 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fdba0 0x7f29a810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a810dc00 con 0x7f29a80fe4f0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.723+0000 7f29ad9f6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a810e420 con 0x7f29a80fdba0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48812/0 (socket says 172.21.15.100:48812) 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 -- 172.21.15.100:0/2508015114 learned_addr learned my addr 172.21.15.100:0/2508015114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a6ffd640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fdba0 0x7f29a810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 -- 172.21.15.100:0/2508015114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fdba0 msgr2=0x7f29a810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fdba0 0x7f29a810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 -- 172.21.15.100:0/2508015114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998005040 con 0x7f29a80fe4f0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29a67fc640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c7e0 tx=0x7f299c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299c00a7a0 con 0x7f29a80fe4f0 2024-09-13T02:54:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a810e6b0 con 0x7f29a80fe4f0 2024-09-13T02:54:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f299c00ada0 con 0x7f29a80fe4f0 2024-09-13T02:54:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299c0113a0 con 0x7f29a80fe4f0 2024-09-13T02:54:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.724+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a810ec50 con 0x7f29a80fe4f0 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.725+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a80fa040 con 0x7f29a80fe4f0 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.726+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f299c012400 con 0x7f29a80fe4f0 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.726+0000 7f298f7fe640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 0x7f29900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.726+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f299c08e200 con 0x7f29a80fe4f0 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.726+0000 7f29a6ffd640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 0x7f29900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.727+0000 7f29a6ffd640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 0x7f29900709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.730+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f299c057370 con 0x7f29a80fe4f0 2024-09-13T02:54:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.921+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29a810efe0 con 0x7f299006e530 2024-09-13T02:54:33.923 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:33 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T02:54:33.622+0000 7f247d5d0640 -1 Falling back to public interface 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.923+0000 7f298f7fe640 1 -- 172.21.15.100:0/2508015114 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f29a810efe0 con 0x7f299006e530 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:54:33.924 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "7/21 daemons upgraded", 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:54:33.925 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 msgr2=0x7f29900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 0x7f29900709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998035040 comp rx=0 tx=0).stop 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 msgr2=0x7f29a810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c7e0 tx=0x7f299c0043c0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 shutdown_connections 2024-09-13T02:54:33.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f299006e530 0x7f29900709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a80fe4f0 0x7f29a810d5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 --2- 172.21.15.100:0/2508015114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29a80fdba0 0x7f29a810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 >> 172.21.15.100:0/2508015114 conn(0x7f29a80f63a0 msgr2=0x7f29a80f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 shutdown_connections 2024-09-13T02:54:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:33.925+0000 7f29ad9f6640 1 -- 172.21.15.100:0/2508015114 wait complete. 2024-09-13T02:54:34.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 -- 172.21.15.100:0/3611405608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a340ff700 msgr2=0x7f1a34101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3611405608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a340ff700 0x7f1a34101ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0048d0 tx=0x7f1a1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 -- 172.21.15.100:0/3611405608 shutdown_connections 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3611405608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a340ff700 0x7f1a34101ae0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3611405608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a34065bc0 0x7f1a340ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.006+0000 7f1a3a776640 1 -- 172.21.15.100:0/3611405608 >> 172.21.15.100:0/3611405608 conn(0x7f1a340f6c10 msgr2=0x7f1a340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 -- 172.21.15.100:0/3611405608 shutdown_connections 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 -- 172.21.15.100:0/3611405608 wait complete. 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 Processor -- start 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 -- start start 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a340ff700 0x7f1a3410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3410dcb0 con 0x7f1a34065bc0 2024-09-13T02:54:34.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a3a776640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3410e480 con 0x7f1a340ff700 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a33fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a33fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48834/0 (socket says 172.21.15.100:48834) 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a33fff640 1 -- 172.21.15.100:0/3743007958 learned_addr learned my addr 172.21.15.100:0/3743007958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.007+0000 7f1a2bfff640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a340ff700 0x7f1a3410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a33fff640 1 -- 172.21.15.100:0/3743007958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a340ff700 msgr2=0x7f1a3410d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a33fff640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a340ff700 0x7f1a3410d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a33fff640 1 -- 172.21.15.100:0/3743007958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c005040 con 0x7f1a34065bc0 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a33fff640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400eb70 tx=0x7f1a2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a24007c30 con 0x7f1a34065bc0 2024-09-13T02:54:34.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a2400f040 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a2400caa0 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3410e710 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.008+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3410ecb0 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.010+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a340fa890 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.010+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1a2400cd10 con 0x7f1a34065bc0 2024-09-13T02:54:34.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.010+0000 7f1a317fa640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 0x7f1a200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.010+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1a2408e390 con 0x7f1a34065bc0 2024-09-13T02:54:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.011+0000 7f1a2bfff640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 0x7f1a200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:34.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.011+0000 7f1a2bfff640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 0x7f1a200709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a3410ced0 tx=0x7f1a1c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:34.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.015+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1a24057500 con 0x7f1a34065bc0 2024-09-13T02:54:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:33 smithi100 ceph-mon[92340]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:33 smithi100 ceph-mon[92340]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:33 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3685438649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:34.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:33 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3817892118' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:34.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:33 smithi122 ceph-mon[79680]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:34.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:33 smithi122 ceph-mon[79680]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:34.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:33 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3685438649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:34.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:33 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3817892118' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:34.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.269+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1a3404b720 con 0x7f1a34065bc0 2024-09-13T02:54:34.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.270+0000 7f1a317fa640 1 -- 172.21.15.100:0/3743007958 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f1a2405abc0 con 0x7f1a34065bc0 2024-09-13T02:54:34.271 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: osd.1 (root=default,host=smithi100) is down 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T02:54:34.272 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T02:54:34.273 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T02:54:34.273 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-13T02:54:34.277 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-13T02:54:34.277 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T02:54:34.277 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-13T02:54:34.277 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 msgr2=0x7f1a200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 0x7f1a200709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a3410ced0 tx=0x7f1a1c035040 comp rx=0 tx=0).stop 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 msgr2=0x7f1a3410d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400eb70 tx=0x7f1a2400b040 comp rx=0 tx=0).stop 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 shutdown_connections 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1a2006e530 0x7f1a200709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a340ff700 0x7f1a3410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 --2- 172.21.15.100:0/3743007958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a34065bc0 0x7f1a3410d120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 >> 172.21.15.100:0/3743007958 conn(0x7f1a340f6c10 msgr2=0x7f1a340f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 shutdown_connections 2024-09-13T02:54:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:54:34.272+0000 7f1a3a776640 1 -- 172.21.15.100:0/3743007958 wait complete. 2024-09-13T02:54:35.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:34 smithi122 ceph-mon[79680]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:35.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:34 smithi122 ceph-mon[79680]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:35.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:34 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3743007958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:34 smithi100 ceph-mon[92340]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:34 smithi100 ceph-mon[92340]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:35.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:34 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3743007958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:37 smithi100 ceph-mon[92340]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:37 smithi122 ceph-mon[79680]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:38 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:38 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:38 smithi100 ceph-mon[92340]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:38.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:38 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:54:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:38 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:38 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:54:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:38 smithi122 ceph-mon[79680]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:38.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:38 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:54:39.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:39 smithi100 ceph-mon[92340]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:54:39.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:39 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T02:54:39.672+0000 7f247d5d0640 -1 osd.1 52 log_to_monitors true 2024-09-13T02:54:39.927 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 02:54:39 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T02:54:39.744+0000 7f247536a640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:54:40.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:39 smithi122 ceph-mon[79680]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:54:40.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:40 smithi100 ceph-mon[92340]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:54:40.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:40 smithi100 ceph-mon[92340]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:54:40.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:40 smithi100 ceph-mon[92340]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:54:40.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:40 smithi100 ceph-mon[92340]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:41.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:40 smithi122 ceph-mon[79680]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:54:41.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:40 smithi122 ceph-mon[79680]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:54:41.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:40 smithi122 ceph-mon[79680]: from='osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:54:41.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:40 smithi122 ceph-mon[79680]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:41.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:54:41.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445] boot 2024-09-13T02:54:41.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:41.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:41 smithi100 ceph-mon[92340]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:54:42.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: osd.1 [v2:172.21.15.100:6810/3705500445,v1:172.21.15.100:6811/3705500445] boot 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:42.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:42.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:41 smithi122 ceph-mon[79680]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:54:43.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:42 smithi100 ceph-mon[92340]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T02:54:43.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:42 smithi100 ceph-mon[92340]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:43.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:42 smithi122 ceph-mon[79680]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T02:54:43.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:42 smithi122 ceph-mon[79680]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:45 smithi100 ceph-mon[92340]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:45 smithi122 ceph-mon[79680]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-09-13T02:54:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:46 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2024-09-13T02:54:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:46 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:54:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:46 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2024-09-13T02:54:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:46 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:54:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:47 smithi100 ceph-mon[92340]: pgmap v74: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:47 smithi122 ceph-mon[79680]: pgmap v74: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:49 smithi100 ceph-mon[92340]: pgmap v75: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:49 smithi122 ceph-mon[79680]: pgmap v75: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:51.643 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:51 smithi100 ceph-mon[92340]: pgmap v76: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:51 smithi122 ceph-mon[79680]: pgmap v76: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:53.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:53 smithi100 ceph-mon[92340]: pgmap v77: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:53 smithi122 ceph-mon[79680]: pgmap v77: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:55 smithi100 ceph-mon[92340]: pgmap v78: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:55 smithi122 ceph-mon[79680]: pgmap v78: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:56.595 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:56 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:56 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:57 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:57 smithi100 ceph-mon[92340]: Upgrade: osd.2 is safe to restart 2024-09-13T02:54:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:57 smithi100 ceph-mon[92340]: pgmap v79: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:57 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:54:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:57 smithi122 ceph-mon[79680]: Upgrade: osd.2 is safe to restart 2024-09-13T02:54:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:57 smithi122 ceph-mon[79680]: pgmap v79: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:58.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: Upgrade: Updating osd.2 2024-09-13T02:54:58.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:58.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:54:58.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:58.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: Deploying daemon osd.2 on smithi100 2024-09-13T02:54:58.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:54:58 smithi100 ceph-mon[92340]: pgmap v80: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:54:58.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: Upgrade: Updating osd.2 2024-09-13T02:54:58.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:54:58.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:54:58.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:58.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: Deploying daemon osd.2 on smithi100 2024-09-13T02:54:58.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:54:58 smithi122 ceph-mon[79680]: pgmap v80: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:00.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:00.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:00.427 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:00 smithi100 systemd[1]: Stopping Ceph osd.2 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:55:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:00.926 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:00 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[61834]: 2024-09-13T02:55:00.614+0000 7f8f30228640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:55:00.926 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:00 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[61834]: 2024-09-13T02:55:00.614+0000 7f8f30228640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-13T02:55:00.926 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:00 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[61834]: 2024-09-13T02:55:00.614+0000 7f8f30228640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:55:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:01 smithi100 ceph-mon[92340]: pgmap v81: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:01 smithi100 ceph-mon[92340]: osd.2 marked itself down and dead 2024-09-13T02:55:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:01 smithi122 ceph-mon[79680]: pgmap v81: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:01 smithi122 ceph-mon[79680]: osd.2 marked itself down and dead 2024-09-13T02:55:02.133 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:01 smithi100 podman[111266]: 2024-09-13 02:55:01.790691328 +0000 UTC m=+1.295487386 container died 543ed33257e2506018c29da19fb938a028e9580f3945d073ab081f9ed8917b82 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T02:55:02.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:02 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:55:02.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:02 smithi100 ceph-mon[92340]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T02:55:02.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:02 smithi100 ceph-mon[92340]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T02:55:02.427 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:02 smithi100 podman[111266]: 2024-09-13 02:55:02.231345943 +0000 UTC m=+1.736141962 container cleanup 543ed33257e2506018c29da19fb938a028e9580f3945d073ab081f9ed8917b82 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-bbdadfa, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T02:55:02.427 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:02 smithi100 bash[111266]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2 2024-09-13T02:55:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:02 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:55:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:02 smithi122 ceph-mon[79680]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T02:55:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:02 smithi122 ceph-mon[79680]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T02:55:02.896 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:02 smithi100 podman[111282]: 2024-09-13 02:55:02.452449909 +0000 UTC m=+0.652554456 container remove 543ed33257e2506018c29da19fb938a028e9580f3945d073ab081f9ed8917b82 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, ceph=True, RELEASE=quincy-bbdadfa, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:55:03.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:02 smithi100 podman[111371]: 2024-09-13 02:55:02.798185868 +0000 UTC m=+0.016225347 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:03.177 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:02 smithi100 podman[111371]: 2024-09-13 02:55:02.900632282 +0000 UTC m=+0.118671748 container create 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T02:55:03.177 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 podman[111371]: 2024-09-13 02:55:03.136898277 +0000 UTC m=+0.354937744 container init 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T02:55:03.177 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 podman[111371]: 2024-09-13 02:55:03.140090681 +0000 UTC m=+0.358130147 container start 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T02:55:03.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:03 smithi100 ceph-mon[92340]: pgmap v83: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:03.505 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 podman[111371]: 2024-09-13 02:55:03.245185412 +0000 UTC m=+0.463224889 container attach 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:55:03.505 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 podman[111371]: 2024-09-13 02:55:03.336230094 +0000 UTC m=+0.554269570 container died 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T02:55:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:03 smithi122 ceph-mon[79680]: pgmap v83: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:04.360 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 podman[111394]: 2024-09-13 02:55:03.958220597 +0000 UTC m=+0.616103480 container remove 2b0393fb8cc3952a1fb3deffd9ebd948ea76d95ac99871fc3d99c8b7425832a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:55:04.360 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T02:55:04.360 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 systemd[1]: Stopped Ceph osd.2 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:55:04.360 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:03 smithi100 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.2.service: Consumed 45.882s CPU time. 2024-09-13T02:55:04.360 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 systemd[1]: Starting Ceph osd.2 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 -- 172.21.15.100:0/3503807674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 msgr2=0x7fc98c0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 --2- 172.21.15.100:0/3503807674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c0fa650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc9800048d0 tx=0x7fc980009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 -- 172.21.15.100:0/3503807674 shutdown_connections 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 --2- 172.21.15.100:0/3503807674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c0fa650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 --2- 172.21.15.100:0/3503807674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 0x7fc98c0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 -- 172.21.15.100:0/3503807674 >> 172.21.15.100:0/3503807674 conn(0x7fc98c0f63a0 msgr2=0x7fc98c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 -- 172.21.15.100:0/3503807674 shutdown_connections 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.357+0000 7fc993a38640 1 -- 172.21.15.100:0/3503807674 wait complete. 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 Processor -- start 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 -- start start 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 0x7fc98c10f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c10fe20 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc993a38640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c110640 con 0x7fc98c0fdba0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.358+0000 7fc990fd3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38886/0 (socket says 172.21.15.100:38886) 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 -- 172.21.15.100:0/189236504 learned_addr learned my addr 172.21.15.100:0/189236504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc9917d4640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 0x7fc98c10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 -- 172.21.15.100:0/189236504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 msgr2=0x7fc98c10f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 0x7fc98c10f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 -- 172.21.15.100:0/189236504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980005040 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc990fd3640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9800048a0 tx=0x7fc980009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc980038070 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c110870 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc98002abd0 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.359+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc980033640 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.360+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c110e10 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.361+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c0fa040 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.361+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc980030020 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.361+0000 7fc989ffb640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 0x7fc9740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.361+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc9800ae480 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.362+0000 7fc9917d4640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 0x7fc9740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.362+0000 7fc9917d4640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 0x7fc9740709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc97c004550 tx=0x7fc97c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.366+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc980077620 con 0x7fc98c0fe4f0 2024-09-13T02:55:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.557+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc98c105010 con 0x7fc97406e530 2024-09-13T02:55:04.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.558+0000 7fc989ffb640 1 -- 172.21.15.100:0/189236504 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc98c105010 con 0x7fc97406e530 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 msgr2=0x7fc9740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 0x7fc9740709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc97c004550 tx=0x7fc97c009040 comp rx=0 tx=0).stop 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 msgr2=0x7fc98c10f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9800048a0 tx=0x7fc980009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 shutdown_connections 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.560+0000 7fc993a38640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc97406e530 0x7fc9740709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.561+0000 7fc993a38640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc98c0fe4f0 0x7fc98c10f7d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.561+0000 7fc993a38640 1 --2- 172.21.15.100:0/189236504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc98c0fdba0 0x7fc98c10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.561+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 >> 172.21.15.100:0/189236504 conn(0x7fc98c0f63a0 msgr2=0x7fc98c0f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:04.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.561+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 shutdown_connections 2024-09-13T02:55:04.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.561+0000 7fc993a38640 1 -- 172.21.15.100:0/189236504 wait complete. 2024-09-13T02:55:04.570 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:55:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/2955376625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 msgr2=0x7f0f68101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/2955376625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f68101a80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f500048d0 tx=0x7f0f50009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/2955376625 shutdown_connections 2024-09-13T02:55:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/2955376625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f68101a80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/2955376625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f680ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/2955376625 >> 172.21.15.100:0/2955376625 conn(0x7f0f680f6c10 msgr2=0x7f0f680f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/2955376625 shutdown_connections 2024-09-13T02:55:04.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.640+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/2955376625 wait complete. 2024-09-13T02:55:04.643 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 podman[111494]: 2024-09-13 02:55:04.391129125 +0000 UTC m=+0.111342475 container create d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T02:55:04.643 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 podman[111494]: 2024-09-13 02:55:04.296245461 +0000 UTC m=+0.016458815 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 Processor -- start 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 -- start start 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f6810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6810dc40 con 0x7f0f680ff6a0 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f6d3ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6810e460 con 0x7f0f68066790 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f5ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f5ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38910/0 (socket says 172.21.15.100:38910) 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f5ffff640 1 -- 172.21.15.100:0/3480090789 learned_addr learned my addr 172.21.15.100:0/3480090789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f5ffff640 1 -- 172.21.15.100:0/3480090789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 msgr2=0x7f0f6810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.641+0000 7f0f66ffd640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f6810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5ffff640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f6810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5ffff640 1 -- 172.21.15.100:0/3480090789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50005040 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f66ffd640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f6810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5ffff640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f50003080 tx=0x7f0f50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f50038070 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f5002abd0 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6810e690 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f5003e670 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.642+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6810ec30 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.643+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f680fa8b0 con 0x7f0f680ff6a0 2024-09-13T02:55:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.644+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0f50030020 con 0x7f0f680ff6a0 2024-09-13T02:55:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.644+0000 7f0f5f7fe640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 0x7f0f540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.644+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0f500ae5b0 con 0x7f0f680ff6a0 2024-09-13T02:55:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.644+0000 7f0f66ffd640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 0x7f0f540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.644+0000 7f0f66ffd640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 0x7f0f540709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f580041d0 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.648+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0f500776a0 con 0x7f0f680ff6a0 2024-09-13T02:55:04.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.840+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f6810ef60 con 0x7f0f5406e530 2024-09-13T02:55:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.842+0000 7f0f5f7fe640 1 -- 172.21.15.100:0/3480090789 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0f6810ef60 con 0x7f0f5406e530 2024-09-13T02:55:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 msgr2=0x7f0f540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 0x7f0f540709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f580041d0 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 msgr2=0x7f0f6810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f50003080 tx=0x7f0f50009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 shutdown_connections 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f5406e530 0x7f0f540709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f680ff6a0 0x7f0f6810d5f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 --2- 172.21.15.100:0/3480090789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f68066790 0x7f0f6810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 >> 172.21.15.100:0/3480090789 conn(0x7f0f680f6c10 msgr2=0x7f0f680f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 shutdown_connections 2024-09-13T02:55:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.844+0000 7f0f6d3ec640 1 -- 172.21.15.100:0/3480090789 wait complete. 2024-09-13T02:55:04.926 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 podman[111494]: 2024-09-13 02:55:04.669015708 +0000 UTC m=+0.389229061 container init d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 podman[111494]: 2024-09-13 02:55:04.673932204 +0000 UTC m=+0.394145554 container start d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 podman[111494]: 2024-09-13 02:55:04.760817798 +0000 UTC m=+0.481031164 container attach d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 bash[111494]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:04.927 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:04 smithi100 bash[111494]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 -- 172.21.15.100:0/1386305976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fc520 msgr2=0x7fb8f00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/1386305976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fc520 0x7fb8f00fc930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009c50 tx=0x7fb8e8004d10 comp rx=0 tx=0).stop 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 -- 172.21.15.100:0/1386305976 shutdown_connections 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/1386305976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/1386305976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fc520 0x7fb8f00fc930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 -- 172.21.15.100:0/1386305976 >> 172.21.15.100:0/1386305976 conn(0x7fb8f00f7ce0 msgr2=0x7fb8f00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 -- 172.21.15.100:0/1386305976 shutdown_connections 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.927+0000 7fb8f84b7640 1 -- 172.21.15.100:0/1386305976 wait complete. 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 Processor -- start 2024-09-13T02:55:04.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 -- start start 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 0x7fb8f010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f010dc40 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f84b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f010e460 con 0x7fb8f00fc520 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38928/0 (socket says 172.21.15.100:38928) 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 -- 172.21.15.100:0/2536309950 learned_addr learned my addr 172.21.15.100:0/2536309950 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f6253640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 0x7fb8f010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 -- 172.21.15.100:0/2536309950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 msgr2=0x7fb8f010d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 0x7fb8f010d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.928+0000 7fb8f5a52640 1 -- 172.21.15.100:0/2536309950 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80098b0 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8f6253640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 0x7fb8f010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8f5a52640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4002a50 tx=0x7fb8e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e4007c30 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8e400f040 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f010e6f0 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e400da90 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.929+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f010ec90 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.930+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f00fb980 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.931+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb8e400dd00 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.931+0000 7fb8eeffd640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 0x7fb8d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.931+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb8e408da90 con 0x7fb8f00fd7f0 2024-09-13T02:55:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.931+0000 7fb8f6253640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 0x7fb8d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:04.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.932+0000 7fb8f6253640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 0x7fb8d80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8000f80 tx=0x7fb8e8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:04.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:04.935+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb8e4056b80 con 0x7fb8f00fd7f0 2024-09-13T02:55:05.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.109+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f010f080 con 0x7fb8d806e530 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.117+0000 7fb8eeffd640 1 -- 172.21.15.100:0/2536309950 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb8f010f080 con 0x7fb8d806e530 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (3m) 28s ago 12m 17.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (92s) 28s ago 12m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (88s) 84s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (3m) 28s ago 11m 75.0M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (6m) 28s ago 6m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:55:05.119 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (6m) 28s ago 6m 13.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (6m) 84s ago 6m 16.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (6m) 84s ago 6m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (3m) 28s ago 13m 496M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (2m) 84s ago 11m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (2m) 28s ago 13m 44.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (2m) 84s ago 11m 34.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 28s ago 12m 16.6M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (3m) 84s ago 11m 16.8M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (68s) 28s ago 10m 94.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (33s) 28s ago 10m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (9m) 28s ago 9m 182M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 543ed33257e2 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (9m) 84s ago 9m 259M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:55:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (8m) 84s ago 8m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:55:05.121 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (8m) 84s ago 8m 224M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:55:05.121 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (2m) 28s ago 11m 53.9M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:55:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 msgr2=0x7fb8d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 0x7fb8d80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8000f80 tx=0x7fb8e8004d10 comp rx=0 tx=0).stop 2024-09-13T02:55:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 msgr2=0x7fb8f010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4002a50 tx=0x7fb8e4004600 comp rx=0 tx=0).stop 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 shutdown_connections 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb8d806e530 0x7fb8d80709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8f00fd7f0 0x7fb8f010d5f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 --2- 172.21.15.100:0/2536309950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8f00fc520 0x7fb8f010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.119+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 >> 172.21.15.100:0/2536309950 conn(0x7fb8f00f7ce0 msgr2=0x7fb8f00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.120+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 shutdown_connections 2024-09-13T02:55:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.120+0000 7fb8f84b7640 1 -- 172.21.15.100:0/2536309950 wait complete. 2024-09-13T02:55:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.197+0000 7fce9bc75640 1 -- 172.21.15.100:0/881651280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fc700 msgr2=0x7fce940fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.197+0000 7fce9bc75640 1 --2- 172.21.15.100:0/881651280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fc700 0x7fce940fcb70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce840048d0 tx=0x7fce84009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 -- 172.21.15.100:0/881651280 shutdown_connections 2024-09-13T02:55:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 --2- 172.21.15.100:0/881651280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fc700 0x7fce940fcb70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 --2- 172.21.15.100:0/881651280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fb430 0x7fce940fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 -- 172.21.15.100:0/881651280 >> 172.21.15.100:0/881651280 conn(0x7fce940f6c10 msgr2=0x7fce940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 -- 172.21.15.100:0/881651280 shutdown_connections 2024-09-13T02:55:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.198+0000 7fce9bc75640 1 -- 172.21.15.100:0/881651280 wait complete. 2024-09-13T02:55:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 Processor -- start 2024-09-13T02:55:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 -- start start 2024-09-13T02:55:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fb430 0x7fce9410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9410dbd0 con 0x7fce940fb430 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce9bc75640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9410e3f0 con 0x7fce940fc700 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce99210640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce99210640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:43722/0 (socket says 172.21.15.100:43722) 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce99210640 1 -- 172.21.15.100:0/1572941863 learned_addr learned my addr 172.21.15.100:0/1572941863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.199+0000 7fce99a11640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fb430 0x7fce9410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce99210640 1 -- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fb430 msgr2=0x7fce9410d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce99210640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fb430 0x7fce9410d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce99210640 1 -- 172.21.15.100:0/1572941863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84005040 con 0x7fce940fc700 2024-09-13T02:55:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce99210640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce840043d0 tx=0x7fce84009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce84038070 con 0x7fce940fc700 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9410e620 con 0x7fce940fc700 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9410ebc0 con 0x7fce940fc700 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce8402ae90 con 0x7fce940fc700 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.200+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8403e670 con 0x7fce940fc700 2024-09-13T02:55:05.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.202+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce940fa890 con 0x7fce940fc700 2024-09-13T02:55:05.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.202+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fce84030020 con 0x7fce940fc700 2024-09-13T02:55:05.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.203+0000 7fce8a7fc640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 0x7fce80074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.203+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fce840ae280 con 0x7fce940fc700 2024-09-13T02:55:05.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.203+0000 7fce99a11640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 0x7fce80074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.203+0000 7fce99a11640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 0x7fce80074df0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce90004eb0 tx=0x7fce9000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.208+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce840774a0 con 0x7fce940fc700 2024-09-13T02:55:05.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.444+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce94103e30 con 0x7fce940fc700 2024-09-13T02:55:05.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.445+0000 7fce8a7fc640 1 -- 172.21.15.100:0/1572941863 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fce8407ab60 con 0x7fce940fc700 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 3, 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:05.447 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 7, 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:55:05.448 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 msgr2=0x7fce80074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 0x7fce80074df0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce90004eb0 tx=0x7fce9000b040 comp rx=0 tx=0).stop 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 msgr2=0x7fce9410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce840043d0 tx=0x7fce84009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 shutdown_connections 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fce80072940 0x7fce80074df0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce940fc700 0x7fce9410d580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 --2- 172.21.15.100:0/1572941863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce940fb430 0x7fce9410d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 >> 172.21.15.100:0/1572941863 conn(0x7fce940f6c10 msgr2=0x7fce940655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 shutdown_connections 2024-09-13T02:55:05.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.447+0000 7fce9bc75640 1 -- 172.21.15.100:0/1572941863 wait complete. 2024-09-13T02:55:05.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-mon[92340]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- 172.21.15.100:0/3980884189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 msgr2=0x7f93a40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/3980884189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a40fdc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f938c0048d0 tx=0x7f938c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- 172.21.15.100:0/3980884189 shutdown_connections 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/3980884189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a40fdc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/3980884189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 0x7f93a40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- 172.21.15.100:0/3980884189 >> 172.21.15.100:0/3980884189 conn(0x7f93a40f7d30 msgr2=0x7f93a40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- 172.21.15.100:0/3980884189 shutdown_connections 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- 172.21.15.100:0/3980884189 wait complete. 2024-09-13T02:55:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 Processor -- start 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.531+0000 7f93aa9c5640 1 -- start start 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93aa9c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 0x7f93a410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93aa9c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93aa9c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a410dc20 con 0x7f93a40fd820 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93aa9c5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a410e440 con 0x7f93a40fc550 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38960/0 (socket says 172.21.15.100:38960) 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 -- 172.21.15.100:0/441556946 learned_addr learned my addr 172.21.15.100:0/441556946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a3fff640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 0x7f93a410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 -- 172.21.15.100:0/441556946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 msgr2=0x7f93a410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 0x7f93a410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 -- 172.21.15.100:0/441556946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c005040 con 0x7f93a40fd820 2024-09-13T02:55:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a37fe640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f938c0043d0 tx=0x7f938c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f938c038070 con 0x7f93a40fd820 2024-09-13T02:55:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a410e670 con 0x7f93a40fd820 2024-09-13T02:55:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f938c02ae90 con 0x7f93a40fd820 2024-09-13T02:55:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.532+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f938c03e670 con 0x7f93a40fd820 2024-09-13T02:55:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.533+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a410ec10 con 0x7f93a40fd820 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.534+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a40fb9b0 con 0x7f93a40fd820 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.534+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f938c030020 con 0x7f93a40fd820 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.534+0000 7f93a0ff9640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 0x7f93900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.534+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f938c0ae370 con 0x7f93a40fd820 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.535+0000 7f93a3fff640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 0x7f93900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.535+0000 7f93a3fff640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 0x7f93900709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9394004ed0 tx=0x7f939400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.539+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f938c077510 con 0x7f93a40fd820 2024-09-13T02:55:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:05 smithi122 ceph-mon[79680]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:05.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.740+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93a410ee00 con 0x7f93a40fd820 2024-09-13T02:55:05.742 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:55:05.742 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:55:05.742 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:55:05.742 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.741+0000 7f93a0ff9640 1 -- 172.21.15.100:0/441556946 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f938c07abd0 con 0x7f93a40fd820 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stdout:e20 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:54:38:305822+0000 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:05.743 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 20 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:54:37.621540+0000 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:55:05.744 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:55:05.745 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 24259,14470 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:05.746 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 msgr2=0x7f93900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 0x7f93900709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9394004ed0 tx=0x7f939400b040 comp rx=0 tx=0).stop 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 msgr2=0x7f93a410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f938c0043d0 tx=0x7f938c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 shutdown_connections 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f939006e530 0x7f93900709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93a40fd820 0x7f93a410d5d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 --2- 172.21.15.100:0/441556946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93a40fc550 0x7f93a410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 >> 172.21.15.100:0/441556946 conn(0x7f93a40f7d30 msgr2=0x7f93a40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 shutdown_connections 2024-09-13T02:55:05.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.743+0000 7f93aa9c5640 1 -- 172.21.15.100:0/441556946 wait complete. 2024-09-13T02:55:05.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- 172.21.15.100:0/566410549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 msgr2=0x7fc8fc101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 --2- 172.21.15.100:0/566410549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc101ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40048d0 tx=0x7fc8e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- 172.21.15.100:0/566410549 shutdown_connections 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 --2- 172.21.15.100:0/566410549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc101ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 --2- 172.21.15.100:0/566410549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 0x7fc8fc0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- 172.21.15.100:0/566410549 >> 172.21.15.100:0/566410549 conn(0x7fc8fc0f6c00 msgr2=0x7fc8fc0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- 172.21.15.100:0/566410549 shutdown_connections 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- 172.21.15.100:0/566410549 wait complete. 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 Processor -- start 2024-09-13T02:55:05.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.824+0000 7fc902052640 1 -- start start 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 0x7fc8fc10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc10dc00 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc10e420 con 0x7fc8fc066450 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38976/0 (socket says 172.21.15.100:38976) 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 -- 172.21.15.100:0/1703676399 learned_addr learned my addr 172.21.15.100:0/1703676399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8fb7fe640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 0x7fc8fc10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 -- 172.21.15.100:0/1703676399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 msgr2=0x7fc8fc10d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 0x7fc8fc10d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 -- 172.21.15.100:0/1703676399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4005040 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8faffd640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40048a0 tx=0x7fc8e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e4038070 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8e402abd0 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc10e650 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e4033640 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.825+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc10ebf0 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.826+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc0fa880 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.827+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc8e4030020 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.827+0000 7fc8f3fff640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 0x7fc8e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.827+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc8e40ae470 con 0x7fc8fc0ff6f0 2024-09-13T02:55:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.827+0000 7fc8fb7fe640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 0x7fc8e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.828+0000 7fc8fb7fe640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 0x7fc8e80709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0661b0 tx=0x7fc8f4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:05.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:05.832+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc8e4077610 con 0x7fc8fc0ff6f0 2024-09-13T02:55:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.025+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8fc10eed0 con 0x7fc8e806e530 2024-09-13T02:55:06.027 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:55:06.027 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:55:06.027 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate[111532]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 bash[111494]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:55:06.028 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:05 smithi100 podman[111494]: 2024-09-13 02:55:05.882649627 +0000 UTC m=+1.602862986 container died d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.027+0000 7fc8f3fff640 1 -- 172.21.15.100:0/1703676399 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc8fc10eed0 con 0x7fc8e806e530 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:55:06.029 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "8/21 daemons upgraded", 2024-09-13T02:55:06.030 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:55:06.030 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:55:06.030 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:55:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.028+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 msgr2=0x7fc8e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.028+0000 7fc902052640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 0x7fc8e80709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0661b0 tx=0x7fc8f4009040 comp rx=0 tx=0).stop 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.028+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 msgr2=0x7fc8fc10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.028+0000 7fc902052640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40048a0 tx=0x7fc8e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 shutdown_connections 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc8e806e530 0x7fc8e80709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8fc0ff6f0 0x7fc8fc10d5b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 --2- 172.21.15.100:0/1703676399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc8fc066450 0x7fc8fc10d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 >> 172.21.15.100:0/1703676399 conn(0x7fc8fc0f6c00 msgr2=0x7fc8fc0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 shutdown_connections 2024-09-13T02:55:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.029+0000 7fc902052640 1 -- 172.21.15.100:0/1703676399 wait complete. 2024-09-13T02:55:06.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 -- 172.21.15.100:0/30592649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fc520 msgr2=0x7fa66c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 --2- 172.21.15.100:0/30592649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fc520 0x7fa66c0fc930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0048d0 tx=0x7fa65c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 -- 172.21.15.100:0/30592649 shutdown_connections 2024-09-13T02:55:06.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 --2- 172.21.15.100:0/30592649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 --2- 172.21.15.100:0/30592649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fc520 0x7fa66c0fc930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 -- 172.21.15.100:0/30592649 >> 172.21.15.100:0/30592649 conn(0x7fa66c0f7ce0 msgr2=0x7fa66c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 -- 172.21.15.100:0/30592649 shutdown_connections 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.108+0000 7fa671fb7640 1 -- 172.21.15.100:0/30592649 wait complete. 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 Processor -- start 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 -- start start 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 0x7fa66c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c10dc40 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa671fb7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c10e460 con 0x7fa66c0fc520 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39002/0 (socket says 172.21.15.100:39002) 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 -- 172.21.15.100:0/1248923605 learned_addr learned my addr 172.21.15.100:0/1248923605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:06.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa66b7fe640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 0x7fa66c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 -- 172.21.15.100:0/1248923605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 msgr2=0x7fa66c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 0x7fa66c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 -- 172.21.15.100:0/1248923605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c005040 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa66b7fe640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 0x7fa66c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.109+0000 7fa663fff640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa654002a50 tx=0x7fa654004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.110+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa654007c30 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.110+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa65400f040 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.110+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c10e6f0 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.110+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65400da90 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.110+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c10ec90 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.111+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0fb980 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.111+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa65400dd00 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.112+0000 7fa668ff9640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 0x7fa6580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.112+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa65408daf0 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.112+0000 7fa66b7fe640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 0x7fa6580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.112+0000 7fa66b7fe640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 0x7fa6580709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007ac0 tx=0x7fa65c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.116+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa654056b60 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.358+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa66c10ef50 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.358+0000 7fa668ff9640 1 -- 172.21.15.100:0/1248923605 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7fa65405a220 con 0x7fa66c0fd7f0 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 45/360 objects degraded (12.500%), 12 pgs degraded 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout: osd.2 (root=default,host=smithi100) is down 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/360 objects degraded (12.500%), 12 pgs degraded 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T02:55:06.360 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T02:55:06.361 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 msgr2=0x7fa6580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 0x7fa6580709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007ac0 tx=0x7fa65c035040 comp rx=0 tx=0).stop 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 msgr2=0x7fa66c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa654002a50 tx=0x7fa654004600 comp rx=0 tx=0).stop 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 shutdown_connections 2024-09-13T02:55:06.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa65806e530 0x7fa6580709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa66c0fd7f0 0x7fa66c10d5f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 --2- 172.21.15.100:0/1248923605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa66c0fc520 0x7fa66c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.360+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 >> 172.21.15.100:0/1248923605 conn(0x7fa66c0f7ce0 msgr2=0x7fa66c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.361+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 shutdown_connections 2024-09-13T02:55:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:06.361+0000 7fa671fb7640 1 -- 172.21.15.100:0/1248923605 wait complete. 2024-09-13T02:55:06.676 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:06 smithi100 podman[111784]: 2024-09-13 02:55:06.548935941 +0000 UTC m=+0.657399924 container remove d828b3e47672ca9ea3d03318d7c3e36ebb7f4559d4b20c4d6792cda0b4f0fae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T02:55:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:06 smithi100 ceph-mon[92340]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:06 smithi100 ceph-mon[92340]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:06 smithi100 ceph-mon[92340]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:06 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1572941863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:06.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:06 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/441556946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:06 smithi122 ceph-mon[79680]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:06 smithi122 ceph-mon[79680]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:06 smithi122 ceph-mon[79680]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:06 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1572941863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:06 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/441556946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:07.045 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:06 smithi100 podman[111869]: 2024-09-13 02:55:06.656838468 +0000 UTC m=+0.016779926 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:07.045 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:06 smithi100 podman[111869]: 2024-09-13 02:55:06.808561419 +0000 UTC m=+0.168502866 container create 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T02:55:07.045 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:07 smithi100 podman[111869]: 2024-09-13 02:55:07.044250579 +0000 UTC m=+0.404192027 container init 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:07.311 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:07 smithi100 podman[111869]: 2024-09-13 02:55:07.047380347 +0000 UTC m=+0.407321794 container start 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T02:55:07.311 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-osd[111888]: -- 172.21.15.100:0/1165891015 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b3060a1e0 con 0x564b2f990000 2024-09-13T02:55:07.311 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:07 smithi100 bash[111869]: 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e 2024-09-13T02:55:07.311 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:07 smithi100 systemd[1]: Started Ceph osd.2 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:55:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 45/360 objects degraded (12.500%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1248923605' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 45/360 objects degraded (12.500%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1248923605' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:07.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:09.316 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:08 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T02:55:08.936+0000 7fe5e959f640 -1 Falling back to public interface 2024-09-13T02:55:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:09 smithi100 ceph-mon[92340]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:09 smithi122 ceph-mon[79680]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:11 smithi100 ceph-mon[92340]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:11 smithi122 ceph-mon[79680]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:13.619 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:13 smithi100 ceph-mon[92340]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:13.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:13 smithi122 ceph-mon[79680]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:13.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:14.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:14 smithi100 ceph-mon[92340]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:55:14.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:14.556 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:14.556 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:14 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T02:55:14.274+0000 7fe5e959f640 -1 osd.2 57 log_to_monitors true 2024-09-13T02:55:14.556 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 02:55:14 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T02:55:14.323+0000 7fe5e1339640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:55:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:14 smithi122 ceph-mon[79680]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:55:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:15 smithi100 ceph-mon[92340]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:15 smithi100 ceph-mon[92340]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:55:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:15 smithi100 ceph-mon[92340]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:55:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:15 smithi100 ceph-mon[92340]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:55:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:15 smithi122 ceph-mon[79680]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 45/360 objects degraded (12.500%) 2024-09-13T02:55:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:15 smithi122 ceph-mon[79680]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:55:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:15 smithi122 ceph-mon[79680]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:55:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:15 smithi122 ceph-mon[79680]: from='osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863] boot 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:16.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:55:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: osd.2 [v2:172.21.15.100:6818/1073177863,v1:172.21.15.100:6819/1073177863] boot 2024-09-13T02:55:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:16.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:17 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:17 smithi100 ceph-mon[92340]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:55:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:17 smithi100 ceph-mon[92340]: pgmap v93: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 35/360 objects degraded (9.722%) 2024-09-13T02:55:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:17 smithi100 ceph-mon[92340]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T02:55:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:17 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 35/360 objects degraded (9.722%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:17 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:17 smithi122 ceph-mon[79680]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:55:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:17 smithi122 ceph-mon[79680]: pgmap v93: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 35/360 objects degraded (9.722%) 2024-09-13T02:55:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:17 smithi122 ceph-mon[79680]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T02:55:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:17 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 35/360 objects degraded (9.722%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:19 smithi100 ceph-mon[92340]: pgmap v95: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 35/360 objects degraded (9.722%) 2024-09-13T02:55:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:19 smithi122 ceph-mon[79680]: pgmap v95: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 35/360 objects degraded (9.722%) 2024-09-13T02:55:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:20 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/360 objects degraded (9.722%), 10 pgs degraded) 2024-09-13T02:55:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:20 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:55:20.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:20 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/360 objects degraded (9.722%), 10 pgs degraded) 2024-09-13T02:55:20.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:20 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:55:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:21 smithi100 ceph-mon[92340]: pgmap v96: 65 pgs: 5 peering, 60 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:21 smithi122 ceph-mon[79680]: pgmap v96: 65 pgs: 5 peering, 60 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:23 smithi100 ceph-mon[92340]: pgmap v97: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:23 smithi122 ceph-mon[79680]: pgmap v97: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:25.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:25 smithi100 ceph-mon[92340]: pgmap v98: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:25 smithi122 ceph-mon[79680]: pgmap v98: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:27 smithi100 ceph-mon[92340]: pgmap v99: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:27 smithi122 ceph-mon[79680]: pgmap v99: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:29 smithi100 ceph-mon[92340]: pgmap v100: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:29.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:29.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:29 smithi122 ceph-mon[79680]: pgmap v100: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:31 smithi100 ceph-mon[92340]: pgmap v101: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:31 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:31 smithi122 ceph-mon[79680]: pgmap v101: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:31 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:32 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:32 smithi100 ceph-mon[92340]: Upgrade: osd.3 is safe to restart 2024-09-13T02:55:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:32 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:55:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:32 smithi122 ceph-mon[79680]: Upgrade: osd.3 is safe to restart 2024-09-13T02:55:33.573 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:33 smithi122 ceph-mon[79680]: pgmap v102: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:33.573 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:33.573 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:55:33.574 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:33 smithi100 ceph-mon[92340]: pgmap v102: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:55:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:34.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:34 smithi100 ceph-mon[92340]: Upgrade: Updating osd.3 2024-09-13T02:55:34.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:34 smithi100 ceph-mon[92340]: Deploying daemon osd.3 on smithi122 2024-09-13T02:55:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:34 smithi122 ceph-mon[79680]: Upgrade: Updating osd.3 2024-09-13T02:55:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:34 smithi122 ceph-mon[79680]: Deploying daemon osd.3 on smithi122 2024-09-13T02:55:35.621 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:35 smithi122 ceph-mon[79680]: pgmap v103: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:35.621 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:35 smithi122 systemd[1]: Stopping Ceph osd.3 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:55:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:35 smithi100 ceph-mon[92340]: pgmap v103: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:35.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:35 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[39946]: 2024-09-13T02:55:35.645+0000 7f1e15eb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:55:35.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:35 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[39946]: 2024-09-13T02:55:35.645+0000 7f1e15eb4640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-13T02:55:35.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:35 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[39946]: 2024-09-13T02:55:35.645+0000 7f1e15eb4640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:55:36.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 -- 172.21.15.100:0/1796587275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 msgr2=0x7f06000fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 --2- 172.21.15.100:0/1796587275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f06000fc940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0048d0 tx=0x7f05fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 -- 172.21.15.100:0/1796587275 shutdown_connections 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 --2- 172.21.15.100:0/1796587275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 0x7f06000fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 --2- 172.21.15.100:0/1796587275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f06000fc940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 -- 172.21.15.100:0/1796587275 >> 172.21.15.100:0/1796587275 conn(0x7f06000f7d10 msgr2=0x7f06000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 -- 172.21.15.100:0/1796587275 shutdown_connections 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.458+0000 7f0607b48640 1 -- 172.21.15.100:0/1796587275 wait complete. 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 Processor -- start 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 -- start start 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 0x7f060006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060006fff0 con 0x7f06000fc530 2024-09-13T02:55:36.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f0607b48640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600070130 con 0x7f06000fd800 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60750/0 (socket says 172.21.15.100:60750) 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 -- 172.21.15.100:0/1001185280 learned_addr learned my addr 172.21.15.100:0/1001185280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06050e3640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 0x7f060006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 -- 172.21.15.100:0/1001185280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 msgr2=0x7f060006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 0x7f060006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 -- 172.21.15.100:0/1001185280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc005040 con 0x7f06000fc530 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.459+0000 7f06058e4640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0043d0 tx=0x7f05fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.460+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05fc038070 con 0x7f06000fc530 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.460+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05fc02ae90 con 0x7f06000fc530 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.460+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000703b0 con 0x7f06000fc530 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.460+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05fc03e670 con 0x7f06000fc530 2024-09-13T02:55:36.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.460+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06000708d0 con 0x7f06000fc530 2024-09-13T02:55:36.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.461+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06000fb990 con 0x7f06000fc530 2024-09-13T02:55:36.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.461+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f05fc030020 con 0x7f06000fc530 2024-09-13T02:55:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.462+0000 7f05f67fc640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 0x7f05ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.462+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f05fc0ae1a0 con 0x7f06000fc530 2024-09-13T02:55:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.462+0000 7f06050e3640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 0x7f05ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.462+0000 7f06050e3640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 0x7f05ec0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009fd0 tx=0x7f05f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.466+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f05fc077340 con 0x7f06000fc530 2024-09-13T02:55:36.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.649+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06000708d0 con 0x7f05ec06e530 2024-09-13T02:55:36.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.650+0000 7f05f67fc640 1 -- 172.21.15.100:0/1001185280 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f06000708d0 con 0x7f05ec06e530 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 msgr2=0x7f05ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 0x7f05ec0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009fd0 tx=0x7f05f000b040 comp rx=0 tx=0).stop 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 msgr2=0x7f0600071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0043d0 tx=0x7f05fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 shutdown_connections 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f05ec06e530 0x7f05ec0709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06000fd800 0x7f060006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 --2- 172.21.15.100:0/1001185280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06000fc530 0x7f0600071570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 >> 172.21.15.100:0/1001185280 conn(0x7f06000f7d10 msgr2=0x7f06000f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:36.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.652+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 shutdown_connections 2024-09-13T02:55:36.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.653+0000 7f0607b48640 1 -- 172.21.15.100:0/1001185280 wait complete. 2024-09-13T02:55:36.662 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:55:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:36 smithi100 ceph-mon[92340]: osd.3 marked itself down and dead 2024-09-13T02:55:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:36 smithi122 ceph-mon[79680]: osd.3 marked itself down and dead 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 -- 172.21.15.100:0/1122949799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 msgr2=0x7feff80fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 --2- 172.21.15.100:0/1122949799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff80fdfc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fefe80048d0 tx=0x7fefe8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 -- 172.21.15.100:0/1122949799 shutdown_connections 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 --2- 172.21.15.100:0/1122949799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 0x7feff80fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 --2- 172.21.15.100:0/1122949799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff80fdfc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 -- 172.21.15.100:0/1122949799 >> 172.21.15.100:0/1122949799 conn(0x7feff80f63b0 msgr2=0x7feff80f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 -- 172.21.15.100:0/1122949799 shutdown_connections 2024-09-13T02:55:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.732+0000 7feffd707640 1 -- 172.21.15.100:0/1122949799 wait complete. 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 Processor -- start 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 -- start start 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 0x7feff810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff810dc30 con 0x7feff80fdbb0 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feffd707640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff810e450 con 0x7feff80fe500 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60762/0 (socket says 172.21.15.100:60762) 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 -- 172.21.15.100:0/2991456645 learned_addr learned my addr 172.21.15.100:0/2991456645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff67fc640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 0x7feff810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 -- 172.21.15.100:0/2991456645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 msgr2=0x7feff810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 0x7feff810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.733+0000 7feff6ffd640 1 -- 172.21.15.100:0/2991456645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8005040 con 0x7feff80fdbb0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7feff6ffd640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fefe80043d0 tx=0x7fefe8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe8038070 con 0x7feff80fdbb0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefe802ae90 con 0x7feff80fdbb0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe803e670 con 0x7feff80fdbb0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff810e680 con 0x7feff80fdbb0 2024-09-13T02:55:36.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.734+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff810ec20 con 0x7feff80fdbb0 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.735+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff80fa050 con 0x7feff80fdbb0 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.735+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fefe8030020 con 0x7feff80fdbb0 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.736+0000 7fefdf7fe640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 0x7fefe00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.736+0000 7feff67fc640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 0x7fefe00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.736+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fefe80ae3e0 con 0x7feff80fdbb0 2024-09-13T02:55:36.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.736+0000 7feff67fc640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 0x7fefe00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feff810ce50 tx=0x7fefec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:36.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.740+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fefe80774d0 con 0x7feff80fdbb0 2024-09-13T02:55:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.924+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feff810ef50 con 0x7fefe006e530 2024-09-13T02:55:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.925+0000 7fefdf7fe640 1 -- 172.21.15.100:0/2991456645 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7feff810ef50 con 0x7fefe006e530 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 msgr2=0x7fefe00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 0x7fefe00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feff810ce50 tx=0x7fefec00b040 comp rx=0 tx=0).stop 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 msgr2=0x7feff810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fefe80043d0 tx=0x7fefe8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 shutdown_connections 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fefe006e530 0x7fefe00709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feff80fe500 0x7feff810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 --2- 172.21.15.100:0/2991456645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff80fdbb0 0x7feff810d0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 >> 172.21.15.100:0/2991456645 conn(0x7feff80f63b0 msgr2=0x7feff80f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 shutdown_connections 2024-09-13T02:55:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:36.927+0000 7feffd707640 1 -- 172.21.15.100:0/2991456645 wait complete. 2024-09-13T02:55:37.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 -- 172.21.15.100:0/2348774222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fc520 msgr2=0x7ff81c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 --2- 172.21.15.100:0/2348774222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fc520 0x7ff81c0fc930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8040048d0 tx=0x7ff804009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 -- 172.21.15.100:0/2348774222 shutdown_connections 2024-09-13T02:55:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 --2- 172.21.15.100:0/2348774222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 --2- 172.21.15.100:0/2348774222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fc520 0x7ff81c0fc930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.005+0000 7ff82121a640 1 -- 172.21.15.100:0/2348774222 >> 172.21.15.100:0/2348774222 conn(0x7ff81c0f7ce0 msgr2=0x7ff81c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.006+0000 7ff82121a640 1 -- 172.21.15.100:0/2348774222 shutdown_connections 2024-09-13T02:55:37.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.006+0000 7ff82121a640 1 -- 172.21.15.100:0/2348774222 wait complete. 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.006+0000 7ff82121a640 1 Processor -- start 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.006+0000 7ff82121a640 1 -- start start 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff82121a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff82121a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff82121a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c10dc10 con 0x7ff81c0fd7f0 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff82121a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c10e430 con 0x7ff81c0fc520 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:38964/0 (socket says 172.21.15.100:38964) 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60770/0 (socket says 172.21.15.100:60770) 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 -- 172.21.15.100:0/2575313922 learned_addr learned my addr 172.21.15.100:0/2575313922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 -- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 msgr2=0x7ff81c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 -- 172.21.15.100:0/2575313922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804005040 con 0x7ff81c0fc520 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81a59c640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.007+0000 7ff81ad9d640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8040043d0 tx=0x7ff804009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.008+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff804038070 con 0x7ff81c0fc520 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.008+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff80402ae90 con 0x7ff81c0fc520 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.008+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff80403e670 con 0x7ff81c0fc520 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.008+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81c10e660 con 0x7ff81c0fc520 2024-09-13T02:55:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.008+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81c10eb30 con 0x7ff81c0fc520 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.009+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81c0fb980 con 0x7ff81c0fc520 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.010+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff804030020 con 0x7ff81c0fc520 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.010+0000 7ff8137fe640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 0x7ff8080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.010+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff8040ae430 con 0x7ff81c0fc520 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.010+0000 7ff81a59c640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 0x7ff8080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.011+0000 7ff81a59c640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 0x7ff8080709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff81c10ce30 tx=0x7ff80c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.014+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff8040775d0 con 0x7ff81c0fc520 2024-09-13T02:55:37.127 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:36 smithi122 podman[88313]: 2024-09-13 02:55:36.808399281 +0000 UTC m=+1.288569700 container died 054579f81acfafb56dc7e66e97f826423281ddf9425cb4a38b9d8800efe35338 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T02:55:37.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.188+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff81c10ef50 con 0x7ff80806e530 2024-09-13T02:55:37.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.197+0000 7ff8137fe640 1 -- 172.21.15.100:0/2575313922 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff81c10ef50 con 0x7ff80806e530 2024-09-13T02:55:37.198 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 24s ago 12m 25.5M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (2m) 24s ago 12m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (2m) 116s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 24s ago 12m 79.2M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (7m) 24s ago 7m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (7m) 24s ago 7m 13.6M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (7m) 116s ago 7m 16.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (7m) 116s ago 7m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (3m) 24s ago 13m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (3m) 116s ago 11m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (2m) 24s ago 14m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:55:37.199 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (2m) 116s ago 11m 34.3M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 24s ago 12m 17.0M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (3m) 116s ago 11m 16.8M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (100s) 24s ago 11m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (65s) 24s ago 10m 93.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (30s) 24s ago 10m 14.3M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (9m) 116s ago 9m 259M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 054579f81acf 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (9m) 116s ago 9m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (8m) 116s ago 8m 224M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:55:37.200 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (3m) 24s ago 12m 60.5M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 msgr2=0x7ff8080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 0x7ff8080709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff81c10ce30 tx=0x7ff80c00b040 comp rx=0 tx=0).stop 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 msgr2=0x7ff81c10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8040043d0 tx=0x7ff804009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 shutdown_connections 2024-09-13T02:55:37.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff80806e530 0x7ff8080709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff81c0fd7f0 0x7ff81c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 --2- 172.21.15.100:0/2575313922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff81c0fc520 0x7ff81c10d080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 >> 172.21.15.100:0/2575313922 conn(0x7ff81c0f7ce0 msgr2=0x7ff81c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 shutdown_connections 2024-09-13T02:55:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.199+0000 7ff82121a640 1 -- 172.21.15.100:0/2575313922 wait complete. 2024-09-13T02:55:37.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 -- 172.21.15.100:0/2177472705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 msgr2=0x7f56a80fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 --2- 172.21.15.100:0/2177472705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fa660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56a40048d0 tx=0x7f56a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 -- 172.21.15.100:0/2177472705 shutdown_connections 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 --2- 172.21.15.100:0/2177472705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fa660 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 --2- 172.21.15.100:0/2177472705 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 0x7f56a80fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 -- 172.21.15.100:0/2177472705 >> 172.21.15.100:0/2177472705 conn(0x7f56a80f63b0 msgr2=0x7f56a80f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 -- 172.21.15.100:0/2177472705 shutdown_connections 2024-09-13T02:55:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.276+0000 7f56b069a640 1 -- 172.21.15.100:0/2177472705 wait complete. 2024-09-13T02:55:37.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 Processor -- start 2024-09-13T02:55:37.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 -- start start 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 0x7f56a80fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80fbe20 con 0x7f56a80fe500 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56b069a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80fbf60 con 0x7f56a80fdbb0 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60790/0 (socket says 172.21.15.100:60790) 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 -- 172.21.15.100:0/1118317143 learned_addr learned my addr 172.21.15.100:0/1118317143 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56ae436640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 0x7f56a80fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 -- 172.21.15.100:0/1118317143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 msgr2=0x7f56a80fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 0x7f56a80fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 -- 172.21.15.100:0/1118317143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4005040 con 0x7f56a80fe500 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.277+0000 7f56adc35640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56a40043d0 tx=0x7f56a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.278+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a4038070 con 0x7f56a80fe500 2024-09-13T02:55:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.278+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56a402ae90 con 0x7f56a80fe500 2024-09-13T02:55:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.278+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a80fc1e0 con 0x7f56a80fe500 2024-09-13T02:55:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.278+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a403e670 con 0x7f56a80fe500 2024-09-13T02:55:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.278+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a8115100 con 0x7f56a80fe500 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.279+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a80fa050 con 0x7f56a80fe500 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.279+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f56a4030020 con 0x7f56a80fe500 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.280+0000 7f569effd640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 0x7f56940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.280+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f56a40ae2f0 con 0x7f56a80fe500 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.280+0000 7f56ae436640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 0x7f56940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.280+0000 7f56ae436640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 0x7f56940709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56a80fd150 tx=0x7f569800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.284+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f56a4077490 con 0x7f56a80fe500 2024-09-13T02:55:37.419 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:37 smithi122 podman[88313]: 2024-09-13 02:55:37.334463978 +0000 UTC m=+1.814634399 container cleanup 054579f81acfafb56dc7e66e97f826423281ddf9425cb4a38b9d8800efe35338 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-bbdadfa, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T02:55:37.420 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:37 smithi122 bash[88313]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3 2024-09-13T02:55:37.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.534+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56a8115290 con 0x7f56a80fe500 2024-09-13T02:55:37.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:37 smithi100 ceph-mon[92340]: pgmap v104: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:37.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:37 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:55:37.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:37 smithi100 ceph-mon[92340]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T02:55:37.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.535+0000 7f569effd640 1 -- 172.21.15.100:0/1118317143 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f56a407ab50 con 0x7f56a80fe500 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T02:55:37.537 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6, 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 7 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:55:37.538 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 msgr2=0x7f56940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 0x7f56940709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56a80fd150 tx=0x7f569800b040 comp rx=0 tx=0).stop 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 msgr2=0x7f56a80fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56a40043d0 tx=0x7f56a4009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 shutdown_connections 2024-09-13T02:55:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f569406e530 0x7f56940709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56a80fe500 0x7f56a80fb890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 --2- 172.21.15.100:0/1118317143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56a80fdbb0 0x7f56a80fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.537+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 >> 172.21.15.100:0/1118317143 conn(0x7f56a80f63b0 msgr2=0x7f56a80f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.538+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 shutdown_connections 2024-09-13T02:55:37.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.538+0000 7f56b069a640 1 -- 172.21.15.100:0/1118317143 wait complete. 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.615+0000 7ff49ea43640 1 -- 172.21.15.100:0/3578928038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4980ff680 msgr2=0x7ff498101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.615+0000 7ff49ea43640 1 --2- 172.21.15.100:0/3578928038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4980ff680 0x7ff498101a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0048d0 tx=0x7ff48c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 -- 172.21.15.100:0/3578928038 shutdown_connections 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 --2- 172.21.15.100:0/3578928038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4980ff680 0x7ff498101a60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 --2- 172.21.15.100:0/3578928038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff498065c40 0x7ff4980ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 -- 172.21.15.100:0/3578928038 >> 172.21.15.100:0/3578928038 conn(0x7ff4980f6c10 msgr2=0x7ff4980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 -- 172.21.15.100:0/3578928038 shutdown_connections 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 -- 172.21.15.100:0/3578928038 wait complete. 2024-09-13T02:55:37.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 Processor -- start 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 -- start start 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.616+0000 7ff49ea43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff49ea43640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4980ff680 0x7ff49810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff49ea43640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49810dc00 con 0x7ff498065c40 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff49ea43640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49810e420 con 0x7ff4980ff680 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60816/0 (socket says 172.21.15.100:60816) 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 -- 172.21.15.100:0/2049063569 learned_addr learned my addr 172.21.15.100:0/2049063569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff4977fe640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4980ff680 0x7ff49810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 -- 172.21.15.100:0/2049063569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4980ff680 msgr2=0x7ff49810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4980ff680 0x7ff49810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 -- 172.21.15.100:0/2049063569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c005040 con 0x7ff498065c40 2024-09-13T02:55:37.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff497fff640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff488002840 tx=0x7ff488004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff488007c30 con 0x7ff498065c40 2024-09-13T02:55:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff48800f040 con 0x7ff498065c40 2024-09-13T02:55:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49810e6b0 con 0x7ff498065c40 2024-09-13T02:55:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48800d990 con 0x7ff498065c40 2024-09-13T02:55:37.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.617+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49810ec50 con 0x7ff498065c40 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.618+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980fa890 con 0x7ff498065c40 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.619+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff488009600 con 0x7ff498065c40 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.619+0000 7ff494ff9640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 0x7ff4800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.620+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff48808ded0 con 0x7ff498065c40 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.620+0000 7ff4977fe640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 0x7ff4800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.620+0000 7ff4977fe640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 0x7ff4800709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff49810ce20 tx=0x7ff48c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.624+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff488057040 con 0x7ff498065c40 2024-09-13T02:55:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:37 smithi122 ceph-mon[79680]: pgmap v104: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:37 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:55:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:37 smithi122 ceph-mon[79680]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T02:55:37.687 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:37 smithi122 podman[88340]: 2024-09-13 02:55:37.544607223 +0000 UTC m=+0.734074342 container remove 054579f81acfafb56dc7e66e97f826423281ddf9425cb4a38b9d8800efe35338 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa) 2024-09-13T02:55:37.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.826+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff49804b720 con 0x7ff498065c40 2024-09-13T02:55:37.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.826+0000 7ff494ff9640 1 -- 172.21.15.100:0/2049063569 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1947 (secure 0 0 0) 0x7ff48805a700 con 0x7ff498065c40 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:e20 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:54:38:305822+0000 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:37.828 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 20 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:54:37.621540+0000 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:55:37.829 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:55:37.830 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 24259,14470 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:37.831 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 msgr2=0x7ff4800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 0x7ff4800709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff49810ce20 tx=0x7ff48c035040 comp rx=0 tx=0).stop 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 msgr2=0x7ff49810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff488002840 tx=0x7ff488004570 comp rx=0 tx=0).stop 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 shutdown_connections 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff48006e530 0x7ff4800709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4980ff680 0x7ff49810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 --2- 172.21.15.100:0/2049063569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff498065c40 0x7ff49810d070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 >> 172.21.15.100:0/2049063569 conn(0x7ff4980f6c10 msgr2=0x7ff4980f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 shutdown_connections 2024-09-13T02:55:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.828+0000 7ff49ea43640 1 -- 172.21.15.100:0/2049063569 wait complete. 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- 172.21.15.100:0/224044154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 msgr2=0x7f19100fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 --2- 172.21.15.100:0/224044154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f19100fdc60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f19040048d0 tx=0x7f1904009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- 172.21.15.100:0/224044154 shutdown_connections 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 --2- 172.21.15.100:0/224044154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f19100fdc60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 --2- 172.21.15.100:0/224044154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 0x7f19100fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- 172.21.15.100:0/224044154 >> 172.21.15.100:0/224044154 conn(0x7f19100f7ce0 msgr2=0x7f19100fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- 172.21.15.100:0/224044154 shutdown_connections 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- 172.21.15.100:0/224044154 wait complete. 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 Processor -- start 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 -- start start 2024-09-13T02:55:37.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 0x7f191010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.908+0000 7f1917ca8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1917ca8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010e490 con 0x7f19100fd7f0 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1917ca8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010e600 con 0x7f19100fc520 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60820/0 (socket says 172.21.15.100:60820) 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 -- 172.21.15.100:0/743489891 learned_addr learned my addr 172.21.15.100:0/743489891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915a44640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 0x7f191010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 -- 172.21.15.100:0/743489891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 msgr2=0x7f191010d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 0x7f191010d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 -- 172.21.15.100:0/743489891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904005040 con 0x7f19100fd7f0 2024-09-13T02:55:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1915243640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1904003080 tx=0x7f1904009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1904038070 con 0x7f19100fd7f0 2024-09-13T02:55:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f190402abd0 con 0x7f19100fd7f0 2024-09-13T02:55:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191010e880 con 0x7f19100fd7f0 2024-09-13T02:55:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190403e670 con 0x7f19100fd7f0 2024-09-13T02:55:37.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.909+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191010eda0 con 0x7f19100fd7f0 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.910+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19100fb980 con 0x7f19100fd7f0 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.911+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1904030020 con 0x7f19100fd7f0 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.911+0000 7f190e7fc640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.911+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f19040ae3f0 con 0x7f19100fd7f0 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.911+0000 7f1915a44640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:37.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.912+0000 7f1915a44640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 0x7f18f80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908009b50 tx=0x7f1908009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:37.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:37.916+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1904077610 con 0x7f19100fd7f0 2024-09-13T02:55:38.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.102+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1910105110 con 0x7f18f806e530 2024-09-13T02:55:38.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.103+0000 7f190e7fc640 1 -- 172.21.15.100:0/743489891 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1910105110 con 0x7f18f806e530 2024-09-13T02:55:38.104 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "9/21 daemons upgraded", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:55:38.105 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 msgr2=0x7f18f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 0x7f18f80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1908009b50 tx=0x7f1908009120 comp rx=0 tx=0).stop 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 msgr2=0x7f191010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1904003080 tx=0x7f1904009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 shutdown_connections 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f18f806e530 0x7f18f80709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19100fd7f0 0x7f191010d620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 --2- 172.21.15.100:0/743489891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f19100fc520 0x7f191010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 >> 172.21.15.100:0/743489891 conn(0x7f19100f7ce0 msgr2=0x7f19100f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 shutdown_connections 2024-09-13T02:55:38.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.105+0000 7f1917ca8640 1 -- 172.21.15.100:0/743489891 wait complete. 2024-09-13T02:55:38.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 -- 172.21.15.100:0/3297242556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 msgr2=0x7fd2040fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3297242556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd2040fb840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80048d0 tx=0x7fd1f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 -- 172.21.15.100:0/3297242556 shutdown_connections 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3297242556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd2040fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3297242556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd2040fb840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 -- 172.21.15.100:0/3297242556 >> 172.21.15.100:0/3297242556 conn(0x7fd2040f6c10 msgr2=0x7fd2040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.184+0000 7fd20abeb640 1 -- 172.21.15.100:0/3297242556 shutdown_connections 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 -- 172.21.15.100:0/3297242556 wait complete. 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 Processor -- start 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 -- start start 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:38.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd204112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204065c60 con 0x7fd2040fb430 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd20abeb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204065dd0 con 0x7fd2040fc700 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd208987640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd208987640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60844/0 (socket says 172.21.15.100:60844) 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.185+0000 7fd208987640 1 -- 172.21.15.100:0/3944309664 learned_addr learned my addr 172.21.15.100:0/3944309664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd203fff640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd204112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd208987640 1 -- 172.21.15.100:0/3944309664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 msgr2=0x7fd204112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd208987640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd204112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd208987640 1 -- 172.21.15.100:0/3944309664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f8005040 con 0x7fd2040fb430 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd203fff640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd204112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd208987640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80048a0 tx=0x7fd1f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f8038070 con 0x7fd2040fb430 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd204112850 con 0x7fd2040fb430 2024-09-13T02:55:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1f8004290 con 0x7fd2040fb430 2024-09-13T02:55:38.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f8033660 con 0x7fd2040fb430 2024-09-13T02:55:38.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.186+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204112dc0 con 0x7fd2040fb430 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.187+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2040fa890 con 0x7fd2040fb430 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.188+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd1f8030020 con 0x7fd2040fb430 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.188+0000 7fd2017fa640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 0x7fd1f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.188+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1f80ae280 con 0x7fd2040fb430 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.188+0000 7fd203fff640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 0x7fd1f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:38.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.189+0000 7fd203fff640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 0x7fd1f40709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0004fd0 tx=0x7fd1f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.192+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd1f8077420 con 0x7fd2040fb430 2024-09-13T02:55:38.273 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:37 smithi122 podman[88431]: 2024-09-13 02:55:37.845017863 +0000 UTC m=+0.015643548 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:38.273 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:37 smithi122 podman[88431]: 2024-09-13 02:55:37.945415876 +0000 UTC m=+0.116041602 container create fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T02:55:38.273 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 podman[88431]: 2024-09-13 02:55:38.172856275 +0000 UTC m=+0.343481960 container init fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:55:38.274 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 podman[88431]: 2024-09-13 02:55:38.176359134 +0000 UTC m=+0.346984823 container start fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T02:55:38.274 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 podman[88431]: 2024-09-13 02:55:38.272809774 +0000 UTC m=+0.443435475 container attach fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:38.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.424+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd20404b720 con 0x7fd2040fb430 2024-09-13T02:55:38.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.427+0000 7fd2017fa640 1 -- 172.21.15.100:0/3944309664 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fd1f802c870 con 0x7fd2040fb430 2024-09-13T02:55:38.429 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down 2024-09-13T02:55:38.429 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:55:38.429 INFO:teuthology.orchestra.run.smithi100.stdout: osd.3 (root=default,host=smithi122) is down 2024-09-13T02:55:38.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 msgr2=0x7fd1f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 0x7fd1f40709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0004fd0 tx=0x7fd1f000b040 comp rx=0 tx=0).stop 2024-09-13T02:55:38.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 msgr2=0x7fd20410fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80048a0 tx=0x7fd1f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 shutdown_connections 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd1f406e530 0x7fd1f40709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2040fc700 0x7fd204112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 --2- 172.21.15.100:0/3944309664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2040fb430 0x7fd20410fdc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 >> 172.21.15.100:0/3944309664 conn(0x7fd2040f6c10 msgr2=0x7fd2040f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 shutdown_connections 2024-09-13T02:55:38.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:55:38.429+0000 7fd20abeb640 1 -- 172.21.15.100:0/3944309664 wait complete. 2024-09-13T02:55:38.660 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 podman[88431]: 2024-09-13 02:55:38.36526069 +0000 UTC m=+0.535886376 container died fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T02:55:38.660 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: from='client.44185 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T02:55:38.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1118317143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:38.661 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:38 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2049063569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:38.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: from='client.44185 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:38.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T02:55:38.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1118317143' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:38.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:38 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2049063569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:39.382 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 podman[88454]: 2024-09-13 02:55:38.943019027 +0000 UTC m=+0.567149506 container remove fdc96b9c2586a87f3a5df0a11c153475b3f90f86599bd868fe313c8b8c8966f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:39.382 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T02:55:39.382 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 systemd[1]: Stopped Ceph osd.3 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:55:39.382 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:38 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 2.752s CPU time. 2024-09-13T02:55:39.382 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 systemd[1]: Starting Ceph osd.3 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:55:39.681 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:39 smithi122 ceph-mon[79680]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:39.681 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:39 smithi122 ceph-mon[79680]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:39.681 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:39 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3944309664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:39.682 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 podman[88554]: 2024-09-13 02:55:39.282477713 +0000 UTC m=+0.015325190 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:39.682 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 podman[88554]: 2024-09-13 02:55:39.411385487 +0000 UTC m=+0.144232954 container create caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:55:39.682 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 podman[88554]: 2024-09-13 02:55:39.680554251 +0000 UTC m=+0.413401720 container init caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:39 smithi100 ceph-mon[92340]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:39 smithi100 ceph-mon[92340]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:39 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3944309664' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:39.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 podman[88554]: 2024-09-13 02:55:39.684105067 +0000 UTC m=+0.416952530 container start caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T02:55:39.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 podman[88554]: 2024-09-13 02:55:39.755311639 +0000 UTC m=+0.488159112 container attach caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:39.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:39.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 bash[88554]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:39.936 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:39.937 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:39 smithi122 bash[88554]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:55:40.828 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:40 smithi100 ceph-mon[92340]: pgmap v108: 65 pgs: 15 active+undersized, 3 stale+active+clean, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 65/360 objects degraded (18.056%) 2024-09-13T02:55:40.828 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:40 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 65/360 objects degraded (18.056%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:40.832 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-mon[79680]: pgmap v108: 65 pgs: 15 active+undersized, 3 stale+active+clean, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 65/360 objects degraded (18.056%) 2024-09-13T02:55:40.832 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 65/360 objects degraded (18.056%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:40.832 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:55:40.832 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:55:40.833 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:55:40.833 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:55:41.186 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate[88569]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:55:41.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 bash[88554]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:55:41.188 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:40 smithi122 podman[88554]: 2024-09-13 02:55:40.859772782 +0000 UTC m=+1.592620258 container died caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T02:55:41.840 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:41 smithi122 podman[88714]: 2024-09-13 02:55:41.517548549 +0000 UTC m=+0.651437380 container remove caae5fc55aae51d9ad5b2943ed3a4834fd944945e1f915e3eb540a35c4860fb4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T02:55:41.840 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:41 smithi122 podman[88775]: 2024-09-13 02:55:41.726686697 +0000 UTC m=+0.112329686 container create 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:55:41.840 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:41 smithi122 podman[88775]: 2024-09-13 02:55:41.630245462 +0000 UTC m=+0.015888457 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:55:42.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:41 smithi122 podman[88775]: 2024-09-13 02:55:41.929400009 +0000 UTC m=+0.315042996 container init 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f) 2024-09-13T02:55:42.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:41 smithi122 podman[88775]: 2024-09-13 02:55:41.932683918 +0000 UTC m=+0.318326905 container start 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:55:42.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:42 smithi122 ceph-osd[88794]: -- 172.21.15.122:0/525016501 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf05d5a1e0 con 0x55bf05cf0000 2024-09-13T02:55:42.686 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:42 smithi122 bash[88775]: 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 2024-09-13T02:55:42.687 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:42 smithi122 systemd[1]: Started Ceph osd.3 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:55:43.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:43.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:43.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:43 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:43.505 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:43 smithi100 ceph-mon[92340]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:43.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:43.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:43.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:43 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:43.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:43 smithi122 ceph-mon[79680]: pgmap v109: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:44.186 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:43 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T02:55:43.887+0000 7fda475b7640 -1 Falling back to public interface 2024-09-13T02:55:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:45 smithi100 ceph-mon[92340]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:45.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:45.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:45.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:45 smithi122 ceph-mon[79680]: pgmap v110: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:46.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:46.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:46.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:46 smithi100 ceph-mon[92340]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:46.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:46.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:46.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:46 smithi122 ceph-mon[79680]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:48.290 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:48 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:48.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:48 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T02:55:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:49.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:55:49.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:49.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:49.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:55:50.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:50 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:55:50.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:50 smithi100 ceph-mon[92340]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:55:50.436 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:50 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T02:55:50.056+0000 7fda475b7640 -1 osd.3 62 log_to_monitors true 2024-09-13T02:55:50.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:50 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:55:50.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:50 smithi122 ceph-mon[79680]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:55:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:51 smithi100 ceph-mon[92340]: from='osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:55:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:51 smithi100 ceph-mon[92340]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:55:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:51 smithi100 ceph-mon[92340]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:51.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:51 smithi122 ceph-mon[79680]: from='osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:55:51.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:51 smithi122 ceph-mon[79680]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:55:51.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:51 smithi122 ceph-mon[79680]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:52.314 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:52 smithi100 ceph-mon[92340]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:55:52.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:52 smithi100 ceph-mon[92340]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:55:52.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:52 smithi100 ceph-mon[92340]: from='osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:55:52.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:52 smithi100 ceph-mon[92340]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:55:52.315 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:52 smithi100 ceph-mon[92340]: from='osd.3 ' entity='osd.3' 2024-09-13T02:55:52.436 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 02:55:51 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T02:55:51.939+0000 7fda3b349640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:55:52.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:52 smithi122 ceph-mon[79680]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:55:52.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:52 smithi122 ceph-mon[79680]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:55:52.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:52 smithi122 ceph-mon[79680]: from='osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:55:52.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:52 smithi122 ceph-mon[79680]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:55:52.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:52 smithi122 ceph-mon[79680]: from='osd.3 ' entity='osd.3' 2024-09-13T02:55:53.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:53 smithi100 ceph-mon[92340]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:53.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:53 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:55:53.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:53 smithi100 ceph-mon[92340]: osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862] boot 2024-09-13T02:55:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:53 smithi100 ceph-mon[92340]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T02:55:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:53 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:55:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:53 smithi122 ceph-mon[79680]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:53 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:55:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:53 smithi122 ceph-mon[79680]: osd.3 [v2:172.21.15.122:6800/1851521862,v1:172.21.15.122:6801/1851521862] boot 2024-09-13T02:55:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:53 smithi122 ceph-mon[79680]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T02:55:53.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:53 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:55:55.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:54 smithi100 ceph-mon[92340]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T02:55:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:54 smithi100 ceph-mon[92340]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:55.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:54 smithi122 ceph-mon[79680]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T02:55:55.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:54 smithi122 ceph-mon[79680]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/360 objects degraded (20.278%) 2024-09-13T02:55:56.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:56 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded) 2024-09-13T02:55:56.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:56 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:55:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:56 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 73/360 objects degraded (20.278%), 19 pgs degraded) 2024-09-13T02:55:56.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:56 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:55:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:57 smithi100 ceph-mon[92340]: pgmap v119: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:57 smithi122 ceph-mon[79680]: pgmap v119: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:59 smithi100 ceph-mon[92340]: pgmap v120: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:55:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:59 smithi122 ceph-mon[79680]: pgmap v120: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:55:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:55:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:55:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:01 smithi100 ceph-mon[92340]: pgmap v121: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:01 smithi122 ceph-mon[79680]: pgmap v121: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:03 smithi100 ceph-mon[92340]: pgmap v122: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:03 smithi122 ceph-mon[79680]: pgmap v122: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:04.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:56:04.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:04.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:56:04.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:56:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: Upgrade: osd.4 is safe to restart 2024-09-13T02:56:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: pgmap v123: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:56:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: Upgrade: osd.4 is safe to restart 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: pgmap v123: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:56:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:06.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:06 smithi122 ceph-mon[79680]: Upgrade: Updating osd.4 2024-09-13T02:56:06.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:06 smithi122 ceph-mon[79680]: Deploying daemon osd.4 on smithi122 2024-09-13T02:56:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:06 smithi100 ceph-mon[92340]: Upgrade: Updating osd.4 2024-09-13T02:56:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:06 smithi100 ceph-mon[92340]: Deploying daemon osd.4 on smithi122 2024-09-13T02:56:07.512 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:07 smithi122 ceph-mon[79680]: pgmap v124: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:07 smithi100 ceph-mon[92340]: pgmap v124: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:08.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:07 smithi122 systemd[1]: Stopping Ceph osd.4 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:08.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:08 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[46576]: 2024-09-13T02:56:08.140+0000 7f59617b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:56:08.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:08 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[46576]: 2024-09-13T02:56:08.140+0000 7f59617b6640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-13T02:56:08.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:08 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[46576]: 2024-09-13T02:56:08.140+0000 7f59617b6640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.517+0000 7f8562102640 1 -- 172.21.15.100:0/4111006690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 msgr2=0x7f855c0ff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.517+0000 7f8562102640 1 --2- 172.21.15.100:0/4111006690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c0ff220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f854c0048d0 tx=0x7f854c009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.517+0000 7f8562102640 1 -- 172.21.15.100:0/4111006690 shutdown_connections 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.517+0000 7f8562102640 1 --2- 172.21.15.100:0/4111006690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 0x7f855c101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.517+0000 7f8562102640 1 --2- 172.21.15.100:0/4111006690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c0ff220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 -- 172.21.15.100:0/4111006690 >> 172.21.15.100:0/4111006690 conn(0x7f855c0f6c10 msgr2=0x7f855c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 -- 172.21.15.100:0/4111006690 shutdown_connections 2024-09-13T02:56:08.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 -- 172.21.15.100:0/4111006690 wait complete. 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 Processor -- start 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 -- start start 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.518+0000 7f8562102640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 0x7f855c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8562102640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c10dcb0 con 0x7f855c066650 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8562102640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c10e4d0 con 0x7f855c0ff760 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58008/0 (socket says 172.21.15.100:58008) 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 -- 172.21.15.100:0/3121801119 learned_addr learned my addr 172.21.15.100:0/3121801119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855affd640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 0x7f855c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 -- 172.21.15.100:0/3121801119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 msgr2=0x7f855c10d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 0x7f855c10d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 -- 172.21.15.100:0/3121801119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c005040 con 0x7f855c066650 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f855b7fe640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f854c0043d0 tx=0x7f854c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c038070 con 0x7f855c066650 2024-09-13T02:56:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f854c02ae90 con 0x7f855c066650 2024-09-13T02:56:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c10e700 con 0x7f855c066650 2024-09-13T02:56:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854c03e670 con 0x7f855c066650 2024-09-13T02:56:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.519+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c10eca0 con 0x7f855c066650 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.520+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c0fa8b0 con 0x7f855c066650 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.521+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f854c030020 con 0x7f855c066650 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.521+0000 7f8543fff640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 0x7f85440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.522+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f854c0ae280 con 0x7f855c066650 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.522+0000 7f855affd640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 0x7f85440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.522+0000 7f855affd640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 0x7f85440709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f855c10ced0 tx=0x7f855000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.526+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f854c077420 con 0x7f855c066650 2024-09-13T02:56:08.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:08 smithi100 ceph-mon[92340]: osd.4 marked itself down and dead 2024-09-13T02:56:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:08 smithi122 ceph-mon[79680]: osd.4 marked itself down and dead 2024-09-13T02:56:08.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.710+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f855c10efd0 con 0x7f854406e530 2024-09-13T02:56:08.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.712+0000 7f8543fff640 1 -- 172.21.15.100:0/3121801119 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f855c10efd0 con 0x7f854406e530 2024-09-13T02:56:08.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 msgr2=0x7f85440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 0x7f85440709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f855c10ced0 tx=0x7f855000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 msgr2=0x7f855c10d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f854c0043d0 tx=0x7f854c009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 shutdown_connections 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f854406e530 0x7f85440709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f855c0ff760 0x7f855c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 --2- 172.21.15.100:0/3121801119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f855c066650 0x7f855c10d120 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 >> 172.21.15.100:0/3121801119 conn(0x7f855c0f6c10 msgr2=0x7f855c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 shutdown_connections 2024-09-13T02:56:08.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.714+0000 7f8562102640 1 -- 172.21.15.100:0/3121801119 wait complete. 2024-09-13T02:56:08.724 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:56:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1275501606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fb450 msgr2=0x7f3a8c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1275501606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c0fb860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0048d0 tx=0x7f3a7c009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1275501606 shutdown_connections 2024-09-13T02:56:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1275501606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1275501606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c0fb860 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1275501606 >> 172.21.15.100:0/1275501606 conn(0x7f3a8c0f6c10 msgr2=0x7f3a8c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1275501606 shutdown_connections 2024-09-13T02:56:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.793+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1275501606 wait complete. 2024-09-13T02:56:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 Processor -- start 2024-09-13T02:56:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 -- start start 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c10fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0667c0 con 0x7f3a8c0fc720 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a92eb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c066930 con 0x7f3a8c0fb450 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.794+0000 7f3a8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58032/0 (socket says 172.21.15.100:58032) 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 -- 172.21.15.100:0/1492708077 learned_addr learned my addr 172.21.15.100:0/1492708077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a90c52640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c10fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 -- 172.21.15.100:0/1492708077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fb450 msgr2=0x7f3a8c10fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c10fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 -- 172.21.15.100:0/1492708077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c005040 con 0x7f3a8c0fc720 2024-09-13T02:56:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a8bfff640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b790 tx=0x7f3a800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a8000c700 con 0x7f3a8c0fc720 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a8000cd00 con 0x7f3a8c0fc720 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c112a10 con 0x7f3a8c0fc720 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a80015e80 con 0x7f3a8c0fc720 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.795+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c112f30 con 0x7f3a8c0fc720 2024-09-13T02:56:08.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.796+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c0fa8b0 con 0x7f3a8c0fc720 2024-09-13T02:56:08.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.797+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3a80012070 con 0x7f3a8c0fc720 2024-09-13T02:56:08.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.797+0000 7f3a897fa640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:08.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.798+0000 7f3a90c52640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:08.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.798+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3a8008da20 con 0x7f3a8c0fc720 2024-09-13T02:56:08.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.798+0000 7f3a90c52640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 0x7f3a740709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c000c00 tx=0x7f3a7c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:08.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.802+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3a80056b90 con 0x7f3a8c0fc720 2024-09-13T02:56:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.985+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a8c100bd0 con 0x7f3a7406e530 2024-09-13T02:56:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.986+0000 7f3a897fa640 1 -- 172.21.15.100:0/1492708077 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3a8c100bd0 con 0x7f3a7406e530 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.988+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 msgr2=0x7f3a740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.988+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 0x7f3a740709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c000c00 tx=0x7f3a7c035040 comp rx=0 tx=0).stop 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.988+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 msgr2=0x7f3a8c112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.988+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b790 tx=0x7f3a800091d0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.988+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 shutdown_connections 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3a7406e530 0x7f3a740709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a8c0fc720 0x7f3a8c112410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 --2- 172.21.15.100:0/1492708077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a8c0fb450 0x7f3a8c10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 >> 172.21.15.100:0/1492708077 conn(0x7f3a8c0f6c10 msgr2=0x7f3a8c0f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 shutdown_connections 2024-09-13T02:56:08.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:08.989+0000 7f3a92eb6640 1 -- 172.21.15.100:0/1492708077 wait complete. 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 -- 172.21.15.100:0/1331893914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 msgr2=0x7f99700fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 --2- 172.21.15.100:0/1331893914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f99700fdc60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f99640048d0 tx=0x7f9964009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 -- 172.21.15.100:0/1331893914 shutdown_connections 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 --2- 172.21.15.100:0/1331893914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f99700fdc60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 --2- 172.21.15.100:0/1331893914 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 0x7f99700fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.068+0000 7f99780e6640 1 -- 172.21.15.100:0/1331893914 >> 172.21.15.100:0/1331893914 conn(0x7f99700f7ce0 msgr2=0x7f99700fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 -- 172.21.15.100:0/1331893914 shutdown_connections 2024-09-13T02:56:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 -- 172.21.15.100:0/1331893914 wait complete. 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 Processor -- start 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 -- start start 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 0x7f997010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997010dbf0 con 0x7f99700fd7f0 2024-09-13T02:56:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f99780e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997010e410 con 0x7f99700fc520 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.069+0000 7f9975681640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975e82640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 0x7f997010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58050/0 (socket says 172.21.15.100:58050) 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 -- 172.21.15.100:0/1039257424 learned_addr learned my addr 172.21.15.100:0/1039257424 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 -- 172.21.15.100:0/1039257424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 msgr2=0x7f997010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 0x7f997010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 -- 172.21.15.100:0/1039257424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964005040 con 0x7f99700fd7f0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f9975681640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9964003080 tx=0x7f9964009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9964038070 con 0x7f99700fd7f0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f996402abd0 con 0x7f99700fd7f0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996403e670 con 0x7f99700fd7f0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997010e640 con 0x7f99700fd7f0 2024-09-13T02:56:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.070+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997010eb90 con 0x7f99700fd7f0 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.071+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99700fb980 con 0x7f99700fd7f0 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.072+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9964030020 con 0x7f99700fd7f0 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.072+0000 7f996e7fc640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 0x7f99580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.072+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99640ae500 con 0x7f99700fd7f0 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.072+0000 7f9975e82640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 0x7f99580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.073+0000 7f9975e82640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 0x7f99580709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9960004550 tx=0x7f9960009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.076 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:08 smithi122 podman[93210]: 2024-09-13 02:56:08.814124253 +0000 UTC m=+0.771307911 container died 8c3a0b7e332b3782756858faf6131a81dcefb25bf73e857cfa236d5ac60bccf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:56:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.077+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f99640776a0 con 0x7f99700fd7f0 2024-09-13T02:56:09.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.248+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f997010ef10 con 0x7f995806e530 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.257+0000 7f996e7fc640 1 -- 172.21.15.100:0/1039257424 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f997010ef10 con 0x7f995806e530 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (4m) 56s ago 13m 25.5M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (2m) 56s ago 13m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (2m) 24s ago 12m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (4m) 56s ago 13m 79.2M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (7m) 56s ago 7m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (7m) 56s ago 7m 13.6M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:56:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (7m) 24s ago 7m 16.8M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (7m) 24s ago 7m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (4m) 56s ago 14m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (3m) 24s ago 12m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (3m) 56s ago 14m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (3m) 24s ago 12m 38.1M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 56s ago 13m 17.0M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (4m) 24s ago 12m 16.5M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (2m) 56s ago 11m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (97s) 56s ago 11m 93.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (62s) 56s ago 10m 14.3M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (27s) 24s ago 10m 12.1M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (9m) 24s ago 9m 232M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 8c3a0b7e332b 2024-09-13T02:56:09.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (9m) 24s ago 9m 223M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:56:09.261 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (3m) 56s ago 12m 60.5M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:56:09.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 msgr2=0x7f99580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 0x7f99580709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9960004550 tx=0x7f9960009040 comp rx=0 tx=0).stop 2024-09-13T02:56:09.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 msgr2=0x7f997010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9964003080 tx=0x7f9964009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 shutdown_connections 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f995806e530 0x7f99580709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99700fd7f0 0x7f997010d5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 --2- 172.21.15.100:0/1039257424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99700fc520 0x7f997010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.259+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 >> 172.21.15.100:0/1039257424 conn(0x7f99700f7ce0 msgr2=0x7f99700f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.260+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 shutdown_connections 2024-09-13T02:56:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.260+0000 7f99780e6640 1 -- 172.21.15.100:0/1039257424 wait complete. 2024-09-13T02:56:09.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.337+0000 7fc1093fa640 1 -- 172.21.15.100:0/194849014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 msgr2=0x7fc1040fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.337+0000 7fc1093fa640 1 --2- 172.21.15.100:0/194849014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc1040fb880 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009c50 tx=0x7fc0f4004d10 comp rx=0 tx=0).stop 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.337+0000 7fc1093fa640 1 -- 172.21.15.100:0/194849014 shutdown_connections 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 --2- 172.21.15.100:0/194849014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 0x7fc1040fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 --2- 172.21.15.100:0/194849014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc1040fb880 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- 172.21.15.100:0/194849014 >> 172.21.15.100:0/194849014 conn(0x7fc1040f6c10 msgr2=0x7fc1040f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- 172.21.15.100:0/194849014 shutdown_connections 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- 172.21.15.100:0/194849014 wait complete. 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 Processor -- start 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- start start 2024-09-13T02:56:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 0x7fc10410d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10410dc50 con 0x7fc1040fb470 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.338+0000 7fc1093fa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10410e470 con 0x7fc1040fc740 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58072/0 (socket says 172.21.15.100:58072) 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 -- 172.21.15.100:0/2630297952 learned_addr learned my addr 172.21.15.100:0/2630297952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc1027fc640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 0x7fc10410d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 -- 172.21.15.100:0/2630297952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 msgr2=0x7fc10410d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 0x7fc10410d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 -- 172.21.15.100:0/2630297952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40098b0 con 0x7fc1040fb470 2024-09-13T02:56:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc102ffd640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4004a30 tx=0x7fc0f4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f4009710 con 0x7fc1040fb470 2024-09-13T02:56:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0f4032b10 con 0x7fc1040fb470 2024-09-13T02:56:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10410e6a0 con 0x7fc1040fb470 2024-09-13T02:56:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f403db10 con 0x7fc1040fb470 2024-09-13T02:56:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.339+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10410ec40 con 0x7fc1040fb470 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.340+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1040fa8d0 con 0x7fc1040fb470 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.341+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc0f402f030 con 0x7fc1040fb470 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.341+0000 7fc0eb7fe640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 0x7fc0ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.341+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc0f40af850 con 0x7fc1040fb470 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.341+0000 7fc1027fc640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 0x7fc0ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.342+0000 7fc1027fc640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 0x7fc0ec0709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc10410ce70 tx=0x7fc0f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.345+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc0f4078a00 con 0x7fc1040fb470 2024-09-13T02:56:09.403 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:09 smithi122 podman[93210]: 2024-09-13 02:56:09.183300033 +0000 UTC m=+1.140483687 container cleanup 8c3a0b7e332b3782756858faf6131a81dcefb25bf73e857cfa236d5ac60bccf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=quincy-bbdadfa, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T02:56:09.403 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:09 smithi122 bash[93210]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4 2024-09-13T02:56:09.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.594+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc10402aa40 con 0x7fc1040fb470 2024-09-13T02:56:09.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:09 smithi100 ceph-mon[92340]: pgmap v125: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:09.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:09 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:56:09.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:09 smithi100 ceph-mon[92340]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.595+0000 7fc0eb7fe640 1 -- 172.21.15.100:0/2630297952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fc0f407c0c0 con 0x7fc1040fb470 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:09.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 5, 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 8 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:56:09.598 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 msgr2=0x7fc0ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 0x7fc0ec0709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc10410ce70 tx=0x7fc0f800b040 comp rx=0 tx=0).stop 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 msgr2=0x7fc10410d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4004a30 tx=0x7fc0f4004d10 comp rx=0 tx=0).stop 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 shutdown_connections 2024-09-13T02:56:09.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc0ec06e530 0x7fc0ec0709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1040fc740 0x7fc10410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 --2- 172.21.15.100:0/2630297952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1040fb470 0x7fc10410d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 >> 172.21.15.100:0/2630297952 conn(0x7fc1040f6c10 msgr2=0x7fc1040f8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 shutdown_connections 2024-09-13T02:56:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.597+0000 7fc1093fa640 1 -- 172.21.15.100:0/2630297952 wait complete. 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- 172.21.15.100:0/1104248718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 msgr2=0x7ff5e00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 --2- 172.21.15.100:0/1104248718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e00fc960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80048d0 tx=0x7ff5d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- 172.21.15.100:0/1104248718 shutdown_connections 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 --2- 172.21.15.100:0/1104248718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 0x7ff5e00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 --2- 172.21.15.100:0/1104248718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e00fc960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- 172.21.15.100:0/1104248718 >> 172.21.15.100:0/1104248718 conn(0x7ff5e00f7d30 msgr2=0x7ff5e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- 172.21.15.100:0/1104248718 shutdown_connections 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- 172.21.15.100:0/1104248718 wait complete. 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 Processor -- start 2024-09-13T02:56:09.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 -- start start 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.675+0000 7ff5e555f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5e555f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 0x7ff5e010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5e555f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e010dc10 con 0x7ff5e00fc550 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5e555f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e010e430 con 0x7ff5e00fd820 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58086/0 (socket says 172.21.15.100:58086) 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 -- 172.21.15.100:0/3274855013 learned_addr learned my addr 172.21.15.100:0/3274855013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5de7fc640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 0x7ff5e010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 -- 172.21.15.100:0/3274855013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 msgr2=0x7ff5e010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 0x7ff5e010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 -- 172.21.15.100:0/3274855013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8005040 con 0x7ff5e00fc550 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5deffd640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80048a0 tx=0x7ff5d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d8038070 con 0x7ff5e00fc550 2024-09-13T02:56:09.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e010e660 con 0x7ff5e00fc550 2024-09-13T02:56:09.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5d8004290 con 0x7ff5e00fc550 2024-09-13T02:56:09.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d8033660 con 0x7ff5e00fc550 2024-09-13T02:56:09.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.676+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e010ec00 con 0x7ff5e00fc550 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.678+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00fb9b0 con 0x7ff5e00fc550 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.678+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff5d8030020 con 0x7ff5e00fc550 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.678+0000 7ff5d77fe640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 0x7ff5cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.678+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff5d80ae2b0 con 0x7ff5e00fc550 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.678+0000 7ff5de7fc640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 0x7ff5cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.679+0000 7ff5de7fc640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 0x7ff5cc0709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5e010ce30 tx=0x7ff5c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.683+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff5d8077450 con 0x7ff5e00fc550 2024-09-13T02:56:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:09 smithi122 ceph-mon[79680]: pgmap v125: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:09 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:56:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:09 smithi122 ceph-mon[79680]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T02:56:09.686 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:09 smithi122 podman[93229]: 2024-09-13 02:56:09.443209516 +0000 UTC m=+0.626205597 container remove 8c3a0b7e332b3782756858faf6131a81dcefb25bf73e857cfa236d5ac60bccf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=quincy-bbdadfa, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-13T02:56:09.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.886+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff5e010eee0 con 0x7ff5e00fc550 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.886+0000 7ff5d77fe640 1 -- 172.21.15.100:0/3274855013 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1947 (secure 0 0 0) 0x7ff5d802c870 con 0x7ff5e00fc550 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:e20 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:54:38:305822+0000 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:09.888 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 20 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:54:37.621540+0000 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:56:09.889 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:56:09.890 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 24259,14470 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:09.891 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 msgr2=0x7ff5cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 0x7ff5cc0709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff5e010ce30 tx=0x7ff5c800b040 comp rx=0 tx=0).stop 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 msgr2=0x7ff5e010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80048a0 tx=0x7ff5d8009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 shutdown_connections 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff5cc06e530 0x7ff5cc0709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5e00fd820 0x7ff5e010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 --2- 172.21.15.100:0/3274855013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00fc550 0x7ff5e010d080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 >> 172.21.15.100:0/3274855013 conn(0x7ff5e00f7d30 msgr2=0x7ff5e00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 shutdown_connections 2024-09-13T02:56:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.888+0000 7ff5e555f640 1 -- 172.21.15.100:0/3274855013 wait complete. 2024-09-13T02:56:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 -- 172.21.15.100:0/2537625903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fc720 msgr2=0x7f91d00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 --2- 172.21.15.100:0/2537625903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fc720 0x7f91d00fcb90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f91c40048d0 tx=0x7f91c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 -- 172.21.15.100:0/2537625903 shutdown_connections 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 --2- 172.21.15.100:0/2537625903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fc720 0x7f91d00fcb90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 --2- 172.21.15.100:0/2537625903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fb450 0x7f91d00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 -- 172.21.15.100:0/2537625903 >> 172.21.15.100:0/2537625903 conn(0x7f91d00f6c10 msgr2=0x7f91d00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 -- 172.21.15.100:0/2537625903 shutdown_connections 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 -- 172.21.15.100:0/2537625903 wait complete. 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.968+0000 7f91d68e7640 1 Processor -- start 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91d68e7640 1 -- start start 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91d68e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91d68e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fc720 0x7f91d0112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91d68e7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0066750 con 0x7f91d00fb450 2024-09-13T02:56:09.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91d68e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00668c0 con 0x7f91d00fc720 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58104/0 (socket says 172.21.15.100:58104) 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 -- 172.21.15.100:0/1005672238 learned_addr learned my addr 172.21.15.100:0/1005672238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cf7fe640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fc720 0x7f91d0112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 -- 172.21.15.100:0/1005672238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fc720 msgr2=0x7f91d0112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fc720 0x7f91d0112300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 -- 172.21.15.100:0/1005672238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4005040 con 0x7f91d00fb450 2024-09-13T02:56:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.969+0000 7f91cffff640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91c000eb70 tx=0x7f91c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.970+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c0007c30 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.970+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d0112840 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.970+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f91c000f040 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.970+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c000ca60 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.970+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d0112db0 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.971+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00fa8b0 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.971+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f91c000cbc0 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.972+0000 7f91ccff9640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 0x7f91b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.972+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f91c008dcb0 con 0x7f91d00fb450 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.972+0000 7f91cf7fe640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 0x7f91b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.972+0000 7f91cf7fe640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 0x7f91b80709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91c4004540 tx=0x7f91c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:09.976+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f91c0056ed0 con 0x7f91d00fb450 2024-09-13T02:56:10.105 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:09 smithi122 podman[93317]: 2024-09-13 02:56:09.793953957 +0000 UTC m=+0.106123335 container create aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f) 2024-09-13T02:56:10.105 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:09 smithi122 podman[93317]: 2024-09-13 02:56:09.703346603 +0000 UTC m=+0.015515984 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:10.105 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 podman[93317]: 2024-09-13 02:56:10.029857274 +0000 UTC m=+0.342026658 container init aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T02:56:10.105 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 podman[93317]: 2024-09-13 02:56:10.033165117 +0000 UTC m=+0.345334495 container start aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0) 2024-09-13T02:56:10.105 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 podman[93317]: 2024-09-13 02:56:10.104716431 +0000 UTC m=+0.416885809 container attach aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T02:56:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.160+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91d0100ac0 con 0x7f91b806e530 2024-09-13T02:56:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.162+0000 7f91ccff9640 1 -- 172.21.15.100:0/1005672238 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f91d0100ac0 con 0x7f91b806e530 2024-09-13T02:56:10.165 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:56:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:56:10.165 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "10/21 daemons upgraded", 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:56:10.166 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 msgr2=0x7f91b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 0x7f91b80709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91c4004540 tx=0x7f91c4035040 comp rx=0 tx=0).stop 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 msgr2=0x7f91d010fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91c000eb70 tx=0x7f91c000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 shutdown_connections 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f91b806e530 0x7f91b80709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91d00fc720 0x7f91d0112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 --2- 172.21.15.100:0/1005672238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d00fb450 0x7f91d010fdb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 >> 172.21.15.100:0/1005672238 conn(0x7f91d00f6c10 msgr2=0x7f91d00f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 shutdown_connections 2024-09-13T02:56:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.164+0000 7f91d68e7640 1 -- 172.21.15.100:0/1005672238 wait complete. 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- 172.21.15.100:0/3383222912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fc550 msgr2=0x7f1fe80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 --2- 172.21.15.100:0/3383222912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fc550 0x7f1fe80fc960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80048d0 tx=0x7f1fd8009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- 172.21.15.100:0/3383222912 shutdown_connections 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 --2- 172.21.15.100:0/3383222912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fd820 0x7f1fe80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 --2- 172.21.15.100:0/3383222912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fc550 0x7f1fe80fc960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- 172.21.15.100:0/3383222912 >> 172.21.15.100:0/3383222912 conn(0x7f1fe80f7d30 msgr2=0x7f1fe80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- 172.21.15.100:0/3383222912 shutdown_connections 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- 172.21.15.100:0/3383222912 wait complete. 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 Processor -- start 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.242+0000 7f1fed381640 1 -- start start 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fc550 0x7f1fe810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe810dc30 con 0x7f1fe80fd820 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe810e450 con 0x7f1fe80fc550 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58122/0 (socket says 172.21.15.100:58122) 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 -- 172.21.15.100:0/360175965 learned_addr learned my addr 172.21.15.100:0/360175965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fe6ffd640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fc550 0x7f1fe810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 -- 172.21.15.100:0/360175965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fc550 msgr2=0x7f1fe810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fc550 0x7f1fe810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 -- 172.21.15.100:0/360175965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8005040 con 0x7f1fe80fd820 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdffff640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000eb70 tx=0x7f1fd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd0007c30 con 0x7f1fe80fd820 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1fd000f040 con 0x7f1fe80fd820 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe810e680 con 0x7f1fe80fd820 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd000ca60 con 0x7f1fe80fd820 2024-09-13T02:56:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.243+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe810ec20 con 0x7f1fe80fd820 2024-09-13T02:56:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.245+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe80fb9b0 con 0x7f1fe80fd820 2024-09-13T02:56:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.245+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1fd000cbc0 con 0x7f1fe80fd820 2024-09-13T02:56:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.245+0000 7f1fdf7fe640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 0x7f1fd40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.246+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1fd008dd00 con 0x7f1fe80fd820 2024-09-13T02:56:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.246+0000 7f1fe6ffd640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 0x7f1fd40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.246+0000 7f1fe6ffd640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 0x7f1fd40709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8004540 tx=0x7f1fd8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.250+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1fd0056f20 con 0x7f1fe80fd820 2024-09-13T02:56:10.414 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 podman[93317]: 2024-09-13 02:56:10.221300674 +0000 UTC m=+0.533470052 container died aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.481+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1fe804b720 con 0x7f1fe80fd820 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.482+0000 7f1fdf7fe640 1 -- 172.21.15.100:0/360175965 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+783 (secure 0 0 0) 0x7f1fd0019320 con 0x7f1fe80fd820 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 1 pg peering; Degraded data redundancy: 17/360 objects degraded (4.722%), 6 pgs degraded 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: osd.4 (root=default,host=smithi122) is down 2024-09-13T02:56:10.483 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 3.9 is stuck peering for 4m, current state peering, last acting [2,5] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 17/360 objects degraded (4.722%), 6 pgs degraded 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T02:56:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T02:56:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.483+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 msgr2=0x7f1fd40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.483+0000 7f1fed381640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 0x7f1fd40709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8004540 tx=0x7f1fd8035040 comp rx=0 tx=0).stop 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.483+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 msgr2=0x7f1fe810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.483+0000 7f1fed381640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000eb70 tx=0x7f1fd000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 shutdown_connections 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1fd406e530 0x7f1fd40709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fe80fd820 0x7f1fe810d5e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 --2- 172.21.15.100:0/360175965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fe80fc550 0x7f1fe810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 >> 172.21.15.100:0/360175965 conn(0x7f1fe80f7d30 msgr2=0x7f1fe80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 shutdown_connections 2024-09-13T02:56:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:10.484+0000 7f1fed381640 1 -- 172.21.15.100:0/360175965 wait complete. 2024-09-13T02:56:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T02:56:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2630297952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:10.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:10 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3274855013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T02:56:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2630297952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:10.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:10 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3274855013' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:11.188 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 podman[93340]: 2024-09-13 02:56:10.793706882 +0000 UTC m=+0.562937611 container remove aecde469f78a5ebe9b018ca9c81a1977be0e02bf0d40ad07f052a3b24e1d2da8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T02:56:11.189 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T02:56:11.189 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 systemd[1]: Stopped Ceph osd.4 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:11.189 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:10 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.4.service: Consumed 55.074s CPU time. 2024-09-13T02:56:11.189 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 systemd[1]: Starting Ceph osd.4 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:11.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-mon[79680]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:11.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-mon[79680]: pgmap v128: 65 pgs: 7 active+undersized, 2 peering, 3 stale+active+clean, 6 active+undersized+degraded, 47 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 17/360 objects degraded (4.722%) 2024-09-13T02:56:11.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-mon[79680]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T02:56:11.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 17/360 objects degraded (4.722%), 6 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:11.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/360175965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:11.557 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 podman[93441]: 2024-09-13 02:56:11.138348833 +0000 UTC m=+0.015845604 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:11.557 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 podman[93441]: 2024-09-13 02:56:11.253438819 +0000 UTC m=+0.130935584 container create 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T02:56:11.557 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 podman[93441]: 2024-09-13 02:56:11.472419938 +0000 UTC m=+0.349916706 container init 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T02:56:11.557 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 podman[93441]: 2024-09-13 02:56:11.475789196 +0000 UTC m=+0.353285969 container start 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T02:56:11.557 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 podman[93441]: 2024-09-13 02:56:11.555711703 +0000 UTC m=+0.433208468 container attach 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T02:56:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:11 smithi100 ceph-mon[92340]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:11 smithi100 ceph-mon[92340]: pgmap v128: 65 pgs: 7 active+undersized, 2 peering, 3 stale+active+clean, 6 active+undersized+degraded, 47 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 17/360 objects degraded (4.722%) 2024-09-13T02:56:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:11 smithi100 ceph-mon[92340]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T02:56:11.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:11 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 17/360 objects degraded (4.722%), 6 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:11.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:11 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/360175965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:11.936 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:11.936 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 bash[93441]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:11.936 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:11.936 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:11 smithi122 bash[93441]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:12.620 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T02:56:12.620 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T02:56:12.620 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:56:12.620 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate[93456]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T02:56:12.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 bash[93441]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T02:56:12.938 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:12 smithi122 podman[93441]: 2024-09-13 02:56:12.647807829 +0000 UTC m=+1.525304601 container died 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T02:56:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:13 smithi100 ceph-mon[92340]: pgmap v129: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:13.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:13 smithi122 ceph-mon[79680]: pgmap v129: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:13.683 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 podman[93590]: 2024-09-13 02:56:13.359381703 +0000 UTC m=+0.701096158 container remove 41a831091581ff159f06b4b1452a691678d28960252e2efd7c93c15e46779f96 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:56:13.684 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 podman[93649]: 2024-09-13 02:56:13.468530993 +0000 UTC m=+0.015723003 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:13.684 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 podman[93649]: 2024-09-13 02:56:13.568809477 +0000 UTC m=+0.116001479 container create 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T02:56:14.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 podman[93649]: 2024-09-13 02:56:13.804787959 +0000 UTC m=+0.351979959 container init 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:56:14.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 podman[93649]: 2024-09-13 02:56:13.808042115 +0000 UTC m=+0.355234117 container start 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T02:56:14.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 bash[93649]: 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 2024-09-13T02:56:14.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:13 smithi122 systemd[1]: Started Ceph osd.4 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: pgmap v130: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.213 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: pgmap v130: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:15.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:15.473 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:15 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T02:56:15.449+0000 7f46daab3640 -1 Falling back to public interface 2024-09-13T02:56:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:16 smithi100 ceph-mon[92340]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T02:56:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:16 smithi122 ceph-mon[79680]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T02:56:17.653 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:17 smithi122 ceph-mon[79680]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:17.653 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.653 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.653 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.654 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:17 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:17 smithi100 ceph-mon[92340]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:17.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:17 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:18.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:18 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:18.665 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:18 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:19.649 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:19 smithi122 ceph-mon[79680]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:19 smithi100 ceph-mon[92340]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:21.541 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.542 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:21.543 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:21.543 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-mon[79680]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:56:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:21 smithi100 ceph-mon[92340]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:56:21.936 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:21 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T02:56:21.538+0000 7f46daab3640 -1 osd.4 67 log_to_monitors true 2024-09-13T02:56:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:22 smithi100 ceph-mon[92340]: from='osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:56:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:22 smithi100 ceph-mon[92340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:56:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:22 smithi122 ceph-mon[79680]: from='osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:56:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:22 smithi122 ceph-mon[79680]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:56:23.437 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T02:56:23.103+0000 7f46ce845640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: from='osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:23.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:23 smithi122 ceph-mon[79680]: from='osd.4 ' entity='osd.4' 2024-09-13T02:56:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:56:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T02:56:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: from='osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:23 smithi100 ceph-mon[92340]: from='osd.4 ' entity='osd.4' 2024-09-13T02:56:24.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:24 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:56:24.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:24 smithi100 ceph-mon[92340]: osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669] boot 2024-09-13T02:56:24.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:24 smithi100 ceph-mon[92340]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T02:56:24.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:24 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:24 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:56:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:24 smithi122 ceph-mon[79680]: osd.4 [v2:172.21.15.122:6808/2781456669,v1:172.21.15.122:6809/2781456669] boot 2024-09-13T02:56:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:24 smithi122 ceph-mon[79680]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T02:56:24.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:24 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:25.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:25 smithi100 ceph-mon[92340]: pgmap v137: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:25.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:25 smithi100 ceph-mon[92340]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T02:56:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:25 smithi122 ceph-mon[79680]: pgmap v137: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-09-13T02:56:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:25 smithi122 ceph-mon[79680]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T02:56:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:26 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:26 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:27 smithi100 ceph-mon[92340]: pgmap v139: 65 pgs: 8 peering, 3 active+undersized, 3 active+undersized+degraded, 51 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T02:56:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:27 smithi122 ceph-mon[79680]: pgmap v139: 65 pgs: 8 peering, 3 active+undersized, 3 active+undersized+degraded, 51 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T02:56:28.659 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:28 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-09-13T02:56:28.660 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:28 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:56:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:28 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-09-13T02:56:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:28 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:56:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:29 smithi100 ceph-mon[92340]: pgmap v140: 65 pgs: 8 peering, 57 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:29.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:29.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:29 smithi122 ceph-mon[79680]: pgmap v140: 65 pgs: 8 peering, 57 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:31 smithi100 ceph-mon[92340]: pgmap v141: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:31 smithi122 ceph-mon[79680]: pgmap v141: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:33 smithi100 ceph-mon[92340]: pgmap v142: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:33 smithi122 ceph-mon[79680]: pgmap v142: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:35 smithi100 ceph-mon[92340]: pgmap v143: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:35 smithi122 ceph-mon[79680]: pgmap v143: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:36.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:36.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:36 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:36.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:36 smithi100 ceph-mon[92340]: Upgrade: osd.5 is safe to restart 2024-09-13T02:56:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:36 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T02:56:36.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:36 smithi122 ceph-mon[79680]: Upgrade: osd.5 is safe to restart 2024-09-13T02:56:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:37 smithi100 ceph-mon[92340]: pgmap v144: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:37.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:37.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:56:37.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:37 smithi122 ceph-mon[79680]: pgmap v144: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:56:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:38.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:38 smithi122 ceph-mon[79680]: Upgrade: Updating osd.5 2024-09-13T02:56:38.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:38 smithi122 ceph-mon[79680]: Deploying daemon osd.5 on smithi122 2024-09-13T02:56:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:38 smithi100 ceph-mon[92340]: Upgrade: Updating osd.5 2024-09-13T02:56:38.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:38 smithi100 ceph-mon[92340]: Deploying daemon osd.5 on smithi122 2024-09-13T02:56:39.669 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:39 smithi122 systemd[1]: Stopping Ceph osd.5 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:39.670 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:39 smithi122 ceph-mon[79680]: pgmap v145: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:39.670 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:39 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:39 smithi100 ceph-mon[92340]: pgmap v145: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:39 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:39.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[53424]: 2024-09-13T02:56:39.667+0000 7f1c2ae27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:56:39.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[53424]: 2024-09-13T02:56:39.667+0000 7f1c2ae27640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-13T02:56:39.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[53424]: 2024-09-13T02:56:39.667+0000 7f1c2ae27640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:56:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 -- 172.21.15.100:0/3948564860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fb430 msgr2=0x7fc1680fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/3948564860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fb430 0x7fc1680fb840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1580048d0 tx=0x7fc158009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 -- 172.21.15.100:0/3948564860 shutdown_connections 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/3948564860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fc700 0x7fc1680fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/3948564860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fb430 0x7fc1680fb840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 -- 172.21.15.100:0/3948564860 >> 172.21.15.100:0/3948564860 conn(0x7fc1680f6c10 msgr2=0x7fc1680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 -- 172.21.15.100:0/3948564860 shutdown_connections 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.574+0000 7fc16cf1f640 1 -- 172.21.15.100:0/3948564860 wait complete. 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 Processor -- start 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 -- start start 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 0x7fc16810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16810cb10 con 0x7fc1680fc700 2024-09-13T02:56:40.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16cf1f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16810d330 con 0x7fc1680fb430 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc165d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc165d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49422/0 (socket says 172.21.15.100:49422) 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc165d9b640 1 -- 172.21.15.100:0/4207025732 learned_addr learned my addr 172.21.15.100:0/4207025732 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.575+0000 7fc16659c640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 0x7fc16810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc165d9b640 1 -- 172.21.15.100:0/4207025732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 msgr2=0x7fc16810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc165d9b640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 0x7fc16810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc165d9b640 1 -- 172.21.15.100:0/4207025732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158005040 con 0x7fc1680fc700 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc16659c640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 0x7fc16810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc165d9b640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc15c002a50 tx=0x7fc15c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15c007c30 con 0x7fc1680fc700 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc15c00f040 con 0x7fc1680fc700 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16810d5c0 con 0x7fc1680fc700 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15c00da90 con 0x7fc1680fc700 2024-09-13T02:56:40.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.576+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16810db60 con 0x7fc1680fc700 2024-09-13T02:56:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.577+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1680fa890 con 0x7fc1680fc700 2024-09-13T02:56:40.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.578+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc15c00dc30 con 0x7fc1680fc700 2024-09-13T02:56:40.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.578+0000 7fc156ffd640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 0x7fc1500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:40.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.578+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc15c08d9c0 con 0x7fc1680fc700 2024-09-13T02:56:40.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.578+0000 7fc16659c640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 0x7fc1500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:40.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.579+0000 7fc16659c640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 0x7fc1500709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc15800b020 tx=0x7fc158009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:40.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.583+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc15c056b30 con 0x7fc1680fc700 2024-09-13T02:56:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.765+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc16810df40 con 0x7fc15006e530 2024-09-13T02:56:40.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:40 smithi100 ceph-mon[92340]: osd.5 marked itself down and dead 2024-09-13T02:56:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.767+0000 7fc156ffd640 1 -- 172.21.15.100:0/4207025732 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc16810df40 con 0x7fc15006e530 2024-09-13T02:56:41.194 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:40 smithi122 ceph-mon[79680]: osd.5 marked itself down and dead 2024-09-13T02:56:41.195 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:40 smithi122 podman[98477]: 2024-09-13 02:56:40.820499322 +0000 UTC m=+1.274005536 container died d3e0eaab694fae59349659fca2b71aba5f4b9bd49682199a640aa7ca0d606b85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=quincy-bbdadfa, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T02:56:41.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 msgr2=0x7fc1500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 0x7fc1500709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc15800b020 tx=0x7fc158009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 msgr2=0x7fc16810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc15c002a50 tx=0x7fc15c004600 comp rx=0 tx=0).stop 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 shutdown_connections 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc15006e530 0x7fc1500709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1680fc700 0x7fc16810c4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 --2- 172.21.15.100:0/4207025732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1680fb430 0x7fc16810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 >> 172.21.15.100:0/4207025732 conn(0x7fc1680f6c10 msgr2=0x7fc1680f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 shutdown_connections 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.769+0000 7fc16cf1f640 1 -- 172.21.15.100:0/4207025732 wait complete. 2024-09-13T02:56:41.196 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:56:41.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.849+0000 7fc658c81640 1 -- 172.21.15.100:0/1745496631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 msgr2=0x7fc654101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.849+0000 7fc658c81640 1 --2- 172.21.15.100:0/1745496631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc654101a60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0048d0 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- 172.21.15.100:0/1745496631 shutdown_connections 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 --2- 172.21.15.100:0/1745496631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc654101a60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 --2- 172.21.15.100:0/1745496631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 0x7fc6540ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- 172.21.15.100:0/1745496631 >> 172.21.15.100:0/1745496631 conn(0x7fc6540f6c10 msgr2=0x7fc6540f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- 172.21.15.100:0/1745496631 shutdown_connections 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- 172.21.15.100:0/1745496631 wait complete. 2024-09-13T02:56:41.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 Processor -- start 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- start start 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 0x7fc6540fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540fb580 con 0x7fc6540ff680 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.850+0000 7fc658c81640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540fb6f0 con 0x7fc654065c40 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49436/0 (socket says 172.21.15.100:49436) 2024-09-13T02:56:41.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 -- 172.21.15.100:0/321433037 learned_addr learned my addr 172.21.15.100:0/321433037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc65259c640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 0x7fc6540fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 -- 172.21.15.100:0/321433037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 msgr2=0x7fc6540fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 0x7fc6540fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 -- 172.21.15.100:0/321433037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c005040 con 0x7fc6540ff680 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc651d9b640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0043d0 tx=0x7fc63c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc63c038070 con 0x7fc6540ff680 2024-09-13T02:56:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc63c02ae90 con 0x7fc6540ff680 2024-09-13T02:56:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6540fb970 con 0x7fc6540ff680 2024-09-13T02:56:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc63c03e670 con 0x7fc6540ff680 2024-09-13T02:56:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.851+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6540fbe90 con 0x7fc6540ff680 2024-09-13T02:56:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.852+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6540fa890 con 0x7fc6540ff680 2024-09-13T02:56:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.853+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc63c030020 con 0x7fc6540ff680 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.854+0000 7fc64affd640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 0x7fc6400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.854+0000 7fc65259c640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 0x7fc6400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.854+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc63c0ae330 con 0x7fc6540ff680 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.854+0000 7fc65259c640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 0x7fc6400709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6540fc860 tx=0x7fc644009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:40.858+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc63c0774d0 con 0x7fc6540ff680 2024-09-13T02:56:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.041+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6540f8700 con 0x7fc64006e530 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.043+0000 7fc64affd640 1 -- 172.21.15.100:0/321433037 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc6540f8700 con 0x7fc64006e530 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 msgr2=0x7fc6400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 0x7fc6400709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc6540fc860 tx=0x7fc644009040 comp rx=0 tx=0).stop 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 msgr2=0x7fc6540fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0043d0 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 shutdown_connections 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc64006e530 0x7fc6400709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6540ff680 0x7fc6540fb040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 --2- 172.21.15.100:0/321433037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc654065c40 0x7fc6540fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 >> 172.21.15.100:0/321433037 conn(0x7fc6540f6c10 msgr2=0x7fc6540f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 shutdown_connections 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.045+0000 7fc658c81640 1 -- 172.21.15.100:0/321433037 wait complete. 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- 172.21.15.100:0/2138526551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 msgr2=0x7f24300fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 --2- 172.21.15.100:0/2138526551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f24300fcb90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f24240048d0 tx=0x7f2424009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- 172.21.15.100:0/2138526551 shutdown_connections 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 --2- 172.21.15.100:0/2138526551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f24300fcb90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 --2- 172.21.15.100:0/2138526551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 0x7f24300fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- 172.21.15.100:0/2138526551 >> 172.21.15.100:0/2138526551 conn(0x7f24300f6c10 msgr2=0x7f24300f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- 172.21.15.100:0/2138526551 shutdown_connections 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- 172.21.15.100:0/2138526551 wait complete. 2024-09-13T02:56:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 Processor -- start 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.123+0000 7f2438120640 1 -- start start 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2438120640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 0x7f243010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2438120640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2438120640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430066750 con 0x7f24300fc720 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2438120640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300668c0 con 0x7f24300fb450 2024-09-13T02:56:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49458/0 (socket says 172.21.15.100:49458) 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2435ebc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 0x7f243010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 -- 172.21.15.100:0/3528981225 learned_addr learned my addr 172.21.15.100:0/3528981225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 -- 172.21.15.100:0/3528981225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 msgr2=0x7f243010fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 0x7f243010fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 -- 172.21.15.100:0/3528981225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424005040 con 0x7f24300fc720 2024-09-13T02:56:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24356bb640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2424003080 tx=0x7f2424009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2424038070 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2430112870 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f242402ae90 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.124+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2424033660 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.125+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2430112e10 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.126+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24300fa8b0 con 0x7f24300fc720 2024-09-13T02:56:41.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.126+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2424030020 con 0x7f24300fc720 2024-09-13T02:56:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.127+0000 7f24227fc640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 0x7f241c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.127+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f24240ae2e0 con 0x7f24300fc720 2024-09-13T02:56:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.127+0000 7f2435ebc640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 0x7f241c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.127+0000 7f2435ebc640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 0x7f241c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2430066440 tx=0x7f242c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.131+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2424077480 con 0x7f24300fc720 2024-09-13T02:56:41.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.308+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2430100b70 con 0x7f241c06e530 2024-09-13T02:56:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.316+0000 7f24227fc640 1 -- 172.21.15.100:0/3528981225 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2430100b70 con 0x7f241c06e530 2024-09-13T02:56:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 89s ago 13m 25.5M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:56:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (3m) 89s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (3m) 24s ago 13m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 89s ago 13m 79.2M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (8m) 89s ago 8m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (8m) 89s ago 8m 13.6M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (8m) 24s ago 8m 17.0M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (8m) 24s ago 8m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (4m) 89s ago 15m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (4m) 24s ago 12m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (4m) 89s ago 15m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (3m) 24s ago 12m 39.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 89s ago 13m 17.0M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (4m) 24s ago 12m 17.0M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (2m) 89s ago 12m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:56:41.319 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 89s ago 11m 93.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:56:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (94s) 89s ago 11m 14.3M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:56:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (59s) 24s ago 10m 111M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:56:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (27s) 24s ago 10m 14.4M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:56:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (9m) 24s ago 9m 222M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a d3e0eaab694f 2024-09-13T02:56:41.320 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 89s ago 13m 60.5M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 msgr2=0x7f241c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 0x7f241c0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2430066440 tx=0x7f242c00b040 comp rx=0 tx=0).stop 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 msgr2=0x7f2430112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2424003080 tx=0x7f2424009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 shutdown_connections 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f241c06e530 0x7f241c0709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24300fc720 0x7f2430112330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 --2- 172.21.15.100:0/3528981225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24300fb450 0x7f243010fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 >> 172.21.15.100:0/3528981225 conn(0x7f24300f6c10 msgr2=0x7f24300f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 shutdown_connections 2024-09-13T02:56:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.319+0000 7f2438120640 1 -- 172.21.15.100:0/3528981225 wait complete. 2024-09-13T02:56:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 -- 172.21.15.100:0/3055972977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fc570 msgr2=0x7faac00fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 --2- 172.21.15.100:0/3055972977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fc570 0x7faac00fc980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faabc0048d0 tx=0x7faabc009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 -- 172.21.15.100:0/3055972977 shutdown_connections 2024-09-13T02:56:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 --2- 172.21.15.100:0/3055972977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fd840 0x7faac00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 --2- 172.21.15.100:0/3055972977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fc570 0x7faac00fc980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 -- 172.21.15.100:0/3055972977 >> 172.21.15.100:0/3055972977 conn(0x7faac00f7d30 msgr2=0x7faac00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 -- 172.21.15.100:0/3055972977 shutdown_connections 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.395+0000 7faac8112640 1 -- 172.21.15.100:0/3055972977 wait complete. 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 Processor -- start 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 -- start start 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fc570 0x7faac010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac010dc60 con 0x7faac00fd840 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac8112640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac010e430 con 0x7faac00fc570 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49484/0 (socket says 172.21.15.100:49484) 2024-09-13T02:56:41.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 -- 172.21.15.100:0/1323199131 learned_addr learned my addr 172.21.15.100:0/1323199131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac5eae640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fc570 0x7faac010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 -- 172.21.15.100:0/1323199131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fc570 msgr2=0x7faac010d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fc570 0x7faac010d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 -- 172.21.15.100:0/1323199131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc005040 con 0x7faac00fd840 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.396+0000 7faac56ad640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab0002a50 tx=0x7faab0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.397+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab0007c30 con 0x7faac00fd840 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.397+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faab000f040 con 0x7faac00fd840 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.397+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac010e6c0 con 0x7faac00fd840 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.397+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab000da10 con 0x7faac00fd840 2024-09-13T02:56:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.397+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac010ec60 con 0x7faac00fd840 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.398+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac00fb9d0 con 0x7faac00fd840 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.398+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7faab000dc80 con 0x7faac00fd840 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.399+0000 7faab67fc640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 0x7faaac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.399+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faab008d930 con 0x7faac00fd840 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.399+0000 7faac5eae640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 0x7faaac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.399+0000 7faac5eae640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 0x7faaac0709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faabc00b020 tx=0x7faabc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.403+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faab0056ad0 con 0x7faac00fd840 2024-09-13T02:56:41.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:41 smithi122 podman[98477]: 2024-09-13 02:56:41.235188639 +0000 UTC m=+1.688694844 container cleanup d3e0eaab694fae59349659fca2b71aba5f4b9bd49682199a640aa7ca0d606b85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-bbdadfa) 2024-09-13T02:56:41.437 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:41 smithi122 bash[98477]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5 2024-09-13T02:56:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.649+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faac010eef0 con 0x7faac00fd840 2024-09-13T02:56:41.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:41 smithi100 ceph-mon[92340]: pgmap v146: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:41.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:41 smithi100 ceph-mon[92340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:56:41.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:41 smithi100 ceph-mon[92340]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T02:56:41.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:41 smithi100 ceph-mon[92340]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.649+0000 7faab67fc640 1 -- 172.21.15.100:0/1323199131 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7faab005a190 con 0x7faac00fd840 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:41.652 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:56:41.653 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T02:56:41.654 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 9 2024-09-13T02:56:41.654 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:56:41.654 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.652+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 msgr2=0x7faaac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.652+0000 7faac8112640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 0x7faaac0709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faabc00b020 tx=0x7faabc035040 comp rx=0 tx=0).stop 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.652+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 msgr2=0x7faac010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.652+0000 7faac8112640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faab0002a50 tx=0x7faab0004600 comp rx=0 tx=0).stop 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 shutdown_connections 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7faaac06e530 0x7faaac0709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac00fd840 0x7faac010d610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 --2- 172.21.15.100:0/1323199131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faac00fc570 0x7faac010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 >> 172.21.15.100:0/1323199131 conn(0x7faac00f7d30 msgr2=0x7faac00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 shutdown_connections 2024-09-13T02:56:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.653+0000 7faac8112640 1 -- 172.21.15.100:0/1323199131 wait complete. 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.730+0000 7f35a12c6640 1 -- 172.21.15.100:0/486603498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 msgr2=0x7f359c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.730+0000 7f35a12c6640 1 --2- 172.21.15.100:0/486603498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c101b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35900048d0 tx=0x7f3590009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- 172.21.15.100:0/486603498 shutdown_connections 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 --2- 172.21.15.100:0/486603498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c101b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 --2- 172.21.15.100:0/486603498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- 172.21.15.100:0/486603498 >> 172.21.15.100:0/486603498 conn(0x7f359c0f6c10 msgr2=0x7f359c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- 172.21.15.100:0/486603498 shutdown_connections 2024-09-13T02:56:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- 172.21.15.100:0/486603498 wait complete. 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 Processor -- start 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- start start 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c10dc70 con 0x7f359c0ff720 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.731+0000 7f35a12c6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c10e490 con 0x7f359c0666b0 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49504/0 (socket says 172.21.15.100:49504) 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 -- 172.21.15.100:0/1852078113 learned_addr learned my addr 172.21.15.100:0/1852078113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359affd640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 -- 172.21.15.100:0/1852078113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 msgr2=0x7f359c10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 -- 172.21.15.100:0/1852078113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590005040 con 0x7f359c0ff720 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359affd640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f359a7fc640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35900043d0 tx=0x7f3590009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3590038070 con 0x7f359c0ff720 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f359002ae90 con 0x7f359c0ff720 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c10e6c0 con 0x7f359c0ff720 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359003e670 con 0x7f359c0ff720 2024-09-13T02:56:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.732+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c10ec60 con 0x7f359c0ff720 2024-09-13T02:56:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.733+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c0fa8b0 con 0x7f359c0ff720 2024-09-13T02:56:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.734+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3590030020 con 0x7f359c0ff720 2024-09-13T02:56:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.734+0000 7f35837fe640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 0x7f35840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.735+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f35900ae2e0 con 0x7f359c0ff720 2024-09-13T02:56:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.735+0000 7f359affd640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 0x7f35840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.735+0000 7f359affd640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 0x7f35840709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f359c066410 tx=0x7f358c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:41.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.739+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3590077480 con 0x7f359c0ff720 2024-09-13T02:56:41.796 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:41 smithi122 podman[98491]: 2024-09-13 02:56:41.486546265 +0000 UTC m=+0.658930199 container remove d3e0eaab694fae59349659fca2b71aba5f4b9bd49682199a640aa7ca0d606b85 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T02:56:41.796 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:41 smithi122 ceph-mon[79680]: pgmap v146: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:41.796 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:41 smithi122 ceph-mon[79680]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:56:41.796 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:41 smithi122 ceph-mon[79680]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T02:56:41.796 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:41 smithi122 ceph-mon[79680]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T02:56:41.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.942+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f359c10ef80 con 0x7f359c0ff720 2024-09-13T02:56:41.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.943+0000 7f35837fe640 1 -- 172.21.15.100:0/1852078113 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1947 (secure 0 0 0) 0x7f359007ab40 con 0x7f359c0ff720 2024-09-13T02:56:41.944 INFO:teuthology.orchestra.run.smithi100.stdout:e20 2024-09-13T02:56:41.944 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:54:38:305822+0000 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 20 2024-09-13T02:56:41.945 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:54:37.621540+0000 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:56:41.946 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:56:41.947 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 24259,14470 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:56:41.948 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:41.949 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-13T02:56:41.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 msgr2=0x7f35840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 0x7f35840709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f359c066410 tx=0x7f358c00b040 comp rx=0 tx=0).stop 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 msgr2=0x7f359c10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35900043d0 tx=0x7f3590009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 shutdown_connections 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f358406e530 0x7f35840709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0ff720 0x7f359c10d620 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 --2- 172.21.15.100:0/1852078113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f359c0666b0 0x7f359c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 >> 172.21.15.100:0/1852078113 conn(0x7f359c0f6c10 msgr2=0x7f359c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 shutdown_connections 2024-09-13T02:56:41.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:41.945+0000 7f35a12c6640 1 -- 172.21.15.100:0/1852078113 wait complete. 2024-09-13T02:56:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/3431389187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 msgr2=0x7fcb480fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/3431389187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb480fc930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb380048d0 tx=0x7fcb38009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/3431389187 shutdown_connections 2024-09-13T02:56:42.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/3431389187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 0x7fcb480fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/3431389187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb480fc930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.024+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/3431389187 >> 172.21.15.100:0/3431389187 conn(0x7fcb480f7ce0 msgr2=0x7fcb480fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:42.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/3431389187 shutdown_connections 2024-09-13T02:56:42.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/3431389187 wait complete. 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 Processor -- start 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 -- start start 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 0x7fcb4806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4806fff0 con 0x7fcb480fc520 2024-09-13T02:56:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.025+0000 7fcb4d5a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb48070130 con 0x7fcb480fd7f0 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49520/0 (socket says 172.21.15.100:49520) 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 -- 172.21.15.100:0/1901829318 learned_addr learned my addr 172.21.15.100:0/1901829318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb467fc640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 0x7fcb4806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 -- 172.21.15.100:0/1901829318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 msgr2=0x7fcb4806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 0x7fcb4806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 -- 172.21.15.100:0/1901829318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38005040 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb46ffd640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb380043d0 tx=0x7fcb38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb38038070 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb3802ae90 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480703b0 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3803e670 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.026+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb481150d0 con 0x7fcb480fc520 2024-09-13T02:56:42.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.027+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb480fb980 con 0x7fcb480fc520 2024-09-13T02:56:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.028+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcb38030020 con 0x7fcb480fc520 2024-09-13T02:56:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.028+0000 7fcb2f7fe640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 0x7fcb300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.028+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcb380ae2f0 con 0x7fcb480fc520 2024-09-13T02:56:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.028+0000 7fcb467fc640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 0x7fcb300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.029+0000 7fcb467fc640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 0x7fcb300709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c004eb0 tx=0x7fcb3c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:42.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.032+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcb38077510 con 0x7fcb480fc520 2024-09-13T02:56:42.132 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:41 smithi122 podman[98582]: 2024-09-13 02:56:41.697844767 +0000 UTC m=+0.015668120 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:42.133 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:41 smithi122 podman[98582]: 2024-09-13 02:56:41.812341233 +0000 UTC m=+0.130164623 container create e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:56:42.133 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 podman[98582]: 2024-09-13 02:56:42.031487836 +0000 UTC m=+0.349311180 container init e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:56:42.133 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 podman[98582]: 2024-09-13 02:56:42.034750953 +0000 UTC m=+0.352574295 container start e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T02:56:42.133 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 podman[98582]: 2024-09-13 02:56:42.131522204 +0000 UTC m=+0.449345546 container attach e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T02:56:42.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.213+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb48101c50 con 0x7fcb3006e530 2024-09-13T02:56:42.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.214+0000 7fcb2f7fe640 1 -- 172.21.15.100:0/1901829318 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fcb48101c50 con 0x7fcb3006e530 2024-09-13T02:56:42.215 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:56:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:56:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:56:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "11/21 daemons upgraded", 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:56:42.216 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 msgr2=0x7fcb300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 0x7fcb300709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c004eb0 tx=0x7fcb3c00b040 comp rx=0 tx=0).stop 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 msgr2=0x7fcb48071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb380043d0 tx=0x7fcb38009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 shutdown_connections 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcb3006e530 0x7fcb300709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb480fd7f0 0x7fcb4806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 --2- 172.21.15.100:0/1901829318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480fc520 0x7fcb48071570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 >> 172.21.15.100:0/1901829318 conn(0x7fcb480f7ce0 msgr2=0x7fcb480f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:42.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 shutdown_connections 2024-09-13T02:56:42.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.216+0000 7fcb4d5a9640 1 -- 172.21.15.100:0/1901829318 wait complete. 2024-09-13T02:56:42.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.295+0000 7fedb6f8d640 1 -- 172.21.15.100:0/3683901740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 msgr2=0x7fedb00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.295+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/3683901740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb00fcb70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feda4009c50 tx=0x7feda4004d10 comp rx=0 tx=0).stop 2024-09-13T02:56:42.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.295+0000 7fedb6f8d640 1 -- 172.21.15.100:0/3683901740 shutdown_connections 2024-09-13T02:56:42.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/3683901740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb00fcb70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/3683901740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- 172.21.15.100:0/3683901740 >> 172.21.15.100:0/3683901740 conn(0x7fedb00f6c10 msgr2=0x7fedb00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- 172.21.15.100:0/3683901740 shutdown_connections 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- 172.21.15.100:0/3683901740 wait complete. 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 Processor -- start 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- start start 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb01122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0065cc0 con 0x7fedb00fc700 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.296+0000 7fedb6f8d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0065e30 con 0x7fedb00fb430 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedaffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb01122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.100:60930/0 (socket says 172.21.15.100:60930) 2024-09-13T02:56:42.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 -- 172.21.15.100:0/1977247385 learned_addr learned my addr 172.21.15.100:0/1977247385 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:56:42.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 -- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 msgr2=0x7fedb01122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb01122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 -- 172.21.15.100:0/1977247385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40098b0 con 0x7fedb00fb430 2024-09-13T02:56:42.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb4d29640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feda000eb70 tx=0x7feda000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda0007c30 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feda000f040 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb010bb40 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda00094e0 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.297+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb010c0e0 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.298+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb00fa890 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.299+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7feda0009660 con 0x7fedb00fb430 2024-09-13T02:56:42.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.299+0000 7fedad7fa640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 0x7fed980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:42.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.299+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7feda008de90 con 0x7fedb00fb430 2024-09-13T02:56:42.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.299+0000 7fedaffff640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 0x7fed980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:42.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.300+0000 7fedaffff640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 0x7fed980709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feda4000f80 tx=0x7feda403d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.304+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feda0056ff0 con 0x7fedb00fb430 2024-09-13T02:56:42.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 podman[98582]: 2024-09-13 02:56:42.224770245 +0000 UTC m=+0.542593599 container died e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T02:56:42.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.534+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fedb004b720 con 0x7fedb00fb430 2024-09-13T02:56:42.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.536 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T02:56:42.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1323199131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:42.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:42 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1852078113' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:42.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.535+0000 7fedad7fa640 1 -- 172.21.15.100:0/1977247385 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+676 (secure 0 0 0) 0x7feda005a6b0 con 0x7fedb00fb430 2024-09-13T02:56:42.537 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 3 pgs peering 2024-09-13T02:56:42.537 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:56:42.537 INFO:teuthology.orchestra.run.smithi100.stdout: osd.5 (root=default,host=smithi122) is down 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: pg 2.16 is stuck peering for 5m, current state peering, last acting [3,2] 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: pg 3.f is stuck peering for 4m, current state peering, last acting [3,0] 2024-09-13T02:56:42.538 INFO:teuthology.orchestra.run.smithi100.stdout: pg 3.16 is stuck peering for 4m, current state peering, last acting [3,1] 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 msgr2=0x7fed980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 0x7fed980709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feda4000f80 tx=0x7feda403d040 comp rx=0 tx=0).stop 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 msgr2=0x7fedb010fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feda000eb70 tx=0x7feda000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 shutdown_connections 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fed9806e530 0x7fed980709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedb00fc700 0x7fedb01122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 --2- 172.21.15.100:0/1977247385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fedb00fb430 0x7fedb010fd60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 >> 172.21.15.100:0/1977247385 conn(0x7fedb00f6c10 msgr2=0x7fedb00f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 shutdown_connections 2024-09-13T02:56:42.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:56:42.537+0000 7fedb6f8d640 1 -- 172.21.15.100:0/1977247385 wait complete. 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1323199131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:42.819 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:42 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1852078113' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:43.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 podman[98605]: 2024-09-13 02:56:42.818479863 +0000 UTC m=+0.587163142 container remove e3b18e852799e15cba9c05b6d1f378f8a19cba56ff6e750634abe23d8aa7918a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T02:56:43.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T02:56:43.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 systemd[1]: Stopped Ceph osd.5 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:43.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:42 smithi122 systemd[1]: ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.5.service: Consumed 55.335s CPU time. 2024-09-13T02:56:43.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 systemd[1]: Starting Ceph osd.5 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T02:56:43.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-mon[79680]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:43.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-mon[79680]: pgmap v149: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:43.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-mon[79680]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T02:56:43.556 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1977247385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:43.556 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 podman[98706]: 2024-09-13 02:56:43.151880834 +0000 UTC m=+0.015647846 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:43.557 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 podman[98706]: 2024-09-13 02:56:43.269891738 +0000 UTC m=+0.133658735 container create b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T02:56:43.557 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 podman[98706]: 2024-09-13 02:56:43.481008905 +0000 UTC m=+0.344775910 container init b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f) 2024-09-13T02:56:43.557 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 podman[98706]: 2024-09-13 02:56:43.48445071 +0000 UTC m=+0.348217707 container start b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f) 2024-09-13T02:56:43.557 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 podman[98706]: 2024-09-13 02:56:43.555445125 +0000 UTC m=+0.419212138 container attach b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T02:56:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:43 smithi100 ceph-mon[92340]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:43 smithi100 ceph-mon[92340]: pgmap v149: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:56:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:43 smithi100 ceph-mon[92340]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T02:56:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:43 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1977247385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:43.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:43.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 bash[98706]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:43.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:43.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:43 smithi122 bash[98706]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:56:44.632 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T02:56:44.632 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T02:56:44.632 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:56:44.632 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:56:44.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate[98720]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 bash[98706]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T02:56:44.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:44 smithi122 podman[98706]: 2024-09-13 02:56:44.65945581 +0000 UTC m=+1.523222807 container died b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:56:45.563 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:45 smithi122 ceph-mon[79680]: pgmap v150: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T02:56:45.563 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:45.563 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:45.564 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 podman[98850]: 2024-09-13 02:56:45.251195287 +0000 UTC m=+0.582652874 container remove b42a7aca8ad204d32344500409d7c6f38ce069eb77f129d5faffb17ebb3a1a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T02:56:45.564 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 podman[98906]: 2024-09-13 02:56:45.358840021 +0000 UTC m=+0.015683213 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:45.564 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 podman[98906]: 2024-09-13 02:56:45.460326799 +0000 UTC m=+0.117169978 container create 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f) 2024-09-13T02:56:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:45 smithi100 ceph-mon[92340]: pgmap v150: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2024-09-13T02:56:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:45.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:45.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 podman[98906]: 2024-09-13 02:56:45.654170913 +0000 UTC m=+0.311014093 container init 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T02:56:45.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 podman[98906]: 2024-09-13 02:56:45.657347835 +0000 UTC m=+0.314191018 container start 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS) 2024-09-13T02:56:45.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 ceph-osd[98925]: -- 172.21.15.122:0/3949818110 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcde4621e0 con 0x55bcdd60fc00 2024-09-13T02:56:45.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 bash[98906]: 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d 2024-09-13T02:56:45.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:45 smithi122 systemd[1]: Started Ceph osd.5 for 84e01cde-7179-11ef-bceb-c7b262605968. 2024-09-13T02:56:46.591 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:46 smithi122 ceph-mon[79680]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:46.591 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:46.591 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:46.591 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:46 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:46 smithi100 ceph-mon[92340]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:46.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:46 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:47.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:47 smithi122 ceph-mon[79680]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:47.548 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:47 smithi122 ceph-mon[79680]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T02:56:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:47 smithi100 ceph-mon[92340]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:47 smithi100 ceph-mon[92340]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T02:56:47.858 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:47 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T02:56:47.546+0000 7fbcf3551640 -1 Falling back to public interface 2024-09-13T02:56:49.613 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:49 smithi122 ceph-mon[79680]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:49.614 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.614 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.614 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.614 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:49 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:49 smithi100 ceph-mon[92340]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:49 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:51.658 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:51 smithi122 ceph-mon[79680]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:51.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:51 smithi100 ceph-mon[92340]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all osd 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T02:56:53.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:56:53.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:52 smithi100 ceph-mon[92340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:56:53.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T02:56:52.964+0000 7fbcf3551640 -1 osd.5 72 log_to_monitors true 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:53.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all osd 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T02:56:53.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T02:56:53.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T02:56:53.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T02:56:53.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:53.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:56:53.439 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:52 smithi122 ceph-mon[79680]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:56:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 55/360 objects degraded (15.278%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T02:56:54.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: Upgrade: Scaling down filesystem cephfs 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T02:56:54.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:53 smithi100 ceph-mon[92340]: from='osd.5 ' entity='osd.5' 2024-09-13T02:56:54.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T02:56:53.953+0000 7fbce72e3640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:56:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 55/360 objects degraded (15.278%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T02:56:54.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: Upgrade: Scaling down filesystem cephfs 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T02:56:54.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:53 smithi122 ceph-mon[79680]: from='osd.5 ' entity='osd.5' 2024-09-13T02:56:55.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T02:56:55.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: stopping daemon mds.cephfs.smithi122.wmvyfe 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:stopping} 2 up:standby 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:56:55.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:55.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:56:55.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287] boot 2024-09-13T02:56:55.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T02:56:55.428 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: stopping daemon mds.cephfs.smithi122.wmvyfe 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:active} 2 up:standby 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.ciqoxn=up:active,1=cephfs.smithi122.wmvyfe=up:stopping} 2 up:standby 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: osd.5 [v2:172.21.15.122:6816/1618659287,v1:172.21.15.122:6817/1618659287] boot 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: osdmap e76: 6 total, 6 up, 6 in 2024-09-13T02:56:55.438 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:57.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:56 smithi100 ceph-mon[92340]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T02:56:57.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:56 smithi100 ceph-mon[92340]: pgmap v159: 65 pgs: 1 peering, 11 active+undersized, 9 active+undersized+degraded, 44 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2024-09-13T02:56:57.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:56 smithi122 ceph-mon[79680]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T02:56:57.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:56 smithi122 ceph-mon[79680]: pgmap v159: 65 pgs: 1 peering, 11 active+undersized, 9 active+undersized+degraded, 44 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2024-09-13T02:56:58.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:58 smithi100 ceph-mon[92340]: Health check update: Degraded data redundancy: 27/360 objects degraded (7.500%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:58.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:58 smithi122 ceph-mon[79680]: Health check update: Degraded data redundancy: 27/360 objects degraded (7.500%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T02:56:59.429 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:56:59 smithi100 ceph-mon[92340]: pgmap v160: 65 pgs: 1 peering, 2 active+undersized, 2 active+undersized+degraded, 60 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/360 objects degraded (1.667%) 2024-09-13T02:56:59.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:56:59 smithi122 ceph-mon[79680]: pgmap v160: 65 pgs: 1 peering, 2 active+undersized, 2 active+undersized+degraded, 60 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/360 objects degraded (1.667%) 2024-09-13T02:57:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:01 smithi100 ceph-mon[92340]: pgmap v161: 65 pgs: 1 peering, 64 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:57:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:01 smithi122 ceph-mon[79680]: pgmap v161: 65 pgs: 1 peering, 64 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:57:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:02 smithi100 ceph-mon[92340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/360 objects degraded (1.667%), 2 pgs degraded) 2024-09-13T02:57:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:02 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:57:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:02 smithi122 ceph-mon[79680]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/360 objects degraded (1.667%), 2 pgs degraded) 2024-09-13T02:57:02.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:02 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:57:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:03 smithi100 ceph-mon[92340]: pgmap v162: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T02:57:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:03 smithi122 ceph-mon[79680]: pgmap v162: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T02:57:04.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:04.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:04.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:04.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:04 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:04.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:04 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: pgmap v163: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 438 B/s wr, 0 op/s 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.588 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:05 smithi122 ceph-mon[79680]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:57:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: pgmap v163: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 438 B/s wr, 0 op/s 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:05 smithi100 ceph-mon[92340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:57:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:07 smithi100 ceph-mon[92340]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 594 B/s wr, 5 op/s 2024-09-13T02:57:07.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:07 smithi122 ceph-mon[79680]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 594 B/s wr, 5 op/s 2024-09-13T02:57:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:09 smithi100 ceph-mon[92340]: pgmap v165: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-09-13T02:57:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:09 smithi122 ceph-mon[79680]: pgmap v165: 65 pgs: 65 active+clean; 260 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 6 op/s 2024-09-13T02:57:10.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:10 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:10.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:10 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:11 smithi100 ceph-mon[92340]: pgmap v166: 65 pgs: 65 active+clean; 224 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T02:57:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:11 smithi122 ceph-mon[79680]: pgmap v166: 65 pgs: 65 active+clean; 224 MiB data, 927 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 -- 172.21.15.100:0/3800499355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fd7f0 msgr2=0x7f81280fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 --2- 172.21.15.100:0/3800499355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fd7f0 0x7f81280fdc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81180048d0 tx=0x7f8118009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 -- 172.21.15.100:0/3800499355 shutdown_connections 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 --2- 172.21.15.100:0/3800499355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fd7f0 0x7f81280fdc60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 --2- 172.21.15.100:0/3800499355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fc520 0x7f81280fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 -- 172.21.15.100:0/3800499355 >> 172.21.15.100:0/3800499355 conn(0x7f81280f7ce0 msgr2=0x7f81280fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 -- 172.21.15.100:0/3800499355 shutdown_connections 2024-09-13T02:57:12.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.627+0000 7f8130718640 1 -- 172.21.15.100:0/3800499355 wait complete. 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 Processor -- start 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 -- start start 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 0x7f812810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812810e490 con 0x7f81280fc520 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f8130718640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812810e600 con 0x7f81280fd7f0 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f812e4b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f812e4b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44050/0 (socket says 172.21.15.100:44050) 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.628+0000 7f812e4b4640 1 -- 172.21.15.100:0/1223050134 learned_addr learned my addr 172.21.15.100:0/1223050134 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812dcb3640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 0x7f812810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812e4b4640 1 -- 172.21.15.100:0/1223050134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 msgr2=0x7f812810d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812e4b4640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 0x7f812810d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812e4b4640 1 -- 172.21.15.100:0/1223050134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118005040 con 0x7f81280fc520 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812dcb3640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 0x7f812810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f812e4b4640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f812400b790 tx=0x7f81240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f812400c700 con 0x7f81280fc520 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f812400cd00 con 0x7f81280fc520 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8124015e70 con 0x7f81280fc520 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812810e8e0 con 0x7f81280fc520 2024-09-13T02:57:12.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.629+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812810ee00 con 0x7f81280fc520 2024-09-13T02:57:12.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.630+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81281057b0 con 0x7f81280fc520 2024-09-13T02:57:12.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.631+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8124012070 con 0x7f81280fc520 2024-09-13T02:57:12.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.631+0000 7f811effd640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 0x7f81140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.632+0000 7f812dcb3640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 0x7f81140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.632+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f812408db00 con 0x7f81280fc520 2024-09-13T02:57:12.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.632+0000 7f812dcb3640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 0x7f81140709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8118007ac0 tx=0x7f8118035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:12.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.636+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8124056bf0 con 0x7f81280fc520 2024-09-13T02:57:12.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.820+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f812810f0e0 con 0x7f811406e530 2024-09-13T02:57:12.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.822+0000 7f811effd640 1 -- 172.21.15.100:0/1223050134 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f812810f0e0 con 0x7f811406e530 2024-09-13T02:57:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 msgr2=0x7f81140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 0x7f81140709e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8118007ac0 tx=0x7f8118035040 comp rx=0 tx=0).stop 2024-09-13T02:57:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 msgr2=0x7f812810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f812400b790 tx=0x7f81240091d0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 shutdown_connections 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f811406e530 0x7f81140709e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81280fd7f0 0x7f812810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 --2- 172.21.15.100:0/1223050134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280fc520 0x7f812810d0e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 >> 172.21.15.100:0/1223050134 conn(0x7f81280f7ce0 msgr2=0x7f81280f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 shutdown_connections 2024-09-13T02:57:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.824+0000 7f8130718640 1 -- 172.21.15.100:0/1223050134 wait complete. 2024-09-13T02:57:12.834 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 -- 172.21.15.100:0/3810500849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 msgr2=0x7f77d40fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 --2- 172.21.15.100:0/3810500849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d40fc960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77c40048d0 tx=0x7f77c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 -- 172.21.15.100:0/3810500849 shutdown_connections 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 --2- 172.21.15.100:0/3810500849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 0x7f77d40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 --2- 172.21.15.100:0/3810500849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d40fc960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 -- 172.21.15.100:0/3810500849 >> 172.21.15.100:0/3810500849 conn(0x7f77d40f7d30 msgr2=0x7f77d40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 -- 172.21.15.100:0/3810500849 shutdown_connections 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.903+0000 7f77d9934640 1 -- 172.21.15.100:0/3810500849 wait complete. 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 Processor -- start 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 -- start start 2024-09-13T02:57:12.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 0x7f77d410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d410dc10 con 0x7f77d40fc550 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d9934640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d410e430 con 0x7f77d40fd820 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44064/0 (socket says 172.21.15.100:44064) 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 -- 172.21.15.100:0/24701183 learned_addr learned my addr 172.21.15.100:0/24701183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77cbfff640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 0x7f77d410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 -- 172.21.15.100:0/24701183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 msgr2=0x7f77d410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 0x7f77d410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.904+0000 7f77d2ffd640 1 -- 172.21.15.100:0/24701183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4005040 con 0x7f77d40fc550 2024-09-13T02:57:12.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77d2ffd640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77c40048a0 tx=0x7f77c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:12.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c4038070 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d410e660 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77c4004290 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c4033660 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.905+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d410ec00 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.906+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d40fb9b0 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.906+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f77c4030020 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.907+0000 7f77cb7fe640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 0x7f77c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.907+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f77c40ae1d0 con 0x7f77d40fc550 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.907+0000 7f77cbfff640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 0x7f77c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:12.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.907+0000 7f77cbfff640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 0x7f77c00709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77d410ce30 tx=0x7f77bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:12.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:12.911+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f77c40773f0 con 0x7f77d40fc550 2024-09-13T02:57:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.093+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d410ef80 con 0x7f77c006e530 2024-09-13T02:57:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.094+0000 7f77cb7fe640 1 -- 172.21.15.100:0/24701183 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f77d410ef80 con 0x7f77c006e530 2024-09-13T02:57:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 msgr2=0x7f77c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 0x7f77c00709e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77d410ce30 tx=0x7f77bc00b040 comp rx=0 tx=0).stop 2024-09-13T02:57:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 msgr2=0x7f77d410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f77c40048a0 tx=0x7f77c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 shutdown_connections 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f77c006e530 0x7f77c00709e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f77d40fd820 0x7f77d410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 --2- 172.21.15.100:0/24701183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77d40fc550 0x7f77d410d080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 >> 172.21.15.100:0/24701183 conn(0x7f77d40f7d30 msgr2=0x7f77d40f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 shutdown_connections 2024-09-13T02:57:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.096+0000 7f77d9934640 1 -- 172.21.15.100:0/24701183 wait complete. 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 -- 172.21.15.100:0/3995274941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 msgr2=0x7faff40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 --2- 172.21.15.100:0/3995274941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff40fb840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fafe40048d0 tx=0x7fafe4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 -- 172.21.15.100:0/3995274941 shutdown_connections 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 --2- 172.21.15.100:0/3995274941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 0x7faff40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 --2- 172.21.15.100:0/3995274941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff40fb840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 -- 172.21.15.100:0/3995274941 >> 172.21.15.100:0/3995274941 conn(0x7faff40f6c10 msgr2=0x7faff40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 -- 172.21.15.100:0/3995274941 shutdown_connections 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.177+0000 7faff8ad7640 1 -- 172.21.15.100:0/3995274941 wait complete. 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 Processor -- start 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 -- start start 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 0x7faff410c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff410d390 con 0x7faff40fb430 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff8ad7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff410d500 con 0x7faff40fc700 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44080/0 (socket says 172.21.15.100:44080) 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 -- 172.21.15.100:0/15472173 learned_addr learned my addr 172.21.15.100:0/15472173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff1d9b640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 0x7faff410c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 -- 172.21.15.100:0/15472173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 msgr2=0x7faff410c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 0x7faff410c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 -- 172.21.15.100:0/15472173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4005040 con 0x7faff40fb430 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.178+0000 7faff259c640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafe40048a0 tx=0x7fafe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.179+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe403a070 con 0x7faff40fb430 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.179+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafe403faa0 con 0x7faff40fb430 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.179+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff410d780 con 0x7faff40fb430 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.179+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe4033a60 con 0x7faff40fb430 2024-09-13T02:57:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.179+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff410dc40 con 0x7faff40fb430 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.180+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff41046c0 con 0x7faff40fb430 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.180+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fafe4030020 con 0x7faff40fb430 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.181+0000 7fafe2ffd640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 0x7fafdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.181+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fafe40b0b30 con 0x7faff40fb430 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.181+0000 7faff1d9b640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 0x7fafdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.181+0000 7faff1d9b640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 0x7fafdc0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faff410bd90 tx=0x7fafe8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.185+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fafe4079c60 con 0x7faff40fb430 2024-09-13T02:57:13.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.359+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faff410deb0 con 0x7fafdc06e530 2024-09-13T02:57:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.368+0000 7fafe2ffd640 1 -- 172.21.15.100:0/15472173 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faff410deb0 con 0x7fafdc06e530 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (5m) 2m ago 14m 25.5M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (3m) 2m ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (3m) 25s ago 13m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (5m) 2m ago 14m 79.2M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (8m) 2m ago 8m 134M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (8m) 2m ago 8m 13.6M - 17.2.7-1627-gbbdadfa3 a994b00deb3a f4aaf69eb85b 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (8m) 25s ago 8m 17.1M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (8m) 25s ago 8m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (5m) 2m ago 15m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (4m) 25s ago 13m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (4m) 2m ago 15m 47.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:57:13.370 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (4m) 25s ago 13m 41.7M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 2m ago 14m 17.0M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (5m) 25s ago 13m 16.5M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (3m) 2m ago 12m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (2m) 2m ago 12m 93.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (2m) 2m ago 11m 14.3M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (91s) 25s ago 11m 113M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (59s) 25s ago 10m 108M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (28s) 25s ago 10m 12.0M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T02:57:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (4m) 2m ago 13m 60.5M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:57:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 msgr2=0x7fafdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 0x7fafdc0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faff410bd90 tx=0x7fafe8008040 comp rx=0 tx=0).stop 2024-09-13T02:57:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 msgr2=0x7faff410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fafe40048a0 tx=0x7fafe4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 shutdown_connections 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fafdc06e530 0x7fafdc0709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faff40fc700 0x7faff410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 --2- 172.21.15.100:0/15472173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faff40fb430 0x7faff410bfe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 >> 172.21.15.100:0/15472173 conn(0x7faff40f6c10 msgr2=0x7faff40f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 shutdown_connections 2024-09-13T02:57:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.371+0000 7faff8ad7640 1 -- 172.21.15.100:0/15472173 wait complete. 2024-09-13T02:57:13.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 -- 172.21.15.100:0/2230632003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 msgr2=0x7f5e280fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/2230632003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e280fdc60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0048d0 tx=0x7f5e1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 -- 172.21.15.100:0/2230632003 shutdown_connections 2024-09-13T02:57:13.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/2230632003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e280fdc60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/2230632003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e280fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 -- 172.21.15.100:0/2230632003 >> 172.21.15.100:0/2230632003 conn(0x7f5e280f7ce0 msgr2=0x7f5e280fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 -- 172.21.15.100:0/2230632003 shutdown_connections 2024-09-13T02:57:13.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.447+0000 7f5e2fd89640 1 -- 172.21.15.100:0/2230632003 wait complete. 2024-09-13T02:57:13.450 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:13 smithi100 ceph-mon[92340]: pgmap v167: 65 pgs: 65 active+clean; 180 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-13T02:57:13.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 Processor -- start 2024-09-13T02:57:13.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 -- start start 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e2810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2810e490 con 0x7f5e280fd7f0 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.448+0000 7f5e2fd89640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2810e600 con 0x7f5e280fc520 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44098/0 (socket says 172.21.15.100:44098) 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 -- 172.21.15.100:0/3751423760 learned_addr learned my addr 172.21.15.100:0/3751423760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2db25640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e2810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 -- 172.21.15.100:0/3751423760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 msgr2=0x7f5e2810d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e2810d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 -- 172.21.15.100:0/3751423760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c005040 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2db25640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e2810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2d324640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003080 tx=0x7f5e1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e1c038070 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2810e880 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e1c02abd0 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e1c03e670 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.449+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2810eda0 con 0x7f5e280fd7f0 2024-09-13T02:57:13.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.450+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e280fb980 con 0x7f5e280fd7f0 2024-09-13T02:57:13.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.451+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5e1c030020 con 0x7f5e280fd7f0 2024-09-13T02:57:13.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.451+0000 7f5e267fc640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 0x7f5e100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.451+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e1c0ae560 con 0x7f5e280fd7f0 2024-09-13T02:57:13.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.451+0000 7f5e2db25640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 0x7f5e100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.452+0000 7f5e2db25640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 0x7f5e100709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001370 tx=0x7f5e180096a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.456+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e1c077650 con 0x7f5e280fd7f0 2024-09-13T02:57:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:13 smithi122 ceph-mon[79680]: pgmap v167: 65 pgs: 65 active+clean; 180 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-13T02:57:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.690+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e2804b720 con 0x7f5e280fd7f0 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.690+0000 7f5e267fc640 1 -- 172.21.15.100:0/3751423760 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f5e1c07ad10 con 0x7f5e280fd7f0 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:13.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 10 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:57:13.693 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:57:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 msgr2=0x7f5e100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 0x7f5e100709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001370 tx=0x7f5e180096a0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 msgr2=0x7f5e2810d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003080 tx=0x7f5e1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 shutdown_connections 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5e1006e530 0x7f5e100709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e280fd7f0 0x7f5e2810d620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 --2- 172.21.15.100:0/3751423760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e280fc520 0x7f5e2810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 >> 172.21.15.100:0/3751423760 conn(0x7f5e280f7ce0 msgr2=0x7f5e280f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 shutdown_connections 2024-09-13T02:57:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.693+0000 7f5e2fd89640 1 -- 172.21.15.100:0/3751423760 wait complete. 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 -- 172.21.15.100:0/281014591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 msgr2=0x7fd9bc0fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 --2- 172.21.15.100:0/281014591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc0fdc70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00048d0 tx=0x7fd9b0009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 -- 172.21.15.100:0/281014591 shutdown_connections 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 --2- 172.21.15.100:0/281014591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc0fdc70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 --2- 172.21.15.100:0/281014591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 0x7fd9bc0fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 -- 172.21.15.100:0/281014591 >> 172.21.15.100:0/281014591 conn(0x7fd9bc0f7d10 msgr2=0x7fd9bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 -- 172.21.15.100:0/281014591 shutdown_connections 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.771+0000 7fd9c10af640 1 -- 172.21.15.100:0/281014591 wait complete. 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 Processor -- start 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 -- start start 2024-09-13T02:57:13.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 0x7fd9bc10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc10e490 con 0x7fd9bc0fd800 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9c10af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc10e600 con 0x7fd9bc0fc530 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44120/0 (socket says 172.21.15.100:44120) 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 -- 172.21.15.100:0/1848638348 learned_addr learned my addr 172.21.15.100:0/1848638348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9bad9d640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 0x7fd9bc10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 -- 172.21.15.100:0/1848638348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 msgr2=0x7fd9bc10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 0x7fd9bc10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.772+0000 7fd9ba59c640 1 -- 172.21.15.100:0/1848638348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0005040 con 0x7fd9bc0fd800 2024-09-13T02:57:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9ba59c640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0003080 tx=0x7fd9b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b0038070 con 0x7fd9bc0fd800 2024-09-13T02:57:13.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd9b002abd0 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc10e880 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b003e670 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.773+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc10eda0 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.774+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc0fb990 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.774+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd9b0030020 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.775+0000 7fd9a37fe640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 0x7fd9a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.775+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd9b00ae5b0 con 0x7fd9bc0fd800 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.775+0000 7fd9bad9d640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 0x7fd9a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.775+0000 7fd9bad9d640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 0x7fd9a40709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006fd0 tx=0x7fd9ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:13.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.779+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd9b00776a0 con 0x7fd9bc0fd800 2024-09-13T02:57:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.980+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9bc04b720 con 0x7fd9bc0fd800 2024-09-13T02:57:13.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.981+0000 7fd9a37fe640 1 -- 172.21.15.100:0/1848638348 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1943 (secure 0 0 0) 0x7fd9b007ad60 con 0x7fd9bc0fd800 2024-09-13T02:57:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:e22 2024-09-13T02:57:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:56:54:145094+0000 2024-09-13T02:57:13.982 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 22 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:56:54.145092+0000 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:57:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 44 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=14470,1=24259} 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:57:13.984 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 14470 members: 14470 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{0:14470} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.100:6828/2158470851,v1:172.21.15.100:6829/2158470851] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{1:24259} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:14482} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/3310990359,v1:172.21.15.100:6827/3310990359] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:13.985 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:24271} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 22 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.983+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 msgr2=0x7fd9a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.983+0000 7fd9c10af640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 0x7fd9a40709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006fd0 tx=0x7fd9ac008040 comp rx=0 tx=0).stop 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.983+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 msgr2=0x7fd9bc10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.983+0000 7fd9c10af640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0003080 tx=0x7fd9b0009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 shutdown_connections 2024-09-13T02:57:13.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd9a406e530 0x7fd9a40709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9bc0fd800 0x7fd9bc10d620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 --2- 172.21.15.100:0/1848638348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9bc0fc530 0x7fd9bc10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 >> 172.21.15.100:0/1848638348 conn(0x7fd9bc0f7d10 msgr2=0x7fd9bc0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 shutdown_connections 2024-09-13T02:57:13.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:13.984+0000 7fd9c10af640 1 -- 172.21.15.100:0/1848638348 wait complete. 2024-09-13T02:57:14.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 -- 172.21.15.100:0/55155411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fc520 msgr2=0x7fc6bc0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 --2- 172.21.15.100:0/55155411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc0fc930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00048d0 tx=0x7fc6b0009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 -- 172.21.15.100:0/55155411 shutdown_connections 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 --2- 172.21.15.100:0/55155411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 --2- 172.21.15.100:0/55155411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc0fc930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 -- 172.21.15.100:0/55155411 >> 172.21.15.100:0/55155411 conn(0x7fc6bc0f7ce0 msgr2=0x7fc6bc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 -- 172.21.15.100:0/55155411 shutdown_connections 2024-09-13T02:57:14.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 -- 172.21.15.100:0/55155411 wait complete. 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.062+0000 7fc6c4544640 1 Processor -- start 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c4544640 1 -- start start 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c4544640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c4544640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c4544640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc10dc40 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c4544640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc10e460 con 0x7fc6bc0fc520 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44134/0 (socket says 172.21.15.100:44134) 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 -- 172.21.15.100:0/2885894094 learned_addr learned my addr 172.21.15.100:0/2885894094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c22e0640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 -- 172.21.15.100:0/2885894094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fc520 msgr2=0x7fc6bc10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 -- 172.21.15.100:0/2885894094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0005040 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.063+0000 7fc6c1adf640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8002a50 tx=0x7fc6b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.064+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8007c30 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.064+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc6b800f040 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.064+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc10e6f0 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.064+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b800da10 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.064+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc10ec90 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.065+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc0fb980 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.065+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc6b800dbb0 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.066+0000 7fc6aeffd640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 0x7fc6a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.066+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc6b808d8c0 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.066+0000 7fc6c22e0640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 0x7fc6a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.066+0000 7fc6c22e0640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 0x7fc6a80709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000c00 tx=0x7fc6b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:14.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.070+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc6b8056ae0 con 0x7fc6bc0fd7f0 2024-09-13T02:57:14.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.251+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6bc10f010 con 0x7fc6a806e530 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.252+0000 7fc6aeffd640 1 -- 172.21.15.100:0/2885894094 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc6bc10f010 con 0x7fc6a806e530 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "osd", 2024-09-13T02:57:14.254 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:57:14.255 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:57:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.254+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 msgr2=0x7fc6a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 0x7fc6a80709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0000c00 tx=0x7fc6b0035040 comp rx=0 tx=0).stop 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 msgr2=0x7fc6bc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8002a50 tx=0x7fc6b8004600 comp rx=0 tx=0).stop 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 shutdown_connections 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc6a806e530 0x7fc6a80709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6bc0fd7f0 0x7fc6bc10d5f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 --2- 172.21.15.100:0/2885894094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc6bc0fc520 0x7fc6bc10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 >> 172.21.15.100:0/2885894094 conn(0x7fc6bc0f7ce0 msgr2=0x7fc6bc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 shutdown_connections 2024-09-13T02:57:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.255+0000 7fc6c4544640 1 -- 172.21.15.100:0/2885894094 wait complete. 2024-09-13T02:57:14.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.334+0000 7f0636dc5640 1 -- 172.21.15.100:0/1643814433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fc700 msgr2=0x7f06300fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.334+0000 7f0636dc5640 1 --2- 172.21.15.100:0/1643814433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fc700 0x7f06300fcb70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f061c0048d0 tx=0x7f061c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- 172.21.15.100:0/1643814433 shutdown_connections 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 --2- 172.21.15.100:0/1643814433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fc700 0x7f06300fcb70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 --2- 172.21.15.100:0/1643814433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fb430 0x7f06300fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- 172.21.15.100:0/1643814433 >> 172.21.15.100:0/1643814433 conn(0x7f06300f6c10 msgr2=0x7f06300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- 172.21.15.100:0/1643814433 shutdown_connections 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- 172.21.15.100:0/1643814433 wait complete. 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 Processor -- start 2024-09-13T02:57:14.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- start start 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fc700 0x7f063010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063010dc10 con 0x7f06300fb430 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.335+0000 7f0636dc5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063010e430 con 0x7f06300fc700 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44142/0 (socket says 172.21.15.100:44142) 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 -- 172.21.15.100:0/4266134341 learned_addr learned my addr 172.21.15.100:0/4266134341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f062ffff640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fc700 0x7f063010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 -- 172.21.15.100:0/4266134341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fc700 msgr2=0x7f063010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fc700 0x7f063010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 -- 172.21.15.100:0/4266134341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c005040 con 0x7f06300fb430 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0634b61640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0624002a50 tx=0x7f0624004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0624007c30 con 0x7f06300fb430 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f062400f040 con 0x7f06300fb430 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063010e6c0 con 0x7f06300fb430 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.336+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f062400da10 con 0x7f06300fb430 2024-09-13T02:57:14.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.337+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063010ec60 con 0x7f06300fb430 2024-09-13T02:57:14.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.338+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300fa890 con 0x7f06300fb430 2024-09-13T02:57:14.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.338+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f062400dca0 con 0x7f06300fb430 2024-09-13T02:57:14.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.338+0000 7f062d7fa640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 0x7f06200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:14.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.339+0000 7f062ffff640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 0x7f06200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:14.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.339+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f062408d930 con 0x7f06300fb430 2024-09-13T02:57:14.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.339+0000 7f062ffff640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 0x7f06200709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f063010ce30 tx=0x7f061c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:14.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.343+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0624056ad0 con 0x7f06300fb430 2024-09-13T02:57:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.585+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f063004b720 con 0x7f06300fb430 2024-09-13T02:57:14.587 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.587 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.587 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.587 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3751423760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:14.587 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1848638348' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:14.588 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:14.588 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:14.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.586+0000 7f062d7fa640 1 -- 172.21.15.100:0/4266134341 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f062405a190 con 0x7f06300fb430 2024-09-13T02:57:14.588 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:57:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 msgr2=0x7f06200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 0x7f06200709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f063010ce30 tx=0x7f061c035040 comp rx=0 tx=0).stop 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 msgr2=0x7f063010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0624002a50 tx=0x7f0624004600 comp rx=0 tx=0).stop 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 shutdown_connections 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f062006e530 0x7f06200709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f06300fc700 0x7f063010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 --2- 172.21.15.100:0/4266134341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06300fb430 0x7f063010d080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 >> 172.21.15.100:0/4266134341 conn(0x7f06300f6c10 msgr2=0x7f0630065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 shutdown_connections 2024-09-13T02:57:14.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:14.588+0000 7f0636dc5640 1 -- 172.21.15.100:0/4266134341 wait complete. 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3751423760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1848638348' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:14.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: pgmap v168: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/4266134341' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:15 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: pgmap v168: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/4266134341' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:15.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:15 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:16.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:16 smithi100 ceph-mon[92340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:57:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:16 smithi122 ceph-mon[79680]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T02:57:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:17 smithi100 ceph-mon[92340]: pgmap v169: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 8 op/s 2024-09-13T02:57:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:17 smithi122 ceph-mon[79680]: pgmap v169: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 8 op/s 2024-09-13T02:57:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:19 smithi100 ceph-mon[92340]: pgmap v170: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 4 op/s 2024-09-13T02:57:19.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:19 smithi100 ceph-mon[92340]: daemon mds.cephfs.smithi122.wmvyfe finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T02:57:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:19 smithi122 ceph-mon[79680]: pgmap v170: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 4 op/s 2024-09-13T02:57:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:19 smithi122 ceph-mon[79680]: daemon mds.cephfs.smithi122.wmvyfe finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T02:57:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:20 smithi100 ceph-mon[92340]: mds.1 [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] down:stopped 2024-09-13T02:57:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:20 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:57:20.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:20 smithi122 ceph-mon[79680]: mds.1 [v2:172.21.15.122:6824/3893731861,v1:172.21.15.122:6825/3893731861] down:stopped 2024-09-13T02:57:20.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:20 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:57:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:21 smithi100 ceph-mon[92340]: pgmap v171: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-13T02:57:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:21 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6824/209732889,v1:172.21.15.122:6825/209732889] up:boot 2024-09-13T02:57:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:21 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 3 up:standby 2024-09-13T02:57:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:57:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:21 smithi122 ceph-mon[79680]: pgmap v171: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-13T02:57:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:21 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6824/209732889,v1:172.21.15.122:6825/209732889] up:boot 2024-09-13T02:57:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:21 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 3 up:standby 2024-09-13T02:57:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:57:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:23 smithi100 ceph-mon[92340]: pgmap v172: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-09-13T02:57:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:23 smithi122 ceph-mon[79680]: pgmap v172: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-09-13T02:57:25.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: pgmap v173: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T02:57:25.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:25.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:25.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:25.650 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:25 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.slkwfs"]}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: pgmap v173: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:25.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:25 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.slkwfs"]}]: dispatch 2024-09-13T02:57:26.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:26 smithi100 ceph-mon[92340]: Upgrade: It appears safe to stop mds.cephfs.smithi100.slkwfs 2024-09-13T02:57:26.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:26 smithi122 ceph-mon[79680]: Upgrade: It appears safe to stop mds.cephfs.smithi100.slkwfs 2024-09-13T02:57:27.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:27 smithi100 ceph-mon[92340]: pgmap v174: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:57:27.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:27.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:27.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:27 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:27 smithi122 ceph-mon[79680]: pgmap v174: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:57:27.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:27.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.slkwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:27.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:27 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:28 smithi100 ceph-mon[92340]: Upgrade: Updating mds.cephfs.smithi100.slkwfs 2024-09-13T02:57:28.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:28 smithi100 ceph-mon[92340]: Deploying daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:57:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:28 smithi122 ceph-mon[79680]: Upgrade: Updating mds.cephfs.smithi100.slkwfs 2024-09-13T02:57:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:28 smithi122 ceph-mon[79680]: Deploying daemon mds.cephfs.smithi100.slkwfs on smithi100 2024-09-13T02:57:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:29 smithi100 ceph-mon[92340]: pgmap v175: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:57:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:29 smithi100 ceph-mon[92340]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T02:57:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:29 smithi122 ceph-mon[79680]: pgmap v175: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T02:57:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:29 smithi122 ceph-mon[79680]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T02:57:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:30 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:57:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:30 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:57:30.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:30 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:57:30.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:30 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:57:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:31 smithi100 ceph-mon[92340]: pgmap v177: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:31.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:31 smithi122 ceph-mon[79680]: pgmap v177: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:33 smithi100 ceph-mon[92340]: pgmap v178: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:33 smithi122 ceph-mon[79680]: pgmap v178: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:34.521 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:34 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:boot 2024-09-13T02:57:34.521 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:34 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 3 up:standby 2024-09-13T02:57:34.521 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:34 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:57:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:34 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:boot 2024-09-13T02:57:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:34 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.ciqoxn=up:active} 3 up:standby 2024-09-13T02:57:34.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:34 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:57:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:35 smithi100 ceph-mon[92340]: pgmap v179: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:35 smithi122 ceph-mon[79680]: pgmap v179: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:37.683 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:37 smithi100 ceph-mon[92340]: pgmap v180: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:37 smithi122 ceph-mon[79680]: pgmap v180: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:39.269 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:39 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.269 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:39 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.269 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:39 smithi100 ceph-mon[92340]: pgmap v181: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:39.269 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:39 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.269 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:39 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:39 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:39 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:39 smithi122 ceph-mon[79680]: pgmap v181: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:39.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:39 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:39.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:39 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:41.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:41 smithi100 ceph-mon[92340]: pgmap v182: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:41 smithi122 ceph-mon[79680]: pgmap v182: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: Detected new or changed devices on smithi100 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:42.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.ciqoxn"]}]: dispatch 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: Upgrade: It appears safe to stop mds.cephfs.smithi100.ciqoxn 2024-09-13T02:57:42.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:42 smithi100 ceph-mon[92340]: pgmap v183: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:43.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: Detected new or changed devices on smithi100 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:43.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.ciqoxn"]}]: dispatch 2024-09-13T02:57:43.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: Upgrade: It appears safe to stop mds.cephfs.smithi100.ciqoxn 2024-09-13T02:57:43.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:42 smithi122 ceph-mon[79680]: pgmap v183: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 -- 172.21.15.100:0/876339293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fc700 msgr2=0x7f88cc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 --2- 172.21.15.100:0/876339293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fc700 0x7f88cc0fcb70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f88b40048d0 tx=0x7f88b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 -- 172.21.15.100:0/876339293 shutdown_connections 2024-09-13T02:57:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 --2- 172.21.15.100:0/876339293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fc700 0x7f88cc0fcb70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: Upgrade: Updating mds.cephfs.smithi100.ciqoxn 2024-09-13T02:57:44.673 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:44.673 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:44.673 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:44.673 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: Deploying daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:57:44.673 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 --2- 172.21.15.100:0/876339293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fb430 0x7f88cc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.669+0000 7f88d1959640 1 -- 172.21.15.100:0/876339293 >> 172.21.15.100:0/876339293 conn(0x7f88cc0f6c10 msgr2=0x7f88cc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 -- 172.21.15.100:0/876339293 shutdown_connections 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 -- 172.21.15.100:0/876339293 wait complete. 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 Processor -- start 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 -- start start 2024-09-13T02:57:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 0x7f88cc10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc10e4a0 con 0x7f88cc0fb430 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.670+0000 7f88d1959640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc10e610 con 0x7f88cc0fc700 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35470/0 (socket says 172.21.15.100:35470) 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 -- 172.21.15.100:0/608552643 learned_addr learned my addr 172.21.15.100:0/608552643 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88c27fc640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 0x7f88cc10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 -- 172.21.15.100:0/608552643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 msgr2=0x7f88cc10d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 0x7f88cc10d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 -- 172.21.15.100:0/608552643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4005040 con 0x7f88cc0fb430 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88c27fc640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 0x7f88cc10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88caffd640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b790 tx=0x7f88bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88bc00c700 con 0x7f88cc0fb430 2024-09-13T02:57:44.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f88bc00cd00 con 0x7f88cc0fb430 2024-09-13T02:57:44.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc10e8f0 con 0x7f88cc0fb430 2024-09-13T02:57:44.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88bc015e70 con 0x7f88cc0fb430 2024-09-13T02:57:44.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.671+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc10ee10 con 0x7f88cc0fb430 2024-09-13T02:57:44.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.673+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc1046c0 con 0x7f88cc0fb430 2024-09-13T02:57:44.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.673+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f88bc012070 con 0x7f88cc0fb430 2024-09-13T02:57:44.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.674+0000 7f88c3fff640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 0x7f88b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:44.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.674+0000 7f88c27fc640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 0x7f88b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:44.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.674+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f88bc08dd80 con 0x7f88cc0fb430 2024-09-13T02:57:44.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.674+0000 7f88c27fc640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 0x7f88b80709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b020 tx=0x7f88b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:44.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.679+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f88bc056e70 con 0x7f88cc0fb430 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: Upgrade: Updating mds.cephfs.smithi100.ciqoxn 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.ciqoxn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: Deploying daemon mds.cephfs.smithi100.ciqoxn on smithi100 2024-09-13T02:57:44.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:44.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.921+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88cc103f20 con 0x7f88b806e530 2024-09-13T02:57:44.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.923+0000 7f88c3fff640 1 -- 172.21.15.100:0/608552643 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88cc103f20 con 0x7f88b806e530 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 msgr2=0x7f88b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 0x7f88b80709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b020 tx=0x7f88b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 msgr2=0x7f88cc10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00b790 tx=0x7f88bc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 shutdown_connections 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f88b806e530 0x7f88b80709e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f88cc0fc700 0x7f88cc10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 --2- 172.21.15.100:0/608552643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88cc0fb430 0x7f88cc10d0f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.925+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 >> 172.21.15.100:0/608552643 conn(0x7f88cc0f6c10 msgr2=0x7f88cc065630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.926+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 shutdown_connections 2024-09-13T02:57:44.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:44.926+0000 7f88d1959640 1 -- 172.21.15.100:0/608552643 wait complete. 2024-09-13T02:57:44.936 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 -- 172.21.15.100:0/90343360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fc520 msgr2=0x7f98440fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 --2- 172.21.15.100:0/90343360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fc520 0x7f98440fc930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f98340048d0 tx=0x7f9834009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 -- 172.21.15.100:0/90343360 shutdown_connections 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 --2- 172.21.15.100:0/90343360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fd7f0 0x7f98440fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 --2- 172.21.15.100:0/90343360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fc520 0x7f98440fc930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 -- 172.21.15.100:0/90343360 >> 172.21.15.100:0/90343360 conn(0x7f98440f7ce0 msgr2=0x7f98440fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 -- 172.21.15.100:0/90343360 shutdown_connections 2024-09-13T02:57:45.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.007+0000 7f984a660640 1 -- 172.21.15.100:0/90343360 wait complete. 2024-09-13T02:57:45.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 Processor -- start 2024-09-13T02:57:45.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 -- start start 2024-09-13T02:57:45.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fc520 0x7f984410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984410dc10 con 0x7f98440fd7f0 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f984a660640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984410e430 con 0x7f98440fc520 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f98437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f98437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35492/0 (socket says 172.21.15.100:35492) 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f98437fe640 1 -- 172.21.15.100:0/3005959547 learned_addr learned my addr 172.21.15.100:0/3005959547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.008+0000 7f9843fff640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fc520 0x7f984410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f98437fe640 1 -- 172.21.15.100:0/3005959547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fc520 msgr2=0x7f984410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f98437fe640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fc520 0x7f984410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f98437fe640 1 -- 172.21.15.100:0/3005959547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834005040 con 0x7f98440fd7f0 2024-09-13T02:57:45.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f98437fe640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9838002a50 tx=0x7f9838004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9838007c30 con 0x7f98440fd7f0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f983800f040 con 0x7f98440fd7f0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984410e6c0 con 0x7f98440fd7f0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983800dad0 con 0x7f98440fd7f0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.009+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984410ec60 con 0x7f98440fd7f0 2024-09-13T02:57:45.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.010+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98440fb980 con 0x7f98440fd7f0 2024-09-13T02:57:45.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.011+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f983800dc30 con 0x7f98440fd7f0 2024-09-13T02:57:45.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.011+0000 7f9840ff9640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 0x7f982c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.011+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f983808e070 con 0x7f98440fd7f0 2024-09-13T02:57:45.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.011+0000 7f9843fff640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 0x7f982c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.012+0000 7f9843fff640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 0x7f982c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f983400b020 tx=0x7f9834035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.016+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9838057120 con 0x7f98440fd7f0 2024-09-13T02:57:45.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.220+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f984410ef40 con 0x7f982c06e530 2024-09-13T02:57:45.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.221+0000 7f9840ff9640 1 -- 172.21.15.100:0/3005959547 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f984410ef40 con 0x7f982c06e530 2024-09-13T02:57:45.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 msgr2=0x7f982c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 0x7f982c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f983400b020 tx=0x7f9834035040 comp rx=0 tx=0).stop 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 msgr2=0x7f984410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9838002a50 tx=0x7f9838004600 comp rx=0 tx=0).stop 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 shutdown_connections 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f982c06e530 0x7f982c0709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98440fd7f0 0x7f984410d5c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 --2- 172.21.15.100:0/3005959547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98440fc520 0x7f984410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 >> 172.21.15.100:0/3005959547 conn(0x7f98440f7ce0 msgr2=0x7f98440f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 shutdown_connections 2024-09-13T02:57:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.223+0000 7f984a660640 1 -- 172.21.15.100:0/3005959547 wait complete. 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 -- 172.21.15.100:0/58588473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 msgr2=0x7f1c800fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 --2- 172.21.15.100:0/58588473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c800fc930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c700048d0 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 -- 172.21.15.100:0/58588473 shutdown_connections 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 --2- 172.21.15.100:0/58588473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 0x7f1c800fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 --2- 172.21.15.100:0/58588473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c800fc930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 -- 172.21.15.100:0/58588473 >> 172.21.15.100:0/58588473 conn(0x7f1c800f7ce0 msgr2=0x7f1c800fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 -- 172.21.15.100:0/58588473 shutdown_connections 2024-09-13T02:57:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.305+0000 7f1c85aef640 1 -- 172.21.15.100:0/58588473 wait complete. 2024-09-13T02:57:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 Processor -- start 2024-09-13T02:57:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 -- start start 2024-09-13T02:57:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 0x7f1c8010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8010dc10 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.306+0000 7f1c85aef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8010e430 con 0x7f1c800fd7f0 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35506/0 (socket says 172.21.15.100:35506) 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 -- 172.21.15.100:0/1088493674 learned_addr learned my addr 172.21.15.100:0/1088493674 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7effd640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 0x7f1c8010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 -- 172.21.15.100:0/1088493674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 msgr2=0x7f1c8010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 0x7f1c8010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 -- 172.21.15.100:0/1088493674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70005040 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.307+0000 7f1c7f7fe640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1c700043d0 tx=0x7f1c70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.308+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c70038070 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.308+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c70009800 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.308+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7003e670 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.308+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8010e660 con 0x7f1c800fc520 2024-09-13T02:57:45.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.308+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8010eb80 con 0x7f1c800fc520 2024-09-13T02:57:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.309+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c800fb980 con 0x7f1c800fc520 2024-09-13T02:57:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.309+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1c70030020 con 0x7f1c800fc520 2024-09-13T02:57:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.310+0000 7f1c67fff640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 0x7f1c680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.310+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1c700ae2d0 con 0x7f1c800fc520 2024-09-13T02:57:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.310+0000 7f1c7effd640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 0x7f1c680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.310+0000 7f1c7effd640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 0x7f1c680709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c8010ce30 tx=0x7f1c7400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.316+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c70077490 con 0x7f1c800fc520 2024-09-13T02:57:45.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.496+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c8010ef00 con 0x7f1c6806e530 2024-09-13T02:57:45.499 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[92336]: 2024-09-13T02:57:45.299+0000 7f57e100e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:57:45.499 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: pgmap v184: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:45.499 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: Standby daemon mds.cephfs.smithi122.crukff assigned to filesystem cephfs as rank 0 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T02:57:45.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:45 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:replay} 2 up:standby 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.506+0000 7f1c67fff640 1 -- 172.21.15.100:0/1088493674 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1c8010ef00 con 0x7f1c6806e530 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (6m) 7s ago 14m 23.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (4m) 7s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (4m) 57s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:57:45.508 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (6m) 7s ago 14m 86.6M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (9m) 7s ago 9m 133M - 17.2.7-1627-gbbdadfa3 a994b00deb3a feab4bb00fc5 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (12s) 7s ago 9m 15.4M - 19.1.1-322-g7741f7f9 19dc8d659727 3a0baec05ca7 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (9m) 57s ago 9m 17.1M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (9m) 57s ago 9m 120M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 3ccf33288dae 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (5m) 7s ago 16m 504M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (5m) 57s ago 13m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (5m) 7s ago 16m 49.7M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (4m) 57s ago 13m 41.7M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:57:45.509 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 7s ago 15m 16.4M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (6m) 57s ago 14m 16.5M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (3m) 7s ago 13m 101M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (3m) 7s ago 12m 97.9M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (2m) 7s ago 12m 85.1M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (2m) 57s ago 11m 113M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (92s) 57s ago 11m 108M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (60s) 57s ago 10m 12.0M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T02:57:45.510 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 7s ago 14m 61.9M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 msgr2=0x7f1c680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 0x7f1c680709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c8010ce30 tx=0x7f1c7400b040 comp rx=0 tx=0).stop 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 msgr2=0x7f1c8010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1c700043d0 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 shutdown_connections 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1c6806e530 0x7f1c680709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c800fd7f0 0x7f1c8010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 --2- 172.21.15.100:0/1088493674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c800fc520 0x7f1c8010d080 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 >> 172.21.15.100:0/1088493674 conn(0x7f1c800f7ce0 msgr2=0x7f1c800f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 shutdown_connections 2024-09-13T02:57:45.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.508+0000 7f1c85aef640 1 -- 172.21.15.100:0/1088493674 wait complete. 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.585+0000 7f7312fdd640 1 -- 172.21.15.100:0/2842958530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 msgr2=0x7f730c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.585+0000 7f7312fdd640 1 --2- 172.21.15.100:0/2842958530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c0fb860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73040048d0 tx=0x7f7304009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- 172.21.15.100:0/2842958530 shutdown_connections 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 --2- 172.21.15.100:0/2842958530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 0x7f730c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 --2- 172.21.15.100:0/2842958530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c0fb860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- 172.21.15.100:0/2842958530 >> 172.21.15.100:0/2842958530 conn(0x7f730c0f6c10 msgr2=0x7f730c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- 172.21.15.100:0/2842958530 shutdown_connections 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- 172.21.15.100:0/2842958530 wait complete. 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 Processor -- start 2024-09-13T02:57:45.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- start start 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 0x7f730c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c10cb10 con 0x7f730c0fb450 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.586+0000 7f7312fdd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c10d330 con 0x7f730c0fc720 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35530/0 (socket says 172.21.15.100:35530) 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 -- 172.21.15.100:0/3824565463 learned_addr learned my addr 172.21.15.100:0/3824565463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f730bfff640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 0x7f730c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 -- 172.21.15.100:0/3824565463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 msgr2=0x7f730c10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 0x7f730c10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 -- 172.21.15.100:0/3824565463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304005040 con 0x7f730c0fb450 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7310d79640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73040043d0 tx=0x7f7304009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7304038070 con 0x7f730c0fb450 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f730402ae90 con 0x7f730c0fb450 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c10d560 con 0x7f730c0fb450 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730403e670 con 0x7f730c0fb450 2024-09-13T02:57:45.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.587+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c10db00 con 0x7f730c0fb450 2024-09-13T02:57:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.588+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c0fa8b0 con 0x7f730c0fb450 2024-09-13T02:57:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.589+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7304030020 con 0x7f730c0fb450 2024-09-13T02:57:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.589+0000 7f73097fa640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 0x7f72f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.589+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f73040ae390 con 0x7f730c0fb450 2024-09-13T02:57:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.589+0000 7f730bfff640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 0x7f72f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.590+0000 7f730bfff640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 0x7f72f80709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f730c10bd30 tx=0x7f72fc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.594+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f73040774d0 con 0x7f730c0fb450 2024-09-13T02:57:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: pgmap v184: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:57:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:57:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:57:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T02:57:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: Standby daemon mds.cephfs.smithi122.crukff assigned to filesystem cephfs as rank 0 2024-09-13T02:57:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:57:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T02:57:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:45 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:replay} 2 up:standby 2024-09-13T02:57:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.829+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f730c10dde0 con 0x7f730c0fb450 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.829+0000 7f73097fa640 1 -- 172.21.15.100:0/3824565463 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f730407ab90 con 0x7f730c0fb450 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:57:45.832 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 11 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:57:45.833 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.832+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 msgr2=0x7f72f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.832+0000 7f7312fdd640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 0x7f72f80709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f730c10bd30 tx=0x7f72fc009040 comp rx=0 tx=0).stop 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.832+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 msgr2=0x7f730c10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73040043d0 tx=0x7f7304009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 shutdown_connections 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f72f806e530 0x7f72f80709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f730c0fc720 0x7f730c10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 --2- 172.21.15.100:0/3824565463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f730c0fb450 0x7f730c10bf80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 >> 172.21.15.100:0/3824565463 conn(0x7f730c0f6c10 msgr2=0x7f730c0f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 shutdown_connections 2024-09-13T02:57:45.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.833+0000 7f7312fdd640 1 -- 172.21.15.100:0/3824565463 wait complete. 2024-09-13T02:57:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 -- 172.21.15.100:0/763377662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fb3e0 msgr2=0x7f8af00fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 --2- 172.21.15.100:0/763377662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fb3e0 0x7f8af00fb7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00048d0 tx=0x7f8ae0009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 -- 172.21.15.100:0/763377662 shutdown_connections 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 --2- 172.21.15.100:0/763377662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fc6b0 0x7f8af00fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 --2- 172.21.15.100:0/763377662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fb3e0 0x7f8af00fb7f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 -- 172.21.15.100:0/763377662 >> 172.21.15.100:0/763377662 conn(0x7f8af00f6b80 msgr2=0x7f8af00f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 -- 172.21.15.100:0/763377662 shutdown_connections 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.911+0000 7f8af68c2640 1 -- 172.21.15.100:0/763377662 wait complete. 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 Processor -- start 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 -- start start 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fb3e0 0x7f8af010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af010fd80 con 0x7f8af00fc6b0 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8af68c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01105a0 con 0x7f8af00fb3e0 2024-09-13T02:57:45.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35548/0 (socket says 172.21.15.100:35548) 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aef7fe640 1 -- 172.21.15.100:0/3690169850 learned_addr learned my addr 172.21.15.100:0/3690169850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aeffff640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fb3e0 0x7f8af010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aef7fe640 1 -- 172.21.15.100:0/3690169850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fb3e0 msgr2=0x7f8af010f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.912+0000 7f8aef7fe640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fb3e0 0x7f8af010f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8aef7fe640 1 -- 172.21.15.100:0/3690169850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0005040 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8aef7fe640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4002a80 tx=0x7f8ae4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae4007c30 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ae400f040 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae400dab0 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af0110830 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.913+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af0110d50 con 0x7f8af00fc6b0 2024-09-13T02:57:45.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.914+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af005ed70 con 0x7f8af00fc6b0 2024-09-13T02:57:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.914+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8ae400dc10 con 0x7f8af00fc6b0 2024-09-13T02:57:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.915+0000 7f8aecff9640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 0x7f8ad80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.915+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8ae408d990 con 0x7f8af00fc6b0 2024-09-13T02:57:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.915+0000 7f8aeffff640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 0x7f8ad80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:45.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.915+0000 7f8aeffff640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 0x7f8ad80709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000b020 tx=0x7f8ae0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:45.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:45.919+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ae4056b50 con 0x7f8af00fc6b0 2024-09-13T02:57:46.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.121+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8af0103ec0 con 0x7f8af00fc6b0 2024-09-13T02:57:46.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.122+0000 7f8aecff9640 1 -- 172.21.15.100:0/3690169850 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1744 (secure 0 0 0) 0x7f8ae405a210 con 0x7f8af00fc6b0 2024-09-13T02:57:46.124 INFO:teuthology.orchestra.run.smithi100.stdout:e28 2024-09-13T02:57:46.124 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:57:45:306158+0000 2024-09-13T02:57:46.124 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:46.124 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 28 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:57:45.306149+0000 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:57:46.125 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 79 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=24271} 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 1 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:57:46.126 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{0:24271} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:57:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6824/209732889,v1:172.21.15.122:6825/209732889] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.124+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 msgr2=0x7f8ad80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.124+0000 7f8af68c2640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 0x7f8ad80709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000b020 tx=0x7f8ae0035040 comp rx=0 tx=0).stop 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.124+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 msgr2=0x7f8af010f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.124+0000 7f8af68c2640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4002a80 tx=0x7f8ae4004600 comp rx=0 tx=0).stop 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 shutdown_connections 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ad806e530 0x7f8ad80709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8af00fc6b0 0x7f8af010f730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 --2- 172.21.15.100:0/3690169850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8af00fb3e0 0x7f8af010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 >> 172.21.15.100:0/3690169850 conn(0x7f8af00f6b80 msgr2=0x7f8af0065f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:46.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 shutdown_connections 2024-09-13T02:57:46.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.125+0000 7f8af68c2640 1 -- 172.21.15.100:0/3690169850 wait complete. 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 -- 172.21.15.100:0/1290321585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fc570 msgr2=0x7eff7c0fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 --2- 172.21.15.100:0/1290321585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fc570 0x7eff7c0fc980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0048d0 tx=0x7eff6c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 -- 172.21.15.100:0/1290321585 shutdown_connections 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 --2- 172.21.15.100:0/1290321585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fd840 0x7eff7c0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 --2- 172.21.15.100:0/1290321585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fc570 0x7eff7c0fc980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 -- 172.21.15.100:0/1290321585 >> 172.21.15.100:0/1290321585 conn(0x7eff7c0f7d30 msgr2=0x7eff7c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 -- 172.21.15.100:0/1290321585 shutdown_connections 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.204+0000 7eff82359640 1 -- 172.21.15.100:0/1290321585 wait complete. 2024-09-13T02:57:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 Processor -- start 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 -- start start 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fc570 0x7eff7c10f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c10fe50 con 0x7eff7c0fd840 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff82359640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c110670 con 0x7eff7c0fc570 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35580/0 (socket says 172.21.15.100:35580) 2024-09-13T02:57:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7b7fe640 1 -- 172.21.15.100:0/899444227 learned_addr learned my addr 172.21.15.100:0/899444227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7bfff640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fc570 0x7eff7c10f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7b7fe640 1 -- 172.21.15.100:0/899444227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fc570 msgr2=0x7eff7c10f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.205+0000 7eff7b7fe640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fc570 0x7eff7c10f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff7b7fe640 1 -- 172.21.15.100:0/899444227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c005040 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff7b7fe640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff7000eb70 tx=0x7eff7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff70007c30 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff7000f040 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c1108a0 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff7000ca60 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.206+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c110e40 con 0x7eff7c0fd840 2024-09-13T02:57:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.207+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c0fb9d0 con 0x7eff7c0fd840 2024-09-13T02:57:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.207+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7eff7000cbc0 con 0x7eff7c0fd840 2024-09-13T02:57:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.208+0000 7eff78ff9640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 0x7eff640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.208+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6582+0+0 (secure 0 0 0) 0x7eff7008dde0 con 0x7eff7c0fd840 2024-09-13T02:57:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.208+0000 7eff7bfff640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 0x7eff640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.208+0000 7eff7bfff640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 0x7eff640709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff6c004540 tx=0x7eff6c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:46.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.212+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff70056f20 con 0x7eff7c0fd840 2024-09-13T02:57:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.400+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff7c105100 con 0x7eff6406e530 2024-09-13T02:57:46.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:46 smithi100 ceph-mon[92340]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:46.402 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:46 smithi100 ceph-mon[92340]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:46.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:46 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3824565463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:46.403 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:46 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3690169850' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.401+0000 7eff78ff9640 1 -- 172.21.15.100:0/899444227 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7eff7c105100 con 0x7eff6406e530 2024-09-13T02:57:46.403 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:57:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:57:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:57:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "osd", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "13/21 daemons upgraded", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:57:46.404 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:57:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 msgr2=0x7eff640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 0x7eff640709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff6c004540 tx=0x7eff6c035040 comp rx=0 tx=0).stop 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 msgr2=0x7eff7c10f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff7000eb70 tx=0x7eff7000b040 comp rx=0 tx=0).stop 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 shutdown_connections 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7eff6406e530 0x7eff640709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff7c0fd840 0x7eff7c10f800 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 --2- 172.21.15.100:0/899444227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff7c0fc570 0x7eff7c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 >> 172.21.15.100:0/899444227 conn(0x7eff7c0f7d30 msgr2=0x7eff7c0f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 shutdown_connections 2024-09-13T02:57:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.403+0000 7eff82359640 1 -- 172.21.15.100:0/899444227 wait complete. 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- 172.21.15.100:0/384403300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 msgr2=0x7fa694101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 --2- 172.21.15.100:0/384403300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa694101b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0048d0 tx=0x7fa67c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- 172.21.15.100:0/384403300 shutdown_connections 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 --2- 172.21.15.100:0/384403300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa694101b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 --2- 172.21.15.100:0/384403300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 0x7fa6940ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- 172.21.15.100:0/384403300 >> 172.21.15.100:0/384403300 conn(0x7fa6940f6c10 msgr2=0x7fa6940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- 172.21.15.100:0/384403300 shutdown_connections 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- 172.21.15.100:0/384403300 wait complete. 2024-09-13T02:57:46.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 Processor -- start 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.482+0000 7fa698dc5640 1 -- start start 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa698dc5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 0x7fa6940fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa698dc5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa698dc5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940fb670 con 0x7fa6940ff720 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa698dc5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940fb7b0 con 0x7fa6940666b0 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35588/0 (socket says 172.21.15.100:35588) 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 -- 172.21.15.100:0/3802891844 learned_addr learned my addr 172.21.15.100:0/3802891844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa69259c640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 0x7fa6940fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 -- 172.21.15.100:0/3802891844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 msgr2=0x7fa6940fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 0x7fa6940fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 -- 172.21.15.100:0/3802891844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c005040 con 0x7fa6940ff720 2024-09-13T02:57:46.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa691d9b640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0043d0 tx=0x7fa67c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:46.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c038070 con 0x7fa6940ff720 2024-09-13T02:57:46.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa67c02ae90 con 0x7fa6940ff720 2024-09-13T02:57:46.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940fba30 con 0x7fa6940ff720 2024-09-13T02:57:46.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.483+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c03e670 con 0x7fa6940ff720 2024-09-13T02:57:46.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.484+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa694115130 con 0x7fa6940ff720 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.484+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69404b720 con 0x7fa6940ff720 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.485+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa67c030020 con 0x7fa6940ff720 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.486+0000 7fa68affd640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 0x7fa6800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.486+0000 7fa69259c640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 0x7fa6800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.486+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa67c0ae2a0 con 0x7fa6940ff720 2024-09-13T02:57:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.486+0000 7fa69259c640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 0x7fa6800709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6940fc9a0 tx=0x7fa68400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.490+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa67c077460 con 0x7fa6940ff720 2024-09-13T02:57:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:46 smithi122 ceph-mon[79680]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:46 smithi122 ceph-mon[79680]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:46 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3824565463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:46 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3690169850' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.723+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa694104f60 con 0x7fa6940ff720 2024-09-13T02:57:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.723+0000 7fa68affd640 1 -- 172.21.15.100:0/3802891844 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fa67c07ab20 con 0x7fa6940ff720 2024-09-13T02:57:46.726 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-13T02:57:46.726 INFO:teuthology.orchestra.run.smithi100.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T02:57:46.726 INFO:teuthology.orchestra.run.smithi100.stdout: fs cephfs is degraded 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 msgr2=0x7fa6800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 0x7fa6800709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6940fc9a0 tx=0x7fa68400b040 comp rx=0 tx=0).stop 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 msgr2=0x7fa6940fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0043d0 tx=0x7fa67c009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 shutdown_connections 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fa68006e530 0x7fa6800709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6940ff720 0x7fa6940fb0e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 --2- 172.21.15.100:0/3802891844 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa6940666b0 0x7fa6940fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 >> 172.21.15.100:0/3802891844 conn(0x7fa6940f6c10 msgr2=0x7fa6940f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 shutdown_connections 2024-09-13T02:57:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:57:46.725+0000 7fa698dc5640 1 -- 172.21.15.100:0/3802891844 wait complete. 2024-09-13T02:57:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:47 smithi100 ceph-mon[92340]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:47 smithi100 ceph-mon[92340]: pgmap v186: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-09-13T02:57:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:47 smithi100 ceph-mon[92340]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:47.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:47 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3802891844' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:47 smithi122 ceph-mon[79680]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:47 smithi122 ceph-mon[79680]: pgmap v186: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 1 op/s 2024-09-13T02:57:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:47 smithi122 ceph-mon[79680]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:47 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3802891844' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:49.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:49 smithi100 ceph-mon[92340]: pgmap v187: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-09-13T02:57:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:49 smithi122 ceph-mon[79680]: pgmap v187: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 2 op/s 2024-09-13T02:57:51.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:51 smithi100 ceph-mon[92340]: pgmap v188: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T02:57:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:51 smithi122 ceph-mon[79680]: pgmap v188: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T02:57:52.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:52 smithi100 ceph-mon[92340]: reconnect by client.14508 v1:172.21.15.122:0/793709049 after 0 2024-09-13T02:57:52.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:52 smithi100 ceph-mon[92340]: reconnect by client.24289 v1:172.21.15.100:0/2880732361 after 0.000999976 2024-09-13T02:57:52.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:52 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:reconnect 2024-09-13T02:57:52.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:52 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:reconnect} 2 up:standby 2024-09-13T02:57:52.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:52 smithi122 ceph-mon[79680]: reconnect by client.14508 v1:172.21.15.122:0/793709049 after 0 2024-09-13T02:57:52.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:52 smithi122 ceph-mon[79680]: reconnect by client.24289 v1:172.21.15.100:0/2880732361 after 0.000999976 2024-09-13T02:57:52.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:52 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:reconnect 2024-09-13T02:57:52.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:52 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:reconnect} 2 up:standby 2024-09-13T02:57:53.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:53 smithi100 ceph-mon[92340]: pgmap v189: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-13T02:57:53.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:53 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:rejoin 2024-09-13T02:57:53.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:53 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:rejoin} 2 up:standby 2024-09-13T02:57:53.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:53 smithi100 ceph-mon[92340]: daemon mds.cephfs.smithi122.crukff is now active in filesystem cephfs as rank 0 2024-09-13T02:57:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:53 smithi122 ceph-mon[79680]: pgmap v189: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-13T02:57:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:53 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:rejoin 2024-09-13T02:57:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:53 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi122.crukff=up:rejoin} 2 up:standby 2024-09-13T02:57:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:53 smithi122 ceph-mon[79680]: daemon mds.cephfs.smithi122.crukff is now active in filesystem cephfs as rank 0 2024-09-13T02:57:54.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:54 smithi100 ceph-mon[92340]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:57:54.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:54 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:57:54.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:54 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:active 2024-09-13T02:57:54.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:54 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 2 up:standby 2024-09-13T02:57:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:54 smithi122 ceph-mon[79680]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:57:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:54 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:57:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:54 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] up:active 2024-09-13T02:57:54.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:54 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 2 up:standby 2024-09-13T02:57:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:55 smithi100 ceph-mon[92340]: pgmap v190: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T02:57:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:55 smithi122 ceph-mon[79680]: pgmap v190: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T02:57:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:57 smithi100 ceph-mon[92340]: pgmap v191: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 651 B/s wr, 8 op/s 2024-09-13T02:57:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:57.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:57 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:57 smithi122 ceph-mon[79680]: pgmap v191: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 651 B/s wr, 8 op/s 2024-09-13T02:57:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:57:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:57 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:58.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:58 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] up:boot 2024-09-13T02:57:58.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:58 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 3 up:standby 2024-09-13T02:57:58.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:58 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:57:58.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:58 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] up:boot 2024-09-13T02:57:58.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:58 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 3 up:standby 2024-09-13T02:57:58.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:58 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:57:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:59 smithi100 ceph-mon[92340]: pgmap v192: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T02:57:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:57:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:59 smithi122 ceph-mon[79680]: pgmap v192: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T02:57:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:57:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:01 smithi100 ceph-mon[92340]: pgmap v193: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T02:58:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:01 smithi122 ceph-mon[79680]: pgmap v193: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 7.3 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-13T02:58:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:02.871 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:02.871 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:02 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:02.871 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:02 smithi100 ceph-mon[92340]: pgmap v194: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-13T02:58:03.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:03.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:02 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:03.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:02 smithi122 ceph-mon[79680]: pgmap v194: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: pgmap v195: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 272 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.655 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.656 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:05 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi122.wmvyfe"]}]: dispatch 2024-09-13T02:58:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: pgmap v195: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 272 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:05.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:05 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi122.wmvyfe"]}]: dispatch 2024-09-13T02:58:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:06 smithi100 ceph-mon[92340]: Upgrade: It appears safe to stop mds.cephfs.smithi122.wmvyfe 2024-09-13T02:58:06.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:06 smithi122 ceph-mon[79680]: Upgrade: It appears safe to stop mds.cephfs.smithi122.wmvyfe 2024-09-13T02:58:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: pgmap v196: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-13T02:58:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: Upgrade: Updating mds.cephfs.smithi122.wmvyfe 2024-09-13T02:58:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:58:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:07.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:07 smithi100 ceph-mon[92340]: Deploying daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: pgmap v196: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: Upgrade: Updating mds.cephfs.smithi122.wmvyfe 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.wmvyfe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:07.683 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:07 smithi122 ceph-mon[79680]: Deploying daemon mds.cephfs.smithi122.wmvyfe on smithi122 2024-09-13T02:58:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:09 smithi100 ceph-mon[92340]: pgmap v197: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-13T02:58:09.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:09 smithi100 ceph-mon[92340]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T02:58:09.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:09 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 2 up:standby 2024-09-13T02:58:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:09 smithi122 ceph-mon[79680]: pgmap v197: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.3 KiB/s wr, 2 op/s 2024-09-13T02:58:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:09 smithi122 ceph-mon[79680]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T02:58:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:09 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 2 up:standby 2024-09-13T02:58:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:11 smithi100 ceph-mon[92340]: pgmap v199: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:11 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:11 smithi122 ceph-mon[79680]: pgmap v199: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:11 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:13 smithi100 ceph-mon[92340]: pgmap v200: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:13 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:13 smithi122 ceph-mon[79680]: pgmap v200: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:13 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:14 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6824/1347589345,v1:172.21.15.122:6825/1347589345] up:boot 2024-09-13T02:58:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:14 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 3 up:standby 2024-09-13T02:58:14.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:14.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:14 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6824/1347589345,v1:172.21.15.122:6825/1347589345] up:boot 2024-09-13T02:58:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:14 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi122.crukff=up:active} 3 up:standby 2024-09-13T02:58:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:15 smithi100 ceph-mon[92340]: pgmap v201: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:15 smithi122 ceph-mon[79680]: pgmap v201: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:16.665 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:16 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.666 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:16 smithi122 ceph-mon[79680]: pgmap v202: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:16.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:16 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:16.820 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:16 smithi100 ceph-mon[92340]: pgmap v202: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3855600505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc080ff700 msgr2=0x7fdc08101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3855600505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc080ff700 0x7fdc08101ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00048d0 tx=0x7fdbf0009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3855600505 shutdown_connections 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3855600505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc080ff700 0x7fdc08101ae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3855600505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc08065bc0 0x7fdc080ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3855600505 >> 172.21.15.100:0/3855600505 conn(0x7fdc080f6c10 msgr2=0x7fdc080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3855600505 shutdown_connections 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3855600505 wait complete. 2024-09-13T02:58:16.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.818+0000 7fdc0d2e8640 1 Processor -- start 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc0d2e8640 1 -- start start 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc0d2e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc0d2e8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc080ff700 0x7fdc080fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc0d2e8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080fb650 con 0x7fdc08065bc0 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc0d2e8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080fb790 con 0x7fdc080ff700 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47130/0 (socket says 172.21.15.100:47130) 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 -- 172.21.15.100:0/3894325301 learned_addr learned my addr 172.21.15.100:0/3894325301 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdbfe7fc640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc080ff700 0x7fdc080fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 -- 172.21.15.100:0/3894325301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc080ff700 msgr2=0x7fdc080fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc080ff700 0x7fdc080fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.819+0000 7fdc06ffd640 1 -- 172.21.15.100:0/3894325301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0005040 con 0x7fdc08065bc0 2024-09-13T02:58:16.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdc06ffd640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8002a80 tx=0x7fdbf8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf8007c30 con 0x7fdc08065bc0 2024-09-13T02:58:16.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc080fba70 con 0x7fdc08065bc0 2024-09-13T02:58:16.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbf800f040 con 0x7fdc08065bc0 2024-09-13T02:58:16.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf800dad0 con 0x7fdc08065bc0 2024-09-13T02:58:16.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.820+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc081150d0 con 0x7fdc08065bc0 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.821+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc080fa890 con 0x7fdc08065bc0 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.821+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdbf800dc30 con 0x7fdc08065bc0 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.822+0000 7fdbfffff640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 0x7fdbf40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.822+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdbf808e050 con 0x7fdc08065bc0 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.822+0000 7fdbfe7fc640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 0x7fdbf40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:16.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.822+0000 7fdbfe7fc640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 0x7fdbf40709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000c00 tx=0x7fdbf0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:16.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:16.826+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbf80570e0 con 0x7fdc08065bc0 2024-09-13T02:58:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.014+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc080f8700 con 0x7fdbf406e530 2024-09-13T02:58:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.015+0000 7fdbfffff640 1 -- 172.21.15.100:0/3894325301 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdc080f8700 con 0x7fdbf406e530 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 msgr2=0x7fdbf40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 0x7fdbf40709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0000c00 tx=0x7fdbf0035040 comp rx=0 tx=0).stop 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 msgr2=0x7fdc080fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8002a80 tx=0x7fdbf8004570 comp rx=0 tx=0).stop 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 shutdown_connections 2024-09-13T02:58:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fdbf406e530 0x7fdbf40709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc080ff700 0x7fdc080fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 --2- 172.21.15.100:0/3894325301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc08065bc0 0x7fdc080fcbd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 >> 172.21.15.100:0/3894325301 conn(0x7fdc080f6c10 msgr2=0x7fdc080f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 shutdown_connections 2024-09-13T02:58:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.018+0000 7fdc0d2e8640 1 -- 172.21.15.100:0/3894325301 wait complete. 2024-09-13T02:58:17.028 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:58:17.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 -- 172.21.15.100:0/3426954760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fb450 msgr2=0x7f54d00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 --2- 172.21.15.100:0/3426954760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fb450 0x7f54d00fb860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009c50 tx=0x7f54cc004d10 comp rx=0 tx=0).stop 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 -- 172.21.15.100:0/3426954760 shutdown_connections 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 --2- 172.21.15.100:0/3426954760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fc720 0x7f54d00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 --2- 172.21.15.100:0/3426954760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fb450 0x7f54d00fb860 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 -- 172.21.15.100:0/3426954760 >> 172.21.15.100:0/3426954760 conn(0x7f54d00f6c10 msgr2=0x7f54d00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 -- 172.21.15.100:0/3426954760 shutdown_connections 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.097+0000 7f54d8331640 1 -- 172.21.15.100:0/3426954760 wait complete. 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 Processor -- start 2024-09-13T02:58:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 -- start start 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fb450 0x7f54d00ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00fdfa0 con 0x7f54d00fc720 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d8331640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00fe0e0 con 0x7f54d00fb450 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d58cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d58cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47142/0 (socket says 172.21.15.100:47142) 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d58cc640 1 -- 172.21.15.100:0/2670445179 learned_addr learned my addr 172.21.15.100:0/2670445179 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.098+0000 7f54d60cd640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fb450 0x7f54d00ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d58cc640 1 -- 172.21.15.100:0/2670445179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fb450 msgr2=0x7f54d00ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d58cc640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fb450 0x7f54d00ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d58cc640 1 -- 172.21.15.100:0/2670445179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0098b0 con 0x7f54d00fc720 2024-09-13T02:58:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d58cc640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f54c000eb70 tx=0x7f54c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0007c30 con 0x7f54d00fc720 2024-09-13T02:58:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54c000f040 con 0x7f54d00fc720 2024-09-13T02:58:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c00094e0 con 0x7f54d00fc720 2024-09-13T02:58:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d00fe360 con 0x7f54d00fc720 2024-09-13T02:58:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.099+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d0115190 con 0x7f54d00fc720 2024-09-13T02:58:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.100+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00fa8b0 con 0x7f54d00fc720 2024-09-13T02:58:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.101+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f54c0009640 con 0x7f54d00fc720 2024-09-13T02:58:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.101+0000 7f54c6ffd640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 0x7f54bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.101+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f54c008de70 con 0x7f54d00fc720 2024-09-13T02:58:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.101+0000 7f54d60cd640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 0x7f54bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.102+0000 7f54d60cd640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 0x7f54bc0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f54cc032470 tx=0x7f54cc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.106+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f54c0056f80 con 0x7f54d00fc720 2024-09-13T02:58:17.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.289+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d0103f80 con 0x7f54bc06e530 2024-09-13T02:58:17.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.291+0000 7f54c6ffd640 1 -- 172.21.15.100:0/2670445179 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f54d0103f80 con 0x7f54bc06e530 2024-09-13T02:58:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 msgr2=0x7f54bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 0x7f54bc0709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f54cc032470 tx=0x7f54cc004d10 comp rx=0 tx=0).stop 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 msgr2=0x7f54d00fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f54c000eb70 tx=0x7f54c000b040 comp rx=0 tx=0).stop 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 shutdown_connections 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f54bc06e530 0x7f54bc0709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d00fc720 0x7f54d00fda60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 --2- 172.21.15.100:0/2670445179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54d00fb450 0x7f54d00ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 >> 172.21.15.100:0/2670445179 conn(0x7f54d00f6c10 msgr2=0x7f54d0066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 shutdown_connections 2024-09-13T02:58:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.293+0000 7f54d8331640 1 -- 172.21.15.100:0/2670445179 wait complete. 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 -- 172.21.15.100:0/3830551247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 msgr2=0x7fd124101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 --2- 172.21.15.100:0/3830551247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd124101b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd1180048d0 tx=0x7fd118009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 -- 172.21.15.100:0/3830551247 shutdown_connections 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 --2- 172.21.15.100:0/3830551247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd124101b20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 --2- 172.21.15.100:0/3830551247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 0x7fd1240ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 -- 172.21.15.100:0/3830551247 >> 172.21.15.100:0/3830551247 conn(0x7fd1240f6c10 msgr2=0x7fd1240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 -- 172.21.15.100:0/3830551247 shutdown_connections 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.371+0000 7fd129ba9640 1 -- 172.21.15.100:0/3830551247 wait complete. 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 Processor -- start 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 -- start start 2024-09-13T02:58:17.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 0x7fd12410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12410dc20 con 0x7fd1240ff740 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd129ba9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12410e3f0 con 0x7fd124065b80 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47172/0 (socket says 172.21.15.100:47172) 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 -- 172.21.15.100:0/1948208645 learned_addr learned my addr 172.21.15.100:0/1948208645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd1237fe640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 0x7fd12410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 -- 172.21.15.100:0/1948208645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 msgr2=0x7fd12410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 0x7fd12410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.372+0000 7fd122ffd640 1 -- 172.21.15.100:0/1948208645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118005040 con 0x7fd1240ff740 2024-09-13T02:58:17.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd122ffd640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1180043d0 tx=0x7fd118009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd118038070 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12410e620 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd11802ae90 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11803e670 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.373+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12410ebc0 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.374+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1240fa890 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.375+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd118030020 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.375+0000 7fd10bfff640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 0x7fd10c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.375+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd1180ae3d0 con 0x7fd1240ff740 2024-09-13T02:58:17.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.375+0000 7fd1237fe640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 0x7fd10c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.376+0000 7fd1237fe640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 0x7fd10c0709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1240658e0 tx=0x7fd11400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.379+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd118077590 con 0x7fd1240ff740 2024-09-13T02:58:17.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.554+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd12410ef60 con 0x7fd10c06e530 2024-09-13T02:58:17.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.563+0000 7fd10bfff640 1 -- 172.21.15.100:0/1948208645 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd12410ef60 con 0x7fd10c06e530 2024-09-13T02:58:17.564 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:58:17.564 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (6m) 16s ago 15m 23.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:58:17.564 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (4m) 16s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:58:17.564 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (4m) 2s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (6m) 16s ago 15m 83.1M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (21s) 16s ago 9m 10.9M - 19.1.1-322-g7741f7f9 19dc8d659727 8f4ffac719a6 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (44s) 16s ago 10m 15.5M - 19.1.1-322-g7741f7f9 19dc8d659727 3a0baec05ca7 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (9m) 2s ago 9m 72.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 77ad8294c3fd 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (5s) 2s ago 9m 11.5M - 19.1.1-322-g7741f7f9 19dc8d659727 3a61ca537875 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (6m) 16s ago 16m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (5m) 2s ago 14m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (5m) 16s ago 16m 50.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (5m) 2s ago 14m 38.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 16s ago 15m 16.5M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (6m) 2s ago 14m 18.0M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 16s ago 13m 105M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (3m) 16s ago 13m 104M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:58:17.565 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 16s ago 12m 91.4M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:58:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (2m) 2s ago 12m 123M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:58:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (2m) 2s ago 11m 114M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:58:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (92s) 2s ago 11m 98.6M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T02:58:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (5m) 16s ago 15m 62.2M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 msgr2=0x7fd10c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 0x7fd10c0709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1240658e0 tx=0x7fd11400b040 comp rx=0 tx=0).stop 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 msgr2=0x7fd12410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1180043d0 tx=0x7fd118009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 shutdown_connections 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fd10c06e530 0x7fd10c0709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1240ff740 0x7fd12410d5d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 --2- 172.21.15.100:0/1948208645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd124065b80 0x7fd12410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 >> 172.21.15.100:0/1948208645 conn(0x7fd1240f6c10 msgr2=0x7fd1240f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 shutdown_connections 2024-09-13T02:58:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.565+0000 7fd129ba9640 1 -- 172.21.15.100:0/1948208645 wait complete. 2024-09-13T02:58:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 -- 172.21.15.100:0/4146193368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 msgr2=0x7f22c40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 --2- 172.21.15.100:0/4146193368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c40fb860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f22b40048d0 tx=0x7f22b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 -- 172.21.15.100:0/4146193368 shutdown_connections 2024-09-13T02:58:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 --2- 172.21.15.100:0/4146193368 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 0x7f22c40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 --2- 172.21.15.100:0/4146193368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c40fb860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 -- 172.21.15.100:0/4146193368 >> 172.21.15.100:0/4146193368 conn(0x7f22c40f6c10 msgr2=0x7f22c40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 -- 172.21.15.100:0/4146193368 shutdown_connections 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 -- 172.21.15.100:0/4146193368 wait complete. 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.643+0000 7f22cbd88640 1 Processor -- start 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22cbd88640 1 -- start start 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22cbd88640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22cbd88640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 0x7f22c410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22cbd88640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c410dc30 con 0x7f22c40fb450 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22cbd88640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c410e450 con 0x7f22c40fc720 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47192/0 (socket says 172.21.15.100:47192) 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 -- 172.21.15.100:0/1979425247 learned_addr learned my addr 172.21.15.100:0/1979425247 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:17.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9323640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 0x7f22c410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 -- 172.21.15.100:0/1979425247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 msgr2=0x7f22c410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 0x7f22c410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 -- 172.21.15.100:0/1979425247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4005040 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.644+0000 7f22c9b24640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22b40043d0 tx=0x7f22b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.645+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b4038070 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.645+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c410e680 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.645+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22b402ae90 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.645+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b403e670 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.645+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c410ec20 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.646+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c40fa8b0 con 0x7f22c40fb450 2024-09-13T02:58:17.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.646+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f22b4030020 con 0x7f22c40fb450 2024-09-13T02:58:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.647+0000 7f22c27fc640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 0x7f22ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.647+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f22b40ae390 con 0x7f22c40fb450 2024-09-13T02:58:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.647+0000 7f22c9323640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 0x7f22ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.647+0000 7f22c9323640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 0x7f22ac0709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22c410ce50 tx=0x7f22b8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.652+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f22b40774d0 con 0x7f22c40fb450 2024-09-13T02:58:17.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.882+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22c4103f10 con 0x7f22c40fb450 2024-09-13T02:58:17.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.883+0000 7f22c27fc640 1 -- 172.21.15.100:0/1979425247 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f22b407ab90 con 0x7f22c40fb450 2024-09-13T02:58:17.884 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:58:17.884 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:58:17.884 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:58:17.885 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 13 2024-09-13T02:58:17.886 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:58:17.886 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 msgr2=0x7f22ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 0x7f22ac0709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22c410ce50 tx=0x7f22b8009040 comp rx=0 tx=0).stop 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 msgr2=0x7f22c410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22b40043d0 tx=0x7f22b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 shutdown_connections 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f22ac06e530 0x7f22ac0709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22c40fc720 0x7f22c410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 --2- 172.21.15.100:0/1979425247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40fb450 0x7f22c410d0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.885+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 >> 172.21.15.100:0/1979425247 conn(0x7f22c40f6c10 msgr2=0x7f22c40660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.886+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 shutdown_connections 2024-09-13T02:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.886+0000 7f22cbd88640 1 -- 172.21.15.100:0/1979425247 wait complete. 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 -- 172.21.15.100:0/270934991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 msgr2=0x7fb5580fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/270934991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb5580fad90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5540048d0 tx=0x7fb554009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 -- 172.21.15.100:0/270934991 shutdown_connections 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/270934991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 0x7fb5580fdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/270934991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb5580fad90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 -- 172.21.15.100:0/270934991 >> 172.21.15.100:0/270934991 conn(0x7fb5580f63c0 msgr2=0x7fb5580f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 -- 172.21.15.100:0/270934991 shutdown_connections 2024-09-13T02:58:17.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.965+0000 7fb55f7ae640 1 -- 172.21.15.100:0/270934991 wait complete. 2024-09-13T02:58:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 Processor -- start 2024-09-13T02:58:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 -- start start 2024-09-13T02:58:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 0x7fb55810fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558110160 con 0x7fb5580fa980 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55f7ae640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558110980 con 0x7fb5580fb2d0 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55d54a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55d54a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47210/0 (socket says 172.21.15.100:47210) 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55d54a640 1 -- 172.21.15.100:0/1411439606 learned_addr learned my addr 172.21.15.100:0/1411439606 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.966+0000 7fb55cd49640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 0x7fb55810fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55d54a640 1 -- 172.21.15.100:0/1411439606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 msgr2=0x7fb55810fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55d54a640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 0x7fb55810fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55d54a640 1 -- 172.21.15.100:0/1411439606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554005040 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55d54a640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb554000c00 tx=0x7fb554009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb554038070 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb554004290 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558110bb0 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb55403e430 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.967+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558111150 con 0x7fb5580fa980 2024-09-13T02:58:17.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.968+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580fa060 con 0x7fb5580fa980 2024-09-13T02:58:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.969+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb554030020 con 0x7fb5580fa980 2024-09-13T02:58:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.969+0000 7fb54dffb640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 0x7fb5440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.969+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb5540ae1e0 con 0x7fb5580fa980 2024-09-13T02:58:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.969+0000 7fb55cd49640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 0x7fb5440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:17.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.970+0000 7fb55cd49640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 0x7fb5440709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb55810f380 tx=0x7fb54800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:17.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:17.974+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb5540773a0 con 0x7fb5580fa980 2024-09-13T02:58:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.178+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb5581113c0 con 0x7fb5580fa980 2024-09-13T02:58:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.178+0000 7fb54dffb640 1 -- 172.21.15.100:0/1411439606 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1937 (secure 0 0 0) 0x7fb55407aa60 con 0x7fb5580fa980 2024-09-13T02:58:18.180 INFO:teuthology.orchestra.run.smithi100.stdout:e34 2024-09-13T02:58:18.180 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:58:13:378451+0000 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 31 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:57:53.381740+0000 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:58:18.181 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 79 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 1 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:in 0 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=24271} 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 1 2024-09-13T02:58:18.182 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 24271 members: 24271 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{0:24271} state up:active seq 145 join_fscid=1 addr [v2:172.21.15.122:6826/3862727751,v1:172.21.15.122:6827/3862727751] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:18.183 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{-1:34436} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:18.184 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6824/1347589345,v1:172.21.15.122:6825/1347589345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 34 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 msgr2=0x7fb5440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 0x7fb5440709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb55810f380 tx=0x7fb54800b040 comp rx=0 tx=0).stop 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 msgr2=0x7fb55810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb554000c00 tx=0x7fb554009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 shutdown_connections 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb54406e530 0x7fb5440709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5580fb2d0 0x7fb55810fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 --2- 172.21.15.100:0/1411439606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5580fa980 0x7fb55810f5d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.180+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 >> 172.21.15.100:0/1411439606 conn(0x7fb5580f63c0 msgr2=0x7fb5580f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.181+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 shutdown_connections 2024-09-13T02:58:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.181+0000 7fb55f7ae640 1 -- 172.21.15.100:0/1411439606 wait complete. 2024-09-13T02:58:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 -- 172.21.15.100:0/2106765023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 msgr2=0x7f40dc070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 --2- 172.21.15.100:0/2106765023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc070470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f40c40048d0 tx=0x7f40c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 -- 172.21.15.100:0/2106765023 shutdown_connections 2024-09-13T02:58:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 --2- 172.21.15.100:0/2106765023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc070470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 --2- 172.21.15.100:0/2106765023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.259+0000 7f40e102a640 1 -- 172.21.15.100:0/2106765023 >> 172.21.15.100:0/2106765023 conn(0x7f40dc0f7d30 msgr2=0x7f40dc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:18.262 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:18 smithi100 ceph-mon[92340]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:18.262 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:18 smithi100 ceph-mon[92340]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:18.262 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:18 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1979425247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.260+0000 7f40e102a640 1 -- 172.21.15.100:0/2106765023 shutdown_connections 2024-09-13T02:58:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.260+0000 7f40e102a640 1 -- 172.21.15.100:0/2106765023 wait complete. 2024-09-13T02:58:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 Processor -- start 2024-09-13T02:58:18.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 -- start start 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc10f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc10fe60 con 0x7f40dc070000 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40e102a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc110680 con 0x7f40dc071590 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47234/0 (socket says 172.21.15.100:47234) 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 -- 172.21.15.100:0/968352966 learned_addr learned my addr 172.21.15.100:0/968352966 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40da59c640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc10f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 -- 172.21.15.100:0/968352966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 msgr2=0x7f40dc10f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc10f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 -- 172.21.15.100:0/968352966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4005040 con 0x7f40dc070000 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40da59c640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:18.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.261+0000 7f40dad9d640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00eb70 tx=0x7f40cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.262+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40cc007c30 con 0x7f40dc070000 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.262+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f40cc00f040 con 0x7f40dc070000 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.262+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40cc00cb00 con 0x7f40dc070000 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.262+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc110910 con 0x7f40dc070000 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.262+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc110eb0 con 0x7f40dc070000 2024-09-13T02:58:18.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.263+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc0fb9b0 con 0x7f40dc070000 2024-09-13T02:58:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.263+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f40cc014440 con 0x7f40dc070000 2024-09-13T02:58:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.264+0000 7f40d37fe640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 0x7f40c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.264+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f40cc08e470 con 0x7f40dc070000 2024-09-13T02:58:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.264+0000 7f40da59c640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 0x7f40c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.264+0000 7f40da59c640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 0x7f40c80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40c4007ac0 tx=0x7f40c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:18.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.268+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40cc057570 con 0x7f40dc070000 2024-09-13T02:58:18.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:18 smithi122 ceph-mon[79680]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:18.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:18 smithi122 ceph-mon[79680]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:18.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:18 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1979425247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:18.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.453+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40dc1112c0 con 0x7f40c806e530 2024-09-13T02:58:18.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.454+0000 7f40d37fe640 1 -- 172.21.15.100:0/968352966 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f40dc1112c0 con 0x7f40c806e530 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osd", 2024-09-13T02:58:18.456 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "15/21 daemons upgraded", 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:58:18.457 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 msgr2=0x7f40c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 0x7f40c80709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40c4007ac0 tx=0x7f40c4035040 comp rx=0 tx=0).stop 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 msgr2=0x7f40dc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00eb70 tx=0x7f40cc00b040 comp rx=0 tx=0).stop 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 shutdown_connections 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f40c806e530 0x7f40c80709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40dc071590 0x7f40dc10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 --2- 172.21.15.100:0/968352966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40dc070000 0x7f40dc10f2d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 >> 172.21.15.100:0/968352966 conn(0x7f40dc0f7d30 msgr2=0x7f40dc0f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 shutdown_connections 2024-09-13T02:58:18.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.456+0000 7f40e102a640 1 -- 172.21.15.100:0/968352966 wait complete. 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 -- 172.21.15.100:0/3934052378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc0ff700 msgr2=0x7f6ecc101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 --2- 172.21.15.100:0/3934052378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc101ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80048d0 tx=0x7f6ec8009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 -- 172.21.15.100:0/3934052378 shutdown_connections 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 --2- 172.21.15.100:0/3934052378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc101ae0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 --2- 172.21.15.100:0/3934052378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc0ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 -- 172.21.15.100:0/3934052378 >> 172.21.15.100:0/3934052378 conn(0x7f6ecc0f6c10 msgr2=0x7f6ecc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 -- 172.21.15.100:0/3934052378 shutdown_connections 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.534+0000 7f6ed4351640 1 -- 172.21.15.100:0/3934052378 wait complete. 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 Processor -- start 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 -- start start 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc10dcb0 con 0x7f6ecc065bc0 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed4351640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc10e480 con 0x7f6ecc0ff700 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed20ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed18ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed20ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43030/0 (socket says 172.21.15.100:43030) 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed20ed640 1 -- 172.21.15.100:0/642458615 learned_addr learned my addr 172.21.15.100:0/642458615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed18ec640 1 -- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 msgr2=0x7f6ecc10d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed18ec640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed18ec640 1 -- 172.21.15.100:0/642458615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8005040 con 0x7f6ecc0ff700 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.535+0000 7f6ed20ed640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ed18ec640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc10d660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80048a0 tx=0x7f6ec8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec8038070 con 0x7f6ecc0ff700 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc10e6b0 con 0x7f6ecc0ff700 2024-09-13T02:58:18.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc10ec20 con 0x7f6ecc0ff700 2024-09-13T02:58:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6ec802ae90 con 0x7f6ecc0ff700 2024-09-13T02:58:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.536+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec8033660 con 0x7f6ecc0ff700 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.537+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0005240 con 0x7f6ecc0ff700 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.538+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f6ec8030020 con 0x7f6ecc0ff700 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.538+0000 7f6ec2ffd640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 0x7f6eb80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.538+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6ec80ae180 con 0x7f6ecc0ff700 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.538+0000 7f6ed20ed640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 0x7f6eb80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.538+0000 7f6ed20ed640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 0x7f6eb80709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fd0 tx=0x7f6ebc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:18.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.546+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6ec8077340 con 0x7f6ecc0ff700 2024-09-13T02:58:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.777+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6eb00054f0 con 0x7f6ecc0ff700 2024-09-13T02:58:18.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.778+0000 7f6ec2ffd640 1 -- 172.21.15.100:0/642458615 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6ec807aa00 con 0x7f6ecc0ff700 2024-09-13T02:58:18.779 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:58:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 msgr2=0x7f6eb80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 0x7f6eb80709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fd0 tx=0x7f6ebc00b040 comp rx=0 tx=0).stop 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 msgr2=0x7f6ecc10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc10d660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80048a0 tx=0x7f6ec8009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 shutdown_connections 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f6eb806e530 0x7f6eb80709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ecc0ff700 0x7f6ecc10d660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 --2- 172.21.15.100:0/642458615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ecc065bc0 0x7f6ecc10d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:18.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 >> 172.21.15.100:0/642458615 conn(0x7f6ecc0f6c10 msgr2=0x7f6ecc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:18.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 shutdown_connections 2024-09-13T02:58:18.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:18.780+0000 7f6ed4351640 1 -- 172.21.15.100:0/642458615 wait complete. 2024-09-13T02:58:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:19 smithi122 ceph-mon[79680]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:19 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1411439606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:19.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:19 smithi122 ceph-mon[79680]: pgmap v203: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:19.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:19 smithi122 ceph-mon[79680]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:19.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:19 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/642458615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:19.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:19 smithi100 ceph-mon[92340]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:19.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:19 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1411439606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:19.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:19 smithi100 ceph-mon[92340]: pgmap v203: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:19.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:19 smithi100 ceph-mon[92340]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:19.427 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:19 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/642458615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:20.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: Detected new or changed devices on smithi122 2024-09-13T02:58:20.379 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.380 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.380 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:20.380 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:20.380 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.380 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi122.crukff"]}]: dispatch 2024-09-13T02:58:20.381 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:20 smithi122 ceph-mon[79680]: Upgrade: It appears safe to stop mds.cephfs.smithi122.crukff 2024-09-13T02:58:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: Detected new or changed devices on smithi122 2024-09-13T02:58:20.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi122.crukff"]}]: dispatch 2024-09-13T02:58:20.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:20 smithi100 ceph-mon[92340]: Upgrade: It appears safe to stop mds.cephfs.smithi122.crukff 2024-09-13T02:58:21.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:21 smithi122 ceph-mon[79680]: pgmap v204: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:21.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:21.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:58:21.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:21 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:21 smithi100 ceph-mon[92340]: pgmap v204: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi122.crukff", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:58:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:21 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:22.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:22 smithi122 ceph-mon[79680]: Upgrade: Updating mds.cephfs.smithi122.crukff 2024-09-13T02:58:22.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:22 smithi122 ceph-mon[79680]: Deploying daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:58:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:22 smithi100 ceph-mon[92340]: Upgrade: Updating mds.cephfs.smithi122.crukff 2024-09-13T02:58:22.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:22 smithi100 ceph-mon[92340]: Deploying daemon mds.cephfs.smithi122.crukff on smithi122 2024-09-13T02:58:23.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:22 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[92336]: 2024-09-13T02:58:22.733+0000 7f57e100e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:58:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: pgmap v205: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:58:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:58:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T02:58:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: Standby daemon mds.cephfs.smithi100.slkwfs assigned to filesystem cephfs as rank 0 2024-09-13T02:58:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:58:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T02:58:23.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:23 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:replay} 2 up:standby 2024-09-13T02:58:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: pgmap v205: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: Standby daemon mds.cephfs.smithi100.slkwfs assigned to filesystem cephfs as rank 0 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:58:23.712 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T02:58:23.713 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:23 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:replay} 2 up:standby 2024-09-13T02:58:25.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:25 smithi100 ceph-mon[92340]: pgmap v207: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T02:58:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:25 smithi122 ceph-mon[79680]: pgmap v207: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-13T02:58:27.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:27 smithi100 ceph-mon[92340]: pgmap v208: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T02:58:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:27 smithi122 ceph-mon[79680]: pgmap v208: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-09-13T02:58:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:29 smithi100 ceph-mon[92340]: pgmap v209: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T02:58:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:29.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:29 smithi122 ceph-mon[79680]: pgmap v209: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T02:58:29.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:29.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: reconnect by client.24289 v1:172.21.15.100:0/2880732361 after 0.000999975 2024-09-13T02:58:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: reconnect by client.14508 v1:172.21.15.122:0/793709049 after 0.000999975 2024-09-13T02:58:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:reconnect 2024-09-13T02:58:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:reconnect} 2 up:standby 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:30 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: reconnect by client.24289 v1:172.21.15.100:0/2880732361 after 0.000999975 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: reconnect by client.14508 v1:172.21.15.122:0/793709049 after 0.000999975 2024-09-13T02:58:30.677 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:reconnect 2024-09-13T02:58:30.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:reconnect} 2 up:standby 2024-09-13T02:58:30.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:30.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:30.678 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:30 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:31.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: pgmap v210: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T02:58:31.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:rejoin 2024-09-13T02:58:31.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.122:6826/2951042813,v1:172.21.15.122:6827/2951042813] up:boot 2024-09-13T02:58:31.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:rejoin} 3 up:standby 2024-09-13T02:58:31.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:58:31.437 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:31 smithi122 ceph-mon[79680]: daemon mds.cephfs.smithi100.slkwfs is now active in filesystem cephfs as rank 0 2024-09-13T02:58:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: pgmap v210: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-13T02:58:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:rejoin 2024-09-13T02:58:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.122:6826/2951042813,v1:172.21.15.122:6827/2951042813] up:boot 2024-09-13T02:58:31.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: fsmap cephfs:1/1 {0=cephfs.smithi100.slkwfs=up:rejoin} 3 up:standby 2024-09-13T02:58:31.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:58:31.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:31 smithi100 ceph-mon[92340]: daemon mds.cephfs.smithi100.slkwfs is now active in filesystem cephfs as rank 0 2024-09-13T02:58:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:58:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:58:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:active 2024-09-13T02:58:32.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 3 up:standby 2024-09-13T02:58:32.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:32.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:32 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:58:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:58:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] up:active 2024-09-13T02:58:32.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 3 up:standby 2024-09-13T02:58:32.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:32.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:32 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:33 smithi100 ceph-mon[92340]: pgmap v211: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T02:58:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:33.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:33 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:33 smithi122 ceph-mon[79680]: pgmap v211: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T02:58:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:33 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:35.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:35 smithi122 ceph-mon[79680]: pgmap v212: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T02:58:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:35 smithi100 ceph-mon[92340]: pgmap v212: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-09-13T02:58:37.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all mds 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.ciqoxn"}]': finished 2024-09-13T02:58:37.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.slkwfs"}]': finished 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.crukff"}]': finished 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.wmvyfe"}]': finished 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:58:37.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:36 smithi100 ceph-mon[92340]: pgmap v213: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-13T02:58:37.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all mds 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.ciqoxn"}]: dispatch 2024-09-13T02:58:37.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.ciqoxn"}]': finished 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.slkwfs"}]: dispatch 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.slkwfs"}]': finished 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.crukff"}]: dispatch 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.crukff"}]': finished 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.wmvyfe"}]: dispatch 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi122.wmvyfe"}]': finished 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:58:37.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:36 smithi122 ceph-mon[79680]: pgmap v213: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: daemon mds.cephfs.smithi100.ciqoxn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Cluster is now healthy 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 3 up:standby 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi100.ciqoxn=up:starting} 2 up:standby 2024-09-13T02:58:38.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all rgw 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: daemon mds.cephfs.smithi100.ciqoxn is now active in filesystem cephfs as rank 1 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all iscsi 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all nfs 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: Upgrade: Setting container_image for all nvmeof 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:37 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: daemon mds.cephfs.smithi100.ciqoxn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Cluster is now healthy 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: fsmap cephfs:1 {0=cephfs.smithi100.slkwfs=up:active} 3 up:standby 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi100.ciqoxn=up:starting} 2 up:standby 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all rgw 2024-09-13T02:58:38.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: daemon mds.cephfs.smithi100.ciqoxn is now active in filesystem cephfs as rank 1 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all iscsi 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.188 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all nfs 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: Upgrade: Setting container_image for all nvmeof 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:38.189 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:37 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:39 smithi100 ceph-mon[92340]: mds.? [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] up:active 2024-09-13T02:58:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:39 smithi100 ceph-mon[92340]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:58:39.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:39 smithi100 ceph-mon[92340]: pgmap v214: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-13T02:58:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:39 smithi122 ceph-mon[79680]: mds.? [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] up:active 2024-09-13T02:58:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:39 smithi122 ceph-mon[79680]: fsmap cephfs:2 {0=cephfs.smithi100.slkwfs=up:active,1=cephfs.smithi100.ciqoxn=up:active} 2 up:standby 2024-09-13T02:58:39.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:39 smithi122 ceph-mon[79680]: pgmap v214: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-13T02:58:40.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:40 smithi100 ceph-mon[92340]: Upgrade: Updating grafana.smithi100 2024-09-13T02:58:40.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:40 smithi100 ceph-mon[92340]: Deploying daemon grafana.smithi100 on smithi100 2024-09-13T02:58:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:40 smithi122 ceph-mon[79680]: Upgrade: Updating grafana.smithi100 2024-09-13T02:58:40.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:40 smithi122 ceph-mon[79680]: Deploying daemon grafana.smithi100 on smithi100 2024-09-13T02:58:41.327 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:41 smithi100 ceph-mon[92340]: pgmap v215: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-13T02:58:41.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:41 smithi122 ceph-mon[79680]: pgmap v215: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-13T02:58:43.622 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:43 smithi100 ceph-mon[92340]: pgmap v216: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-13T02:58:43.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:43 smithi122 ceph-mon[79680]: pgmap v216: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-13T02:58:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:45 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:45.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:45 smithi100 ceph-mon[92340]: pgmap v217: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.4 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-13T02:58:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:45 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:45.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:45 smithi122 ceph-mon[79680]: pgmap v217: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.4 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-13T02:58:47.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:47 smithi100 ceph-mon[92340]: pgmap v218: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T02:58:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:47 smithi122 ceph-mon[79680]: pgmap v218: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 -- 172.21.15.100:0/1397174328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fdc50 msgr2=0x7ff4680fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 --2- 172.21.15.100:0/1397174328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fdc50 0x7ff4680fe060 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4640048d0 tx=0x7ff464009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 -- 172.21.15.100:0/1397174328 shutdown_connections 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 --2- 172.21.15.100:0/1397174328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fe5a0 0x7ff4680fa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 --2- 172.21.15.100:0/1397174328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fdc50 0x7ff4680fe060 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 -- 172.21.15.100:0/1397174328 >> 172.21.15.100:0/1397174328 conn(0x7ff4680f63b0 msgr2=0x7ff4680f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 -- 172.21.15.100:0/1397174328 shutdown_connections 2024-09-13T02:58:48.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.863+0000 7ff46fb36640 1 -- 172.21.15.100:0/1397174328 wait complete. 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 Processor -- start 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 -- start start 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 0x7ff46810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46810dca0 con 0x7ff4680fe5a0 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46fb36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46810e470 con 0x7ff4680fdc50 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46d0d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46d0d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35072/0 (socket says 172.21.15.100:35072) 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46d0d1640 1 -- 172.21.15.100:0/3158134841 learned_addr learned my addr 172.21.15.100:0/3158134841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.864+0000 7ff46d8d2640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 0x7ff46810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46d0d1640 1 -- 172.21.15.100:0/3158134841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 msgr2=0x7ff46810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46d0d1640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 0x7ff46810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46d0d1640 1 -- 172.21.15.100:0/3158134841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464005040 con 0x7ff4680fe5a0 2024-09-13T02:58:48.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46d8d2640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 0x7ff46810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46d0d1640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff458002870 tx=0x7ff458004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff458002e00 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff45800f040 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46810e700 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4580094f0 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.865+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46810eca0 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.866+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4680fa050 con 0x7ff4680fe5a0 2024-09-13T02:58:48.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.867+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff458007c30 con 0x7ff4680fe5a0 2024-09-13T02:58:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.867+0000 7ff45e7fc640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 0x7ff4540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.867+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff45808d8b0 con 0x7ff4680fe5a0 2024-09-13T02:58:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.867+0000 7ff46d8d2640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 0x7ff4540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:48.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.868+0000 7ff46d8d2640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 0x7ff4540709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff464000c00 tx=0x7ff464035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:48.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:48.872+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff458056a20 con 0x7ff4680fe5a0 2024-09-13T02:58:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.057+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff46810f020 con 0x7ff45406e530 2024-09-13T02:58:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.058+0000 7ff45e7fc640 1 -- 172.21.15.100:0/3158134841 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7ff46810f020 con 0x7ff45406e530 2024-09-13T02:58:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 msgr2=0x7ff4540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 0x7ff4540709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff464000c00 tx=0x7ff464035040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 msgr2=0x7ff46810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff458002870 tx=0x7ff458004600 comp rx=0 tx=0).stop 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 shutdown_connections 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff45406e530 0x7ff4540709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4680fe5a0 0x7ff46810d650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 --2- 172.21.15.100:0/3158134841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff4680fdc50 0x7ff46810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 >> 172.21.15.100:0/3158134841 conn(0x7ff4680f63b0 msgr2=0x7ff4680f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 shutdown_connections 2024-09-13T02:58:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.061+0000 7ff46fb36640 1 -- 172.21.15.100:0/3158134841 wait complete. 2024-09-13T02:58:49.072 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T02:58:49.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 -- 172.21.15.100:0/3814921863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c4065be0 msgr2=0x7f85c40ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 --2- 172.21.15.100:0/3814921863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c4065be0 0x7f85c40ff1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85b40048d0 tx=0x7f85b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 -- 172.21.15.100:0/3814921863 shutdown_connections 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 --2- 172.21.15.100:0/3814921863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c40ff6e0 0x7f85c4101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 --2- 172.21.15.100:0/3814921863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c4065be0 0x7f85c40ff1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.142+0000 7f85ca5be640 1 -- 172.21.15.100:0/3814921863 >> 172.21.15.100:0/3814921863 conn(0x7f85c40f6c10 msgr2=0x7f85c40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 -- 172.21.15.100:0/3814921863 shutdown_connections 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 -- 172.21.15.100:0/3814921863 wait complete. 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 Processor -- start 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 -- start start 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 0x7f85c410d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c410dcc0 con 0x7f85c40ff6e0 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85ca5be640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c410e490 con 0x7f85c4065be0 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35086/0 (socket says 172.21.15.100:35086) 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85bbfff640 1 -- 172.21.15.100:0/2473373220 learned_addr learned my addr 172.21.15.100:0/2473373220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.143+0000 7f85c3fff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 0x7f85c410d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85bbfff640 1 -- 172.21.15.100:0/2473373220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 msgr2=0x7f85c410d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85bbfff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 0x7f85c410d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85bbfff640 1 -- 172.21.15.100:0/2473373220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4005040 con 0x7f85c40ff6e0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85c3fff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 0x7f85c410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85bbfff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00eb70 tx=0x7f85ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ac007c30 con 0x7f85c40ff6e0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85ac00f040 con 0x7f85c40ff6e0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ac0094e0 con 0x7f85c40ff6e0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c410e6c0 con 0x7f85c40ff6e0 2024-09-13T02:58:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.144+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c410ec60 con 0x7f85c40ff6e0 2024-09-13T02:58:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.145+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c40fa890 con 0x7f85c40ff6e0 2024-09-13T02:58:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.145+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f85ac009660 con 0x7f85c40ff6e0 2024-09-13T02:58:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.146+0000 7f85c17fa640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.146+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f85ac08df60 con 0x7f85c40ff6e0 2024-09-13T02:58:49.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.146+0000 7f85c3fff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.147+0000 7f85c3fff640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 0x7f85b00709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85b40048a0 tx=0x7f85b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.150+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85ac0c31b0 con 0x7f85c40ff6e0 2024-09-13T02:58:49.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.340+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c410ef90 con 0x7f85b006e530 2024-09-13T02:58:49.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.342+0000 7f85c17fa640 1 -- 172.21.15.100:0/2473373220 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f85c410ef90 con 0x7f85b006e530 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 msgr2=0x7f85b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 0x7f85b00709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85b40048a0 tx=0x7f85b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 msgr2=0x7f85c410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00eb70 tx=0x7f85ac00b040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 shutdown_connections 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85c40ff6e0 0x7f85c410d670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 --2- 172.21.15.100:0/2473373220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85c4065be0 0x7f85c410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 >> 172.21.15.100:0/2473373220 conn(0x7f85c40f6c10 msgr2=0x7f85c40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 shutdown_connections 2024-09-13T02:58:49.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.344+0000 7f85ca5be640 1 -- 172.21.15.100:0/2473373220 wait complete. 2024-09-13T02:58:49.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 -- 172.21.15.100:0/1438107433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 msgr2=0x7f2df00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 --2- 172.21.15.100:0/1438107433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df00fcb90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2de40048d0 tx=0x7f2de4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 -- 172.21.15.100:0/1438107433 shutdown_connections 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 --2- 172.21.15.100:0/1438107433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df00fcb90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 --2- 172.21.15.100:0/1438107433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 0x7f2df00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 -- 172.21.15.100:0/1438107433 >> 172.21.15.100:0/1438107433 conn(0x7f2df00f6c10 msgr2=0x7f2df00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 -- 172.21.15.100:0/1438107433 shutdown_connections 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 -- 172.21.15.100:0/1438107433 wait complete. 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.426+0000 7f2df5c75640 1 Processor -- start 2024-09-13T02:58:49.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2df5c75640 1 -- start start 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2df5c75640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 0x7f2df010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2df5c75640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2df5c75640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df010dc90 con 0x7f2df00fc720 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2df5c75640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df010e460 con 0x7f2df00fb450 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35106/0 (socket says 172.21.15.100:35106) 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 -- 172.21.15.100:0/4142404318 learned_addr learned my addr 172.21.15.100:0/4142404318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2def7fe640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 0x7f2df010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 -- 172.21.15.100:0/4142404318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 msgr2=0x7f2df010d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 0x7f2df010d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 -- 172.21.15.100:0/4142404318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4005040 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.427+0000 7f2deeffd640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2de40048a0 tx=0x7f2de4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.428+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de4038070 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.428+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2de4004290 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.428+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df010e690 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.428+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de4033660 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.428+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df010ec30 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.429+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df00fa8b0 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.429+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2de4030020 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.430+0000 7f2dd7fff640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 0x7f2dd80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.430+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f2de40ae2c0 con 0x7f2df00fc720 2024-09-13T02:58:49.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.430+0000 7f2def7fe640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 0x7f2dd80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.430+0000 7f2def7fe640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 0x7f2dd80709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009af0 tx=0x7f2de000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.434+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2de4077430 con 0x7f2df00fc720 2024-09-13T02:58:49.596 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:49 smithi100 ceph-mon[92340]: pgmap v219: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T02:58:49.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.611+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2df0103fb0 con 0x7f2dd806e530 2024-09-13T02:58:49.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.620+0000 7f2dd7fff640 1 -- 172.21.15.100:0/4142404318 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f2df0103fb0 con 0x7f2dd806e530 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (7m) 48s ago 15m 23.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (5m) 48s ago 16m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (5m) 17s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (7m) 48s ago 15m 83.1M - 9.4.7 954c08fa6188 53ae479b1664 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (53s) 48s ago 10m 10.9M - 19.1.1-322-g7741f7f9 19dc8d659727 8f4ffac719a6 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (76s) 48s ago 10m 15.5M - 19.1.1-322-g7741f7f9 19dc8d659727 3a0baec05ca7 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (19s) 17s ago 10m 14.0M - 19.1.1-322-g7741f7f9 19dc8d659727 23a0a22ff15f 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (37s) 17s ago 10m 12.8M - 19.1.1-322-g7741f7f9 19dc8d659727 3a61ca537875 2024-09-13T02:58:49.622 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (6m) 48s ago 17m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (6m) 17s ago 15m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (6m) 48s ago 17m 50.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (5m) 17s ago 14m 39.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 48s ago 16m 16.5M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (7m) 17s ago 15m 17.6M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (4m) 48s ago 14m 105M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (4m) 48s ago 13m 104M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (3m) 48s ago 13m 91.4M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (3m) 17s ago 12m 125M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (2m) 17s ago 12m 115M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (2m) 17s ago 12m 99.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T02:58:49.623 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (6m) 48s ago 15m 62.2M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 msgr2=0x7f2dd80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 0x7f2dd80709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009af0 tx=0x7f2de000b040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 msgr2=0x7f2df010d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2de40048a0 tx=0x7f2de4009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 shutdown_connections 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2dd806e530 0x7f2dd80709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df00fc720 0x7f2df010d640 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 --2- 172.21.15.100:0/4142404318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2df00fb450 0x7f2df010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 >> 172.21.15.100:0/4142404318 conn(0x7f2df00f6c10 msgr2=0x7f2df0066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 shutdown_connections 2024-09-13T02:58:49.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.622+0000 7f2df5c75640 1 -- 172.21.15.100:0/4142404318 wait complete. 2024-09-13T02:58:49.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:49 smithi122 ceph-mon[79680]: pgmap v219: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 -- 172.21.15.100:0/2326507124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 msgr2=0x7f0f78070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 --2- 172.21.15.100:0/2326507124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f78070450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f740048d0 tx=0x7f0f74009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 -- 172.21.15.100:0/2326507124 shutdown_connections 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 --2- 172.21.15.100:0/2326507124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f78070450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 --2- 172.21.15.100:0/2326507124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7806faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 -- 172.21.15.100:0/2326507124 >> 172.21.15.100:0/2326507124 conn(0x7f0f780f7d10 msgr2=0x7f0f780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 -- 172.21.15.100:0/2326507124 shutdown_connections 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.716+0000 7f0f8006e640 1 -- 172.21.15.100:0/2326507124 wait complete. 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 Processor -- start 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 -- start start 2024-09-13T02:58:49.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7810f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7810fe00 con 0x7f0f7806ffe0 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f8006e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78110620 con 0x7f0f78071570 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f7de0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f7de0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35118/0 (socket says 172.21.15.100:35118) 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f7de0a640 1 -- 172.21.15.100:0/3762915681 learned_addr learned my addr 172.21.15.100:0/3762915681 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.717+0000 7f0f7d609640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7810f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f7de0a640 1 -- 172.21.15.100:0/3762915681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 msgr2=0x7f0f7810f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f7de0a640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7810f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f7de0a640 1 -- 172.21.15.100:0/3762915681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74005040 con 0x7f0f7806ffe0 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f7d609640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f7de0a640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c810 tx=0x7f0f68004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6800a850 con 0x7f0f7806ffe0 2024-09-13T02:58:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f6800ae50 con 0x7f0f7806ffe0 2024-09-13T02:58:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f680113a0 con 0x7f0f7806ffe0 2024-09-13T02:58:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f781108b0 con 0x7f0f7806ffe0 2024-09-13T02:58:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.718+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78110e20 con 0x7f0f7806ffe0 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.719+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f780fb990 con 0x7f0f7806ffe0 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.720+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0f6800a9b0 con 0x7f0f7806ffe0 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.721+0000 7f0f6e7fc640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 0x7f0f640707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.721+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0f6808e130 con 0x7f0f7806ffe0 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.721+0000 7f0f7d609640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 0x7f0f640707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.721+0000 7f0f7d609640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 0x7f0f640707e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009ac0 tx=0x7f0f74035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:49.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.725+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0f68057290 con 0x7f0f7806ffe0 2024-09-13T02:58:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.986+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f78107140 con 0x7f0f7806ffe0 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.987+0000 7f0f6e7fc640 1 -- 172.21.15.100:0/3762915681 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f0f6805a950 con 0x7f0f7806ffe0 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:58:49.989 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:58:49.990 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 msgr2=0x7f0f640707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 0x7f0f640707e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009ac0 tx=0x7f0f74035040 comp rx=0 tx=0).stop 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 msgr2=0x7f0f7810f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800c810 tx=0x7f0f68004430 comp rx=0 tx=0).stop 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 shutdown_connections 2024-09-13T02:58:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0f6406e330 0x7f0f640707e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f78071570 0x7f0f7810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 --2- 172.21.15.100:0/3762915681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f7806ffe0 0x7f0f7810f270 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 >> 172.21.15.100:0/3762915681 conn(0x7f0f780f7d10 msgr2=0x7f0f780f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 shutdown_connections 2024-09-13T02:58:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:49.990+0000 7f0f8006e640 1 -- 172.21.15.100:0/3762915681 wait complete. 2024-09-13T02:58:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 -- 172.21.15.100:0/2739769569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9150065c40 msgr2=0x7f91500ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 --2- 172.21.15.100:0/2739769569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9150065c40 0x7f91500ff140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91380048d0 tx=0x7f9138009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 -- 172.21.15.100:0/2739769569 shutdown_connections 2024-09-13T02:58:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 --2- 172.21.15.100:0/2739769569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91500ff680 0x7f9150101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 --2- 172.21.15.100:0/2739769569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9150065c40 0x7f91500ff140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 -- 172.21.15.100:0/2739769569 >> 172.21.15.100:0/2739769569 conn(0x7f91500f6c10 msgr2=0x7f91500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 -- 172.21.15.100:0/2739769569 shutdown_connections 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 -- 172.21.15.100:0/2739769569 wait complete. 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.078+0000 7f91550ae640 1 Processor -- start 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f91550ae640 1 -- start start 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f91550ae640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9150065c40 0x7f91500fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f91550ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f91550ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500fb580 con 0x7f91500ff680 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f91550ae640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500fb6c0 con 0x7f9150065c40 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35124/0 (socket says 172.21.15.100:35124) 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 -- 172.21.15.100:0/3034784548 learned_addr learned my addr 172.21.15.100:0/3034784548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914ed9d640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9150065c40 0x7f91500fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 -- 172.21.15.100:0/3034784548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9150065c40 msgr2=0x7f91500fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9150065c40 0x7f91500fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 -- 172.21.15.100:0/3034784548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138005040 con 0x7f91500ff680 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.079+0000 7f914e59c640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f914000eb70 tx=0x7f914000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.080+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9140007c30 con 0x7f91500ff680 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.080+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f914000f040 con 0x7f91500ff680 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.080+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500fb940 con 0x7f91500ff680 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.080+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9140009550 con 0x7f91500ff680 2024-09-13T02:58:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.080+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9150115140 con 0x7f91500ff680 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.081+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91500fa890 con 0x7f91500ff680 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.081+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9140009820 con 0x7f91500ff680 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.082+0000 7f91477fe640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 0x7f913c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.082+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f914008de90 con 0x7f91500ff680 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.082+0000 7f914ed9d640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 0x7f913c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.083+0000 7f914ed9d640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 0x7f913c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f9138035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.087+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9140056f80 con 0x7f91500ff680 2024-09-13T02:58:50.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.298+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f915004b720 con 0x7f91500ff680 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.298+0000 7f91477fe640 1 -- 172.21.15.100:0/3034784548 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1995 (secure 0 0 0) 0x7f9140061070 con 0x7f91500ff680 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout:e42 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:58:38:014887+0000 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T02:58:50.300 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 42 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:58:38.014886+0000 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T02:58:50.301 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 81 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=34404,1=34436} 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T02:58:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{0:34404} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{1:34436} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6824/1347589345,v1:172.21.15.122:6825/1347589345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6826/2951042813,v1:172.21.15.122:6827/2951042813] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 42 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 msgr2=0x7f913c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 0x7f913c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9138000c00 tx=0x7f9138035040 comp rx=0 tx=0).stop 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 msgr2=0x7f91500fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f914000eb70 tx=0x7f914000b040 comp rx=0 tx=0).stop 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 shutdown_connections 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f913c06e530 0x7f913c0709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91500ff680 0x7f91500fb040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 --2- 172.21.15.100:0/3034784548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9150065c40 0x7f91500fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.300+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 >> 172.21.15.100:0/3034784548 conn(0x7f91500f6c10 msgr2=0x7f91500f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.301+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 shutdown_connections 2024-09-13T02:58:50.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.301+0000 7f91550ae640 1 -- 172.21.15.100:0/3034784548 wait complete. 2024-09-13T02:58:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- 172.21.15.100:0/1763580871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ff680 msgr2=0x7fb92c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 --2- 172.21.15.100:0/1763580871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ff680 0x7fb92c101a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9180048d0 tx=0x7fb918009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- 172.21.15.100:0/1763580871 shutdown_connections 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 --2- 172.21.15.100:0/1763580871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ff680 0x7fb92c101a60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 --2- 172.21.15.100:0/1763580871 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c065c40 0x7fb92c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- 172.21.15.100:0/1763580871 >> 172.21.15.100:0/1763580871 conn(0x7fb92c0f6c10 msgr2=0x7fb92c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- 172.21.15.100:0/1763580871 shutdown_connections 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- 172.21.15.100:0/1763580871 wait complete. 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 Processor -- start 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.385+0000 7fb9331a3640 1 -- start start 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb9331a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb9331a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c0ff680 0x7fb92c10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb9331a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c10dc00 con 0x7fb92c065c40 2024-09-13T02:58:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb9331a3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c10e420 con 0x7fb92c0ff680 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35144/0 (socket says 172.21.15.100:35144) 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 -- 172.21.15.100:0/4289202317 learned_addr learned my addr 172.21.15.100:0/4289202317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb92bfff640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c0ff680 0x7fb92c10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 -- 172.21.15.100:0/4289202317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c0ff680 msgr2=0x7fb92c10d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c0ff680 0x7fb92c10d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 -- 172.21.15.100:0/4289202317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918005040 con 0x7fb92c065c40 2024-09-13T02:58:50.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb930f3f640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb92000eb70 tx=0x7fb92000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.386+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb920007c30 con 0x7fb92c065c40 2024-09-13T02:58:50.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.387+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb92000f040 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.387+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c10e6b0 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.387+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb92000caa0 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.387+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c10ec50 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.388+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c0fa890 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.388+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb92000cd10 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.389+0000 7fb9297fa640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 0x7fb91c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.389+0000 7fb92bfff640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 0x7fb91c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.389+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb92008e440 con 0x7fb92c065c40 2024-09-13T02:58:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.389+0000 7fb92bfff640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 0x7fb91c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb918007ac0 tx=0x7fb918035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.393+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb920057500 con 0x7fb92c065c40 2024-09-13T02:58:50.566 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:50 smithi100 ceph-mon[92340]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:50.566 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:50 smithi100 ceph-mon[92340]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:50.566 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:50 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3762915681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:50.566 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:50 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3034784548' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:50.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.602+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb92c10f090 con 0x7fb91c06e530 2024-09-13T02:58:50.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.604+0000 7fb9297fa640 1 -- 172.21.15.100:0/4289202317 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fb92c10f090 con 0x7fb91c06e530 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": true, 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [ 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "osd", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "mds", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: "mon" 2024-09-13T02:58:50.606 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-13T02:58:50.607 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": "16/21 daemons upgraded", 2024-09-13T02:58:50.607 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T02:58:50.607 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:58:50.607 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:58:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 msgr2=0x7fb91c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 0x7fb91c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb918007ac0 tx=0x7fb918035040 comp rx=0 tx=0).stop 2024-09-13T02:58:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 msgr2=0x7fb92c10d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb92000eb70 tx=0x7fb92000b040 comp rx=0 tx=0).stop 2024-09-13T02:58:50.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 shutdown_connections 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fb91c06e530 0x7fb91c0709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb92c0ff680 0x7fb92c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 --2- 172.21.15.100:0/4289202317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c065c40 0x7fb92c10d070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.606+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 >> 172.21.15.100:0/4289202317 conn(0x7fb92c0f6c10 msgr2=0x7fb92c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.607+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 shutdown_connections 2024-09-13T02:58:50.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.607+0000 7fb9331a3640 1 -- 172.21.15.100:0/4289202317 wait complete. 2024-09-13T02:58:50.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:50 smithi122 ceph-mon[79680]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:50.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:50 smithi122 ceph-mon[79680]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:50.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:50 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3762915681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:50.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:50 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3034784548' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 -- 172.21.15.100:0/3490723996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9938065c40 msgr2=0x7f99380ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 --2- 172.21.15.100:0/3490723996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9938065c40 0x7f99380ff140 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f99340048d0 tx=0x7f9934009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 -- 172.21.15.100:0/3490723996 shutdown_connections 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 --2- 172.21.15.100:0/3490723996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f99380ff680 0x7f9938101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 --2- 172.21.15.100:0/3490723996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9938065c40 0x7f99380ff140 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 -- 172.21.15.100:0/3490723996 >> 172.21.15.100:0/3490723996 conn(0x7f99380f6c10 msgr2=0x7f99380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 -- 172.21.15.100:0/3490723996 shutdown_connections 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 -- 172.21.15.100:0/3490723996 wait complete. 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.695+0000 7f994051a640 1 Processor -- start 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f994051a640 1 -- start start 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f994051a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9938065c40 0x7f993810f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f994051a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f994051a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993810fea0 con 0x7f99380ff680 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f994051a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938110670 con 0x7f9938065c40 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35166/0 (socket says 172.21.15.100:35166) 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 -- 172.21.15.100:0/1340566694 learned_addr learned my addr 172.21.15.100:0/1340566694 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993e2b6640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9938065c40 0x7f993810f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 -- 172.21.15.100:0/1340566694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9938065c40 msgr2=0x7f993810f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9938065c40 0x7f993810f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.696+0000 7f993dab5640 1 -- 172.21.15.100:0/1340566694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934005040 con 0x7f99380ff680 2024-09-13T02:58:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f993dab5640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9928002a80 tx=0x7f9928004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9928007c30 con 0x7f99380ff680 2024-09-13T02:58:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f992800f040 con 0x7f99380ff680 2024-09-13T02:58:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9938110900 con 0x7f99380ff680 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992800dab0 con 0x7f99380ff680 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.697+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938110e20 con 0x7f99380ff680 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.698+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380fa890 con 0x7f99380ff680 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.699+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f992800dc30 con 0x7f99380ff680 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.699+0000 7f992effd640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 0x7f99240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.699+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f992808daa0 con 0x7f99380ff680 2024-09-13T02:58:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.699+0000 7f993e2b6640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 0x7f99240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.700+0000 7f993e2b6640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 0x7f99240709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:50.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.705+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9928056b90 con 0x7f99380ff680 2024-09-13T02:58:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.960+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9938104f90 con 0x7f99380ff680 2024-09-13T02:58:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.960+0000 7f992effd640 1 -- 172.21.15.100:0/1340566694 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f992805a250 con 0x7f99380ff680 2024-09-13T02:58:50.962 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:58:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 msgr2=0x7f99240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 0x7f99240709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934035040 comp rx=0 tx=0).stop 2024-09-13T02:58:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 msgr2=0x7f993810f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9928002a80 tx=0x7f9928004600 comp rx=0 tx=0).stop 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 shutdown_connections 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f992406e530 0x7f99240709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99380ff680 0x7f993810f850 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 --2- 172.21.15.100:0/1340566694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9938065c40 0x7f993810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 >> 172.21.15.100:0/1340566694 conn(0x7f99380f6c10 msgr2=0x7f99380fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 shutdown_connections 2024-09-13T02:58:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:58:50.963+0000 7f994051a640 1 -- 172.21.15.100:0/1340566694 wait complete. 2024-09-13T02:58:51.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:51.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: pgmap v220: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:58:51.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:51.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:51.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:51.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:51 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1340566694' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: pgmap v220: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:58:51.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:51.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:51.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:51.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:51 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1340566694' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:52.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:52 smithi100 ceph-mon[92340]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:52.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:52 smithi122 ceph-mon[79680]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:53.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:53 smithi100 ceph-mon[92340]: pgmap v221: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:58:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:53 smithi122 ceph-mon[79680]: pgmap v221: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:58:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:55 smithi100 ceph-mon[92340]: pgmap v222: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:55 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:55 smithi122 ceph-mon[79680]: pgmap v222: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:55 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:56.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:56 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:56.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:56 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:56.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:56 smithi100 ceph-mon[92340]: pgmap v223: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:56.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:56 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:56.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:56 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:56.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:56 smithi122 ceph-mon[79680]: pgmap v223: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: pgmap v224: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:58:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.678 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T02:58:59.679 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T02:58:59.680 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T02:58:59.681 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:59.682 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:58:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: pgmap v224: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.688 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:59.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T02:58:59.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T02:58:59.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.689 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.690 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.691 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:59.692 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:58:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T02:59:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:00 smithi100 ceph-mon[92340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:59:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:00 smithi100 ceph-mon[92340]: Upgrade: Finalizing container_image settings 2024-09-13T02:59:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:00 smithi100 ceph-mon[92340]: Upgrade: Complete! 2024-09-13T02:59:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:00 smithi122 ceph-mon[79680]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:59:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:00 smithi122 ceph-mon[79680]: Upgrade: Finalizing container_image settings 2024-09-13T02:59:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:00 smithi122 ceph-mon[79680]: Upgrade: Complete! 2024-09-13T02:59:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:01 smithi100 ceph-mon[92340]: pgmap v225: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:01 smithi122 ceph-mon[79680]: pgmap v225: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:03 smithi100 ceph-mon[92340]: pgmap v226: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:03 smithi122 ceph-mon[79680]: pgmap v226: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:05 smithi100 ceph-mon[92340]: pgmap v227: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:05 smithi122 ceph-mon[79680]: pgmap v227: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:07 smithi100 ceph-mon[92340]: pgmap v228: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:07 smithi122 ceph-mon[79680]: pgmap v228: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:09 smithi100 ceph-mon[92340]: pgmap v229: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:09 smithi122 ceph-mon[79680]: pgmap v229: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:11 smithi100 ceph-mon[92340]: pgmap v230: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:11 smithi122 ceph-mon[79680]: pgmap v230: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:13 smithi100 ceph-mon[92340]: pgmap v231: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:13 smithi122 ceph-mon[79680]: pgmap v231: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:15 smithi100 ceph-mon[92340]: pgmap v232: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:15 smithi122 ceph-mon[79680]: pgmap v232: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:17 smithi100 ceph-mon[92340]: pgmap v233: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:17 smithi122 ceph-mon[79680]: pgmap v233: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:19.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:19 smithi100 ceph-mon[92340]: pgmap v234: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:19 smithi122 ceph-mon[79680]: pgmap v234: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:21.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.055+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4278344607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 msgr2=0x7f0cec0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.055+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4278344607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec0fdc90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80048d0 tx=0x7f0cd8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4278344607 shutdown_connections 2024-09-13T02:59:21.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4278344607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec0fdc90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4278344607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 0x7f0cec0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4278344607 >> 172.21.15.100:0/4278344607 conn(0x7f0cec0f7d30 msgr2=0x7f0cec0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4278344607 shutdown_connections 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4278344607 wait complete. 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 Processor -- start 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.056+0000 7f0cf2bf0640 1 -- start start 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cf2bf0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 0x7f0cec10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cf2bf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cf2bf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec10dc40 con 0x7f0cec0fd820 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cf2bf0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec10e460 con 0x7f0cec0fc550 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59052/0 (socket says 172.21.15.100:59052) 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 -- 172.21.15.100:0/4223674803 learned_addr learned my addr 172.21.15.100:0/4223674803 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cf098c640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 0x7f0cec10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 -- 172.21.15.100:0/4223674803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 msgr2=0x7f0cec10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 0x7f0cec10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 -- 172.21.15.100:0/4223674803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8005040 con 0x7f0cec0fd820 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0cebfff640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80048a0 tx=0x7f0cd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.057+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd8038070 con 0x7f0cec0fd820 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.058+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cd8004290 con 0x7f0cec0fd820 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.058+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec10e690 con 0x7f0cec0fd820 2024-09-13T02:59:21.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.058+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd8033660 con 0x7f0cec0fd820 2024-09-13T02:59:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.058+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec10ec30 con 0x7f0cec0fd820 2024-09-13T02:59:21.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.059+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec0fb9b0 con 0x7f0cec0fd820 2024-09-13T02:59:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.059+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0cd8030020 con 0x7f0cec0fd820 2024-09-13T02:59:21.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.060+0000 7f0ce97fa640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 0x7f0cdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.060+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0cd80ae360 con 0x7f0cec0fd820 2024-09-13T02:59:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.060+0000 7f0cf098c640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 0x7f0cdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.061+0000 7f0cf098c640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 0x7f0cdc0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009af0 tx=0x7f0ce000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:21.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.065+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0cd8077450 con 0x7f0cec0fd820 2024-09-13T02:59:21.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.251+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cec10eef0 con 0x7f0cdc06e530 2024-09-13T02:59:21.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.253+0000 7f0ce97fa640 1 -- 172.21.15.100:0/4223674803 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f0cec10eef0 con 0x7f0cdc06e530 2024-09-13T02:59:21.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 msgr2=0x7f0cdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 0x7f0cdc0709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009af0 tx=0x7f0ce000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:21.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 msgr2=0x7f0cec10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:21.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80048a0 tx=0x7f0cd8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 shutdown_connections 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0cdc06e530 0x7f0cdc0709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cec0fd820 0x7f0cec10d5f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 --2- 172.21.15.100:0/4223674803 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cec0fc550 0x7f0cec10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 >> 172.21.15.100:0/4223674803 conn(0x7f0cec0f7d30 msgr2=0x7f0cec0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 shutdown_connections 2024-09-13T02:59:21.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:21.255+0000 7f0cf2bf0640 1 -- 172.21.15.100:0/4223674803 wait complete. 2024-09-13T02:59:21.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:21 smithi100 ceph-mon[92340]: pgmap v235: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:21 smithi122 ceph-mon[79680]: pgmap v235: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:22.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T02:59:22.331 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:22.593 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:22 smithi100 ceph-mon[92340]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:22.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:22 smithi122 ceph-mon[79680]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:23 smithi100 ceph-mon[92340]: pgmap v236: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:23.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:23 smithi122 ceph-mon[79680]: pgmap v236: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/3999209094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a01014d0 msgr2=0x7fe8a01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:24.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/3999209094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a01014d0 0x7fe8a01018a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0048d0 tx=0x7fe89c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/3999209094 shutdown_connections 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/3999209094 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a00fb490 0x7fe8a00fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/3999209094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a01014d0 0x7fe8a01018a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.067+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/3999209094 >> 172.21.15.100:0/3999209094 conn(0x7fe8a00f7030 msgr2=0x7fe8a00f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/3999209094 shutdown_connections 2024-09-13T02:59:24.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/3999209094 wait complete. 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 Processor -- start 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 -- start start 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a01014d0 0x7fe8a01136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0113cd0 con 0x7fe8a00fb490 2024-09-13T02:59:24.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a7fe5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a010d110 con 0x7fe8a01014d0 2024-09-13T02:59:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a5d81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a5d81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59068/0 (socket says 172.21.15.100:59068) 2024-09-13T02:59:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.068+0000 7fe8a5d81640 1 -- 172.21.15.100:0/1472139512 learned_addr learned my addr 172.21.15.100:0/1472139512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:59:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a5580640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a01014d0 0x7fe8a01136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:24.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a5d81640 1 -- 172.21.15.100:0/1472139512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a01014d0 msgr2=0x7fe8a01136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a5d81640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a01014d0 0x7fe8a01136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a5d81640 1 -- 172.21.15.100:0/1472139512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c005040 con 0x7fe8a00fb490 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a5d81640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0043d0 tx=0x7fe89c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c038070 con 0x7fe8a00fb490 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe89c0096e0 con 0x7fe8a00fb490 2024-09-13T02:59:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a010d390 con 0x7fe8a00fb490 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c03d420 con 0x7fe8a00fb490 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.069+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a010d930 con 0x7fe8a00fb490 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.070+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a00fcbd0 con 0x7fe8a00fb490 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.071+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe89c030020 con 0x7fe8a00fb490 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.071+0000 7fe8967fc640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 0x7fe88c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.071+0000 7fe8a5580640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 0x7fe88c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.071+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fe89c0ae6a0 con 0x7fe8a00fb490 2024-09-13T02:59:24.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.072+0000 7fe8a5580640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 0x7fe88c0709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fd0 tx=0x7fe890009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:24.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.076+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe89c077760 con 0x7fe8a00fb490 2024-09-13T02:59:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.248+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8a004b720 con 0x7fe88c06e530 2024-09-13T02:59:24.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.257+0000 7fe8967fc640 1 -- 172.21.15.100:0/1472139512 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe8a004b720 con 0x7fe88c06e530 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (7m) 29s ago 16m 23.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (5m) 29s ago 16m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (5m) 52s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (34s) 29s ago 16m 45.5M - 9.4.12 2bacad6d85d8 16c4888ff14d 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (87s) 29s ago 11m 14.8M - 19.1.1-322-g7741f7f9 19dc8d659727 8f4ffac719a6 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (111s) 29s ago 11m 69.9M - 19.1.1-322-g7741f7f9 19dc8d659727 3a0baec05ca7 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (54s) 52s ago 10m 14.0M - 19.1.1-322-g7741f7f9 19dc8d659727 23a0a22ff15f 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (71s) 52s ago 11m 12.8M - 19.1.1-322-g7741f7f9 19dc8d659727 3a61ca537875 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (7m) 29s ago 17m 513M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (6m) 52s ago 15m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (6m) 29s ago 18m 52.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T02:59:24.259 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (6m) 52s ago 15m 39.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (8m) 29s ago 16m 16.4M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (7m) 52s ago 15m 17.6M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (5m) 29s ago 14m 106M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (4m) 29s ago 14m 106M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (4m) 29s ago 13m 92.9M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (3m) 52s ago 13m 125M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (3m) 52s ago 13m 115M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (2m) 52s ago 12m 99.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T02:59:24.260 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (7m) 29s ago 16m 62.4M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.259+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 msgr2=0x7fe88c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.259+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 0x7fe88c0709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fd0 tx=0x7fe890009e50 comp rx=0 tx=0).stop 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 msgr2=0x7fe8a0113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0043d0 tx=0x7fe89c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 shutdown_connections 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fe88c06e530 0x7fe88c0709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8a01014d0 0x7fe8a01136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 --2- 172.21.15.100:0/1472139512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a00fb490 0x7fe8a0113190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:24.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 >> 172.21.15.100:0/1472139512 conn(0x7fe8a00f7030 msgr2=0x7fe8a0065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:24.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 shutdown_connections 2024-09-13T02:59:24.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:24.260+0000 7fe8a7fe5640 1 -- 172.21.15.100:0/1472139512 wait complete. 2024-09-13T02:59:25.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade status' 2024-09-13T02:59:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:25.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:25 smithi100 ceph-mon[92340]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:25.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:25 smithi100 ceph-mon[92340]: pgmap v237: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:25 smithi122 ceph-mon[79680]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:25.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:25 smithi122 ceph-mon[79680]: pgmap v237: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 -- 172.21.15.100:0/876167741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102ef0 msgr2=0x7ff1b00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/876167741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102ef0 0x7ff1b00fc5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff1980048d0 tx=0x7ff198009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 -- 172.21.15.100:0/876167741 shutdown_connections 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/876167741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102ef0 0x7ff1b00fc5b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/876167741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102550 0x7ff1b0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 -- 172.21.15.100:0/876167741 >> 172.21.15.100:0/876167741 conn(0x7ff1b00f80f0 msgr2=0x7ff1b00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 -- 172.21.15.100:0/876167741 shutdown_connections 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.991+0000 7ff1b50ef640 1 -- 172.21.15.100:0/876167741 wait complete. 2024-09-13T02:59:26.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 Processor -- start 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 -- start start 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102ef0 0x7ff1b0113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01141d0 con 0x7ff1b0102550 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1b50ef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b010d550 con 0x7ff1b0102ef0 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59078/0 (socket says 172.21.15.100:59078) 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 -- 172.21.15.100:0/3702237715 learned_addr learned my addr 172.21.15.100:0/3702237715 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1ae59c640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102ef0 0x7ff1b0113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 -- 172.21.15.100:0/3702237715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102ef0 msgr2=0x7ff1b0113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102ef0 0x7ff1b0113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.992+0000 7ff1aed9d640 1 -- 172.21.15.100:0/3702237715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198005040 con 0x7ff1b0102550 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1aed9d640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b790 tx=0x7ff1a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:26.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a000c700 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1a000cd00 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a0015e70 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b010d7e0 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.993+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b010dcd0 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.994+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b00fdcd0 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.994+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff1a0012070 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.995+0000 7ff1a77fe640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.995+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ff1a008dd30 con 0x7ff1b0102550 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.995+0000 7ff1ae59c640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:26.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:26.996+0000 7ff1ae59c640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 0x7ff19c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff198000c00 tx=0x7ff198035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:27.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.000+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff1a0056df0 con 0x7ff1b0102550 2024-09-13T02:59:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.180+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1b00fbdf0 con 0x7ff19c06e530 2024-09-13T02:59:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.181+0000 7ff1a77fe640 1 -- 172.21.15.100:0/3702237715 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff1b00fbdf0 con 0x7ff19c06e530 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "target_image": null, 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "in_progress": false, 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "which": "", 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "services_complete": [], 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "progress": null, 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout: "is_paused": false 2024-09-13T02:59:27.183 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 msgr2=0x7ff19c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 0x7ff19c0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff198000c00 tx=0x7ff198035040 comp rx=0 tx=0).stop 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 msgr2=0x7ff1b01135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b790 tx=0x7ff1a00091d0 comp rx=0 tx=0).stop 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 shutdown_connections 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff1b0102ef0 0x7ff1b0113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 --2- 172.21.15.100:0/3702237715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b0102550 0x7ff1b01135b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 >> 172.21.15.100:0/3702237715 conn(0x7ff1b00f80f0 msgr2=0x7ff1b00f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 shutdown_connections 2024-09-13T02:59:27.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:27.183+0000 7ff1b50ef640 1 -- 172.21.15.100:0/3702237715 wait complete. 2024-09-13T02:59:27.484 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:27 smithi100 ceph-mon[92340]: pgmap v238: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:27.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:27 smithi122 ceph-mon[79680]: pgmap v238: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:27.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph health detail' 2024-09-13T02:59:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:28.522 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:28 smithi100 ceph-mon[92340]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:28.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:28 smithi122 ceph-mon[79680]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:29.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:29 smithi100 ceph-mon[92340]: pgmap v239: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:29.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:29 smithi122 ceph-mon[79680]: pgmap v239: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:29.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- 172.21.15.100:0/1589841864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc102620 msgr2=0x7f47bc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 --2- 172.21.15.100:0/1589841864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc102620 0x7f47bc1029f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47b80048d0 tx=0x7f47b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- 172.21.15.100:0/1589841864 shutdown_connections 2024-09-13T02:59:29.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 --2- 172.21.15.100:0/1589841864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc0fac80 0x7f47bc0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 --2- 172.21.15.100:0/1589841864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc102620 0x7f47bc1029f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- 172.21.15.100:0/1589841864 >> 172.21.15.100:0/1589841864 conn(0x7f47bc070ce0 msgr2=0x7f47bc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- 172.21.15.100:0/1589841864 shutdown_connections 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- 172.21.15.100:0/1589841864 wait complete. 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 Processor -- start 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- start start 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc102620 0x7f47bc113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc113dc0 con 0x7f47bc0fac80 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.755+0000 7f47c3713640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc10d170 con 0x7f47bc102620 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33244/0 (socket says 172.21.15.100:33244) 2024-09-13T02:59:29.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 -- 172.21.15.100:0/1331560627 learned_addr learned my addr 172.21.15.100:0/1331560627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c0cae640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc102620 0x7f47bc113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 -- 172.21.15.100:0/1331560627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc102620 msgr2=0x7f47bc113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc102620 0x7f47bc113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 -- 172.21.15.100:0/1331560627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8005040 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c14af640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47b8003080 tx=0x7f47b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b8038070 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47b80097e0 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc10d3f0 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47b803d420 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.756+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc10d8b0 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.757+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0657b0 con 0x7f47bc0fac80 2024-09-13T02:59:29.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.758+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f47b8030020 con 0x7f47bc0fac80 2024-09-13T02:59:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.758+0000 7f47b1ffb640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 0x7f47a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.758+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f47b80ae7d0 con 0x7f47bc0fac80 2024-09-13T02:59:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.758+0000 7f47c0cae640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 0x7f47a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.759+0000 7f47c0cae640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 0x7f47a80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47bc10eab0 tx=0x7f47ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:29.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.763+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47b8077810 con 0x7f47bc0fac80 2024-09-13T02:59:30.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.999+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f47bc074c00 con 0x7f47bc0fac80 2024-09-13T02:59:30.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:29.999+0000 7f47b1ffb640 1 -- 172.21.15.100:0/1331560627 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f47b807aed0 con 0x7f47bc0fac80 2024-09-13T02:59:30.001 INFO:teuthology.orchestra.run.smithi100.stdout:HEALTH_OK 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.001+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 msgr2=0x7f47a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.001+0000 7f47c3713640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 0x7f47a80709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47bc10eab0 tx=0x7f47ac008040 comp rx=0 tx=0).stop 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.001+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 msgr2=0x7f47bc1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.001+0000 7f47c3713640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47b8003080 tx=0x7f47b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 shutdown_connections 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f47a806e530 0x7f47a80709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47bc102620 0x7f47bc113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 --2- 172.21.15.100:0/1331560627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc0fac80 0x7f47bc1131f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 >> 172.21.15.100:0/1331560627 conn(0x7f47bc070ce0 msgr2=0x7f47bc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 shutdown_connections 2024-09-13T02:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:30.002+0000 7f47c3713640 1 -- 172.21.15.100:0/1331560627 wait complete. 2024-09-13T02:59:30.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:30 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1331560627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:30.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:30 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1331560627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:30.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T02:59:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:31.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:31 smithi100 ceph-mon[92340]: pgmap v240: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:31.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:31 smithi122 ceph-mon[79680]: pgmap v240: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 -- 172.21.15.100:0/2307310449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 msgr2=0x7f74e00fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 --2- 172.21.15.100:0/2307310449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e00fd910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f74d0004900 tx=0x7f74d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 -- 172.21.15.100:0/2307310449 shutdown_connections 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 --2- 172.21.15.100:0/2307310449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 0x7f74e01065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 --2- 172.21.15.100:0/2307310449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e00fd910 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 -- 172.21.15.100:0/2307310449 >> 172.21.15.100:0/2307310449 conn(0x7f74e00f7000 msgr2=0x7f74e00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 -- 172.21.15.100:0/2307310449 shutdown_connections 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 -- 172.21.15.100:0/2307310449 wait complete. 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.561+0000 7f74e6624640 1 Processor -- start 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74e6624640 1 -- start start 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74e6624640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:32.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74e6624640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 0x7f74e01137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74e6624640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0113db0 con 0x7f74e00fd540 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74e6624640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e010d1f0 con 0x7f74e00fdee0 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33272/0 (socket says 172.21.15.100:33272) 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 -- 172.21.15.100:0/1735520715 learned_addr learned my addr 172.21.15.100:0/1735520715 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74df7fe640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 0x7f74e01137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 -- 172.21.15.100:0/1735520715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 msgr2=0x7f74e01137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 0x7f74e01137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 -- 172.21.15.100:0/1735520715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0005040 con 0x7f74e00fd540 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.562+0000 7f74dffff640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009ac0 tx=0x7f74d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.563+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d0038070 con 0x7f74e00fd540 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.563+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74d002ae80 con 0x7f74e00fd540 2024-09-13T02:59:32.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.563+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e010d470 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.563+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d0009680 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.563+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e010d930 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.564+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e00662d0 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.564+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f74d0030020 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.564+0000 7f74dcff9640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 0x7f74c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.565+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f74d00ae7d0 con 0x7f74e00fd540 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.565+0000 7f74df7fe640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 0x7f74c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.565+0000 7f74df7fe640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 0x7f74c80709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4007fd0 tx=0x7f74d4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.569+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74d0077810 con 0x7f74e00fd540 2024-09-13T02:59:32.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.803+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f74e004b720 con 0x7f74e00fd540 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.804+0000 7f74dcff9640 1 -- 172.21.15.100:0/1735520715 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f74d007aed0 con 0x7f74e00fd540 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:59:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T02:59:32.806 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 msgr2=0x7f74c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 0x7f74c80709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4007fd0 tx=0x7f74d4009e90 comp rx=0 tx=0).stop 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 msgr2=0x7f74e0113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009ac0 tx=0x7f74d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 shutdown_connections 2024-09-13T02:59:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f74c806e530 0x7f74c80709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74e00fdee0 0x7f74e01137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 --2- 172.21.15.100:0/1735520715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74e00fd540 0x7f74e0113270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 >> 172.21.15.100:0/1735520715 conn(0x7f74e00f7000 msgr2=0x7f74e00f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 shutdown_connections 2024-09-13T02:59:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T02:59:32.806+0000 7f74e6624640 1 -- 172.21.15.100:0/1735520715 wait complete. 2024-09-13T02:59:33.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T02:59:33.664 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:33 smithi100 ceph-mon[92340]: pgmap v241: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:33 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1735520715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:33.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:33 smithi122 ceph-mon[79680]: pgmap v241: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:33.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:33 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1735520715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:35.217 INFO:teuthology.orchestra.run.smithi100.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T02:59:35.739 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:35 smithi122 ceph-mon[79680]: pgmap v242: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:35.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:35 smithi100 ceph-mon[92340]: pgmap v242: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:35.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'sleep 60' 2024-09-13T02:59:36.083 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T02:59:37.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:37 smithi100 ceph-mon[92340]: pgmap v243: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:37 smithi122 ceph-mon[79680]: pgmap v243: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:39.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:39 smithi100 ceph-mon[92340]: pgmap v244: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:39.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:39 smithi122 ceph-mon[79680]: pgmap v244: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:41.728 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:41 smithi100 ceph-mon[92340]: pgmap v245: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:41.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:41 smithi122 ceph-mon[79680]: pgmap v245: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:43.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:43 smithi100 ceph-mon[92340]: pgmap v246: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:43.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:43 smithi122 ceph-mon[79680]: pgmap v246: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:44.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:44.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:45.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:45 smithi100 ceph-mon[92340]: pgmap v247: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:45.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:45 smithi122 ceph-mon[79680]: pgmap v247: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:47.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:47 smithi100 ceph-mon[92340]: pgmap v248: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:47.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:47 smithi122 ceph-mon[79680]: pgmap v248: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:48.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:48 smithi100 ceph-mon[92340]: pgmap v249: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:48.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:48 smithi122 ceph-mon[79680]: pgmap v249: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:51.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:51 smithi100 ceph-mon[92340]: pgmap v250: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:51.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:51 smithi122 ceph-mon[79680]: pgmap v250: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:53.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:53 smithi100 ceph-mon[92340]: pgmap v251: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:53.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:53 smithi122 ceph-mon[79680]: pgmap v251: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:55 smithi100 ceph-mon[92340]: pgmap v252: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:55.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:55 smithi122 ceph-mon[79680]: pgmap v252: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:57 smithi100 ceph-mon[92340]: pgmap v253: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:57.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:57 smithi122 ceph-mon[79680]: pgmap v253: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:59 smithi100 ceph-mon[92340]: pgmap v254: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 02:59:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:59 smithi122 ceph-mon[79680]: pgmap v254: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T02:59:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:59.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 02:59:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:00.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:00.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:00.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:00:00.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:00 smithi100 ceph-mon[92340]: overall HEALTH_OK 2024-09-13T03:00:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:00:00.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:00 smithi122 ceph-mon[79680]: overall HEALTH_OK 2024-09-13T03:00:01.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:01 smithi100 ceph-mon[92340]: pgmap v255: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:01 smithi122 ceph-mon[79680]: pgmap v255: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:03.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:03 smithi100 ceph-mon[92340]: pgmap v256: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:03.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:03 smithi122 ceph-mon[79680]: pgmap v256: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:05 smithi100 ceph-mon[92340]: pgmap v257: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:05 smithi122 ceph-mon[79680]: pgmap v257: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:07 smithi100 ceph-mon[92340]: pgmap v258: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:07 smithi122 ceph-mon[79680]: pgmap v258: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:09 smithi100 ceph-mon[92340]: pgmap v259: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:09 smithi122 ceph-mon[79680]: pgmap v259: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:11.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:11 smithi100 ceph-mon[92340]: pgmap v260: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:11 smithi122 ceph-mon[79680]: pgmap v260: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:13.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:13 smithi100 ceph-mon[92340]: pgmap v261: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:13 smithi122 ceph-mon[79680]: pgmap v261: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:14.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:15.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:15 smithi100 ceph-mon[92340]: pgmap v262: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:15 smithi122 ceph-mon[79680]: pgmap v262: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:17 smithi100 ceph-mon[92340]: pgmap v263: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:17 smithi122 ceph-mon[79680]: pgmap v263: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:19 smithi122 ceph-mon[79680]: pgmap v264: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:19.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:19 smithi100 ceph-mon[92340]: pgmap v264: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:21 smithi122 ceph-mon[79680]: pgmap v265: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:21.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:21 smithi100 ceph-mon[92340]: pgmap v265: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:23.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:23 smithi100 ceph-mon[92340]: pgmap v266: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:23.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:23 smithi122 ceph-mon[79680]: pgmap v266: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:25 smithi100 ceph-mon[92340]: pgmap v267: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:25.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:25 smithi122 ceph-mon[79680]: pgmap v267: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:27.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:27 smithi100 ceph-mon[92340]: pgmap v268: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:27.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:27 smithi122 ceph-mon[79680]: pgmap v268: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:29.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:29 smithi100 ceph-mon[92340]: pgmap v269: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:29.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:29 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:29 smithi122 ceph-mon[79680]: pgmap v269: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:29.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:29 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:31.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:31 smithi100 ceph-mon[92340]: pgmap v270: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:31.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:31 smithi122 ceph-mon[79680]: pgmap v270: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:33.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:33 smithi100 ceph-mon[92340]: pgmap v271: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:33.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:33 smithi122 ceph-mon[79680]: pgmap v271: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:35.738 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:35 smithi122 ceph-mon[79680]: pgmap v272: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:35.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:35 smithi100 ceph-mon[92340]: pgmap v272: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:37.898 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:37 smithi100 ceph-mon[92340]: pgmap v273: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:37.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:37 smithi122 ceph-mon[79680]: pgmap v273: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:38.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T03:00:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:39.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:39 smithi100 ceph-mon[92340]: pgmap v274: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:39.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:39 smithi122 ceph-mon[79680]: pgmap v274: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- 172.21.15.100:0/272131773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 msgr2=0x7f1ec00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/272131773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec00fc5b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00048d0 tx=0x7f1eb0009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- 172.21.15.100:0/272131773 shutdown_connections 2024-09-13T03:00:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/272131773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec00fc5b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/272131773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 0x7f1ec0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- 172.21.15.100:0/272131773 >> 172.21.15.100:0/272131773 conn(0x7f1ec00f80f0 msgr2=0x7f1ec00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- 172.21.15.100:0/272131773 shutdown_connections 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- 172.21.15.100:0/272131773 wait complete. 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 Processor -- start 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.201+0000 7f1ec72b7640 1 -- start start 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec72b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 0x7f1ec0113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec72b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec72b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0114090 con 0x7f1ec0102ef0 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec72b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec010d4a0 con 0x7f1ec0102550 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35722/0 (socket says 172.21.15.100:35722) 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 -- 172.21.15.100:0/2709190901 learned_addr learned my addr 172.21.15.100:0/2709190901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec5053640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 0x7f1ec0113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 -- 172.21.15.100:0/2709190901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 msgr2=0x7f1ec0113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 0x7f1ec0113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 -- 172.21.15.100:0/2709190901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0005040 con 0x7f1ec0102ef0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec4852640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0003080 tx=0x7f1eb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb0038070 con 0x7f1ec0102ef0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1eb0009760 con 0x7f1ec0102ef0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec010d720 con 0x7f1ec0102ef0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.202+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb0033420 con 0x7f1ec0102ef0 2024-09-13T03:00:40.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.203+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec010dc00 con 0x7f1ec0102ef0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.204+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec00fdcd0 con 0x7f1ec0102ef0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.204+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1eb0030020 con 0x7f1ec0102ef0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.205+0000 7f1eb5ffb640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 0x7f1eac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.205+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f1eb00adf10 con 0x7f1ec0102ef0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.205+0000 7f1ec5053640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 0x7f1eac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.205+0000 7f1ec5053640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 0x7f1eac0709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc004c40 tx=0x7f1ebc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.209+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1eb0076f50 con 0x7f1ec0102ef0 2024-09-13T03:00:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.384+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 --> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec01095d0 con 0x7f1eac06e530 2024-09-13T03:00:40.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.394+0000 7f1eb5ffb640 1 -- 172.21.15.100:0/2709190901 <== mgr.34104 v2:172.21.15.100:6800/1224467238 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1ec01095d0 con 0x7f1eac06e530 2024-09-13T03:00:40.395 INFO:teuthology.orchestra.run.smithi100.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:00:40.395 INFO:teuthology.orchestra.run.smithi100.stdout:alertmanager.smithi100 smithi100 *:9093,9094 running (9m) 105s ago 17m 23.8M - 0.25.0 c8568f914cd2 6beb09ceaaf6 2024-09-13T03:00:40.395 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi100 smithi100 running (7m) 105s ago 18m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 1a03e1aa85bb 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:crash.smithi122 smithi122 running (7m) 2m ago 17m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 c98ec6364f06 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:grafana.smithi100 smithi100 *:3000 running (110s) 105s ago 17m 45.5M - 9.4.12 2bacad6d85d8 16c4888ff14d 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.ciqoxn smithi100 running (2m) 105s ago 12m 14.8M - 19.1.1-322-g7741f7f9 19dc8d659727 8f4ffac719a6 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi100.slkwfs smithi100 running (3m) 105s ago 12m 69.9M - 19.1.1-322-g7741f7f9 19dc8d659727 3a0baec05ca7 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.crukff smithi122 running (2m) 2m ago 12m 14.0M - 19.1.1-322-g7741f7f9 19dc8d659727 23a0a22ff15f 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mds.cephfs.smithi122.wmvyfe smithi122 running (2m) 2m ago 12m 12.8M - 19.1.1-322-g7741f7f9 19dc8d659727 3a61ca537875 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi100.lhjyck smithi100 *:8443,9283,8765 running (8m) 105s ago 19m 513M - 19.1.1-322-g7741f7f9 19dc8d659727 e9a97cfa579f 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mgr.smithi122.ptcenr smithi122 *:8443,9283,8765 running (8m) 2m ago 16m 442M - 19.1.1-322-g7741f7f9 19dc8d659727 55481524d594 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi100 smithi100 running (8m) 105s ago 19m 52.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 848f83d5f0d1 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:mon.smithi122 smithi122 running (7m) 2m ago 16m 39.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 a73db8aebd49 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi100 smithi100 *:9100 running (9m) 105s ago 17m 16.4M - 1.5.0 0da6a335fe13 769ed3ec6bfe 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:node-exporter.smithi122 smithi122 *:9100 running (8m) 2m ago 16m 17.6M - 1.5.0 0da6a335fe13 b294b45a7e70 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 smithi100 running (6m) 105s ago 16m 106M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 7109e9226248 2024-09-13T03:00:40.396 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 smithi100 running (6m) 105s ago 15m 106M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 dd5f29e1974b 2024-09-13T03:00:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 smithi100 running (5m) 105s ago 15m 92.9M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 249e28b309c0 2024-09-13T03:00:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 smithi122 running (4m) 2m ago 14m 125M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 6aec48388f68 2024-09-13T03:00:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 smithi122 running (4m) 2m ago 14m 115M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 52ac34c169ce 2024-09-13T03:00:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 smithi122 running (3m) 2m ago 13m 99.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 14187c578b5b 2024-09-13T03:00:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:prometheus.smithi100 smithi100 *:9095 running (8m) 105s ago 17m 62.4M - 2.43.0 a07b618ecd1d 352cb9959735 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 msgr2=0x7f1eac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 0x7f1eac0709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc004c40 tx=0x7f1ebc009040 comp rx=0 tx=0).stop 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 msgr2=0x7f1ec0113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0003080 tx=0x7f1eb0009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 shutdown_connections 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f1eac06e530 0x7f1eac0709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ec0102ef0 0x7f1ec0113a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 --2- 172.21.15.100:0/2709190901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ec0102550 0x7f1ec0113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 >> 172.21.15.100:0/2709190901 conn(0x7f1ec00f80f0 msgr2=0x7f1ec00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 shutdown_connections 2024-09-13T03:00:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:40.396+0000 7f1ec72b7640 1 -- 172.21.15.100:0/2709190901 wait complete. 2024-09-13T03:00:40.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T03:00:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:41.758 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:41 smithi100 ceph-mon[92340]: pgmap v275: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:41.758 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:41 smithi100 ceph-mon[92340]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:41.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:41 smithi122 ceph-mon[79680]: pgmap v275: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:41.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:41 smithi122 ceph-mon[79680]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:42.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 -- 172.21.15.100:0/1231280441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 msgr2=0x7f00441029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:42.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1231280441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f00441029f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f00340048d0 tx=0x7f0034009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:42.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 -- 172.21.15.100:0/1231280441 shutdown_connections 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1231280441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 0x7f00440fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1231280441 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f00441029f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 -- 172.21.15.100:0/1231280441 >> 172.21.15.100:0/1231280441 conn(0x7f0044070ce0 msgr2=0x7f00440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 -- 172.21.15.100:0/1231280441 shutdown_connections 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.875+0000 7f004bfa6640 1 -- 172.21.15.100:0/1231280441 wait complete. 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 Processor -- start 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 -- start start 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 0x7f00441131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044113dc0 con 0x7f0044102620 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f004bfa6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004410d170 con 0x7f00440fac80 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f0049541640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f0049541640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35742/0 (socket says 172.21.15.100:35742) 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.876+0000 7f0049541640 1 -- 172.21.15.100:0/1194475492 learned_addr learned my addr 172.21.15.100:0/1194475492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f0049d42640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 0x7f00441131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f0049541640 1 -- 172.21.15.100:0/1194475492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 msgr2=0x7f00441131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f0049541640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 0x7f00441131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f0049541640 1 -- 172.21.15.100:0/1194475492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034005040 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f0049541640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f004000b790 tx=0x7f00400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004000c700 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f004000cd00 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004410d450 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0040015e70 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.877+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004410d970 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.878+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440657b0 con 0x7f0044102620 2024-09-13T03:00:42.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.879+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0040012070 con 0x7f0044102620 2024-09-13T03:00:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.879+0000 7f003a7fc640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 0x7f00300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.879+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f004008de30 con 0x7f0044102620 2024-09-13T03:00:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.879+0000 7f0049d42640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 0x7f00300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.879+0000 7f0049d42640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 0x7f00300709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0034009ac0 tx=0x7f0034035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:42.883+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0040056e70 con 0x7f0044102620 2024-09-13T03:00:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.124+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0044109650 con 0x7f0044102620 2024-09-13T03:00:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.124+0000 7f003a7fc640 1 -- 172.21.15.100:0/1194475492 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f004005a530 con 0x7f0044102620 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": { 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": { 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": { 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T03:00:43.126 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: "overall": { 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-13T03:00:43.127 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 msgr2=0x7f00300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 0x7f00300709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0034009ac0 tx=0x7f0034035040 comp rx=0 tx=0).stop 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 msgr2=0x7f0044113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f004000b790 tx=0x7f00400091d0 comp rx=0 tx=0).stop 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 shutdown_connections 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f003006e530 0x7f00300709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0044102620 0x7f0044113730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 --2- 172.21.15.100:0/1194475492 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00440fac80 0x7f00441131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 >> 172.21.15.100:0/1194475492 conn(0x7f0044070ce0 msgr2=0x7f0044105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 shutdown_connections 2024-09-13T03:00:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:43.126+0000 7f004bfa6640 1 -- 172.21.15.100:0/1194475492 wait complete. 2024-09-13T03:00:43.761 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:43 smithi100 ceph-mon[92340]: pgmap v276: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:43.761 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:43 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1194475492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:43.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T03:00:43.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:43 smithi122 ceph-mon[79680]: pgmap v276: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:43.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:43 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1194475492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.031 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:44.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:44.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 -- 172.21.15.100:0/2724247429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 msgr2=0x7f247c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2724247429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c0fc5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24700048d0 tx=0x7f2470009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 -- 172.21.15.100:0/2724247429 shutdown_connections 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2724247429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c0fc5b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2724247429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 0x7f247c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 -- 172.21.15.100:0/2724247429 >> 172.21.15.100:0/2724247429 conn(0x7f247c0f80f0 msgr2=0x7f247c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 -- 172.21.15.100:0/2724247429 shutdown_connections 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.671+0000 7f2483dd4640 1 -- 172.21.15.100:0/2724247429 wait complete. 2024-09-13T03:00:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 Processor -- start 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 -- start start 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 0x7f247c113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1140b0 con 0x7f247c102ef0 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2483dd4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c10d4c0 con 0x7f247c102550 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35758/0 (socket says 172.21.15.100:35758) 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 -- 172.21.15.100:0/2246619979 learned_addr learned my addr 172.21.15.100:0/2246619979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f2481b70640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 0x7f247c113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 -- 172.21.15.100:0/2246619979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 msgr2=0x7f247c113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 0x7f247c113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.672+0000 7f248136f640 1 -- 172.21.15.100:0/2246619979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470005040 con 0x7f247c102ef0 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f248136f640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24700043d0 tx=0x7f2470009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:45.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2470038070 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f24700096e0 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247002c8a0 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c10d740 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.673+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c10dc80 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.674+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c0fdcd0 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.674+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2470030020 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.675+0000 7f247a7fc640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 0x7f24640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.675+0000 7f2481b70640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 0x7f24640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.675+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f24700ade90 con 0x7f247c102ef0 2024-09-13T03:00:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.675+0000 7f2481b70640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 0x7f24640709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2474004ed0 tx=0x7f247400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.680+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2470077000 con 0x7f247c102ef0 2024-09-13T03:00:45.911 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:45 smithi100 ceph-mon[92340]: pgmap v277: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:45.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.910+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f247c0fbd50 con 0x7f247c102ef0 2024-09-13T03:00:45.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.911+0000 7f247a7fc640 1 -- 172.21.15.100:0/2246619979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f247007a6c0 con 0x7f247c102ef0 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 msgr2=0x7f24640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 0x7f24640709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2474004ed0 tx=0x7f247400b040 comp rx=0 tx=0).stop 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 msgr2=0x7f247c113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24700043d0 tx=0x7f2470009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 shutdown_connections 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f246406e530 0x7f24640709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c102ef0 0x7f247c113a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 --2- 172.21.15.100:0/2246619979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f247c102550 0x7f247c113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:45.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 >> 172.21.15.100:0/2246619979 conn(0x7f247c0f80f0 msgr2=0x7f247c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:45.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 shutdown_connections 2024-09-13T03:00:45.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:45.913+0000 7f2483dd4640 1 -- 172.21.15.100:0/2246619979 wait complete. 2024-09-13T03:00:45.923 INFO:teuthology.orchestra.run.smithi100.stdout:true 2024-09-13T03:00:45.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:45 smithi122 ceph-mon[79680]: pgmap v277: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:46.559 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:46 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2246619979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T03:00:46.839 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:46.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:46 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2246619979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.629 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:47 smithi100 ceph-mon[92340]: pgmap v278: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:47.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:47 smithi122 ceph-mon[79680]: pgmap v278: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 -- 172.21.15.100:0/1738018223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 msgr2=0x7f86141029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1738018223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141029f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86040048d0 tx=0x7f8604009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 -- 172.21.15.100:0/1738018223 shutdown_connections 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1738018223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86140fac80 0x7f86140fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1738018223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141029f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 -- 172.21.15.100:0/1738018223 >> 172.21.15.100:0/1738018223 conn(0x7f8614070ce0 msgr2=0x7f86140710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 -- 172.21.15.100:0/1738018223 shutdown_connections 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 -- 172.21.15.100:0/1738018223 wait complete. 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.414+0000 7f861a0ec640 1 Processor -- start 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 -- start start 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86140fac80 0x7f86141131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614113ce0 con 0x7f8614102620 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861410d120 con 0x7f86140fac80 2024-09-13T03:00:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45932/0 (socket says 172.21.15.100:45932) 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 -- 172.21.15.100:0/1701407483 learned_addr learned my addr 172.21.15.100:0/1701407483 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 -- 172.21.15.100:0/1701407483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86140fac80 msgr2=0x7f86141131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86140fac80 0x7f86141131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 -- 172.21.15.100:0/1701407483 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604005040 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f8612ffd640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85fc002a50 tx=0x7f85fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85fc007c30 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861410d400 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85fc00f040 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85fc00db50 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.415+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861410d9a0 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.416+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86140657b0 con 0x7f8614102620 2024-09-13T03:00:48.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.417+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f85fc00dcb0 con 0x7f8614102620 2024-09-13T03:00:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.417+0000 7f860bfff640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 0x7f86000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.417+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f85fc08e210 con 0x7f8614102620 2024-09-13T03:00:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.417+0000 7f86137fe640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 0x7f86000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.418+0000 7f86137fe640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 0x7f86000709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f86040043d0 tx=0x7f8604009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.422+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85fc057250 con 0x7f8614102620 2024-09-13T03:00:48.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.657+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8614109570 con 0x7f8614102620 2024-09-13T03:00:48.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.657+0000 7f860bfff640 1 -- 172.21.15.100:0/1701407483 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f85fc05a910 con 0x7f8614102620 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 msgr2=0x7f86000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 0x7f86000709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f86040043d0 tx=0x7f8604009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 msgr2=0x7f86141136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85fc002a50 tx=0x7f85fc004600 comp rx=0 tx=0).stop 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 shutdown_connections 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f860006e530 0x7f86000709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8614102620 0x7f86141136e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 --2- 172.21.15.100:0/1701407483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86140fac80 0x7f86141131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 >> 172.21.15.100:0/1701407483 conn(0x7f8614070ce0 msgr2=0x7f8614105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.659+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 shutdown_connections 2024-09-13T03:00:48.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:48.660+0000 7f861a0ec640 1 -- 172.21.15.100:0/1701407483 wait complete. 2024-09-13T03:00:48.670 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)" 2024-09-13T03:00:49.290 DEBUG:teuthology.parallel:result is None 2024-09-13T03:00:49.290 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T03:00:49.306 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T03:00:49.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T03:00:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:49 smithi100 ceph-mon[92340]: pgmap v279: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:49.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:49 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1701407483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:49 smithi122 ceph-mon[79680]: pgmap v279: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:49 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1701407483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 -- 172.21.15.100:0/204029218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 msgr2=0x7fbc24102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 --2- 172.21.15.100:0/204029218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24102920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc140048d0 tx=0x7fbc14009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 -- 172.21.15.100:0/204029218 shutdown_connections 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 --2- 172.21.15.100:0/204029218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 0x7fbc240fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 --2- 172.21.15.100:0/204029218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24102920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 -- 172.21.15.100:0/204029218 >> 172.21.15.100:0/204029218 conn(0x7fbc240f80f0 msgr2=0x7fbc240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.194+0000 7fbc290c4640 1 -- 172.21.15.100:0/204029218 shutdown_connections 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 -- 172.21.15.100:0/204029218 wait complete. 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 Processor -- start 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 -- start start 2024-09-13T03:00:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 0x7fbc24113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc241140d0 con 0x7fbc24102550 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.195+0000 7fbc290c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2410d4e0 con 0x7fbc24102ef0 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45946/0 (socket says 172.21.15.100:45946) 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 -- 172.21.15.100:0/3205935460 learned_addr learned my addr 172.21.15.100:0/3205935460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc2259c640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 0x7fbc24113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 -- 172.21.15.100:0/3205935460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 msgr2=0x7fbc24113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 0x7fbc24113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 -- 172.21.15.100:0/3205935460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14005040 con 0x7fbc24102550 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc22d9d640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc140043d0 tx=0x7fbc14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc14038070 con 0x7fbc24102550 2024-09-13T03:00:51.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc140096e0 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2410d760 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc1403d420 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.196+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2410dd00 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.197+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc240fdcd0 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.198+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbc14030020 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.198+0000 7fbc0b7fe640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 0x7fbc0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.198+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbc140ae6e0 con 0x7fbc24102550 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.198+0000 7fbc2259c640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 0x7fbc0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.199+0000 7fbc2259c640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 0x7fbc0c0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc2410e7c0 tx=0x7fbc1800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:51.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.202+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbc14077720 con 0x7fbc24102550 2024-09-13T03:00:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.403+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc2404b720 con 0x7fbc24102550 2024-09-13T03:00:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.404+0000 7fbc0b7fe640 1 -- 172.21.15.100:0/3205935460 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 42 v42) v1 ==== 76+0+1995 (secure 0 0 0) 0x7fbc1407ade0 con 0x7fbc24102550 2024-09-13T03:00:51.405 INFO:teuthology.orchestra.run.smithi100.stdout:e42 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:btime 2024-09-13T02:58:38:014887+0000 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:legacy client fscid: 1 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:fs_name cephfs 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 42 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-13T02:48:11.655979+0000 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2024-09-13T02:58:38.014886+0000 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:tableserver 0 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:root 0 2024-09-13T03:00:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:session_timeout 60 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:session_autoclose 300 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:max_file_size 1099511627776 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:max_xattr_size 65536 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:required_client_features {} 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure 0 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:last_failure_osd_epoch 81 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:max_mds 2 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:in 0,1 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:up {0=34404,1=34436} 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:failed 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:damaged 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:stopped 2024-09-13T03:00:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:data_pools [3] 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:metadata_pool 2 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:inline_data disabled 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:balancer 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:bal_rank_mask -1 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:standby_count_wanted 1 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:qdb_cluster leader: 34404 members: 34404,34436 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.slkwfs{0:34404} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.100:6826/416870061,v1:172.21.15.100:6827/416870061] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi100.ciqoxn{1:34436} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.100:6828/3551062666,v1:172.21.15.100:6829/3551062666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:Standby daemons: 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:51.408 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.wmvyfe{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6824/1347589345,v1:172.21.15.122:6825/1347589345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:00:51.409 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.cephfs.smithi122.crukff{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.122:6826/2951042813,v1:172.21.15.122:6827/2951042813] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 42 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 msgr2=0x7fbc0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 0x7fbc0c0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc2410e7c0 tx=0x7fbc1800b040 comp rx=0 tx=0).stop 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 msgr2=0x7fbc24113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc140043d0 tx=0x7fbc14009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 shutdown_connections 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fbc0c06e530 0x7fbc0c0709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbc24102ef0 0x7fbc24113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 --2- 172.21.15.100:0/3205935460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc24102550 0x7fbc24113540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 >> 172.21.15.100:0/3205935460 conn(0x7fbc240f80f0 msgr2=0x7fbc240f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 shutdown_connections 2024-09-13T03:00:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:51.407+0000 7fbc290c4640 1 -- 172.21.15.100:0/3205935460 wait complete. 2024-09-13T03:00:51.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:51 smithi100 ceph-mon[92340]: pgmap v280: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:51.776 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:51 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3205935460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:51.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:51 smithi122 ceph-mon[79680]: pgmap v280: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:51.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:51 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3205935460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:52.031 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T03:00:52.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T03:00:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:53.632 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:53 smithi100 ceph-mon[92340]: pgmap v281: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 -- 172.21.15.100:0/2644630673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fdf20 msgr2=0x7fc394106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2644630673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fdf20 0x7fc394106560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc3880048d0 tx=0x7fc388009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 -- 172.21.15.100:0/2644630673 shutdown_connections 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2644630673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fdf20 0x7fc394106560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2644630673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fd580 0x7fc3940fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 -- 172.21.15.100:0/2644630673 >> 172.21.15.100:0/2644630673 conn(0x7fc3940f7010 msgr2=0x7fc3940f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 -- 172.21.15.100:0/2644630673 shutdown_connections 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.849+0000 7fc399c3e640 1 -- 172.21.15.100:0/2644630673 wait complete. 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 Processor -- start 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 -- start start 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fdf20 0x7fc394119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39411a4a0 con 0x7fc3940fd580 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc399c3e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394113820 con 0x7fc3940fdf20 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc3937fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc3937fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45974/0 (socket says 172.21.15.100:45974) 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc3937fe640 1 -- 172.21.15.100:0/2583378472 learned_addr learned my addr 172.21.15.100:0/2583378472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.850+0000 7fc392ffd640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fdf20 0x7fc394119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc3937fe640 1 -- 172.21.15.100:0/2583378472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fdf20 msgr2=0x7fc394119dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc3937fe640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fdf20 0x7fc394119dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc3937fe640 1 -- 172.21.15.100:0/2583378472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388005040 con 0x7fc3940fd580 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc3937fe640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc38400b790 tx=0x7fc3840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38400c700 con 0x7fc3940fd580 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc394113ab0 con 0x7fc3940fd580 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc38400cd00 con 0x7fc3940fd580 2024-09-13T03:00:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc384015e70 con 0x7fc3940fd580 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.851+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394113fa0 con 0x7fc3940fd580 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.852+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940663b0 con 0x7fc3940fd580 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.852+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc384012070 con 0x7fc3940fd580 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.853+0000 7fc37bfff640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 0x7fc37c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.853+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc38408ddb0 con 0x7fc3940fd580 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.853+0000 7fc392ffd640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 0x7fc37c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.853+0000 7fc392ffd640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 0x7fc37c0709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc394114c40 tx=0x7fc388035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:53.857+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc384056f40 con 0x7fc3940fd580 2024-09-13T03:00:53.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:53 smithi122 ceph-mon[79680]: pgmap v281: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.055+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39404b720 con 0x7fc3940fd580 2024-09-13T03:00:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.056+0000 7fc37bfff640 1 -- 172.21.15.100:0/2583378472 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5281 (secure 0 0 0) 0x7fc38405a600 con 0x7fc3940fd580 2024-09-13T03:00:54.058 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:54.058 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":42,"btime":"2024-09-13T02:58:38:014887+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44343,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6827/2951042813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2951042813},{"type":"v1","addr":"172.21.15.122:6827","nonce":2951042813}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:38.014886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34436":{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":1,"incarnation":41,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404,34436]},"id":1}]} 2024-09-13T03:00:54.058 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 42 2024-09-13T03:00:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 msgr2=0x7fc37c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 0x7fc37c0709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc394114c40 tx=0x7fc388035040 comp rx=0 tx=0).stop 2024-09-13T03:00:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 msgr2=0x7fc394119880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc38400b790 tx=0x7fc3840091d0 comp rx=0 tx=0).stop 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 shutdown_connections 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc37c06e530 0x7fc37c0709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3940fdf20 0x7fc394119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 --2- 172.21.15.100:0/2583378472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3940fd580 0x7fc394119880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 >> 172.21.15.100:0/2583378472 conn(0x7fc3940f7010 msgr2=0x7fc3940fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 shutdown_connections 2024-09-13T03:00:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:54.058+0000 7fc399c3e640 1 -- 172.21.15.100:0/2583378472 wait complete. 2024-09-13T03:00:54.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:54 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2583378472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:00:54.715 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2024-09-13T03:00:54.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-13T03:00:54.943 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:54 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2583378472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:00:54.965 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:55.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:55 smithi100 ceph-mon[92340]: pgmap v282: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:55.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:55 smithi122 ceph-mon[79680]: pgmap v282: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 -- 172.21.15.100:0/2915700596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 msgr2=0x7f4b141018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 --2- 172.21.15.100:0/2915700596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b141018e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4b040048d0 tx=0x7f4b04009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 -- 172.21.15.100:0/2915700596 shutdown_connections 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 --2- 172.21.15.100:0/2915700596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 0x7f4b140fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 --2- 172.21.15.100:0/2915700596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b141018e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 -- 172.21.15.100:0/2915700596 >> 172.21.15.100:0/2915700596 conn(0x7f4b140f7090 msgr2=0x7f4b140f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 -- 172.21.15.100:0/2915700596 shutdown_connections 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.473+0000 7f4b19723640 1 -- 172.21.15.100:0/2915700596 wait complete. 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 Processor -- start 2024-09-13T03:00:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 -- start start 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 0x7f4b140f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140f8090 con 0x7f4b14101510 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b19723640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140f8200 con 0x7f4b140fb4d0 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46004/0 (socket says 172.21.15.100:46004) 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 -- 172.21.15.100:0/424270932 learned_addr learned my addr 172.21.15.100:0/424270932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:56.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b12ffd640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 0x7f4b140f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 -- 172.21.15.100:0/424270932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 msgr2=0x7f4b140f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 0x7f4b140f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.474+0000 7f4b127fc640 1 -- 172.21.15.100:0/424270932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04005040 con 0x7f4b14101510 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4b127fc640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800b790 tx=0x7f4b080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b0800c700 con 0x7f4b14101510 2024-09-13T03:00:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b0800cd00 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b14119540 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b08015e70 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.475+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b14119a00 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.476+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b140fcc10 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.476+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4b08012070 con 0x7f4b14101510 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.477+0000 7f4afb7fe640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 0x7f4afc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.477+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f4b0808de30 con 0x7f4b14101510 2024-09-13T03:00:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.477+0000 7f4b12ffd640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 0x7f4afc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.477+0000 7f4b12ffd640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 0x7f4afc0709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009ac0 tx=0x7f4b04035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.481+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b08056e70 con 0x7f4b14101510 2024-09-13T03:00:56.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.682+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f4b1404b720 con 0x7f4b14101510 2024-09-13T03:00:56.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.682+0000 7f4afb7fe640 1 -- 172.21.15.100:0/424270932 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v42) v1 ==== 107+0+4927 (secure 0 0 0) 0x7f4b0805a530 con 0x7f4b14101510 2024-09-13T03:00:56.684 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:56.684 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:50:03.128315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:00:56.684 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 msgr2=0x7f4afc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 0x7f4afc0709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009ac0 tx=0x7f4b04035040 comp rx=0 tx=0).stop 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 msgr2=0x7f4b140f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800b790 tx=0x7f4b080091d0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 shutdown_connections 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4afc06e530 0x7f4afc0709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b14101510 0x7f4b140f7a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 --2- 172.21.15.100:0/424270932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b140fb4d0 0x7f4b140f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 >> 172.21.15.100:0/424270932 conn(0x7f4b140f7090 msgr2=0x7f4b140659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 shutdown_connections 2024-09-13T03:00:56.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:56.685+0000 7f4b19723640 1 -- 172.21.15.100:0/424270932 wait complete. 2024-09-13T03:00:57.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-13T03:00:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:00:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:57 smithi100 ceph-mon[92340]: pgmap v283: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:57 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/424270932' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T03:00:57.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:57 smithi122 ceph-mon[79680]: pgmap v283: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:57.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:57 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/424270932' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 -- 172.21.15.100:0/3591402666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 msgr2=0x7f12bc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 --2- 172.21.15.100:0/3591402666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc101890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0048d0 tx=0x7f12ac009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 -- 172.21.15.100:0/3591402666 shutdown_connections 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 --2- 172.21.15.100:0/3591402666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 0x7f12bc0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 --2- 172.21.15.100:0/3591402666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc101890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 -- 172.21.15.100:0/3591402666 >> 172.21.15.100:0/3591402666 conn(0x7f12bc0f7020 msgr2=0x7f12bc0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 -- 172.21.15.100:0/3591402666 shutdown_connections 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.190+0000 7f12c0d60640 1 -- 172.21.15.100:0/3591402666 wait complete. 2024-09-13T03:00:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 Processor -- start 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 -- start start 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 0x7f12bc10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc10ed60 con 0x7f12bc1014c0 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12c0d60640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc10eed0 con 0x7f12bc0fb480 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60572/0 (socket says 172.21.15.100:60572) 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 -- 172.21.15.100:0/2809371060 learned_addr learned my addr 172.21.15.100:0/2809371060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12ba59c640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 0x7f12bc10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 -- 172.21.15.100:0/2809371060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 msgr2=0x7f12bc10e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 0x7f12bc10e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 -- 172.21.15.100:0/2809371060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac005040 con 0x7f12bc1014c0 2024-09-13T03:00:59.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.191+0000 7f12b9d9b640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12a4002a50 tx=0x7f12a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.192+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a4007c30 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.192+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12a400f040 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.192+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc117240 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.192+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a400da10 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.192+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc117750 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.193+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc0fcbc0 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.193+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f12a400dbb0 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.193+0000 7f12b2ffd640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 0x7f12a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.194+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f12a408d8c0 con 0x7f12bc1014c0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.194+0000 7f12ba59c640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 0x7f12a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.194+0000 7f12ba59c640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 0x7f12a80709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009ac0 tx=0x7f12ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.198+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f12a4056a30 con 0x7f12bc1014c0 2024-09-13T03:00:59.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.400+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f12bc0fac40 con 0x7f12bc1014c0 2024-09-13T03:00:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.401+0000 7f12b2ffd640 1 -- 172.21.15.100:0/2809371060 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v42) v1 ==== 107+0+4928 (secure 0 0 0) 0x7f12a405a0f0 con 0x7f12bc1014c0 2024-09-13T03:00:59.404 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:00:59.404 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:50:38.732479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:00:59.404 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-09-13T03:00:59.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 msgr2=0x7f12a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 0x7f12a80709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009ac0 tx=0x7f12ac035040 comp rx=0 tx=0).stop 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 msgr2=0x7f12bc10e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12a4002a50 tx=0x7f12a4004600 comp rx=0 tx=0).stop 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 shutdown_connections 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f12a806e530 0x7f12a80709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12bc1014c0 0x7f12bc10e710 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 --2- 172.21.15.100:0/2809371060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12bc0fb480 0x7f12bc10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 >> 172.21.15.100:0/2809371060 conn(0x7f12bc0f7020 msgr2=0x7f12bc0f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:59.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 shutdown_connections 2024-09-13T03:00:59.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:00:59.403+0000 7f12c0d60640 1 -- 172.21.15.100:0/2809371060 wait complete. 2024-09-13T03:00:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:59 smithi100 ceph-mon[92340]: pgmap v284: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:59.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:59.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:00:59 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2809371060' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T03:00:59.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:59 smithi122 ceph-mon[79680]: pgmap v284: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:00:59.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:59.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:00:59 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2809371060' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T03:01:00.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T03:01:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:00.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:00.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:00.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:00.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:01:00.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:00.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:00.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:00.938 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:01:01.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:01 smithi122 ceph-mon[79680]: pgmap v285: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:01.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:01 smithi100 ceph-mon[92340]: pgmap v285: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:02.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 -- 172.21.15.100:0/3703161946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 msgr2=0x7f9f4c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 --2- 172.21.15.100:0/3703161946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c0fb910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0048d0 tx=0x7f9f3c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 -- 172.21.15.100:0/3703161946 shutdown_connections 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 --2- 172.21.15.100:0/3703161946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c0fb910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 --2- 172.21.15.100:0/3703161946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 -- 172.21.15.100:0/3703161946 >> 172.21.15.100:0/3703161946 conn(0x7f9f4c0f7060 msgr2=0x7f9f4c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 -- 172.21.15.100:0/3703161946 shutdown_connections 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.095+0000 7f9f532ad640 1 -- 172.21.15.100:0/3703161946 wait complete. 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 Processor -- start 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 -- start start 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c112670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c112d00 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f532ad640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c10c0b0 con 0x7f9f4c1014e0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f51049640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f51049640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60600/0 (socket says 172.21.15.100:60600) 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f51049640 1 -- 172.21.15.100:0/430242523 learned_addr learned my addr 172.21.15.100:0/430242523 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.096+0000 7f9f50848640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c112670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f51049640 1 -- 172.21.15.100:0/430242523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 msgr2=0x7f9f4c112670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f51049640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c112670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f51049640 1 -- 172.21.15.100:0/430242523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c005040 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f50848640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f51049640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800b790 tx=0x7f9f480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f4800c700 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f4800cd00 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c10c390 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f48015e70 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.097+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c10c880 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.098+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c0fcbe0 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.099+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9f48012070 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.099+0000 7f9f41ffb640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 0x7f9f380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.099+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9f4808de30 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.099+0000 7f9f50848640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 0x7f9f380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.100+0000 7f9f50848640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 0x7f9f380709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0f74a0 tx=0x7f9f3c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.103+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f48056e70 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.303+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f9f4c0fac60 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.303+0000 7f9f41ffb640 1 -- 172.21.15.100:0/430242523 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v42) v1 ==== 107+0+4942 (secure 0 0 0) 0x7f9f4805a530 con 0x7f9f4c0fb4a0 2024-09-13T03:01:02.306 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:02.306 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"btime":"2024-09-13T02:54:14:355758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:54:14.355755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470,24259]},"id":1}]} 2024-09-13T03:01:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-09-13T03:01:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 msgr2=0x7f9f380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 0x7f9f380709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0f74a0 tx=0x7f9f3c035040 comp rx=0 tx=0).stop 2024-09-13T03:01:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 msgr2=0x7f9f4c112130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800b790 tx=0x7f9f480091d0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 shutdown_connections 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9f3806e530 0x7f9f380709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f4c1014e0 0x7f9f4c112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 --2- 172.21.15.100:0/430242523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f4c0fb4a0 0x7f9f4c112130 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 >> 172.21.15.100:0/430242523 conn(0x7f9f4c0f7060 msgr2=0x7f9f4c0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 shutdown_connections 2024-09-13T03:01:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:02.306+0000 7f9f532ad640 1 -- 172.21.15.100:0/430242523 wait complete. 2024-09-13T03:01:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:02 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/430242523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T03:01:02.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:02 smithi100 ceph-mon[92340]: pgmap v286: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:02.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:02 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/430242523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T03:01:02.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:02 smithi122 ceph-mon[79680]: pgmap v286: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:02.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T03:01:03.222 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 -- 172.21.15.100:0/868474157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 msgr2=0x7f12480fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 --2- 172.21.15.100:0/868474157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f12480fbbe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12380048d0 tx=0x7f1238009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 -- 172.21.15.100:0/868474157 shutdown_connections 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 --2- 172.21.15.100:0/868474157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 0x7f12480fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 --2- 172.21.15.100:0/868474157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f12480fbbe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 -- 172.21.15.100:0/868474157 >> 172.21.15.100:0/868474157 conn(0x7f12480723b0 msgr2=0x7f12480727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 -- 172.21.15.100:0/868474157 shutdown_connections 2024-09-13T03:01:04.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 -- 172.21.15.100:0/868474157 wait complete. 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.819+0000 7f124e3e3640 1 Processor -- start 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f124e3e3640 1 -- start start 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f124e3e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f124e3e3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 0x7f124810e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f124e3e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124810ed70 con 0x7f12480fb810 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f124e3e3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124810eee0 con 0x7f12480fcf80 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60624/0 (socket says 172.21.15.100:60624) 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 -- 172.21.15.100:0/1946449818 learned_addr learned my addr 172.21.15.100:0/1946449818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f12477fe640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 0x7f124810e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 -- 172.21.15.100:0/1946449818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 msgr2=0x7f124810e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 0x7f124810e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:04.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 -- 172.21.15.100:0/1946449818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238005040 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.820+0000 7f1247fff640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1238003080 tx=0x7f1238009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.821+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1238038070 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.821+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248117210 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.821+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12380097e0 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.821+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123803d420 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.821+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248117680 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.822+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12480fcbc0 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.822+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1238030020 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.823+0000 7f1244ff9640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 0x7f12340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.823+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f12380ae7d0 con 0x7f12480fb810 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.823+0000 7f12477fe640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 0x7f12340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:04.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.823+0000 7f12477fe640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 0x7f12340709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1230006fd0 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:04.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:04.827+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1238077810 con 0x7f12480fb810 2024-09-13T03:01:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.029+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f1248072ec0 con 0x7f12480fb810 2024-09-13T03:01:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.030+0000 7f1244ff9640 1 -- 172.21.15.100:0/1946449818 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v42) v1 ==== 107+0+4941 (secure 0 0 0) 0x7f123807aed0 con 0x7f12480fb810 2024-09-13T03:01:05.031 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:05.032 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"btime":"2024-09-13T02:54:38:305822+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:54:37.621540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[24259,14470]},"id":1}]} 2024-09-13T03:01:05.032 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 20 2024-09-13T03:01:05.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 msgr2=0x7f12340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:05.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 0x7f12340709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1230006fd0 tx=0x7f1230008040 comp rx=0 tx=0).stop 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 msgr2=0x7f124810e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1238003080 tx=0x7f1238009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 shutdown_connections 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f123406e530 0x7f12340709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f12480fcf80 0x7f124810e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 --2- 172.21.15.100:0/1946449818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12480fb810 0x7f124810e1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 >> 172.21.15.100:0/1946449818 conn(0x7f12480723b0 msgr2=0x7f12480fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 shutdown_connections 2024-09-13T03:01:05.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:05.032+0000 7f124e3e3640 1 -- 172.21.15.100:0/1946449818 wait complete. 2024-09-13T03:01:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:05 smithi100 ceph-mon[92340]: pgmap v287: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:05.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:05 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1946449818' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:01:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:05 smithi122 ceph-mon[79680]: pgmap v287: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:05.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:05 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1946449818' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:01:05.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T03:01:05.972 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:07.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.575+0000 7f84e28bb640 1 -- 172.21.15.100:0/2299152917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc0fbd90 msgr2=0x7f84dc0fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.575+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2299152917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc0fbd90 0x7f84dc0fc200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84c40048d0 tx=0x7f84c4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- 172.21.15.100:0/2299152917 shutdown_connections 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2299152917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc0fbd90 0x7f84dc0fc200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2299152917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc100410 0x7f84dc1007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- 172.21.15.100:0/2299152917 >> 172.21.15.100:0/2299152917 conn(0x7f84dc070ce0 msgr2=0x7f84dc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- 172.21.15.100:0/2299152917 shutdown_connections 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- 172.21.15.100:0/2299152917 wait complete. 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 Processor -- start 2024-09-13T03:01:07.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- start start 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc0fbd90 0x7f84dc1120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc112c30 con 0x7f84dc100410 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84e28bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc10c070 con 0x7f84dc0fbd90 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60640/0 (socket says 172.21.15.100:60640) 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.576+0000 7f84d3fff640 1 -- 172.21.15.100:0/2248331587 learned_addr learned my addr 172.21.15.100:0/2248331587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84dbfff640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc0fbd90 0x7f84dc1120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d3fff640 1 -- 172.21.15.100:0/2248331587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc0fbd90 msgr2=0x7f84dc1120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d3fff640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc0fbd90 0x7f84dc1120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d3fff640 1 -- 172.21.15.100:0/2248331587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4005040 con 0x7f84dc100410 2024-09-13T03:01:07.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d3fff640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000c00 tx=0x7f84c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c403a070 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc10c2f0 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84c403f8c0 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c40337f0 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.577+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc10c810 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.578+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc0fcda0 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.578+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f84c4030020 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.579+0000 7f84d97fa640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 0x7f84c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.579+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f84c40b0a10 con 0x7f84dc100410 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.579+0000 7f84dbfff640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 0x7f84c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.579+0000 7f84dbfff640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 0x7f84c80709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009fd0 tx=0x7f84cc009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.583+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f84c4079a50 con 0x7f84dc100410 2024-09-13T03:01:07.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:07 smithi100 ceph-mon[92340]: pgmap v288: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:07.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:07 smithi122 ceph-mon[79680]: pgmap v288: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.783+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f84dc108500 con 0x7f84dc100410 2024-09-13T03:01:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.783+0000 7f84d97fa640 1 -- 172.21.15.100:0/2248331587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v42) v1 ==== 107+0+4941 (secure 0 0 0) 0x7f84c407d110 con 0x7f84dc100410 2024-09-13T03:01:07.785 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:07.785 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"btime":"2024-09-13T02:56:54:141642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:56:53.144402+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470,24259]},"id":1}]} 2024-09-13T03:01:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 msgr2=0x7f84c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 0x7f84c80709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009fd0 tx=0x7f84cc009e50 comp rx=0 tx=0).stop 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 msgr2=0x7f84dc112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f84c4000c00 tx=0x7f84c4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 shutdown_connections 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f84c806e530 0x7f84c80709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84dc100410 0x7f84dc112630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 --2- 172.21.15.100:0/2248331587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f84dc0fbd90 0x7f84dc1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.785+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 >> 172.21.15.100:0/2248331587 conn(0x7f84dc070ce0 msgr2=0x7f84dc0fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.786+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 shutdown_connections 2024-09-13T03:01:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:07.786+0000 7f84e28bb640 1 -- 172.21.15.100:0/2248331587 wait complete. 2024-09-13T03:01:08.436 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-09-13T03:01:08.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T03:01:08.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:08 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2248331587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:01:08.681 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:08.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:08 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2248331587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:01:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:09 smithi100 ceph-mon[92340]: pgmap v289: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:09.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:09 smithi122 ceph-mon[79680]: pgmap v289: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 -- 172.21.15.100:0/3453502274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 msgr2=0x7f53341088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 --2- 172.21.15.100:0/3453502274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f53341088f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f53280048d0 tx=0x7f5328009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 -- 172.21.15.100:0/3453502274 shutdown_connections 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 --2- 172.21.15.100:0/3453502274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f53341088f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 --2- 172.21.15.100:0/3453502274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 0x7f533406fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 -- 172.21.15.100:0/3453502274 >> 172.21.15.100:0/3453502274 conn(0x7f53340f80f0 msgr2=0x7f53340fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 -- 172.21.15.100:0/3453502274 shutdown_connections 2024-09-13T03:01:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.232+0000 7f53398c6640 1 -- 172.21.15.100:0/3453502274 wait complete. 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 Processor -- start 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 -- start start 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 0x7f5334115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53341162f0 con 0x7f5334070360 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.233+0000 7f53398c6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533410f700 con 0x7f533406fa50 2024-09-13T03:01:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38190/0 (socket says 172.21.15.100:38190) 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 -- 172.21.15.100:0/399976598 learned_addr learned my addr 172.21.15.100:0/399976598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f5332ffd640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 0x7f5334115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 -- 172.21.15.100:0/399976598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 msgr2=0x7f5334115760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 0x7f5334115760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 -- 172.21.15.100:0/399976598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328005040 con 0x7f5334070360 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53327fc640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5328000c00 tx=0x7f5328009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5328038070 con 0x7f5334070360 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f532802ade0 con 0x7f5334070360 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533410f980 con 0x7f5334070360 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532802c7b0 con 0x7f5334070360 2024-09-13T03:01:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.234+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533410fe40 con 0x7f5334070360 2024-09-13T03:01:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.235+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334071190 con 0x7f5334070360 2024-09-13T03:01:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.236+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5328030020 con 0x7f5334070360 2024-09-13T03:01:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.236+0000 7f531b7fe640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 0x7f531c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.236+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f53280ae670 con 0x7f5334070360 2024-09-13T03:01:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.236+0000 7f5332ffd640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 0x7f531c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.237+0000 7f5332ffd640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 0x7f531c0709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5324009af0 tx=0x7f532400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.241+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53280776b0 con 0x7f5334070360 2024-09-13T03:01:10.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.446+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f5334110e40 con 0x7f5334070360 2024-09-13T03:01:10.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.446+0000 7f531b7fe640 1 -- 172.21.15.100:0/399976598 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v42) v1 ==== 107+0+4937 (secure 0 0 0) 0x7f5334110e40 con 0x7f5334070360 2024-09-13T03:01:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:10.448 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"btime":"2024-09-13T02:56:54:145094+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:56:54.145092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14470,"mds_1":24259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24259":{"gid":24259,"name":"cephfs.smithi122.wmvyfe","rank":1,"incarnation":6,"state":"up:stopping","state_seq":4,"addr":"172.21.15.122:6825/3893731861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":3893731861},{"type":"v1","addr":"172.21.15.122:6825","nonce":3893731861}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-13T03:01:10.448 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 22 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 msgr2=0x7f531c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 0x7f531c0709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5324009af0 tx=0x7f532400b040 comp rx=0 tx=0).stop 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 msgr2=0x7f5334115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5328000c00 tx=0x7f5328009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 shutdown_connections 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f531c06e530 0x7f531c0709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5334070360 0x7f5334115ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 --2- 172.21.15.100:0/399976598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f533406fa50 0x7f5334115760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 >> 172.21.15.100:0/399976598 conn(0x7f53340f80f0 msgr2=0x7f53340f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 shutdown_connections 2024-09-13T03:01:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:10.449+0000 7f53398c6640 1 -- 172.21.15.100:0/399976598 wait complete. 2024-09-13T03:01:11.052 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-09-13T03:01:11.052 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T03:01:11.312 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:11.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:11 smithi100 ceph-mon[92340]: pgmap v290: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:11.672 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:11 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/399976598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:01:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:11 smithi122 ceph-mon[79680]: pgmap v290: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:11 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/399976598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 -- 172.21.15.100:0/2735164626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc0fbd90 msgr2=0x7f7ffc0fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 --2- 172.21.15.100:0/2735164626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc0fc200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0048d0 tx=0x7f7fec009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 -- 172.21.15.100:0/2735164626 shutdown_connections 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 --2- 172.21.15.100:0/2735164626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc0fc200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 --2- 172.21.15.100:0/2735164626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc100410 0x7f7ffc1007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 -- 172.21.15.100:0/2735164626 >> 172.21.15.100:0/2735164626 conn(0x7f7ffc070ce0 msgr2=0x7f7ffc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 -- 172.21.15.100:0/2735164626 shutdown_connections 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.937+0000 7f8002f7b640 1 -- 172.21.15.100:0/2735164626 wait complete. 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 Processor -- start 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 -- start start 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc112c70 con 0x7f7ffc100410 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.938+0000 7f8002f7b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc10c0b0 con 0x7f7ffc0fbd90 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38204/0 (socket says 172.21.15.100:38204) 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 -- 172.21.15.100:0/1947151447 learned_addr learned my addr 172.21.15.100:0/1947151447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f8000d17640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 -- 172.21.15.100:0/1947151447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc0fbd90 msgr2=0x7f7ffc112130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc112130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 -- 172.21.15.100:0/1947151447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec005040 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff3fff640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec038070 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc10c330 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fec02ade0 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec02c7e0 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.939+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc10c7f0 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.940+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0fcda0 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.941+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7fec030020 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.941+0000 7f7ff17fa640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 0x7f7fe40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.941+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7fec0adea0 con 0x7f7ffc100410 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.941+0000 7f8000d17640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 0x7f7fe40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.942+0000 7f8000d17640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 0x7f7fe40709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8004ed0 tx=0x7f7ff800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:12.946+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7fec076f90 con 0x7f7ffc100410 2024-09-13T03:01:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.152+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f7ffc108520 con 0x7f7ffc100410 2024-09-13T03:01:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.152+0000 7f7ff17fa640 1 -- 172.21.15.100:0/1947151447 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v42) v1 ==== 107+0+4139 (secure 0 0 0) 0x7f7fec07a650 con 0x7f7ffc100410 2024-09-13T03:01:13.154 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:13.155 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"btime":"2024-09-13T02:57:19:361288+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:18.367737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 msgr2=0x7f7fe40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 0x7f7fe40709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8004ed0 tx=0x7f7ff800b040 comp rx=0 tx=0).stop 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 msgr2=0x7f7ffc112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 shutdown_connections 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f7fe406e530 0x7f7fe40709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ffc100410 0x7f7ffc112670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 --2- 172.21.15.100:0/1947151447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ffc0fbd90 0x7f7ffc112130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 >> 172.21.15.100:0/1947151447 conn(0x7f7ffc070ce0 msgr2=0x7f7ffc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.154+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 shutdown_connections 2024-09-13T03:01:13.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:13.155+0000 7f8002f7b640 1 -- 172.21.15.100:0/1947151447 wait complete. 2024-09-13T03:01:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:13 smithi100 ceph-mon[92340]: pgmap v291: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:13.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:13 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1947151447' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:01:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:13 smithi122 ceph-mon[79680]: pgmap v291: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:13.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:13 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1947151447' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:01:13.811 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-13T03:01:13.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T03:01:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:14.543 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:14 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:14.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:14 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:15.562 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:15 smithi100 ceph-mon[92340]: pgmap v292: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:15.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:15 smithi122 ceph-mon[79680]: pgmap v292: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:15.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- 172.21.15.100:0/2130870160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 msgr2=0x7fc7c0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:15.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 --2- 172.21.15.100:0/2130870160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0065430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00048d0 tx=0x7fc7b0009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- 172.21.15.100:0/2130870160 shutdown_connections 2024-09-13T03:01:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 --2- 172.21.15.100:0/2130870160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0065430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 --2- 172.21.15.100:0/2130870160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 0x7fc7c00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- 172.21.15.100:0/2130870160 >> 172.21.15.100:0/2130870160 conn(0x7fc7c00723b0 msgr2=0x7fc7c00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- 172.21.15.100:0/2130870160 shutdown_connections 2024-09-13T03:01:15.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- 172.21.15.100:0/2130870160 wait complete. 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 Processor -- start 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- start start 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 0x7fc7c0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0113e00 con 0x7fc7c0064fc0 2024-09-13T03:01:15.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.771+0000 7fc7c8693640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c010d1b0 con 0x7fc7c00fe460 2024-09-13T03:01:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38222/0 (socket says 172.21.15.100:38222) 2024-09-13T03:01:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 -- 172.21.15.100:0/529416530 learned_addr learned my addr 172.21.15.100:0/529416530 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c5c2e640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 0x7fc7c0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:15.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 -- 172.21.15.100:0/529416530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 msgr2=0x7fc7c0113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 0x7fc7c0113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 -- 172.21.15.100:0/529416530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0005040 con 0x7fc7c0064fc0 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c642f640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b790 tx=0x7fc7bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7bc00c700 con 0x7fc7c0064fc0 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7bc00cd00 con 0x7fc7c0064fc0 2024-09-13T03:01:15.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c010d490 con 0x7fc7c0064fc0 2024-09-13T03:01:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7bc015e80 con 0x7fc7c0064fc0 2024-09-13T03:01:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.772+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c010d980 con 0x7fc7c0064fc0 2024-09-13T03:01:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.773+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c00fdcf0 con 0x7fc7c0064fc0 2024-09-13T03:01:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.774+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc7bc012070 con 0x7fc7c0064fc0 2024-09-13T03:01:15.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.774+0000 7fc7b6ffd640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 0x7fc7ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.774+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc7bc08db10 con 0x7fc7c0064fc0 2024-09-13T03:01:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.774+0000 7fc7c5c2e640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 0x7fc7ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.775+0000 7fc7c5c2e640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 0x7fc7ac0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ac0 tx=0x7fc7b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:15.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.779+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc7bc056b50 con 0x7fc7c0064fc0 2024-09-13T03:01:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.977+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fc7c004b7a0 con 0x7fc7c0064fc0 2024-09-13T03:01:15.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.978+0000 7fc7b6ffd640 1 -- 172.21.15.100:0/529416530 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v42) v1 ==== 107+0+4918 (secure 0 0 0) 0x7fc7c004b7a0 con 0x7fc7c0064fc0 2024-09-13T03:01:15.980 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:15.980 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":24,"btime":"2024-09-13T02:57:20:368555+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14482,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/3310990359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3310990359},{"type":"v1","addr":"172.21.15.100:6827","nonce":3310990359}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:18.367737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-13T03:01:15.980 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 24 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 msgr2=0x7fc7ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 0x7fc7ac0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ac0 tx=0x7fc7b0035040 comp rx=0 tx=0).stop 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 msgr2=0x7fc7c0113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00b790 tx=0x7fc7bc0091d0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 shutdown_connections 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fc7ac06e530 0x7fc7ac0709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7c00fe460 0x7fc7c0113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 --2- 172.21.15.100:0/529416530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7c0064fc0 0x7fc7c0113230 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 >> 172.21.15.100:0/529416530 conn(0x7fc7c00723b0 msgr2=0x7fc7c0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 shutdown_connections 2024-09-13T03:01:15.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:15.980+0000 7fc7c8693640 1 -- 172.21.15.100:0/529416530 wait complete. 2024-09-13T03:01:16.642 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-13T03:01:16.642 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T03:01:16.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:16 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/529416530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:01:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:16.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:16 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/529416530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:01:17.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:17 smithi100 ceph-mon[92340]: pgmap v293: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:17.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:17 smithi122 ceph-mon[79680]: pgmap v293: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- 172.21.15.100:0/3374377392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 msgr2=0x7f47a01029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 --2- 172.21.15.100:0/3374377392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a01029f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f479c0048d0 tx=0x7f479c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- 172.21.15.100:0/3374377392 shutdown_connections 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 --2- 172.21.15.100:0/3374377392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 0x7f47a00fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 --2- 172.21.15.100:0/3374377392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a01029f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- 172.21.15.100:0/3374377392 >> 172.21.15.100:0/3374377392 conn(0x7f47a0070ce0 msgr2=0x7f47a00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:18.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- 172.21.15.100:0/3374377392 shutdown_connections 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- 172.21.15.100:0/3374377392 wait complete. 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 Processor -- start 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.446+0000 7f47a76b7640 1 -- start start 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a76b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 0x7f47a01131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a76b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a76b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0113d30 con 0x7f47a0102620 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a76b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a010d170 con 0x7f47a00fac80 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59802/0 (socket says 172.21.15.100:59802) 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 -- 172.21.15.100:0/2578180149 learned_addr learned my addr 172.21.15.100:0/2578180149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a5453640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 0x7f47a01131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 -- 172.21.15.100:0/2578180149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 msgr2=0x7f47a01131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:18.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 0x7f47a01131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 -- 172.21.15.100:0/2578180149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c005040 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a4c52640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4790002a50 tx=0x7f4790004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4790007c30 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f479000f040 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a010d450 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.447+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479000da10 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.448+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a010d9f0 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.448+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a00657b0 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.449+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f479000dc80 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.449+0000 7f4795ffb640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 0x7f478c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.449+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f479008d9e0 con 0x7f47a0102620 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.449+0000 7f47a5453640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 0x7f478c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:18.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.450+0000 7f47a5453640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 0x7f478c0709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f479c009ac0 tx=0x7f479c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:18.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.454+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4790056ad0 con 0x7f47a0102620 2024-09-13T03:01:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.654+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f47a0109590 con 0x7f47a0102620 2024-09-13T03:01:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.655+0000 7f4795ffb640 1 -- 172.21.15.100:0/2578180149 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v42) v1 ==== 107+0+4136 (secure 0 0 0) 0x7f479005a190 con 0x7f47a0102620 2024-09-13T03:01:18.656 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:18.656 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"btime":"2024-09-13T02:57:29:390372+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:18.367737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-13T03:01:18.657 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 msgr2=0x7f478c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 0x7f478c0709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f479c009ac0 tx=0x7f479c035040 comp rx=0 tx=0).stop 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 msgr2=0x7f47a0113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4790002a50 tx=0x7f4790004600 comp rx=0 tx=0).stop 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 shutdown_connections 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f478c06e530 0x7f478c0709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a0102620 0x7f47a0113730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 --2- 172.21.15.100:0/2578180149 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47a00fac80 0x7f47a01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 >> 172.21.15.100:0/2578180149 conn(0x7f47a0070ce0 msgr2=0x7f47a0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 shutdown_connections 2024-09-13T03:01:18.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:18.657+0000 7f47a76b7640 1 -- 172.21.15.100:0/2578180149 wait complete. 2024-09-13T03:01:19.246 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-13T03:01:19.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T03:01:19.492 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:19.613 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:19 smithi100 ceph-mon[92340]: pgmap v294: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:19.613 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:19 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2578180149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:01:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:19 smithi122 ceph-mon[79680]: pgmap v294: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:19.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:19 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2578180149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/1532692957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 msgr2=0x7f2fcc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/1532692957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc102920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40048d0 tx=0x7f2fc4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/1532692957 shutdown_connections 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/1532692957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 0x7f2fcc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/1532692957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc102920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/1532692957 >> 172.21.15.100:0/1532692957 conn(0x7f2fcc0f80f0 msgr2=0x7f2fcc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/1532692957 shutdown_connections 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.076+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/1532692957 wait complete. 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 Processor -- start 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 -- start start 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 0x7f2fcc113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc114100 con 0x7f2fcc102550 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd2ed4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc10d510 con 0x7f2fcc102ef0 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd0c70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd0c70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59812/0 (socket says 172.21.15.100:59812) 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.077+0000 7f2fd0c70640 1 -- 172.21.15.100:0/2521803583 learned_addr learned my addr 172.21.15.100:0/2521803583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fcbfff640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 0x7f2fcc113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd0c70640 1 -- 172.21.15.100:0/2521803583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 msgr2=0x7f2fcc113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd0c70640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 0x7f2fcc113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd0c70640 1 -- 172.21.15.100:0/2521803583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4005040 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd0c70640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc4038070 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc10d790 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2fc402ade0 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc402c7e0 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.078+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc10dcd0 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.079+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc0fdcd0 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.080+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2fc4030020 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.080+0000 7f2fc97fa640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 0x7f2fb80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.080+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f2fc40adea0 con 0x7f2fcc102550 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.080+0000 7f2fcbfff640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 0x7f2fb80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.080+0000 7f2fcbfff640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 0x7f2fb80709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc10e7f0 tx=0x7f2fbc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.084+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2fc4076f90 con 0x7f2fcc102550 2024-09-13T03:01:21.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.290+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f2fcc04b750 con 0x7f2fcc102550 2024-09-13T03:01:21.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.290+0000 7f2fc97fa640 1 -- 172.21.15.100:0/2521803583 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v42) v1 ==== 107+0+4983 (secure 0 0 0) 0x7f2fc407a650 con 0x7f2fcc102550 2024-09-13T03:01:21.292 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:21.292 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"btime":"2024-09-13T02:57:33:410902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:18.367737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi100.ciqoxn","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.100:6829/2158470851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2158470851},{"type":"v1","addr":"172.21.15.100:6829","nonce":2158470851}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-09-13T03:01:21.292 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 26 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 msgr2=0x7f2fb80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 0x7f2fb80709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc10e7f0 tx=0x7f2fbc009040 comp rx=0 tx=0).stop 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 msgr2=0x7f2fcc113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 shutdown_connections 2024-09-13T03:01:21.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fb806e530 0x7f2fb80709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fcc102ef0 0x7f2fcc113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 --2- 172.21.15.100:0/2521803583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc102550 0x7f2fcc113570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:21.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 >> 172.21.15.100:0/2521803583 conn(0x7f2fcc0f80f0 msgr2=0x7f2fcc0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:21.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 shutdown_connections 2024-09-13T03:01:21.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:21.293+0000 7f2fd2ed4640 1 -- 172.21.15.100:0/2521803583 wait complete. 2024-09-13T03:01:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:21 smithi100 ceph-mon[92340]: pgmap v295: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:21.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:21 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2521803583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:01:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:21 smithi122 ceph-mon[79680]: pgmap v295: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:21.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:21 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2521803583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:01:21.994 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-13T03:01:21.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T03:01:22.238 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:23.641 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:23 smithi100 ceph-mon[92340]: pgmap v296: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.865+0000 7f5dd70a1640 1 -- 172.21.15.100:0/159658528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 msgr2=0x7f5dd00fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.865+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/159658528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd00fc5c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009c50 tx=0x7f5dc4004d10 comp rx=0 tx=0).stop 2024-09-13T03:01:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 -- 172.21.15.100:0/159658528 shutdown_connections 2024-09-13T03:01:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/159658528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd00fc5c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:23.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/159658528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 0x7f5dd0102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 -- 172.21.15.100:0/159658528 >> 172.21.15.100:0/159658528 conn(0x7f5dd00f8100 msgr2=0x7f5dd00fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 -- 172.21.15.100:0/159658528 shutdown_connections 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 -- 172.21.15.100:0/159658528 wait complete. 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 Processor -- start 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 -- start start 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.866+0000 7f5dd70a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 0x7f5dd0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd70a1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd70a1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd0113d40 con 0x7f5dd0102f00 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd70a1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd010d180 con 0x7f5dd0102560 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59830/0 (socket says 172.21.15.100:59830) 2024-09-13T03:01:23.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 -- 172.21.15.100:0/4154460697 learned_addr learned my addr 172.21.15.100:0/4154460697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd4e3d640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 0x7f5dd0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 -- 172.21.15.100:0/4154460697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 msgr2=0x7f5dd0113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 0x7f5dd0113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 -- 172.21.15.100:0/4154460697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40098b0 con 0x7f5dd0102f00 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcffff640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4003400 tx=0x7f5dc4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4007a70 con 0x7f5dd0102f00 2024-09-13T03:01:23.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5dc4009570 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd010d400 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc403d810 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.867+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd010d9a0 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.868+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd00fdce0 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.869+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5dc402f030 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.869+0000 7f5dcd7fa640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 0x7f5db80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.869+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5dc40af0f0 con 0x7f5dd0102f00 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.869+0000 7f5dd4e3d640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 0x7f5db80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.870+0000 7f5dd4e3d640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 0x7f5db80709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00041d0 tx=0x7f5dc0004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:23.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:23.874+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5dc4078130 con 0x7f5dd0102f00 2024-09-13T03:01:23.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:23 smithi122 ceph-mon[79680]: pgmap v296: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:24.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.078+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f5dd0109590 con 0x7f5dd0102f00 2024-09-13T03:01:24.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.079+0000 7f5dcd7fa640 1 -- 172.21.15.100:0/4154460697 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v42) v1 ==== 107+0+4181 (secure 0 0 0) 0x7f5dc407b7f0 con 0x7f5dd0102f00 2024-09-13T03:01:24.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:24.080 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":27,"btime":"2024-09-13T02:57:45:301355+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24271,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:45.301352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:24.080 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 27 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 msgr2=0x7f5db80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 0x7f5db80709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00041d0 tx=0x7f5dc0004330 comp rx=0 tx=0).stop 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 msgr2=0x7f5dd0113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4003400 tx=0x7f5dc4004d10 comp rx=0 tx=0).stop 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 shutdown_connections 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f5db806e530 0x7f5db80709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dd0102f00 0x7f5dd0113740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:24.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 --2- 172.21.15.100:0/4154460697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5dd0102560 0x7f5dd0113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:24.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 >> 172.21.15.100:0/4154460697 conn(0x7f5dd00f8100 msgr2=0x7f5dd00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:24.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 shutdown_connections 2024-09-13T03:01:24.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:24.081+0000 7f5dd70a1640 1 -- 172.21.15.100:0/4154460697 wait complete. 2024-09-13T03:01:24.768 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:24 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/4154460697' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:01:24.796 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-13T03:01:24.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T03:01:24.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:24 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/4154460697' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:01:25.041 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:25.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:25 smithi100 ceph-mon[92340]: pgmap v297: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:25.940 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:25 smithi122 ceph-mon[79680]: pgmap v297: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 -- 172.21.15.100:0/2109829230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 msgr2=0x7f9e1c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 --2- 172.21.15.100:0/2109829230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c1018b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e180048d0 tx=0x7f9e18009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 -- 172.21.15.100:0/2109829230 shutdown_connections 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 --2- 172.21.15.100:0/2109829230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 --2- 172.21.15.100:0/2109829230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c1018b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 -- 172.21.15.100:0/2109829230 >> 172.21.15.100:0/2109829230 conn(0x7f9e1c0f7060 msgr2=0x7f9e1c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 -- 172.21.15.100:0/2109829230 shutdown_connections 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 -- 172.21.15.100:0/2109829230 wait complete. 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.705+0000 7f9e23e51640 1 Processor -- start 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e23e51640 1 -- start start 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e23e51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c10e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e23e51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e23e51640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c10eca0 con 0x7f9e1c1014e0 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e23e51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c10ee10 con 0x7f9e1c0fb4a0 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59850/0 (socket says 172.21.15.100:59850) 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 -- 172.21.15.100:0/3911451651 learned_addr learned my addr 172.21.15.100:0/3911451651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e21bed640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c10e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 -- 172.21.15.100:0/3911451651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 msgr2=0x7f9e1c10e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c10e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 -- 172.21.15.100:0/3911451651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18005040 con 0x7f9e1c1014e0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e21bed640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.706+0000 7f9e213ec640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00c790 tx=0x7f9e0c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.707+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c00a820 con 0x7f9e1c1014e0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.707+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e0c00ae20 con 0x7f9e1c1014e0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.707+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c1171d0 con 0x7f9e1c1014e0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.707+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c0113a0 con 0x7f9e1c1014e0 2024-09-13T03:01:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.707+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c117710 con 0x7f9e1c1014e0 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.708+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c0fcbe0 con 0x7f9e1c1014e0 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.708+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9e0c012400 con 0x7f9e1c1014e0 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.709+0000 7f9e127fc640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 0x7f9e080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.709+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9e0c08e300 con 0x7f9e1c1014e0 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.709+0000 7f9e21bed640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 0x7f9e080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:26.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.709+0000 7f9e21bed640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 0x7f9e080709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e18007ac0 tx=0x7f9e18035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:26.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.713+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9e0c057460 con 0x7f9e1c1014e0 2024-09-13T03:01:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.914+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9e1c04b720 con 0x7f9e1c1014e0 2024-09-13T03:01:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.914+0000 7f9e127fc640 1 -- 172.21.15.100:0/3911451651 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v42) v1 ==== 107+0+4192 (secure 0 0 0) 0x7f9e0c05ab20 con 0x7f9e1c1014e0 2024-09-13T03:01:26.917 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:26.917 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"btime":"2024-09-13T02:57:45:306158+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:45.306149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:replay","state_seq":2,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-09-13T03:01:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 msgr2=0x7f9e080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 0x7f9e080709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e18007ac0 tx=0x7f9e18035040 comp rx=0 tx=0).stop 2024-09-13T03:01:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 msgr2=0x7f9e1c10e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00c790 tx=0x7f9e0c0043c0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 shutdown_connections 2024-09-13T03:01:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f9e0806e530 0x7f9e080709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e1c1014e0 0x7f9e1c10e6a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 --2- 172.21.15.100:0/3911451651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e1c0fb4a0 0x7f9e1c10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 >> 172.21.15.100:0/3911451651 conn(0x7f9e1c0f7060 msgr2=0x7f9e1c0f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:26.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 shutdown_connections 2024-09-13T03:01:26.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:26.917+0000 7f9e23e51640 1 -- 172.21.15.100:0/3911451651 wait complete. 2024-09-13T03:01:27.516 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:27 smithi100 ceph-mon[92340]: pgmap v298: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:27.516 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:27 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3911451651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:01:27.542 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-13T03:01:27.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T03:01:27.788 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:27.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:27 smithi122 ceph-mon[79680]: pgmap v298: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:27.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:27 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3911451651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:01:29.316 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:29 smithi100 ceph-mon[92340]: pgmap v299: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:29.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:29 smithi122 ceph-mon[79680]: pgmap v299: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- 172.21.15.100:0/4105880552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 msgr2=0x7f38dc101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 --2- 172.21.15.100:0/4105880552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc101860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0048d0 tx=0x7f38cc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- 172.21.15.100:0/4105880552 shutdown_connections 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 --2- 172.21.15.100:0/4105880552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 0x7f38dc0fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 --2- 172.21.15.100:0/4105880552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc101860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- 172.21.15.100:0/4105880552 >> 172.21.15.100:0/4105880552 conn(0x7f38dc071450 msgr2=0x7f38dc071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- 172.21.15.100:0/4105880552 shutdown_connections 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- 172.21.15.100:0/4105880552 wait complete. 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 Processor -- start 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.537+0000 7f38e15c4640 1 -- start start 2024-09-13T03:01:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 0x7f38dc113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc113c70 con 0x7f38dc101490 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc10d0b0 con 0x7f38dc0fb470 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58170/0 (socket says 172.21.15.100:58170) 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 -- 172.21.15.100:0/2360178219 learned_addr learned my addr 172.21.15.100:0/2360178219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38daffd640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 0x7f38dc113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 -- 172.21.15.100:0/2360178219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 msgr2=0x7f38dc113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 0x7f38dc113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 -- 172.21.15.100:0/2360178219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc005040 con 0x7f38dc101490 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d27fc640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f38c4002a80 tx=0x7f38c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c4007c30 con 0x7f38dc101490 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc10d390 con 0x7f38dc101490 2024-09-13T03:01:29.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38c400f040 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38c400dab0 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.538+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc10d8b0 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.539+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0fcb50 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.540+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f38c400dc10 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.540+0000 7f38d3fff640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 0x7f38c80709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.541+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f38c408daa0 con 0x7f38dc101490 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.541+0000 7f38daffd640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 0x7f38c80709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.541+0000 7f38daffd640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 0x7f38c80709f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009ac0 tx=0x7f38cc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:29.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.545+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38c4056b90 con 0x7f38dc101490 2024-09-13T03:01:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.745+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f38dc108430 con 0x7f38dc101490 2024-09-13T03:01:29.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.746+0000 7f38d3fff640 1 -- 172.21.15.100:0/2360178219 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v42) v1 ==== 107+0+4197 (secure 0 0 0) 0x7f38c405a250 con 0x7f38dc101490 2024-09-13T03:01:29.748 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:29.748 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"btime":"2024-09-13T02:57:51:371749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:50.914767+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":143,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:29.748 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 29 2024-09-13T03:01:29.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 msgr2=0x7f38c80709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:29.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 0x7f38c80709f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009ac0 tx=0x7f38cc035040 comp rx=0 tx=0).stop 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 msgr2=0x7f38dc113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f38c4002a80 tx=0x7f38c4004600 comp rx=0 tx=0).stop 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 shutdown_connections 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f38c806e540 0x7f38c80709f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38dc101490 0x7f38dc113670 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 --2- 172.21.15.100:0/2360178219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38dc0fb470 0x7f38dc113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 >> 172.21.15.100:0/2360178219 conn(0x7f38dc071450 msgr2=0x7f38dc064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 shutdown_connections 2024-09-13T03:01:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:29.748+0000 7f38e15c4640 1 -- 172.21.15.100:0/2360178219 wait complete. 2024-09-13T03:01:30.356 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:30 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:30.356 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:30 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2360178219' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:01:30.380 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-13T03:01:30.380 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T03:01:30.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:30 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:30.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:30 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2360178219' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:01:30.628 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:31.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:31 smithi100 ceph-mon[92340]: pgmap v300: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:31.436 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:31 smithi122 ceph-mon[79680]: pgmap v300: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.198+0000 7f186d3e2640 1 -- 172.21.15.100:0/896534247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102f00 msgr2=0x7f18680fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.198+0000 7f186d3e2640 1 --2- 172.21.15.100:0/896534247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102f00 0x7f18680fc5c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f18500048d0 tx=0x7f1850009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- 172.21.15.100:0/896534247 shutdown_connections 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 --2- 172.21.15.100:0/896534247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102f00 0x7f18680fc5c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 --2- 172.21.15.100:0/896534247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102560 0x7f1868102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- 172.21.15.100:0/896534247 >> 172.21.15.100:0/896534247 conn(0x7f18680f8100 msgr2=0x7f18680fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- 172.21.15.100:0/896534247 shutdown_connections 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- 172.21.15.100:0/896534247 wait complete. 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 Processor -- start 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- start start 2024-09-13T03:01:32.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102f00 0x7f18681137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868113e50 con 0x7f1868102560 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.199+0000 7f186d3e2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186810d200 con 0x7f1868102f00 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58182/0 (socket says 172.21.15.100:58182) 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 -- 172.21.15.100:0/4262415720 learned_addr learned my addr 172.21.15.100:0/4262415720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f18667fc640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102f00 0x7f18681137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 -- 172.21.15.100:0/4262415720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102f00 msgr2=0x7f18681137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102f00 0x7f18681137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 -- 172.21.15.100:0/4262415720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850005040 con 0x7f1868102560 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f1866ffd640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f185800bbb0 tx=0x7f1858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185800c940 con 0x7f1868102560 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f18580092e0 con 0x7f1868102560 2024-09-13T03:01:32.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186810d4e0 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1858007640 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.200+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186810d9d0 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.201+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680fdce0 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.202+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1858012070 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.202+0000 7f185f7fe640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 0x7f18540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.202+0000 7f18667fc640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 0x7f18540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.202+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f185808e3c0 con 0x7f1868102560 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.203+0000 7f18667fc640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 0x7f18540709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c00 tx=0x7f1850035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:32.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.207+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1858057400 con 0x7f1868102560 2024-09-13T03:01:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.411+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f186804b750 con 0x7f1868102560 2024-09-13T03:01:32.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.412+0000 7f185f7fe640 1 -- 172.21.15.100:0/4262415720 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v42) v1 ==== 107+0+4194 (secure 0 0 0) 0x7f185805aac0 con 0x7f1868102560 2024-09-13T03:01:32.413 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:32.414 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"btime":"2024-09-13T02:57:52:376685+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:51.377893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":144,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:32.414 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-09-13T03:01:32.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 msgr2=0x7f18540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 0x7f18540709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c00 tx=0x7f1850035040 comp rx=0 tx=0).stop 2024-09-13T03:01:32.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 msgr2=0x7f1868113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:32.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f185800bbb0 tx=0x7f1858009840 comp rx=0 tx=0).stop 2024-09-13T03:01:32.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 shutdown_connections 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f185406e530 0x7f18540709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1868102f00 0x7f18681137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 --2- 172.21.15.100:0/4262415720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1868102560 0x7f1868113280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 >> 172.21.15.100:0/4262415720 conn(0x7f18680f8100 msgr2=0x7f18680f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 shutdown_connections 2024-09-13T03:01:32.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:32.414+0000 7f186d3e2640 1 -- 172.21.15.100:0/4262415720 wait complete. 2024-09-13T03:01:33.069 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-13T03:01:33.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T03:01:33.314 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:33.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:33 smithi100 ceph-mon[92340]: pgmap v301: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:33.677 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:33 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/4262415720' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:01:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:33 smithi122 ceph-mon[79680]: pgmap v301: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:33.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:33 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/4262415720' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- 172.21.15.100:0/1960485319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776806fa70 msgr2=0x7f776806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 --2- 172.21.15.100:0/1960485319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776806fa70 0x7f776806fe40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7760009c80 tx=0x7f7760004d10 comp rx=0 tx=0).stop 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- 172.21.15.100:0/1960485319 shutdown_connections 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 --2- 172.21.15.100:0/1960485319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7768070380 0x7f77681088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 --2- 172.21.15.100:0/1960485319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776806fa70 0x7f776806fe40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- 172.21.15.100:0/1960485319 >> 172.21.15.100:0/1960485319 conn(0x7f77680f8110 msgr2=0x7f77680fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- 172.21.15.100:0/1960485319 shutdown_connections 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- 172.21.15.100:0/1960485319 wait complete. 2024-09-13T03:01:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 Processor -- start 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.890+0000 7f776ca18640 1 -- start start 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776806fa70 0x7f7768115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7768116010 con 0x7f7768070380 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776810f420 con 0x7f776806fa70 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58188/0 (socket says 172.21.15.100:58188) 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 -- 172.21.15.100:0/3313895814 learned_addr learned my addr 172.21.15.100:0/3313895814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776659c640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776806fa70 0x7f7768115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 -- 172.21.15.100:0/3313895814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776806fa70 msgr2=0x7f7768115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776806fa70 0x7f7768115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 -- 172.21.15.100:0/3313895814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600098b0 con 0x7f7768070380 2024-09-13T03:01:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f7765d9b640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7750002a50 tx=0x7f7750004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7750007c30 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776810f700 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f775000f040 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775000da90 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.891+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776810fc20 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.893+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77680711b0 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.893+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f775000dd00 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.893+0000 7f775effd640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 0x7f77540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.893+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f775008db20 con 0x7f7768070380 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.894+0000 7f776659c640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 0x7f77540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.894+0000 7f776659c640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 0x7f77540709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7760004a30 tx=0x7f7760004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:34.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:34.898+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7750056b60 con 0x7f7768070380 2024-09-13T03:01:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.099+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f77680fbd30 con 0x7f7768070380 2024-09-13T03:01:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.100+0000 7f775effd640 1 -- 172.21.15.100:0/3313895814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v42) v1 ==== 107+0+4203 (secure 0 0 0) 0x7f775005a220 con 0x7f7768070380 2024-09-13T03:01:35.102 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:35.102 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"btime":"2024-09-13T02:57:53:381744+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:53.381740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:active","state_seq":145,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-13T03:01:35.102 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 31 2024-09-13T03:01:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 msgr2=0x7f77540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 0x7f77540709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7760004a30 tx=0x7f7760004d10 comp rx=0 tx=0).stop 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 msgr2=0x7f77681159c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7750002a50 tx=0x7f7750004600 comp rx=0 tx=0).stop 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 shutdown_connections 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f775406e530 0x7f77540709e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7768070380 0x7f77681159c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 --2- 172.21.15.100:0/3313895814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f776806fa70 0x7f7768115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 >> 172.21.15.100:0/3313895814 conn(0x7f77680f8110 msgr2=0x7f77680f9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 shutdown_connections 2024-09-13T03:01:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:35.102+0000 7f776ca18640 1 -- 172.21.15.100:0/3313895814 wait complete. 2024-09-13T03:01:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:35 smithi100 ceph-mon[92340]: pgmap v302: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:35.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:35 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3313895814' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:01:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:35 smithi122 ceph-mon[79680]: pgmap v302: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:35.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:35 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3313895814' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:01:35.808 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-13T03:01:35.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T03:01:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:37.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:37 smithi100 ceph-mon[92340]: pgmap v303: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:37.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/396502393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 msgr2=0x7fcf480fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/396502393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf480fd3d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf300048d0 tx=0x7fcf30009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/396502393 shutdown_connections 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/396502393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf480fd3d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/396502393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 0x7fcf480fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/396502393 >> 172.21.15.100:0/396502393 conn(0x7fcf480723b0 msgr2=0x7fcf480727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/396502393 shutdown_connections 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/396502393 wait complete. 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 Processor -- start 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- start start 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 0x7fcf4810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:37.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4810ec90 con 0x7fcf480fcf80 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.671+0000 7fcf4e5ad640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4810ee00 con 0x7fcf480fb810 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58198/0 (socket says 172.21.15.100:58198) 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 -- 172.21.15.100:0/2175738074 learned_addr learned my addr 172.21.15.100:0/2175738074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf47fff640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 0x7fcf4810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 -- 172.21.15.100:0/2175738074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 msgr2=0x7fcf4810e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 0x7fcf4810e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 -- 172.21.15.100:0/2175738074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30005040 con 0x7fcf480fcf80 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf3ffff640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf30000c00 tx=0x7fcf30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf30038070 con 0x7fcf480fcf80 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf3002ade0 con 0x7fcf480fcf80 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf481171c0 con 0x7fcf480fcf80 2024-09-13T03:01:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3002c7e0 con 0x7fcf480fcf80 2024-09-13T03:01:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.672+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf48117620 con 0x7fcf480fcf80 2024-09-13T03:01:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.673+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf480fcbc0 con 0x7fcf480fcf80 2024-09-13T03:01:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.674+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fcf30030020 con 0x7fcf480fcf80 2024-09-13T03:01:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.674+0000 7fcf457fa640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 0x7fcf340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.674+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fcf300ade00 con 0x7fcf480fcf80 2024-09-13T03:01:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.675+0000 7fcf47fff640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 0x7fcf340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.675+0000 7fcf47fff640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 0x7fcf340709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf38004eb0 tx=0x7fcf3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.679+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf30076f70 con 0x7fcf480fcf80 2024-09-13T03:01:37.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:37 smithi122 ceph-mon[79680]: pgmap v303: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:37.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.878+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fcf48072ec0 con 0x7fcf480fcf80 2024-09-13T03:01:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.879+0000 7fcf457fa640 1 -- 172.21.15.100:0/2175738074 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v42) v1 ==== 107+0+5053 (secure 0 0 0) 0x7fcf3007a630 con 0x7fcf480fcf80 2024-09-13T03:01:37.882 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:37.882 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"btime":"2024-09-13T02:57:57:394986+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44283,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/209732889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":209732889},{"type":"v1","addr":"172.21.15.122:6825","nonce":209732889}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:53.381740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:active","state_seq":145,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-13T03:01:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 32 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 msgr2=0x7fcf340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 0x7fcf340709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf38004eb0 tx=0x7fcf3800b040 comp rx=0 tx=0).stop 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 msgr2=0x7fcf4810e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf30000c00 tx=0x7fcf30009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 shutdown_connections 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7fcf3406e530 0x7fcf340709e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf480fcf80 0x7fcf4810e690 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 --2- 172.21.15.100:0/2175738074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf480fb810 0x7fcf4810e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.881+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 >> 172.21.15.100:0/2175738074 conn(0x7fcf480723b0 msgr2=0x7fcf480fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.882+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 shutdown_connections 2024-09-13T03:01:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:37.882+0000 7fcf4e5ad640 1 -- 172.21.15.100:0/2175738074 wait complete. 2024-09-13T03:01:38.524 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:38 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2175738074' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:01:38.549 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-13T03:01:38.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T03:01:38.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:38 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2175738074' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:01:38.795 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:39.630 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:39 smithi100 ceph-mon[92340]: pgmap v304: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:39.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:39 smithi122 ceph-mon[79680]: pgmap v304: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 -- 172.21.15.100:0/786661977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102560 msgr2=0x7f580c102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 --2- 172.21.15.100:0/786661977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102560 0x7f580c102930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f58080048d0 tx=0x7f5808009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 -- 172.21.15.100:0/786661977 shutdown_connections 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 --2- 172.21.15.100:0/786661977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102f00 0x7f580c0fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 --2- 172.21.15.100:0/786661977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102560 0x7f580c102930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 -- 172.21.15.100:0/786661977 >> 172.21.15.100:0/786661977 conn(0x7f580c0f8120 msgr2=0x7f580c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 -- 172.21.15.100:0/786661977 shutdown_connections 2024-09-13T03:01:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 -- 172.21.15.100:0/786661977 wait complete. 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.485+0000 7f58136cc640 1 Processor -- start 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f58136cc640 1 -- start start 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f58136cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102560 0x7f580c115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f58136cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f58136cc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c115f50 con 0x7f580c102f00 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f58136cc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c1160c0 con 0x7f580c102560 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39410/0 (socket says 172.21.15.100:39410) 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 -- 172.21.15.100:0/548868873 learned_addr learned my addr 172.21.15.100:0/548868873 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5811468640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102560 0x7f580c115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 -- 172.21.15.100:0/548868873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102560 msgr2=0x7f580c115410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102560 0x7f580c115410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 -- 172.21.15.100:0/548868873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808005040 con 0x7f580c102f00 2024-09-13T03:01:40.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5810c67640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c760 tx=0x7f57fc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.486+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57fc00a7a0 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.487+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f57fc00ada0 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.487+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c10f540 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.487+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57fc0113a0 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.487+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c10fae0 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.488+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0fdce0 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.488+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f57fc012400 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.489+0000 7f5801ffb640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 0x7f57f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.489+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f57fc08e350 con 0x7f580c102f00 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.489+0000 7f5811468640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 0x7f57f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.489+0000 7f5811468640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 0x7f57f80709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5808009ac0 tx=0x7f5808035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:40.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.493+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f57fc057410 con 0x7f580c102f00 2024-09-13T03:01:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.694+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f580c0fbd60 con 0x7f580c102f00 2024-09-13T03:01:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.694+0000 7f5801ffb640 1 -- 172.21.15.100:0/548868873 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v42) v1 ==== 107+0+4274 (secure 0 0 0) 0x7f57fc05aad0 con 0x7f580c102f00 2024-09-13T03:01:40.697 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:40.697 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":33,"btime":"2024-09-13T02:58:08:369354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:53.381740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:active","state_seq":145,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-13T03:01:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 33 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 msgr2=0x7f57f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 0x7f57f80709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5808009ac0 tx=0x7f5808035040 comp rx=0 tx=0).stop 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 msgr2=0x7f580c115950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c760 tx=0x7f57fc00cb60 comp rx=0 tx=0).stop 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 shutdown_connections 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f57f806e530 0x7f57f80709e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f580c102f00 0x7f580c115950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 --2- 172.21.15.100:0/548868873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f580c102560 0x7f580c115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.696+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 >> 172.21.15.100:0/548868873 conn(0x7f580c0f8120 msgr2=0x7f580c0f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.697+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 shutdown_connections 2024-09-13T03:01:40.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:40.697+0000 7f58136cc640 1 -- 172.21.15.100:0/548868873 wait complete. 2024-09-13T03:01:41.338 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-13T03:01:41.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T03:01:41.597 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:41.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:41 smithi100 ceph-mon[92340]: pgmap v305: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:41.608 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:41 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/548868873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:01:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:41 smithi122 ceph-mon[79680]: pgmap v305: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:41.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:41 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/548868873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:01:43.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 -- 172.21.15.100:0/3027097096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 msgr2=0x7f91080fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 --2- 172.21.15.100:0/3027097096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f91080fc5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f90f80048d0 tx=0x7f90f8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 -- 172.21.15.100:0/3027097096 shutdown_connections 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 --2- 172.21.15.100:0/3027097096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f91080fc5b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 --2- 172.21.15.100:0/3027097096 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 0x7f9108102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 -- 172.21.15.100:0/3027097096 >> 172.21.15.100:0/3027097096 conn(0x7f91080f80f0 msgr2=0x7f91080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 -- 172.21.15.100:0/3027097096 shutdown_connections 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.200+0000 7f910fd9d640 1 -- 172.21.15.100:0/3027097096 wait complete. 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 Processor -- start 2024-09-13T03:01:43.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 -- start start 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 0x7f9108113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108114090 con 0x7f9108102ef0 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910fd9d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910810d4a0 con 0x7f9108102550 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910d338640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910d338640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39442/0 (socket says 172.21.15.100:39442) 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910d338640 1 -- 172.21.15.100:0/2110281092 learned_addr learned my addr 172.21.15.100:0/2110281092 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.201+0000 7f910db39640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 0x7f9108113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910d338640 1 -- 172.21.15.100:0/2110281092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 msgr2=0x7f9108113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910d338640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 0x7f9108113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910d338640 1 -- 172.21.15.100:0/2110281092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8005040 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910d338640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90f80043d0 tx=0x7f90f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f8038070 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910810d720 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90f80096e0 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f802c8a0 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.202+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910810dc60 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.203+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91080fdcd0 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.203+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f90f8030020 con 0x7f9108102ef0 2024-09-13T03:01:43.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.204+0000 7f90fe7fc640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 0x7f90f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.204+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f90f80adeb0 con 0x7f9108102ef0 2024-09-13T03:01:43.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.204+0000 7f910db39640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 0x7f90f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.204+0000 7f910db39640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 0x7f90f40709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9104004eb0 tx=0x7f910400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.208+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90f8076fa0 con 0x7f9108102ef0 2024-09-13T03:01:43.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.407+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f9108109560 con 0x7f9108102ef0 2024-09-13T03:01:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.408+0000 7f90fe7fc640 1 -- 172.21.15.100:0/2110281092 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v42) v1 ==== 107+0+5124 (secure 0 0 0) 0x7f90f807a660 con 0x7f9108102ef0 2024-09-13T03:01:43.409 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:43.409 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"btime":"2024-09-13T02:58:13:378451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:57:53.381740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24271},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24271":{"gid":24271,"name":"cephfs.smithi122.crukff","rank":0,"incarnation":28,"state":"up:active","state_seq":145,"addr":"172.21.15.122:6827/3862727751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":3862727751},{"type":"v1","addr":"172.21.15.122:6827","nonce":3862727751}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24271,"qdb_cluster":[24271]},"id":1}]} 2024-09-13T03:01:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 34 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 msgr2=0x7f90f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 0x7f90f40709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9104004eb0 tx=0x7f910400b040 comp rx=0 tx=0).stop 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 msgr2=0x7f9108113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90f80043d0 tx=0x7f90f8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 shutdown_connections 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f90f406e530 0x7f90f40709e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9108102ef0 0x7f9108113a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 --2- 172.21.15.100:0/2110281092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9108102550 0x7f9108113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 >> 172.21.15.100:0/2110281092 conn(0x7f91080f80f0 msgr2=0x7f91080f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 shutdown_connections 2024-09-13T03:01:43.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:43.410+0000 7f910fd9d640 1 -- 172.21.15.100:0/2110281092 wait complete. 2024-09-13T03:01:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:43 smithi100 ceph-mon[92340]: pgmap v306: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:43.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:43 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2110281092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:01:43.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:43 smithi122 ceph-mon[79680]: pgmap v306: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:43.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:43 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2110281092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:01:43.979 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-13T03:01:43.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T03:01:44.229 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:44.605 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:44 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:44.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:44 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:45.568 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:45 smithi100 ceph-mon[92340]: pgmap v307: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:45.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:45 smithi122 ceph-mon[79680]: pgmap v307: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:46.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- 172.21.15.100:0/2930009813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102530 msgr2=0x7f32ec102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 --2- 172.21.15.100:0/2930009813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102530 0x7f32ec102900 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0048d0 tx=0x7f32dc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- 172.21.15.100:0/2930009813 shutdown_connections 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 --2- 172.21.15.100:0/2930009813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102ed0 0x7f32ec0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 --2- 172.21.15.100:0/2930009813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102530 0x7f32ec102900 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- 172.21.15.100:0/2930009813 >> 172.21.15.100:0/2930009813 conn(0x7f32ec0f80f0 msgr2=0x7f32ec0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- 172.21.15.100:0/2930009813 shutdown_connections 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- 172.21.15.100:0/2930009813 wait complete. 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 Processor -- start 2024-09-13T03:01:46.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.989+0000 7f32f1547640 1 -- start start 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102530 0x7f32ec113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec113d80 con 0x7f32ec102ed0 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec10d1c0 con 0x7f32ec102530 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39464/0 (socket says 172.21.15.100:39464) 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 -- 172.21.15.100:0/591123685 learned_addr learned my addr 172.21.15.100:0/591123685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32eaffd640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102530 0x7f32ec113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 -- 172.21.15.100:0/591123685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102530 msgr2=0x7f32ec113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102530 0x7f32ec113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 -- 172.21.15.100:0/591123685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc005040 con 0x7f32ec102ed0 2024-09-13T03:01:46.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e27fc640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f32d4002840 tx=0x7f32d4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d4007c30 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec10d4a0 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f32d400f040 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32d400d990 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.990+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec10da40 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.991+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec0fdcb0 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.992+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f32d4009600 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.992+0000 7f32e3fff640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 0x7f32d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.992+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f32d408d9a0 con 0x7f32ec102ed0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.993+0000 7f32eaffd640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 0x7f32d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.993+0000 7f32eaffd640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 0x7f32d80709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009ac0 tx=0x7f32dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:46.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:45.997+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f32d4056a90 con 0x7f32ec102ed0 2024-09-13T03:01:46.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.200+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f32ec1095a0 con 0x7f32ec102ed0 2024-09-13T03:01:46.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.201+0000 7f32e3fff640 1 -- 172.21.15.100:0/591123685 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v42) v1 ==== 107+0+4320 (secure 0 0 0) 0x7f32d405a150 con 0x7f32ec102ed0 2024-09-13T03:01:46.202 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:46.202 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"btime":"2024-09-13T02:58:22:734054+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:22.734051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:46.203 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 35 2024-09-13T03:01:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 msgr2=0x7f32d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 0x7f32d80709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009ac0 tx=0x7f32dc035040 comp rx=0 tx=0).stop 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 msgr2=0x7f32ec113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f32d4002840 tx=0x7f32d4004570 comp rx=0 tx=0).stop 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 shutdown_connections 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f32d806e530 0x7f32d80709e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32ec102ed0 0x7f32ec113780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 --2- 172.21.15.100:0/591123685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32ec102530 0x7f32ec113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 >> 172.21.15.100:0/591123685 conn(0x7f32ec0f80f0 msgr2=0x7f32ec0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 shutdown_connections 2024-09-13T03:01:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:46.203+0000 7f32f1547640 1 -- 172.21.15.100:0/591123685 wait complete. 2024-09-13T03:01:46.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:46 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/591123685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:01:46.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:46 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/591123685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:01:46.868 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-13T03:01:46.869 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T03:01:47.114 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:47.571 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:47 smithi100 ceph-mon[92340]: pgmap v308: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:47.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:47 smithi122 ceph-mon[79680]: pgmap v308: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.703+0000 7f471c539640 1 -- 172.21.15.100:0/1469328816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4714102620 msgr2=0x7f47141029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 --2- 172.21.15.100:0/1469328816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4714102620 0x7f47141029f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47100048d0 tx=0x7f4710009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 -- 172.21.15.100:0/1469328816 shutdown_connections 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 --2- 172.21.15.100:0/1469328816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47140fac80 0x7f47140fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 --2- 172.21.15.100:0/1469328816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4714102620 0x7f47141029f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 -- 172.21.15.100:0/1469328816 >> 172.21.15.100:0/1469328816 conn(0x7f4714070ce0 msgr2=0x7f47140710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 -- 172.21.15.100:0/1469328816 shutdown_connections 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 -- 172.21.15.100:0/1469328816 wait complete. 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 Processor -- start 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.704+0000 7f471c539640 1 -- start start 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4714102620 0x7f4714113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714113d10 con 0x7f47140fac80 2024-09-13T03:01:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471410d150 con 0x7f4714102620 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47396/0 (socket says 172.21.15.100:47396) 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 -- 172.21.15.100:0/341245770 learned_addr learned my addr 172.21.15.100:0/341245770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 -- 172.21.15.100:0/341245770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4714102620 msgr2=0x7f4714113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f4719ad4640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4714102620 0x7f4714113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4714102620 0x7f4714113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 -- 172.21.15.100:0/341245770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710005040 con 0x7f47140fac80 2024-09-13T03:01:48.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471a2d5640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f4710009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:48.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4710038070 con 0x7f47140fac80 2024-09-13T03:01:48.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f471002ade0 con 0x7f47140fac80 2024-09-13T03:01:48.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471002c7e0 con 0x7f47140fac80 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471410d3d0 con 0x7f47140fac80 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.705+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471410d890 con 0x7f47140fac80 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.706+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47140657b0 con 0x7f47140fac80 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.707+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4710030020 con 0x7f47140fac80 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.707+0000 7f470affd640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 0x7f47000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:48.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.707+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f47100ade00 con 0x7f47140fac80 2024-09-13T03:01:48.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.707+0000 7f4719ad4640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 0x7f47000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:48.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.708+0000 7f4719ad4640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 0x7f47000709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4704009af0 tx=0x7f470400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:48.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.712+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4710076f70 con 0x7f47140fac80 2024-09-13T03:01:48.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.911+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f471404b750 con 0x7f47140fac80 2024-09-13T03:01:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.912+0000 7f470affd640 1 -- 172.21.15.100:0/341245770 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v42) v1 ==== 107+0+4399 (secure 0 0 0) 0x7f471007a630 con 0x7f47140fac80 2024-09-13T03:01:48.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:48.914 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":36,"btime":"2024-09-13T02:58:22:743533+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:22.743520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 36 2024-09-13T03:01:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 msgr2=0x7f47000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 0x7f47000709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4704009af0 tx=0x7f470400b040 comp rx=0 tx=0).stop 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 msgr2=0x7f47141131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f4710009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 shutdown_connections 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f470006e530 0x7f47000709e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4714102620 0x7f4714113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 --2- 172.21.15.100:0/341245770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47140fac80 0x7f47141131d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 >> 172.21.15.100:0/341245770 conn(0x7f4714070ce0 msgr2=0x7f4714105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 shutdown_connections 2024-09-13T03:01:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:48.914+0000 7f471c539640 1 -- 172.21.15.100:0/341245770 wait complete. 2024-09-13T03:01:49.548 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:49 smithi100 ceph-mon[92340]: pgmap v309: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:49.548 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:49 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/341245770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:01:49.575 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-13T03:01:49.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T03:01:49.821 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:49 smithi122 ceph-mon[79680]: pgmap v309: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:49.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:49 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/341245770' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:01:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 -- 172.21.15.100:0/124375611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 msgr2=0x7f25c0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 --2- 172.21.15.100:0/124375611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0102900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0048d0 tx=0x7f25bc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 -- 172.21.15.100:0/124375611 shutdown_connections 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 --2- 172.21.15.100:0/124375611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 --2- 172.21.15.100:0/124375611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0102900 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 -- 172.21.15.100:0/124375611 >> 172.21.15.100:0/124375611 conn(0x7f25c00f8110 msgr2=0x7f25c00fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 -- 172.21.15.100:0/124375611 shutdown_connections 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.411+0000 7f25c853a640 1 -- 172.21.15.100:0/124375611 wait complete. 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 Processor -- start 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 -- start start 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c0115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0116000 con 0x7f25c0102530 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c853a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c010f3f0 con 0x7f25c0102ed0 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c62d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:51.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c62d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47418/0 (socket says 172.21.15.100:47418) 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c62d6640 1 -- 172.21.15.100:0/3961747657 learned_addr learned my addr 172.21.15.100:0/3961747657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.412+0000 7f25c5ad5640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c0115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c62d6640 1 -- 172.21.15.100:0/3961747657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 msgr2=0x7f25c0115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c62d6640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c0115970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c62d6640 1 -- 172.21.15.100:0/3961747657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc005040 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c5ad5640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c0115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c62d6640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc038070 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f25bc03daf0 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c010f670 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc033b20 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.413+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c010fb90 con 0x7f25c0102530 2024-09-13T03:01:51.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.414+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c00fdcb0 con 0x7f25c0102530 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.414+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f25bc030020 con 0x7f25c0102530 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.415+0000 7f25b6ffd640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 0x7f25ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.415+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f25bc0ae480 con 0x7f25c0102530 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.415+0000 7f25c5ad5640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 0x7f25ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.415+0000 7f25c5ad5640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 0x7f25ac0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25c0110d30 tx=0x7f25b0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:51.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.419+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f25bc077570 con 0x7f25c0102530 2024-09-13T03:01:51.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.623+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f25c00fbd30 con 0x7f25c0102530 2024-09-13T03:01:51.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.624+0000 7f25b6ffd640 1 -- 172.21.15.100:0/3961747657 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v42) v1 ==== 107+0+4403 (secure 0 0 0) 0x7f25bc07ac30 con 0x7f25c0102530 2024-09-13T03:01:51.626 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:51.626 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"btime":"2024-09-13T02:58:29:364532+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:28.474704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:51.627 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 msgr2=0x7f25ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 0x7f25ac0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25c0110d30 tx=0x7f25b0008040 comp rx=0 tx=0).stop 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 msgr2=0x7f25c0115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 shutdown_connections 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f25ac06e530 0x7f25ac0709e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0102ed0 0x7f25c0115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 --2- 172.21.15.100:0/3961747657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25c0102530 0x7f25c0115430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 >> 172.21.15.100:0/3961747657 conn(0x7f25c00f8110 msgr2=0x7f25c00f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 shutdown_connections 2024-09-13T03:01:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:51.626+0000 7f25c853a640 1 -- 172.21.15.100:0/3961747657 wait complete. 2024-09-13T03:01:51.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:51 smithi100 ceph-mon[92340]: pgmap v310: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:51.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:51 smithi122 ceph-mon[79680]: pgmap v310: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:52.292 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-13T03:01:52.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-13T03:01:52.674 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:52 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3961747657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:01:52.789 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:52.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:52 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3961747657' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:01:53.628 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:53 smithi100 ceph-mon[92340]: pgmap v311: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:53.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:53 smithi122 ceph-mon[79680]: pgmap v311: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:54.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 -- 172.21.15.100:0/4039154413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 msgr2=0x7f3bc406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:54.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 --2- 172.21.15.100:0/4039154413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc406fe00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40048d0 tx=0x7f3bb4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 -- 172.21.15.100:0/4039154413 shutdown_connections 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 --2- 172.21.15.100:0/4039154413 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc41088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 --2- 172.21.15.100:0/4039154413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc406fe00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 -- 172.21.15.100:0/4039154413 >> 172.21.15.100:0/4039154413 conn(0x7f3bc40f80f0 msgr2=0x7f3bc40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 -- 172.21.15.100:0/4039154413 shutdown_connections 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 -- 172.21.15.100:0/4039154413 wait complete. 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.408+0000 7f3bca48f640 1 Processor -- start 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bca48f640 1 -- start start 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bca48f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bca48f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc4115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bca48f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4115f10 con 0x7f3bc406fa30 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bca48f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc410f350 con 0x7f3bc4070340 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:54.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47446/0 (socket says 172.21.15.100:47446) 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 -- 172.21.15.100:0/3356713310 learned_addr learned my addr 172.21.15.100:0/3356713310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc37fe640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc4115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 -- 172.21.15.100:0/3356713310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 msgr2=0x7f3bc4115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc4115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 -- 172.21.15.100:0/3356713310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4005040 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc37fe640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc4115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc3fff640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4003080 tx=0x7f3bb4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.409+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb4038070 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.410+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3bb40097e0 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.410+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc410f5d0 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.410+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb403d420 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.410+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc410fa90 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.411+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4071170 con 0x7f3bc406fa30 2024-09-13T03:01:54.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.411+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3bb4030020 con 0x7f3bc406fa30 2024-09-13T03:01:54.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.411+0000 7f3bc0ff9640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 0x7f3bac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:54.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.411+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3bb40ae810 con 0x7f3bc406fa30 2024-09-13T03:01:54.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.412+0000 7f3bc37fe640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 0x7f3bac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:54.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.412+0000 7f3bc37fe640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 0x7f3bac0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4110c90 tx=0x7f3bb8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:54.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.416+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3bb4077850 con 0x7f3bc406fa30 2024-09-13T03:01:54.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.620+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f3bc404b720 con 0x7f3bc406fa30 2024-09-13T03:01:54.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.621+0000 7f3bc0ff9640 1 -- 172.21.15.100:0/3356713310 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v42) v1 ==== 107+0+5250 (secure 0 0 0) 0x7f3bb407af10 con 0x7f3bc406fa30 2024-09-13T03:01:54.623 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:54.623 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"btime":"2024-09-13T02:58:30:366312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44343,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6827/2951042813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2951042813},{"type":"v1","addr":"172.21.15.122:6827","nonce":2951042813}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:29.369618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:01:54.623 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 38 2024-09-13T03:01:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 msgr2=0x7f3bac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 0x7f3bac0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4110c90 tx=0x7f3bb8009040 comp rx=0 tx=0).stop 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 msgr2=0x7f3bc41153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4003080 tx=0x7f3bb4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 shutdown_connections 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f3bac06e530 0x7f3bac0709e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bc4070340 0x7f3bc4115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 --2- 172.21.15.100:0/3356713310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bc406fa30 0x7f3bc41153d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 >> 172.21.15.100:0/3356713310 conn(0x7f3bc40f80f0 msgr2=0x7f3bc40f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 shutdown_connections 2024-09-13T03:01:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:54.623+0000 7f3bca48f640 1 -- 172.21.15.100:0/3356713310 wait complete. 2024-09-13T03:01:55.235 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-13T03:01:55.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-13T03:01:55.484 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:55.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:55 smithi100 ceph-mon[92340]: pgmap v312: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:55.789 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:55 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3356713310' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:01:55.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:55 smithi122 ceph-mon[79680]: pgmap v312: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:55.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:55 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3356713310' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:01:57.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/3321688236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102ef0 msgr2=0x7f2ff00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/3321688236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102ef0 0x7f2ff00fc5b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80048d0 tx=0x7f2fd8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/3321688236 shutdown_connections 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/3321688236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102ef0 0x7f2ff00fc5b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/3321688236 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102550 0x7f2ff0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/3321688236 >> 172.21.15.100:0/3321688236 conn(0x7f2ff00f80f0 msgr2=0x7f2ff00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/3321688236 shutdown_connections 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/3321688236 wait complete. 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 Processor -- start 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.180+0000 7f2ff5eb4640 1 -- start start 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102ef0 0x7f2ff0113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:57.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0114090 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff010d4a0 con 0x7f2ff0102ef0 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47474/0 (socket says 172.21.15.100:47474) 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 -- 172.21.15.100:0/2658967753 learned_addr learned my addr 172.21.15.100:0/2658967753 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fe6ffd640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102ef0 0x7f2ff0113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 -- 172.21.15.100:0/2658967753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102ef0 msgr2=0x7f2ff0113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102ef0 0x7f2ff0113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 -- 172.21.15.100:0/2658967753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8005040 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fef7fe640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0002a50 tx=0x7f2fe0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe0007c30 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff010d780 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2fe000f040 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe000dad0 con 0x7f2ff0102550 2024-09-13T03:01:57.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.181+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff010dcf0 con 0x7f2ff0102550 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.182+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff00fdcd0 con 0x7f2ff0102550 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.183+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2fe000dc30 con 0x7f2ff0102550 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.183+0000 7f2fecff9640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 0x7f2fdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.183+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f2fe008e0c0 con 0x7f2ff0102550 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.183+0000 7f2fe6ffd640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 0x7f2fdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.184+0000 7f2fe6ffd640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 0x7f2fdc0709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80048a0 tx=0x7f2fd8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:57.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.188+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2fe0057100 con 0x7f2ff0102550 2024-09-13T03:01:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.390+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f2ff004b750 con 0x7f2ff0102550 2024-09-13T03:01:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.391+0000 7f2fecff9640 1 -- 172.21.15.100:0/2658967753 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v42) v1 ==== 107+0+5259 (secure 0 0 0) 0x7f2fe005a7c0 con 0x7f2ff0102550 2024-09-13T03:01:57.392 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:01:57.393 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"btime":"2024-09-13T02:58:31:374641+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44343,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6827/2951042813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2951042813},{"type":"v1","addr":"172.21.15.122:6827","nonce":2951042813}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:31.374637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-09-13T03:01:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 39 2024-09-13T03:01:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 msgr2=0x7f2fdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 0x7f2fdc0709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80048a0 tx=0x7f2fd8035040 comp rx=0 tx=0).stop 2024-09-13T03:01:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 msgr2=0x7f2ff0113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0002a50 tx=0x7f2fe0004600 comp rx=0 tx=0).stop 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 shutdown_connections 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f2fdc06e530 0x7f2fdc0709e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ff0102ef0 0x7f2ff0113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 --2- 172.21.15.100:0/2658967753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff0102550 0x7f2ff0113500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 >> 172.21.15.100:0/2658967753 conn(0x7f2ff00f80f0 msgr2=0x7f2ff00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 shutdown_connections 2024-09-13T03:01:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:57.393+0000 7f2ff5eb4640 1 -- 172.21.15.100:0/2658967753 wait complete. 2024-09-13T03:01:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:57 smithi100 ceph-mon[92340]: pgmap v313: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:57.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:57 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/2658967753' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T03:01:57.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:57 smithi122 ceph-mon[79680]: pgmap v313: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:57.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:57 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/2658967753' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T03:01:57.991 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-13T03:01:57.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-13T03:01:58.235 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:01:59.619 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:59 smithi100 ceph-mon[92340]: pgmap v314: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:59.619 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:01:59 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:59.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 -- 172.21.15.100:0/3866820954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 msgr2=0x7f4d04108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 --2- 172.21.15.100:0/3866820954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04108920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80048d0 tx=0x7f4cf8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 -- 172.21.15.100:0/3866820954 shutdown_connections 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 --2- 172.21.15.100:0/3866820954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04108920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 --2- 172.21.15.100:0/3866820954 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 0x7f4d0406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 -- 172.21.15.100:0/3866820954 >> 172.21.15.100:0/3866820954 conn(0x7f4d040f8100 msgr2=0x7f4d040fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.895+0000 7f4d0a331640 1 -- 172.21.15.100:0/3866820954 shutdown_connections 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.896+0000 7f4d0a331640 1 -- 172.21.15.100:0/3866820954 wait complete. 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.896+0000 7f4d0a331640 1 Processor -- start 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d0a331640 1 -- start start 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d0a331640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 0x7f4d04115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d0a331640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d0a331640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04115f60 con 0x7f4d04070340 2024-09-13T03:01:59.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d0a331640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041160d0 con 0x7f4d0406fa30 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55690/0 (socket says 172.21.15.100:55690) 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 -- 172.21.15.100:0/1134813049 learned_addr learned my addr 172.21.15.100:0/1134813049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d03fff640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 0x7f4d04115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 -- 172.21.15.100:0/1134813049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 msgr2=0x7f4d04115420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 0x7f4d04115420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 -- 172.21.15.100:0/1134813049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8005040 con 0x7f4d04070340 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.897+0000 7f4d037fe640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.898+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf8038070 con 0x7f4d04070340 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.898+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4cf802ade0 con 0x7f4d04070340 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.898+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0410f4f0 con 0x7f4d04070340 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.898+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf802c7e0 con 0x7f4d04070340 2024-09-13T03:01:59.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.898+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0410f9b0 con 0x7f4d04070340 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.899+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d04071170 con 0x7f4d04070340 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.899+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4cf8030020 con 0x7f4d04070340 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.900+0000 7f4d00ff9640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 0x7f4cec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.900+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f4cf80adea0 con 0x7f4d04070340 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.900+0000 7f4d03fff640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 0x7f4cec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:59.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.900+0000 7f4d03fff640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 0x7f4cec0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4004ed0 tx=0x7f4cf400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:59.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:01:59.905+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4cf8076f90 con 0x7f4d04070340 2024-09-13T03:01:59.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:59 smithi122 ceph-mon[79680]: pgmap v314: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:59.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:01:59 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:00.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.107+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f4d040fbd60 con 0x7f4d04070340 2024-09-13T03:02:00.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.108+0000 7f4d00ff9640 1 -- 172.21.15.100:0/1134813049 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v42) v1 ==== 107+0+5259 (secure 0 0 0) 0x7f4cf807a650 con 0x7f4d04070340 2024-09-13T03:02:00.109 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:02:00.109 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":40,"btime":"2024-09-13T02:58:36:996242+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44343,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6827/2951042813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2951042813},{"type":"v1","addr":"172.21.15.122:6827","nonce":2951042813}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:35.998613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34404},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-09-13T03:02:00.110 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 40 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 msgr2=0x7f4cec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 0x7f4cec0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4004ed0 tx=0x7f4cf400b040 comp rx=0 tx=0).stop 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 msgr2=0x7f4d04115960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000c00 tx=0x7f4cf8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 shutdown_connections 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f4cec06e530 0x7f4cec0709e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d04070340 0x7f4d04115960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:00.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 --2- 172.21.15.100:0/1134813049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d0406fa30 0x7f4d04115420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 >> 172.21.15.100:0/1134813049 conn(0x7f4d040f8100 msgr2=0x7f4d04103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 shutdown_connections 2024-09-13T03:02:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:00.110+0000 7f4d0a331640 1 -- 172.21.15.100:0/1134813049 wait complete. 2024-09-13T03:02:00.740 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:00 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/1134813049' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T03:02:00.740 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:00 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:00.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-13T03:02:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:00 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/1134813049' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T03:02:00.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:00 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:01.019 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:02:01.822 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:01 smithi100 ceph-mon[92340]: pgmap v315: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:01.823 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:01.823 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:01.823 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:01 smithi100 ceph-mon[92340]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:02:01.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:01 smithi122 ceph-mon[79680]: pgmap v315: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:01.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:01.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:01.937 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:01 smithi122 ceph-mon[79680]: from='mgr.34104 172.21.15.100:0/4009825418' entity='mgr.smithi100.lhjyck' 2024-09-13T03:02:02.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 -- 172.21.15.100:0/1502952926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102ef0 msgr2=0x7f8ed40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/1502952926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102ef0 0x7f8ed40fc5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80048d0 tx=0x7f8ec8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 -- 172.21.15.100:0/1502952926 shutdown_connections 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/1502952926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102ef0 0x7f8ed40fc5b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/1502952926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102550 0x7f8ed4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 -- 172.21.15.100:0/1502952926 >> 172.21.15.100:0/1502952926 conn(0x7f8ed40f80f0 msgr2=0x7f8ed40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 -- 172.21.15.100:0/1502952926 shutdown_connections 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.595+0000 7f8ed9a35640 1 -- 172.21.15.100:0/1502952926 wait complete. 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 Processor -- start 2024-09-13T03:02:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 -- start start 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102ef0 0x7f8ed4115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4116200 con 0x7f8ed4102550 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.596+0000 7f8ed9a35640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4116370 con 0x7f8ed4102ef0 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55710/0 (socket says 172.21.15.100:55710) 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 -- 172.21.15.100:0/3752200876 learned_addr learned my addr 172.21.15.100:0/3752200876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed27fc640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102ef0 0x7f8ed4115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 -- 172.21.15.100:0/3752200876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102ef0 msgr2=0x7f8ed4115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102ef0 0x7f8ed4115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 -- 172.21.15.100:0/3752200876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8005040 con 0x7f8ed4102550 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed2ffd640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4002a50 tx=0x7f8ec4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec4007c30 con 0x7f8ed4102550 2024-09-13T03:02:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ec400f040 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed410f7f0 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec400da90 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.597+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed410fd60 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.598+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed40fdcd0 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.599+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8ec400dd00 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.599+0000 7f8ebb7fe640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 0x7f8ebc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.599+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f8ec408db20 con 0x7f8ed4102550 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.599+0000 7f8ed27fc640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 0x7f8ebc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.600+0000 7f8ed27fc640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 0x7f8ebc0709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000c00 tx=0x7f8ec8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.603+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ec4056b60 con 0x7f8ed4102550 2024-09-13T03:02:02.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.806+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f8ed40fbd50 con 0x7f8ed4102550 2024-09-13T03:02:02.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.807+0000 7f8ebb7fe640 1 -- 172.21.15.100:0/3752200876 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v42) v1 ==== 107+0+5276 (secure 0 0 0) 0x7f8ec405a220 con 0x7f8ed4102550 2024-09-13T03:02:02.808 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-13T03:02:02.808 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"btime":"2024-09-13T02:58:37:003101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44311,"name":"cephfs.smithi122.wmvyfe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6825/1347589345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":1347589345},{"type":"v1","addr":"172.21.15.122:6825","nonce":1347589345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44343,"name":"cephfs.smithi122.crukff","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6827/2951042813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2951042813},{"type":"v1","addr":"172.21.15.122:6827","nonce":2951042813}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T02:48:11.655979+0000","modified":"2024-09-13T02:58:37.003079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi100.slkwfs","rank":0,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.100:6827/416870061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":416870061},{"type":"v1","addr":"172.21.15.100:6827","nonce":416870061}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34436":{"gid":34436,"name":"cephfs.smithi100.ciqoxn","rank":1,"incarnation":41,"state":"up:starting","state_seq":1,"addr":"172.21.15.100:6829/3551062666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3551062666},{"type":"v1","addr":"172.21.15.100:6829","nonce":3551062666}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34404,"qdb_cluster":[34404]},"id":1}]} 2024-09-13T03:02:02.808 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 41 2024-09-13T03:02:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 msgr2=0x7f8ebc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 0x7f8ebc0709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000c00 tx=0x7f8ec8035040 comp rx=0 tx=0).stop 2024-09-13T03:02:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 msgr2=0x7f8ed41156c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4002a50 tx=0x7f8ec4004600 comp rx=0 tx=0).stop 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 shutdown_connections 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f8ebc06e530 0x7f8ebc0709e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ed4102ef0 0x7f8ed4115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 --2- 172.21.15.100:0/3752200876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ed4102550 0x7f8ed41156c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 >> 172.21.15.100:0/3752200876 conn(0x7f8ed40f80f0 msgr2=0x7f8ed406fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 shutdown_connections 2024-09-13T03:02:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:02.809+0000 7f8ed9a35640 1 -- 172.21.15.100:0/3752200876 wait complete. 2024-09-13T03:02:03.466 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T03:02:03.476 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T03:02:03.477 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T03:02:03.477 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:02:03.496 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-13T03:02:03.496 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:02:03.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:02:03.841 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:02:03.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:03 smithi100 ceph-mon[92340]: pgmap v316: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:03.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:03 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3752200876' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T03:02:03.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:03 smithi122 ceph-mon[79680]: pgmap v316: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:03.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:03 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3752200876' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 -- 172.21.15.100:0/3957515648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c0fb4b0 msgr2=0x7f554c0fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 --2- 172.21.15.100:0/3957515648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c0fb4b0 0x7f554c0fb920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f55400048d0 tx=0x7f5540009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 -- 172.21.15.100:0/3957515648 shutdown_connections 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 --2- 172.21.15.100:0/3957515648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c0fb4b0 0x7f554c0fb920 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 --2- 172.21.15.100:0/3957515648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c1014f0 0x7f554c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 -- 172.21.15.100:0/3957515648 >> 172.21.15.100:0/3957515648 conn(0x7f554c0f7090 msgr2=0x7f554c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 -- 172.21.15.100:0/3957515648 shutdown_connections 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.443+0000 7f5551b00640 1 -- 172.21.15.100:0/3957515648 wait complete. 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 Processor -- start 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 -- start start 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c0fb4b0 0x7f554c10bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c10c9f0 con 0x7f554c1014f0 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f5551b00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c10cb30 con 0x7f554c0fb4b0 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f554affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f554affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55726/0 (socket says 172.21.15.100:55726) 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.444+0000 7f554affd640 1 -- 172.21.15.100:0/3207634167 learned_addr learned my addr 172.21.15.100:0/3207634167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f554b7fe640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c0fb4b0 0x7f554c10bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f554affd640 1 -- 172.21.15.100:0/3207634167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c0fb4b0 msgr2=0x7f554c10bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f554affd640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c0fb4b0 0x7f554c10bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f554affd640 1 -- 172.21.15.100:0/3207634167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540005040 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f554affd640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5540003080 tx=0x7f5540009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5540038070 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f55400097e0 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c10cdb0 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f554003d420 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.445+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c1198b0 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.446+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c0fcbf0 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.446+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5540030020 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.447+0000 7f5533fff640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 0x7f55340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.447+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f55400ae7a0 con 0x7f554c1014f0 2024-09-13T03:02:05.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.447+0000 7f554b7fe640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 0x7f55340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.447+0000 7f554b7fe640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 0x7f55340709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f553c007fd0 tx=0x7f553c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.451+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f55400777e0 con 0x7f554c1014f0 2024-09-13T03:02:05.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.630+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f554c04b720 con 0x7f554c1014f0 2024-09-13T03:02:05.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.631+0000 7f5533fff640 1 -- 172.21.15.100:0/3207634167 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v81) v1 ==== 81+0+2580 (secure 0 0 0) 0x7f554007aea0 con 0x7f554c1014f0 2024-09-13T03:02:05.632 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6829/2158470851 2024-09-14T02:57:45.301137+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6828/2158470851 2024-09-14T02:57:45.301137+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2620401114 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2131214238 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2131214238 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3004082795 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/491786587 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3848826713 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2646621563 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2463712336 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3121511218 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6826/3862727751 2024-09-14T02:58:22.733713+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1318550883 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6826/781877866 2024-09-14T02:48:27.582587+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3842284467 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/1286357473 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/4207623253 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2288018786 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6828/3888337405 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3600671764 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/50319557 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2459548553 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3404957479 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/3366491670 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3121511218 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/62422032 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:05.635 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/1286357473 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2208660492 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2830706839 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3061337984 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/610472047 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6829/3888337405 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6827/781877866 2024-09-14T02:48:27.582587+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/2814878065 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3198025344 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/808939656 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/808939656 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1141279129 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3842284467 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:05.636 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6827/3862727751 2024-09-14T02:58:22.733713+0000 2024-09-13T03:02:05.637 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1955372089 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:05.637 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/864164020 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.637 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/2246255803 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:05.639 INFO:teuthology.orchestra.run.smithi100.stderr:listed 43 entries 2024-09-13T03:02:05.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 msgr2=0x7f55340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 0x7f55340709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f553c007fd0 tx=0x7f553c009040 comp rx=0 tx=0).stop 2024-09-13T03:02:05.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 msgr2=0x7f554c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:05.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5540003080 tx=0x7f5540009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 shutdown_connections 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f553406e530 0x7f55340709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f554c1014f0 0x7f554c10c4b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 --2- 172.21.15.100:0/3207634167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f554c0fb4b0 0x7f554c10bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.633+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 >> 172.21.15.100:0/3207634167 conn(0x7f554c0f7090 msgr2=0x7f554c0f8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:05.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.634+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 shutdown_connections 2024-09-13T03:02:05.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:05.634+0000 7f5551b00640 1 -- 172.21.15.100:0/3207634167 wait complete. 2024-09-13T03:02:05.739 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:05 smithi122 ceph-mon[79680]: pgmap v317: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:05.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:05 smithi100 ceph-mon[92340]: pgmap v317: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:06.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T03:02:06.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:06.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T03:02:06.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T03:02:06.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:06.363 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T03:02:06.429 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T03:02:06.430 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:02:06.450 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T03:02:06.450 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:02:06.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 84e01cde-7179-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:02:06.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:06 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3207634167' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:02:06.756 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/mon.smithi100/config 2024-09-13T03:02:06.906 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:06 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3207634167' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:02:07.829 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:07 smithi100 ceph-mon[92340]: pgmap v318: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:07.936 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:07 smithi122 ceph-mon[79680]: pgmap v318: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3453518796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 msgr2=0x7f0c240fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3453518796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c240fd3d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c140048d0 tx=0x7f0c14009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3453518796 shutdown_connections 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3453518796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c240fd3d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3453518796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c240fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3453518796 >> 172.21.15.100:0/3453518796 conn(0x7f0c240723b0 msgr2=0x7f0c240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:08.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3453518796 shutdown_connections 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3453518796 wait complete. 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 Processor -- start 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 -- start start 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c2410e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.361+0000 7f0c2b2bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c2b2bb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2410ed00 con 0x7f0c240fcf80 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c2b2bb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2410ee70 con 0x7f0c240fb810 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52410/0 (socket says 172.21.15.100:52410) 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 -- 172.21.15.100:0/3804578682 learned_addr learned my addr 172.21.15.100:0/3804578682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c29057640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c2410e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 -- 172.21.15.100:0/3804578682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 msgr2=0x7f0c2410e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:08.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c2410e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 -- 172.21.15.100:0/3804578682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14005040 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c29057640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c2410e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c28856640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000c00 tx=0x7f0c14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c14038070 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c1402ade0 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c1402c7e0 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.362+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c241171e0 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.363+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c24117640 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.364+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c240fcbc0 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.364+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0c14030020 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.365+0000 7f0c19ffb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 0x7f0c100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.365+0000 7f0c29057640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 0x7f0c100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.365+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0c140ade00 con 0x7f0c240fcf80 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.365+0000 7f0c29057640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 0x7f0c100709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009fd0 tx=0x7f0c20009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:08.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.369+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0c14076f70 con 0x7f0c240fcf80 2024-09-13T03:02:08.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.548+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c2404b720 con 0x7f0c240fcf80 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.548+0000 7f0c19ffb640 1 -- 172.21.15.100:0/3804578682 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v81) v1 ==== 81+0+2580 (secure 0 0 0) 0x7f0c1407a630 con 0x7f0c240fcf80 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6829/2158470851 2024-09-14T02:57:45.301137+0000 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6828/2158470851 2024-09-14T02:57:45.301137+0000 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2620401114 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/2131214238 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/2131214238 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.550 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3004082795 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/491786587 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3848826713 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2646621563 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2463712336 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3121511218 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6826/3862727751 2024-09-14T02:58:22.733713+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1318550883 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6826/781877866 2024-09-14T02:48:27.582587+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/3842284467 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/1286357473 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/4207623253 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2288018786 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6828/3888337405 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.551 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3600671764 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/50319557 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2459548553 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3404957479 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/3366491670 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3121511218 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/62422032 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/1286357473 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2208660492 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/2830706839 2024-09-14T02:52:44.214330+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3061337984 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/610472047 2024-09-14T02:41:52.778377+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6829/3888337405 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6827/781877866 2024-09-14T02:48:27.582587+0000 2024-09-13T03:02:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/2814878065 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/3198025344 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/808939656 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6801/808939656 2024-09-14T02:42:21.569382+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1141279129 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:6800/3842284467 2024-09-14T02:43:21.494498+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:6827/3862727751 2024-09-14T02:58:22.733713+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100:0/1955372089 2024-09-14T02:50:48.598983+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/864164020 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.122:0/2246255803 2024-09-14T02:52:05.508907+0000 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:listed 43 entries 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.550+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 msgr2=0x7f0c100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.550+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 0x7f0c100709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009fd0 tx=0x7f0c20009e50 comp rx=0 tx=0).stop 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.550+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 msgr2=0x7f0c2410e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.550+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000c00 tx=0x7f0c14009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.550+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 shutdown_connections 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:6800/1224467238,v1:172.21.15.100:6801/1224467238] conn(0x7f0c1006e530 0x7f0c100709e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c240fcf80 0x7f0c2410e6b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 --2- 172.21.15.100:0/3804578682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c240fb810 0x7f0c2410e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 >> 172.21.15.100:0/3804578682 conn(0x7f0c240723b0 msgr2=0x7f0c240fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 shutdown_connections 2024-09-13T03:02:08.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-13T03:02:08.551+0000 7f0c2b2bb640 1 -- 172.21.15.100:0/3804578682 wait complete. 2024-09-13T03:02:09.220 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T03:02:09.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.220 DEBUG:teuthology.orchestra.run.smithi122:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T03:02:09.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi122.front.sepia.ceph.com 2024-09-13T03:02:09.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.257 DEBUG:teuthology.orchestra.run.smithi122:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T03:02:09.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.332 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-13T03:02:09.349 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T03:02:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T03:02:09.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-13T03:02:09.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.506 DEBUG:teuthology.orchestra.run.smithi122:> ip netns list 2024-09-13T03:02:09.526 INFO:teuthology.orchestra.run.smithi122.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T03:02:09.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T03:02:09.593 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:09 smithi122 ceph-mon[79680]: pgmap v319: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T03:02:09.593 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:09 smithi122 ceph-mon[79680]: from='client.? 172.21.15.100:0/3804578682' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:02:09.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:02:09.598 DEBUG:teuthology.orchestra.run.smithi122:> sudo ip link delete ceph-brx 2024-09-13T03:02:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:09 smithi100 ceph-mon[92340]: pgmap v319: 65 pgs: 65 active+clean; 160 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T03:02:09.676 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:09 smithi100 ceph-mon[92340]: from='client.? 172.21.15.100:0/3804578682' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:02:09.711 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T03:02:09.722 INFO:tasks.cephadm:Teardown begin 2024-09-13T03:02:09.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:02:09.751 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:02:09.780 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T03:02:09.780 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:02:09.807 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:02:09.837 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T03:02:09.837 INFO:tasks.cephadm.mon.smithi100:Stopping mon.smithi100... 2024-09-13T03:02:09.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100 2024-09-13T03:02:10.143 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:09 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:10 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[92336]: 2024-09-13T03:02:10.141+0000 7f57e6819640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:10 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100[92336]: 2024-09-13T03:02:10.141+0000 7f57e6819640 -1 mon.smithi100@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T03:02:10.426 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:10 smithi100 podman[137892]: 2024-09-13 03:02:10.22331371 +0000 UTC m=+0.182639097 container died 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:10.877 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:10 smithi100 podman[137892]: 2024-09-13 03:02:10.607986667 +0000 UTC m=+0.567312060 container cleanup 848f83d5f0d18efc091893c3fa3b38e45bada21f42ea0e6be1c67c3823a73da0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:02:10.877 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Sep 13 03:02:10 smithi100 bash[137892]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi100 2024-09-13T03:02:11.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi100.service' 2024-09-13T03:02:11.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:11.080 INFO:tasks.cephadm.mon.smithi100:Stopped mon.smithi100 2024-09-13T03:02:11.080 INFO:tasks.cephadm.mon.smithi122:Stopping mon.smithi122... 2024-09-13T03:02:11.080 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi122 2024-09-13T03:02:11.390 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 systemd[1]: Stopping Ceph mon.smithi122 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:11.686 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122[79676]: 2024-09-13T03:02:11.388+0000 7f7ab62d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi122 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:11.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122[79676]: 2024-09-13T03:02:11.388+0000 7f7ab62d3640 -1 mon.smithi122@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T03:02:11.687 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 podman[112096]: 2024-09-13 03:02:11.4702688 +0000 UTC m=+0.191727893 container died a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T03:02:12.186 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 podman[112096]: 2024-09-13 03:02:11.947553205 +0000 UTC m=+0.669012297 container cleanup a73db8aebd49b683acd769cfbfd67a6f75038f20389390b268c514f92c3b03a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T03:02:12.187 INFO:journalctl@ceph.mon.smithi122.smithi122.stdout:Sep 13 03:02:11 smithi122 bash[112096]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-mon-smithi122 2024-09-13T03:02:12.346 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@mon.smithi122.service' 2024-09-13T03:02:12.394 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:12.394 INFO:tasks.cephadm.mon.smithi122:Stopped mon.smithi122 2024-09-13T03:02:12.394 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T03:02:12.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.0 2024-09-13T03:02:12.450 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:12 smithi100 systemd[1]: Stopping Ceph osd.0 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:13.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:12 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T03:02:12.712+0000 7f022993c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:13.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:12 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T03:02:12.712+0000 7f022993c640 -1 osd.0 81 *** Got signal Terminated *** 2024-09-13T03:02:13.176 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:12 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0[100890]: 2024-09-13T03:02:12.712+0000 7f022993c640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:18.426 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:18 smithi100 podman[138027]: 2024-09-13 03:02:18.150328729 +0000 UTC m=+5.540766980 container died 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:18.806 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:18 smithi100 podman[138027]: 2024-09-13 03:02:18.53784968 +0000 UTC m=+5.928287930 container cleanup 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD) 2024-09-13T03:02:18.807 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:18 smithi100 bash[138027]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0 2024-09-13T03:02:19.154 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:18 smithi100 podman[138057]: 2024-09-13 03:02:18.80602126 +0000 UTC m=+0.645243194 container remove 7109e92262487c454c75c1a1bb2281439958e117d6e5a6c32d827c4af828ba37 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T03:02:19.426 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.057612242 +0000 UTC m=+0.016321364 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:19.426 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.190244014 +0000 UTC m=+0.148953129 container create dff15adc44986b2df4fac9ccca9b6da2939715264d42ec388a3b9eceb4ab1989 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T03:02:19.927 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.462048486 +0000 UTC m=+0.420757610 container init dff15adc44986b2df4fac9ccca9b6da2939715264d42ec388a3b9eceb4ab1989 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:19.927 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.465761777 +0000 UTC m=+0.424470893 container start dff15adc44986b2df4fac9ccca9b6da2939715264d42ec388a3b9eceb4ab1989 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T03:02:19.927 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.551384826 +0000 UTC m=+0.510093955 container attach dff15adc44986b2df4fac9ccca9b6da2939715264d42ec388a3b9eceb4ab1989 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-13T03:02:19.927 INFO:journalctl@ceph.osd.0.smithi100.stdout:Sep 13 03:02:19 smithi100 podman[138147]: 2024-09-13 03:02:19.653284061 +0000 UTC m=+0.611993180 container died dff15adc44986b2df4fac9ccca9b6da2939715264d42ec388a3b9eceb4ab1989 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T03:02:20.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T03:02:20.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:20.271 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T03:02:20.271 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T03:02:20.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.1 2024-09-13T03:02:20.617 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:20 smithi100 systemd[1]: Stopping Ceph osd.1 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:20.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:20 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T03:02:20.615+0000 7f247a568640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:20.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:20 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T03:02:20.615+0000 7f247a568640 -1 osd.1 81 *** Got signal Terminated *** 2024-09-13T03:02:20.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:20 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1[106229]: 2024-09-13T03:02:20.615+0000 7f247a568640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:26.235 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:25 smithi100 podman[138248]: 2024-09-13 03:02:25.936047792 +0000 UTC m=+5.443530877 container died dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T03:02:26.668 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:26 smithi100 podman[138248]: 2024-09-13 03:02:26.416589675 +0000 UTC m=+5.924072759 container cleanup dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:02:26.669 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:26 smithi100 bash[138248]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1 2024-09-13T03:02:26.926 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:26 smithi100 podman[138263]: 2024-09-13 03:02:26.668171695 +0000 UTC m=+0.725976383 container remove dd5f29e1974b990824952eeedbd0cc36b7013807c0c1bb5cdf418ad50e7dc8c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:27.292 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:26.935677567 +0000 UTC m=+0.015987798 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:27.292 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:27.160946237 +0000 UTC m=+0.241256453 container create 7fdcb8b6b5cd80c2792f76985a18553221b02a775daedbfe929ca5ce9bb49f59 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T03:02:27.639 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:27.438427293 +0000 UTC m=+0.518737519 container init 7fdcb8b6b5cd80c2792f76985a18553221b02a775daedbfe929ca5ce9bb49f59 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731) 2024-09-13T03:02:27.640 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:27.441819583 +0000 UTC m=+0.522129800 container start 7fdcb8b6b5cd80c2792f76985a18553221b02a775daedbfe929ca5ce9bb49f59 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T03:02:27.640 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:27.521797241 +0000 UTC m=+0.602107461 container attach 7fdcb8b6b5cd80c2792f76985a18553221b02a775daedbfe929ca5ce9bb49f59 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:02:27.640 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 13 03:02:27 smithi100 podman[138353]: 2024-09-13 03:02:27.639032086 +0000 UTC m=+0.719342314 container died 7fdcb8b6b5cd80c2792f76985a18553221b02a775daedbfe929ca5ce9bb49f59 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f) 2024-09-13T03:02:28.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T03:02:28.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:28.355 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T03:02:28.355 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T03:02:28.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.2 2024-09-13T03:02:28.676 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:28 smithi100 systemd[1]: Stopping Ceph osd.2 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:29.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:28 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T03:02:28.679+0000 7fe5e6537640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:29.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:28 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T03:02:28.679+0000 7fe5e6537640 -1 osd.2 81 *** Got signal Terminated *** 2024-09-13T03:02:29.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:28 smithi100 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2[111884]: 2024-09-13T03:02:28.679+0000 7fe5e6537640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:34.384 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:34 smithi100 podman[138457]: 2024-09-13 03:02:34.112754621 +0000 UTC m=+5.528277430 container died 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T03:02:34.676 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:34 smithi100 podman[138457]: 2024-09-13 03:02:34.562604092 +0000 UTC m=+5.978126947 container cleanup 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T03:02:34.676 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:34 smithi100 bash[138457]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2 2024-09-13T03:02:35.176 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:34 smithi100 podman[138472]: 2024-09-13 03:02:34.880802955 +0000 UTC m=+0.767083968 container remove 249e28b309c00aa79224df6f731536105e5f69f31d222e8f80c006e250d5349e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T03:02:35.551 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.141545823 +0000 UTC m=+0.015946074 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:35.552 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.273689706 +0000 UTC m=+0.148089949 container create a9bbdeee5c7163159692b54dbdf88d55650465af40a6ff4232b9203cc27e424d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:02:35.552 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.476170963 +0000 UTC m=+0.350571206 container init a9bbdeee5c7163159692b54dbdf88d55650465af40a6ff4232b9203cc27e424d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:02:35.552 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.479382583 +0000 UTC m=+0.353782836 container start a9bbdeee5c7163159692b54dbdf88d55650465af40a6ff4232b9203cc27e424d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T03:02:35.552 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.551145888 +0000 UTC m=+0.425546136 container attach a9bbdeee5c7163159692b54dbdf88d55650465af40a6ff4232b9203cc27e424d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T03:02:35.926 INFO:journalctl@ceph.osd.2.smithi100.stdout:Sep 13 03:02:35 smithi100 podman[138562]: 2024-09-13 03:02:35.66244859 +0000 UTC m=+0.536848836 container died a9bbdeee5c7163159692b54dbdf88d55650465af40a6ff4232b9203cc27e424d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T03:02:36.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T03:02:36.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:36.280 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T03:02:36.280 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T03:02:36.281 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.3 2024-09-13T03:02:36.594 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:36 smithi122 systemd[1]: Stopping Ceph osd.3 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:36.882 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:36 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T03:02:36.591+0000 7fda4454f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:36.882 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:36 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T03:02:36.591+0000 7fda4454f640 -1 osd.3 81 *** Got signal Terminated *** 2024-09-13T03:02:36.882 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:36 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3[88790]: 2024-09-13T03:02:36.591+0000 7fda4454f640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:39.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:38 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:38.964+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:39.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:38 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:38.844+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:40.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:39.964+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:40.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:39 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:39.822+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:41.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:41 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:41.007+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:41.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:40 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:40.831+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:42.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:41 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:41.960+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:42.187 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:41 smithi122 podman[112221]: 2024-09-13 03:02:41.914291998 +0000 UTC m=+5.437229543 container died 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T03:02:42.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:41 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:41.848+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:42.537 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:42 smithi122 podman[112221]: 2024-09-13 03:02:42.276549699 +0000 UTC m=+5.799487245 container cleanup 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:42.537 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:42 smithi122 bash[112221]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3 2024-09-13T03:02:42.856 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:42 smithi122 podman[112247]: 2024-09-13 03:02:42.536385048 +0000 UTC m=+0.616365169 container remove 6aec48388f68059dea7a77180528cf4f54e98dff03bbaf7e45e590b4a53f9744 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:02:43.132 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:42 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:42.918+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:43.133 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:42 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:42.854+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:43.133 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:42 smithi122 podman[112337]: 2024-09-13 03:02:42.795329203 +0000 UTC m=+0.015601417 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:43.133 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:42 smithi122 podman[112337]: 2024-09-13 03:02:42.904358985 +0000 UTC m=+0.124631202 container create 261e18a4948fb5786d0c8774d51a279f1a5ecb7abecb8d53a1cf02d12e318c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T03:02:43.436 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:43 smithi122 podman[112337]: 2024-09-13 03:02:43.132253031 +0000 UTC m=+0.352525246 container init 261e18a4948fb5786d0c8774d51a279f1a5ecb7abecb8d53a1cf02d12e318c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T03:02:43.436 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:43 smithi122 podman[112337]: 2024-09-13 03:02:43.135579771 +0000 UTC m=+0.355851986 container start 261e18a4948fb5786d0c8774d51a279f1a5ecb7abecb8d53a1cf02d12e318c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T03:02:43.436 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:43 smithi122 podman[112337]: 2024-09-13 03:02:43.207234488 +0000 UTC m=+0.427506717 container attach 261e18a4948fb5786d0c8774d51a279f1a5ecb7abecb8d53a1cf02d12e318c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T03:02:43.437 INFO:journalctl@ceph.osd.3.smithi122.stdout:Sep 13 03:02:43 smithi122 podman[112337]: 2024-09-13 03:02:43.316638561 +0000 UTC m=+0.536910776 container died 261e18a4948fb5786d0c8774d51a279f1a5ecb7abecb8d53a1cf02d12e318c9e (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T03:02:43.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:43 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:43.812+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:43.978 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T03:02:44.019 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:44.019 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T03:02:44.019 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T03:02:44.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.4 2024-09-13T03:02:44.358 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:43 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:43.967+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:44.358 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:44 smithi122 systemd[1]: Stopping Ceph osd.4 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:44.358 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:44.356+0000 7f46d7a4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:44.358 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:44.356+0000 7f46d7a4b640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-13T03:02:44.358 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:44.356+0000 7f46d7a4b640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:45.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:45 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:45.002+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:45.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:44 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:44.802+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:46.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:45 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:45.976+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:46.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:45 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:45.814+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:47.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:46 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:46.995+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:47.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:46 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:46.855+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:48.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:47 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:47.953+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:48.186 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:47 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:47.953+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:22.483478+0000 front 2024-09-13T03:02:22.483392+0000 (oldest deadline 2024-09-13T03:02:47.183270+0000) 2024-09-13T03:02:48.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:47 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:47.837+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:49.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:48 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:48.859+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:49.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:48 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:48.990+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.082601+0000 front 2024-09-13T03:02:13.082690+0000 (oldest deadline 2024-09-13T03:02:38.382527+0000) 2024-09-13T03:02:49.187 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:48 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4[93664]: 2024-09-13T03:02:48.990+0000 7f46d0048640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:22.483478+0000 front 2024-09-13T03:02:22.483392+0000 (oldest deadline 2024-09-13T03:02:47.183270+0000) 2024-09-13T03:02:50.115 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:49 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:49.874+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:50.116 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:49 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:49.874+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:50.116 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:49 smithi122 podman[112439]: 2024-09-13 03:02:49.831103714 +0000 UTC m=+5.595286870 container died 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_CLEAN=True) 2024-09-13T03:02:50.116 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112439]: 2024-09-13 03:02:50.11490319 +0000 UTC m=+5.879086345 container cleanup 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T03:02:50.436 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 bash[112439]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4 2024-09-13T03:02:50.436 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112457]: 2024-09-13 03:02:50.349670438 +0000 UTC m=+0.515831035 container remove 52ac34c169ce8e1782780f94b98ca843dccbddadf55b1a010fff9eb98778bdf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T03:02:50.936 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:50 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:50.872+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:50.937 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:50 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:50.872+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:50.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112546]: 2024-09-13 03:02:50.583112301 +0000 UTC m=+0.015983258 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:50.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112546]: 2024-09-13 03:02:50.692326066 +0000 UTC m=+0.125197008 container create f824becfb405055e6ebff621c3ac10e026e5f7404d8baf2b84636c4d1252dd43 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T03:02:50.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112546]: 2024-09-13 03:02:50.91156811 +0000 UTC m=+0.344439057 container init f824becfb405055e6ebff621c3ac10e026e5f7404d8baf2b84636c4d1252dd43 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f) 2024-09-13T03:02:50.937 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:50 smithi122 podman[112546]: 2024-09-13 03:02:50.914917091 +0000 UTC m=+0.347788035 container start f824becfb405055e6ebff621c3ac10e026e5f7404d8baf2b84636c4d1252dd43 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T03:02:51.383 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:51 smithi122 podman[112546]: 2024-09-13 03:02:51.020601023 +0000 UTC m=+0.453471976 container attach f824becfb405055e6ebff621c3ac10e026e5f7404d8baf2b84636c4d1252dd43 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T03:02:51.383 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 03:02:51 smithi122 podman[112546]: 2024-09-13 03:02:51.098538034 +0000 UTC m=+0.531408983 container died f824becfb405055e6ebff621c3ac10e026e5f7404d8baf2b84636c4d1252dd43 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T03:02:51.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T03:02:51.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:51.733 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T03:02:51.733 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T03:02:51.733 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.5 2024-09-13T03:02:51.916 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:51 smithi122 systemd[1]: Stopping Ceph osd.5 for 84e01cde-7179-11ef-bceb-c7b262605968... 2024-09-13T03:02:52.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:51 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:51.914+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:52.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:51 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:51.914+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:52.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:52.069+0000 7fbcf04e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:02:52.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:52.069+0000 7fbcf04e9640 -1 osd.5 81 *** Got signal Terminated *** 2024-09-13T03:02:52.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:52.069+0000 7fbcf04e9640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:02:53.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:52.899+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:53.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:52 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:52.899+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:54.437 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:53 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:53.941+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:54.437 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:53 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:53.941+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:55.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:54 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:54.946+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:55.437 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:54 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:54.946+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:56.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:55 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:55.943+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:56.436 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:55 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:55.944+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:57.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:56 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:56.919+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6806 osd.0 since back 2024-09-13T03:02:13.205009+0000 front 2024-09-13T03:02:13.205111+0000 (oldest deadline 2024-09-13T03:02:38.505091+0000) 2024-09-13T03:02:57.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:56 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:56.919+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6814 osd.1 since back 2024-09-13T03:02:24.405965+0000 front 2024-09-13T03:02:24.405933+0000 (oldest deadline 2024-09-13T03:02:49.105861+0000) 2024-09-13T03:02:57.187 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:56 smithi122 ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5[98921]: 2024-09-13T03:02:56.919+0000 7fbce8ae6640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.100:6822 osd.2 since back 2024-09-13T03:02:31.406945+0000 front 2024-09-13T03:02:31.406826+0000 (oldest deadline 2024-09-13T03:02:56.106604+0000) 2024-09-13T03:02:57.846 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:57 smithi122 podman[112648]: 2024-09-13 03:02:57.542275036 +0000 UTC m=+5.578399970 container died 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:02:58.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:57 smithi122 podman[112648]: 2024-09-13 03:02:57.953215707 +0000 UTC m=+5.989340643 container cleanup 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T03:02:58.186 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:57 smithi122 bash[112648]: ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5 2024-09-13T03:02:58.514 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112665]: 2024-09-13 03:02:58.187823087 +0000 UTC m=+0.638311891 container remove 14187c578b5bcb9c6fd58b2ab1f88d36ab4be310e6bc913cd0d7fa80fbe9d77d (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:02:58.767 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.513728887 +0000 UTC m=+0.111490533 container create ac34e403be5251cb54280e5592f6e467422b00072431e929094013f512a6112a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T03:02:58.767 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.417751308 +0000 UTC m=+0.015512961 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:02:58.767 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.691376965 +0000 UTC m=+0.289138622 container init ac34e403be5251cb54280e5592f6e467422b00072431e929094013f512a6112a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=) 2024-09-13T03:02:58.767 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.694597805 +0000 UTC m=+0.292359453 container start ac34e403be5251cb54280e5592f6e467422b00072431e929094013f512a6112a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:02:58.767 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.766394518 +0000 UTC m=+0.364156181 container attach ac34e403be5251cb54280e5592f6e467422b00072431e929094013f512a6112a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-7741f7f) 2024-09-13T03:02:59.178 INFO:journalctl@ceph.osd.5.smithi122.stdout:Sep 13 03:02:58 smithi122 podman[112753]: 2024-09-13 03:02:58.889675579 +0000 UTC m=+0.487437234 container died ac34e403be5251cb54280e5592f6e467422b00072431e929094013f512a6112a (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-84e01cde-7179-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T03:02:59.492 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-84e01cde-7179-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T03:02:59.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:02:59.532 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T03:02:59.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 84e01cde-7179-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:03:23.557 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 84e01cde-7179-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:03:39.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:03:39.397 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:03:39.424 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T03:03:39.427 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi100/crash 2024-09-13T03:03:39.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:03:39.466 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:03:39.466 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:03:39.468 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi122/crash 2024-09-13T03:03:39.469 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:03:39.492 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/84e01cde-7179-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:03:39.492 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:03:39.493 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T03:03:39.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:03:39.549 INFO:tasks.cephadm:Compressing logs... 2024-09-13T03:03:39.549 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:03:39.591 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:03:39.615 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T03:03:39.615 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-09-13T03:03:39.615 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T03:03:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.ciqoxn.log 2024-09-13T03:03:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:03:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.ciqoxn.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi100.log 2024-09-13T03:03:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi100.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi100.lhjyck.log 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi100.lhjyck.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.5% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:03:39.623 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.2% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:03:39.624 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi122.ptcenr.log 2024-09-13T03:03:39.624 INFO:teuthology.orchestra.run.smithi122.stderr:: No such file or directory 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.crukff.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi122.ptcenr.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.crukff.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi122.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi122.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr: 85.2% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:03:39.625 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.wmvyfe.log 2024-09-13T03:03:39.626 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log: 91.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:03:39.626 INFO:teuthology.orchestra.run.smithi122.stderr: 87.6% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:03:39.626 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T03:03:39.626 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.wmvyfe.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:03:39.636 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:03:39.637 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.slkwfs.log 2024-09-13T03:03:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:03:39.638 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:03:39.640 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.slkwfs.log: 87.6% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:03:39.641 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:03:39.673 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:03:39.679 INFO:teuthology.orchestra.run.smithi122.stderr: 89.7% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi122.ptcenr.log.gz 2024-09-13T03:03:39.959 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mgr.smithi100.lhjyck.log.gz 2024-09-13T03:03:39.981 INFO:teuthology.orchestra.run.smithi122.stderr: 92.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi122.log.gz 2024-09-13T03:03:40.626 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mon.smithi100.log.gz 2024-09-13T03:03:43.185 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T03:03:43.546 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T03:03:44.808 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T03:03:45.050 INFO:teuthology.orchestra.run.smithi100.stderr: 95.1% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.slkwfs.log.gz 2024-09-13T03:03:45.179 INFO:teuthology.orchestra.run.smithi122.stderr: 95.2% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.crukff.log.gz 2024-09-13T03:03:45.239 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T03:03:45.239 INFO:teuthology.orchestra.run.smithi122.stderr: 93.3% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T03:03:46.024 INFO:teuthology.orchestra.run.smithi122.stderr: 93.4% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T03:04:22.678 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi100.ciqoxn.log.gz 2024-09-13T03:04:22.680 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-13T03:04:22.681 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m43.076s 2024-09-13T03:04:22.681 INFO:teuthology.orchestra.run.smithi100.stderr:user 1m2.151s 2024-09-13T03:04:22.681 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m2.022s 2024-09-13T03:04:23.800 INFO:teuthology.orchestra.run.smithi122.stderr: 93.3% -- replaced with /var/log/ceph/84e01cde-7179-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi122.wmvyfe.log.gz 2024-09-13T03:04:23.802 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-09-13T03:04:23.802 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m44.196s 2024-09-13T03:04:23.802 INFO:teuthology.orchestra.run.smithi122.stderr:user 1m3.965s 2024-09-13T03:04:23.802 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m2.090s 2024-09-13T03:04:23.802 INFO:tasks.cephadm:Archiving logs... 2024-09-13T03:04:23.803 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi100/log 2024-09-13T03:04:23.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:04:32.672 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi122/log 2024-09-13T03:04:32.673 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:04:41.915 INFO:tasks.cephadm:Removing cluster... 2024-09-13T03:04:41.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 84e01cde-7179-11ef-bceb-c7b262605968 --force 2024-09-13T03:04:42.461 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 84e01cde-7179-11ef-bceb-c7b262605968 --force 2024-09-13T03:04:43.010 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T03:04:43.010 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:04:43.027 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:04:43.042 INFO:tasks.cephadm:Teardown complete 2024-09-13T03:04:43.042 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T03:04:43.053 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T03:04:43.053 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:04:43.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:04:43.158 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T03:04:43.169 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T03:04:43.169 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:04:43.172 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:04:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:04:43.186 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +190us[ +201us] +/- 36ms 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -281us[ -281us] +/- 54ms 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +50us[ +50us] +/- 85ms 2024-09-13T03:04:43.189 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:04:43.190 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:04:43.191 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-13T03:04:43.191 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +193us[ +199us] +/- 36ms 2024-09-13T03:04:43.191 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -294us[ -287us] +/- 54ms 2024-09-13T03:04:43.191 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +33us[ +40us] +/- 85ms 2024-09-13T03:04:43.191 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:04:43.192 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T03:04:43.203 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T03:04:43.203 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T03:04:43.228 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:04:43.313 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:04:43.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:04:43.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:04:43.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:04:43.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:04:43.447 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T03:04:43.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T03:04:43.485 INFO:teuthology.task.internal:Duration was 1833.033640 seconds 2024-09-13T03:04:43.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T03:04:43.520 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T03:04:43.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:04:43.523 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:04:43.559 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:04:43.563 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:04:43.974 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T03:04:43.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-13T03:04:43.975 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:04:43.996 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-13T03:04:43.996 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:04:44.035 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T03:04:44.036 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:04:44.038 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:04:44.102 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T03:04:44.102 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:04:44.105 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:04:44.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T03:04:44.760 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T03:04:44.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:04:44.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:04:44.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T03:04:44.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:04:44.827 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:04:44.848 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-13T03:04:44.874 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-13T03:04:44.888 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:04:44.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:04:44.933 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:04:44.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:04:44.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T03:04:44.958 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T03:04:44.958 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi100 2024-09-13T03:04:44.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:04:45.021 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903074/remote/smithi122 2024-09-13T03:04:45.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:04:45.057 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T03:04:45.058 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:04:45.060 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:04:45.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T03:04:45.120 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T03:04:45.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T03:04:45.144 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T03:04:45.145 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:04:45.147 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:04:45.159 INFO:teuthology.orchestra.run.smithi100.stdout: 265942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 03:04 /home/ubuntu/cephtest 2024-09-13T03:04:45.162 INFO:teuthology.orchestra.run.smithi122.stdout: 265933 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 03:04 /home/ubuntu/cephtest 2024-09-13T03:04:45.163 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T03:04:45.177 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T03:04:45.247 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1833.033640384674 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T03:04:45.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T03:04:45.329 INFO:teuthology.run:pass